Plano 7 (31067), United States of America, Plano, TexasSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a Data Engineer for the Originations Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumptions as well as building reports in Tableau, ThoughtSpot and other tools to provide insights to stakeholders which includes multiple VPs and Directors. You will have a lot of exposure to AWS services on your day to day job. If you are passionate about innovation in both engineering and analytics, come join our team!What Youll Do:Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insightsBuild the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, PythonBe part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasetsWork in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teamsShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in machine learning, distributed microservices, and full stack systemsCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performanceBasic Qualifications: Bachelors Degree At least 3 years of experience in application development (Internship experience does not apply)At least 1 year of experience in big data technologies Preferred Qualifications: 5+ years of experience in application development including Python, SQL, Scala, or Java2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)3+ years experience with Distributed data computing tools (Kafka, Spark, Flink)2+ year experience working on real-time data and streaming applications 2+ years of experience with NoSQL implementation (DynamoDB, OpenSearch) 2+ years of data warehousing experience (Redshift or Snowflake) At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.comCapital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Our client, a US Fortune 250 company and a global Medical technology corporation serving customers in Clinical Labs, Health care research & Pharmaceutical industry, seeks an Lead Cloud Data Engineer_______________________________________________ NOTE: THIS IS REMOTE ROLE & ONLY W2 CANDIDATES (NO C2C/1099) *** Candidate must be authorized to work in USA without requiring sponsorship *** Position Title – Lead Cloud Data Engineer (Job ID – CFNJP00049660)Location: San Diego CA 92130 (100% Remote acceptable)Duration: 6 months Contract to Hire__________________________________________________________ As the Senior Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data strategy using software engineering best practices. Beyond technical expertise, you will also serve as a change leader, guiding teams through adopting new tools, technologies, and workflows to improve data management and processing. This position requires extensive hands-on data system design and coding experience, as well as the development of modern data pipelines (AWS Step functions, Prefect, Airflow, Luigi, Python, Spark, SQL) and associated code in AWS. You will work closely with stakeholders across the business to understand their data needs, ensure scalability, and foster a culture of innovation and learning within the data engineering team and beyond. Key Responsibilities: <ul><li>Be responsible for the overall architecture of a specific module within a product (e.g., Data-ingestion, near-real-time-data-processor, etc.), perform design and assist implementation considering system characteristics to produce optimal performance, reliability and maintainability.</li><li>Provide technical guidance to team members, ensuring they are working towards the product's architectural goals.</li><li>Create and manage RFCs (Request for Comments) and ADRs (Architecture Decision Records), Design notes and technical documentation for your module, following the architecture governance processes.</li><li>Lead a team of data engineers, providing mentorship, setting priorities, and ensuring alignment with business goals.</li><li>Architect, design, and build scalable data pipelines for processing large volumes of structured and unstructured data from various sources.</li><li>Collaborate with software engineers, architects, and product teams to design and implement systems that enable real-time and batch data processing at scale.</li><li>Be the go-to person for PySpark-based solutions, ensuring optimal performance and reliability for distributed data processing.</li><li>Ensure that data engineering systems adhere to the best data security, privacy, and governance practices in line with industry standards.</li><li>Perform code reviews for the product, ensuring adherence to company coding standards and best practices.</li><li>Develop and implement monitoring and alerting systems to ensure timely detection and resolution of data pipeline failures and performance bottlenecks.</li><li>Act as a champion for new technologies, helping ease transitions and addressing concerns or resistance from team members.</li></ul> Ideal Candidate: <ul><li>Experience leading a data engineering team with a strong focus on software engineering principles such as KISS, DRY, YAGNI etc.</li><li>Candidate MUST have experience in owning large, complex system architecture and hands-on experience designing and implementing data pipelines across large-scale systems.</li><li>Experience implementing and optimizing data pipelines with AWS is a must.</li><li>Production delivery experience in Cloud-based PaaS Big Data related technologies (EMR, Snowflake, Data bricks etc.)</li><li>Experienced in multiple Cloud PaaS persistence technologies, and in-depth knowledge of cloud- based ETL offerings and orchestration technologies (AWS Step Function, Airflow etc.)</li><li>Experienced in stream-based and batch processing, applying modern technologies</li><li>Working experience with distributed file systems (S3, HDFC, ADLS), table formats (HUDI, Iceberg), and various open file formats (JSON, Parquet, Csv, etc.)</li><li>Strong programming experience in PySpark, SQL, Python, etc.</li><li>Database design skills including normalization/de-normalization and data warehouse design</li><li>Knowledge and understanding of relevant legal and regulatory requirements, such as SOX, PCI, HIPAA, Data Protection</li><li>Experience in the healthcare industry, a plus</li><li>A collaborative and informative mentality is a must!</li></ul> Toolset: <ul><li>AWS, preferably AWS certified Data Engineer and AWS certified Solutions Architect.</li><li>Proficiency in at least one programming language C#, GoLang, JavaScript or ReactJs</li><li>Spark / Python / SQL</li><li>Snowflake/ Databricks / Synapse / MS SQL Server</li><li>ETL / Orchestration Tools (Step Function, DBT etc.)</li><li>ML / Notebooks</li></ul> Education and experience required <ul><li>Bachelors or Master’s in Computer Science, Information Systems, or an engineering field or relevant experience.</li><li>10+ years of related experience in developing data solutions and data movement.</li></ul> ________________________________________________ If you're looking for rewarding employment and a company that puts its employees first, we'd like to work with you. We're driven, people driven. Bhupesh KhuranaSenior Technical RecruiterEmail: bkhurana@ameritconsulting.com Amerit Consulting is an extremely fast-growing staffing and consulting firm. Amerit Consulting was founded in 2002 to provide consulting, temporary staffing, direct hire, and payrolling services to Fortune 500 companies nationally; as well as small to mid-sized organizations on a local & regional level. Currently, Amerit has over 2,000 employees in 47 states. We develop and implement solutions that help our clients operate more efficiently, deliver greater customer satisfaction, and see a positive impact on their bottom line. We create value by bringing together the right people to achieve results. Our clients and employees say they choose to work with Amerit because of how we work with them - with service that exceeds their expectations and a personal commitment to their success. Our deep expertise in human capital management has fueled our expansion into direct hire placements, temporary staffing, contract placements, and additional staffing and consulting services that propel our clients’ businesses forward. Amerit Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.Applicants, with criminal histories, are considered in a manner that is consistent with local, state and federal laws.

The Data Engineer - REMOTE provides operational support for the coordination and execution of data extraction activities from all source systems and lines of business to machine readable formats. They will also implement processes and methods to improve data quality. This position requires the ability to effectively collaborate within his/her own department and across broad parts of the organization. Rush Enterprises, Inc. opens the door to the world of opportunity. We are a part of the largest network of commercial vehicle dealerships in North America representing truck and trailer manufacturers. Our franchises include Peterbilt, International, Hino, Isuzu, Ford, IC Bus and Blue Bird. We offer a rewarding career as a leader in the transportation industry. Grow with us as we continue to expand our network of locations and services. Responsibilities:<ul><li>Responsible for gathering information requirements, developing domain data glossaries, , and enforcement of policy to ensure master data is compliant with defined quality requirements within the assigned domain.</li><li>Responsible for build and maintenance of the Extract and Load of data from source to target</li><li>Maintain data quality and metadata processes, adhere to all of data quality rules, thresholds, and standard metrics/quality expectations for data elements that support critical business processes.</li><li>Profiles and reviews statistical analysis and assessment of data to determine effectiveness of data quality controls and metadata capture so as to identify improvement opportunities.</li><li>Perform impact analysis of regulatory, business, and system changes to respective data domains and relevant data governance policies and procedures.</li><li>Responsible for building and sustaining the day-to-day relationships and communications with business partners at various levels of the organization, including Data Steward(s), Line of Business stakeholders, other team members, as well as other internal and external resources.</li><li>Participate in regular Data Analytics team, project, and leadership meetings as needed.</li><li>Development of program artifacts for data analytics including compliance with existing enterprise policies and standards.</li><li>Promote participation and buy-in from business areas for data governance activities.</li><li>Monitor adherence to Data Governance policies and standards, drive continuous improvement, manage non-compliance issue escalations, and provide training and communication.</li></ul> Benefits:<ul><li>We offer exceptional compensation and benefits, 401K and stock purchase, incentives for performance, training, and opportunity for advancement - all in a culture that appreciates and rewards excellence, a positive attitude and integrity.</li></ul> Basic Qualifications:<ul><li>2-5 years of combined experience and knowledge in: data engineering, data extraction, data governance, data management, data quality, data profiling, business analysis/requirements gathering, query/report writing.</li><li>Bachelor's degree preferred.</li><li>Experience with SAP Business Objects, Information Steward, Data Services, or Data Intelligence preferred.</li><li>Experience with SQL extraction both cloud or on-prem, SSIS, Azure SQL extraction and/or Data Factory preferred.</li><li>Knowledge of Data Governance / Data Quality processes and procedures.</li><li>Capable of performing conflict resolution and skilled in problem solving</li></ul> Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabled This job posting does not state or imply that these are the only duties to be performed by this employee. The employee will be required to follow any other instructions and to perform any other duties requested by their leader.

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments. We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at <a>experianplc.com </a>Job Description We are thrilled to announce that NeuroID has been acquired by Experian, a global leader in identity verification and fraud prevention. Experian's solutions helped clients avoid an estimated $15 billion in fraud losses last year. Since 2023, NeuroID has partnered with Experian to provide the latest behavioral analytics, combating identity theft and advanced fraud attacks. Now, as part of Experian's CrossCore® on the Experian Ascend Technology Platform™, we continue to lead the charge in proactive fraud detection and seamless user experiences. Be part of a team that's pioneering the future of fraud prevention! Qualifications NeuroID is looking for a Senior Data Engineer to manage and transform our data pipeline. We are a Snowflake and DBT shop with lots of semi-structured data. The job combines aspects of both product and research so there are several projects and operational aspects of the job. NeuroID detects fraud by analyzing how people type data on web forms and mobile apps (how cool is that?). We are powered by data, and you will be at the heart of what we do. You will report to NeuroID's Chief Data Science Officer, and is remote in the US. You Will: <ul><li>Handle the daily management of data pipeline using DBT</li><li>Implement changes to Snowflake guided by product changes and research needs</li><li>Monitor and make changes to manage pipeline costs</li><li>Troubleshoot and resolve data, system, and performance issues</li></ul>Experience <ul><li>3+ years of experience as a Data/Analytics Engineer using DBT</li><li>DBT experience should include working with semi-structured data, custom macros, incremental models, and job scheduling</li><li>Experience working with Snowflake or other cloud data warehouses. Understand clones, pipes, external stages and optimizing queries.</li><li>Terraform, Python, and AWS experience is strongly preferred</li><li>Very comfortable with modern SQL (cte, window functions)</li><li>Bachelor's Degree in Data Science / Analytics, Computer Science, Information Systems, or Math or an equivalent combination of education and experience</li></ul>Benefits/Perks: <ul><li>Great compensation package and bonus plan</li><li>Core benefits including medical, dental, vision, and matching 401K</li><li>Flexible work environment, ability to work remote, hybrid or in-office</li><li>Flexible time off including volunteer time off, vacation, sick and 12-paid holidays </li></ul>Additional Information Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why. Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Data Engineer Jobs in Garland, TX

Senior Data Engineer
November 6, 2024

Lead Cloud Data Engineer 100 Remoteno C2C
November 6, 2024

Senior Data Engineer
November 4, 2024

Data Engineer Remote
October 24, 2024

Data Engineer Remote
October 24, 2024

Quick filters

Top companies

Data Engineer Jobs in Garland, TX

Senior Data EngineerNovember 6, 2024

Lead Cloud Data Engineer 100 Remoteno C2CNovember 6, 2024

Senior Data EngineerNovember 4, 2024

Data Engineer RemoteOctober 24, 2024

Data Engineer RemoteOctober 24, 2024

Quick filters

Top companies

Senior Data Engineer
November 6, 2024

Lead Cloud Data Engineer 100 Remoteno C2C
November 6, 2024

Senior Data Engineer
November 4, 2024

Data Engineer Remote
October 24, 2024

Data Engineer Remote
October 24, 2024