Plano 1 (31061), United States of America, Plano, TexasSenior Data Engineer (Remote-Eligible)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you''ll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you''ll have the opportunity to be on the forefront of driving a major transformation within Capital One. What You''ll Do:Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in Public cloud services (AWS), Big Data, machine learning, distributed microservices, and full stack systemsUtilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and SnowflakeShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance. Capital One is open to hiring a Remote Employee for this opportunity. Basic Qualifications: Bachelor''s Degree At least 4 years of experience in application development (Internship experience does not apply)At least 1 year of experience in big data technologies Preferred Qualifications: 5+ years of experience in application development including Python, SQL, Scala, or Java5+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)4+ years of experience working on real-time data and streaming applications 4+ years of data warehousing and relational database experience (Snowflake, Oracle, or PostGreSQL) 4+ years of experience in PySpark3+ years of experience with AWS services EC2, EMR, ECS, S3, SNS, Lambda, RDS, EFS, or VPC 3+ years of experience with AWS Security Groups or Identity and Access Management3+ years of experience building CI/CD pipelines3+ years of experience with UNIX/Linux including basic commands and shell scripting2+ years of experience with NoSQL implementation (Mongo or Cassandra) 2+ years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position.No agencies please. Capital One is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex, race, color, age, national origin, religion, physical and mental disability, genetic information, marital status, sexual orientation, gender identity/assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by applicable national, federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City''s Fair Chance Act; Philadelphia''s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at [Click Here to Email Your Resum]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One''s recruiting process, please send an email to [Click Here to Email Your Resum]Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Title: Data Engineer Location: Remote Visa: NO H1B ( Need Genuine only) Duration: 3+ Months Interview: 2 Videos Note: Need LinkedIn updated profile with Pic. Job Description: Need a Data Engineer for short term, 3 months+ person to help with their Client/Financial and expense reimbursement project. Certify & Yardi (makes apps for Prop Mngt/Real Estate companies) will be systems they will pull data from and merge data into Client. Extracts and data manipulation to feed back into various systems, must be experienced. They have not yet decided on Azure Logic Apps or Power Automation or end solution but will be helpful to have either or both here. Implementation of an expense program and/or financials helpful. ETL and data manipulation skills are key. Combination of good data analysis and DBA skills Project Overview - At a high level, getting data extracts out of 3 systems (Yardi, Certify), massaging that data, putting data back into a format to re-insert it back into those systems. Financial System - Some data coming out of the finance and reimbursement system - Lots of the data going back to this system Travel System - source and destination for some of this day HR (Workday) - Some data coming out of this system Each of these systems will push out a file, the Hub will massage the data, format correctly, then feed the data back to these systems Finance has data on GL codes, for instance Travel has data on all the travel logistics Workday has data on the specific employees This is being done as a backend processing piece, tying this info together Logic Apps and Power platforms skillset, data analytics skillset, applying rules to that data, getting them into a good format They are looking to build a piece that would serve as a Hub - Build a Hub that allows all the other tools to talk to each other - This Data Eng will help with building this - Greenfield Pulling data from a lot of sources - Data goes into Hub - Output from the data that feeds back into these systems, particularly back into the Finance System (expenses, reimbursements) A lot of the data going back to Finance would involve Employee Reimbursements Using a User Interface is not that critical (More Power Platforms, Logic Apps) Several databases - SQL Server, PostgreSQL, platform pieces often sit on top of Sharepoint Good candidate - Power Platform (PowerBI), SQL Server, Postgres, experience with data lakes like Hadoop (big data) is a big plus Want the resource available in a post deployment support mode, knowledge transfer to an FTE Some of this info may feed into a Data Lake, or pull data from the Data Lake (data lake in process of being developed)

Title: Principal DATA Engineer - Data Analytics Platform Duration: Direct Hire Visa: USC and GC only ( No Fake , Need Genuine Only) Location: Hybrid available in the following cities: Phoenix, AZ / Chicago, IL / New York, NY / San Francisco, CA ( Need local of these cities only) Interview: 2 Videos Need: Updated LinkedIn with profile pic. Job Description: This position is a hands-on, individual contributor and technical leader involved in setting the standards and ensuring excellence in quality of outputs across multiple teams to create an Analytics Data Platform. This initiative consists of creating an appropriate replica of various bespoke operational data stores and customer contribution data into a data platform that is fit for analytics and data science workloads. Scale and velocity should excite you, not scare you. We are looking for someone who has successfully built and delivered an Analytics Data Platform from the ground up. This is a principal level, individual contributor role responsible for architecting a Data Analytics Platform based on AWS technologies. They will also be responsible for acting as a player/coach with our existing analytics technical platform team consisting of senior and junior data engineers. They will have the support of our Sr. Director, Analytics Technical Platform. It is critical to have actual, hands-on experience architecting and building a data analytics platform for medium to large enterprise based on AWS technologies. Theoretical knowledge is not enough. Key Responsibilities:<ul> <li>Minimum 15 or more years of experience in designing and developing complex software projects.</li> <li>Experience in influencing cross-functional teams to create high throughput, high velocity data pipelines using both streaming and batch processing paradigms.</li> <li>Effective communicator with exceptional public speaking skills. Comfortable presenting to all levels within the company.</li> <li>Experience designing, implementing and operationalizing an analytics data platform in AWS.</li> <li>Networking experience relevant to moving data between on-prem and cloud environments.</li> <li>Experience with data handling processes such as retention policies, masking and encryption for compliance and visibility purposes.</li> <li>Current development skills using python, java or Scala.</li> <li>Experience with multiple data stores such as Oracle, MS-SQL Server, Postgres and noSql variety.</li> <li>Experience running a vendor selection process for relevant analytics platform needs.</li> <li>Expertise in terraform, k8s and/or other cloud orchestration technologies.</li> <li>Experience creating AWS observability and monitoring systems.</li> <li>Experience with several of the following AWS technologies: Glue/Glue Catalog/Glue Crawler, Kinesis/Firehose, RedShift, DynamoDB, Athena.</li> <li>Experience with ETL tools.</li> <li>Experience with data processing orchestration tools.</li> <li>Experience with data cataloging tools.</li></ul>Essential Functions:<ul> <li>Partners with product management to craft product strategy, create product descriptions and ensure alignment to technology roadmaps.</li> <li>Be a thought leader: a senior point of expertise on Data Engineering, Data Science, Business Intelligence, software engineering issues, industry trends and developing technologies. Be a role model to others on the team; coach and mentor team members.</li></ul><ul> <li>Takes ownership for creating technical product design and architecture - evaluating buy vs. build decisions and bought product maturity and fit for purpose.</li> <li>Works closely with customers to understand their needs and create a partnership for making products better.</li> <li>Documents SDLC artifacts so that other team members can understand and "follow the leader" - such as Confluence documentation, jira artifacts and associated MS-office documents (Excel, Word, PPT).</li> <li>Designs, implements and operationalizes a data analytics platform using AWS tools such as:</li> <li>S3 storage</li> <li>Glue and related tools</li> <li>Redshift, DynamoDB</li> <li>Athena</li> <li>Crawlers</li> <li>Observability matters using CloudWatch and CloudTrail</li> <li>Coach and develop others to use the above tools by creating small technical demonstrators or POCs.</li> <li>Creates and conducts presentations for small-to-medium size groups.</li> <li>Support the company's commitment to risk management and protecting the integrity and confidentiality of systems and data.</li> <li>The above job description is not intended to be an all-inclusive list of duties and standards of the position. Incumbents will follow instructions and perform other related duties as assigned by their supervisor.</li></ul>Minimum Qualifications:<ul> <li>Education and/or experience typically obtained through a bachelor's degree in computer science, or related technical field.</li> <li>Minimum 15 or more years of experience in designing and developing complex software projects.</li> <li>Experience in influencing cross-functional teams to create high throughput, high velocity data pipelines using both streaming and batch processing paradigms.</li> <li>Effective communicator with exceptional public speaking skills. Comfortable presenting to all levels within the company.</li> <li>Knowledge of Software Development Lifecycle (SDLC) best practices, software development methodologies (Agile, Scrum, LEAN etc) and DevOps practices.</li> <li>Experience designing, implementing and operationalizing an analytics data platform in AWS.</li> <li>Networking experience relevant to moving data between on-prem and cloud environments.</li> <li>Experience with data handling processes such as retention policies, masking and encryption for compliance and visibility purposes.</li> <li>Current development skills using python, java or Scala.</li> <li>Experience with multiple data stores such as Oracle, MS-SQL Server, Postgres and noSql variety.</li> <li>Experience running a vendor selection process for relevant analytics platform needs.</li> <li>Expertise in terraform, k8s and/or other cloud orchestration technologies.</li> <li>Experience creating AWS observability and monitoring systems.</li> <li>Experience with several of the following AWS technologies: Glue/Glue Catalog/Glue Crawler, Kinesis/Firehose, RedShift, DynamoDB, Athena.</li> <li>Experience with ETL tools.</li> <li>Experience with data processing orchestration tools.</li> <li>Experience with data cataloging tools.</li> <li>Background and drug screen.</li></ul>Preferred Qualifications: •Master's degree in computer science or related field. 972-392-5974 | 972-934-5200(103) ravi.chand@verdant-infotech.com, 5208 Windsor Ln, Copper Canyon, Texas, 75077

Service Center Lewisville Job Description: Data Engineer III Job Summary The Data engineer will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. This role is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. This position will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be comfortable supporting the data needs of multiple teams and systems. Overall, they must strive for efficiency by aligning data systems with business goals. Duties and responsibilities <ul><li>Create and maintain optimal data pipeline architecture,</li><li>Assemble large, complex data sets that meet functional / non-functional business requirements.</li><li>Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.</li><li>Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and various cloud technologies.</li><li>Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.</li><li>Work with the business to assist with data-related technical issues and support their data infrastructure needs.</li><li>Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.</li><li>Work with data and analytics experts to strive for greater functionality in our data systems.</li><li>Create complex SQL queries and database objects (stored procs, views, etc.) to pull and manage data.</li><li>Developing complex data pipelines using SSIS packages, Azure Data Factory, or other related ETL/ELT tools to move and translate data</li><li>Create and maintain documentation on data pipelines</li></ul> Requirements and Qualifications <ul><li>Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field; or equivalent combination of education experience and training that provides the required knowledge and skills.</li><li>4 - 6 years of experience in a Data Engineer role</li><li>Advanced working knowledge of SQL and T-SQL programming</li><li>Experience with ETL and Data Migration</li><li>Experience with relational SQL and NoSQL databases</li><li>Experience with object-oriented/object function scripting languages: Python etc.</li><li>Experience building and optimizing data pipelines, architectures, and data sets.</li><li>Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.</li><li>Experience supporting and working with cross-functional teams in a dynamic environment.</li><li>Strong analytic skills related to working with unstructured datasets.</li><li>Build processes supporting data transformation, data structures, metadata, dependency, and workload management.</li><li>A successful history of manipulating, processing, and extracting value from large, disconnected datasets.</li><li>Experience with Machine Learning is a great plus</li><li>Experience with Snowflake Cloud Data Warehouse is a must</li><li>Experience with transformation tool Coalesce is a must</li><li>Experience with Azure Data Factory is a must</li><li>Experience with message queuing and stream processing such as Pub-Sub, Azure Event Grid, Kafka etc.</li><li>Experience with data pipeline and workflow management tools such as Airflow, etc.</li></ul>

Data Engineer Jobs in Lewisville, TX

Data Engineer With Snowflake Mortgagefinancial Domain
October 23, 2024

Data Engineer Iii
October 20, 2024

Senior Data Engineer Remoteeligible
October 19, 2024

Data Engineer
October 18, 2024

Principal Data Engineer Data Analytics Platform
October 15, 2024

Data Engineer Ii
October 15, 2024

Data Engineer Azure Cloud
October 11, 2024

Data Engineer Azure Cloud
October 5, 2024

Data Engineer
October 5, 2024

Quick filters

Top companies

Data Engineer Jobs in Lewisville, TX

Data Engineer With Snowflake Mortgagefinancial DomainOctober 23, 2024

Data Engineer IiiOctober 20, 2024

Senior Data Engineer RemoteeligibleOctober 19, 2024

Data EngineerOctober 18, 2024

Principal Data Engineer Data Analytics PlatformOctober 15, 2024

Data Engineer IiOctober 15, 2024

Data Engineer Azure CloudOctober 11, 2024

Data Engineer Azure CloudOctober 5, 2024

Data EngineerOctober 5, 2024