Position: Sr. Data Engineer/Data Architect Location: Frisco, TX/ Atlanta, GA Duration: 12 Months Job Type: Contract Work Type: Hybrid Must Have Skills Skill 1 - 8 Yrs. of Exp - Data Engineering, Skill 2 - 8 Yrs. of Exp - Sql, Databricks, Snowflake Skill 3 - 4 Yrs. of Exp - Azure Services, Job Description: <ul> <li>Client is looking for a Sr. Data Engineer/Data Architect who is self driven, can lead a team of Data engineers working on an Onshore-Offshore model collaborating with customer IT SMEs, Business partners</li> </ul>Job responsibilities - <ul> <li>Gather requirements working closely with IT SMEs, Business stakeholders</li> <li>Prepare technical design document, coordinate with offshore team on development activities</li> <li>Design, build and deploy efficient & reliable data pipelines to move and transform data</li> <li>Optimize existing pipelines and maintenance of all source-related data pipelines</li> <li>Support on-call shift as needed to support the team</li> <li>Build and Deploy extensive data quality checks to ensure high quality of data</li> <li>Build high-performance scalable data warehouses and data products</li> <li>Partner with leadership, engineers, product managers and data scientists to understand data needs.</li> <li>Improve existing data movement frameworks and add more features</li> <li>Extreme focus on automation</li> <li>Expert level SQL skills</li> <li>Data Modeling</li> <li>CI/CD Pipeline and DevOps practices</li> <li>Agile fundamentals</li> <li>Prior use of Jira and GitLab</li> </ul>Skills needed <ul> <li>Azure Services</li> <li>Azure DataBricks</li> <li>Python</li> <li>Azure Data Factory</li> <li>GitLab</li> <li>Data Modeling</li> <li>Data Analysis</li> <li>Test Automation</li> <li>SQL</li> <li>Snowflake</li> </ul>

Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our staffing experts can help you find the best job for you. Role: Location: Duration: Required Skills: Job Description: Lead Data Engineer/SnowSQL Developer: Required Skillsets:<ul> <li>Snowflake Knowledge and SQL Proficiency: We need individuals with a profound understanding of Snowflake's architecture, features, and functionality. Additionally, advanced proficiency in SnowSQL is essential for crafting intricate queries and efficiently manipulating data within Snowflake.</li> <li>Scripting and Automation: These professionals should possess the ability to leverage scripting languages for automating SnowSQL tasks and ETL/ELT processes. Their proficiency should extend to optimizing SQL queries, data loading procedures, and data transformation processes to enhance performance.</li> <li>Data Integration: Familiarity with various data integration techniques, including batch and real-time data ingestion. Experience with Informatica Intelligent Cloud Services (IICS) and the capability to configure data connectors and pipelines using SnowSQL .</li> <li>Data Modeling: An understanding of data modeling concepts and the capacity to design effective database schemas within Snowflake. </li></ul>Communication and Collaboration Skills: Strong interpersonal and teamwork skills are essential for effective collaboration with other team members For more information and other jobs available please contact our recruitment team at careers@tekfortune.com. To view all the jobs available in the USA and Asia please visit our website at https://www.tekfortune.com/careers/.

Plano 7 (31067), United States of America, Plano, TexasSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a Data Engineer for the Originations Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumptions as well as building reports in Tableau, ThoughtSpot and other tools to provide insights to stakeholders which includes multiple VPs and Directors. You will have a lot of exposure to AWS services on your day to day job. If you are passionate about innovation in both engineering and analytics, come join our team!What Youll Do:Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insightsBuild the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, PythonBe part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasetsWork in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teamsShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in machine learning, distributed microservices, and full stack systemsCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performanceBasic Qualifications: Bachelors Degree At least 3 years of experience in application development (Internship experience does not apply)At least 1 year of experience in big data technologies Preferred Qualifications: 5+ years of experience in application development including Python, SQL, Scala, or Java2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)3+ years experience with Distributed data computing tools (Kafka, Spark, Flink)2+ year experience working on real-time data and streaming applications 2+ years of experience with NoSQL implementation (DynamoDB, OpenSearch) 2+ years of data warehousing experience (Redshift or Snowflake) At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.comCapital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Data Engineer II A Data Engineer II works alongside Information Architects, Engineers, Data Scientists, and other stakeholders to design, develop, deploy, and end-to-end testing of moderate to advanced data pipelines. The Data Engineer II is responsible for building and maintaining the data pipelines and the data in relational and non-relational databases that support various data engineering applications, tools. The Data Engineer II is responsible for developing and supporting reports that provide accurate and timely data for internal and external clients. The incumbent will develop and maintain the data infrastructure that powers our ability to make timely and data-driven decision. This role requires familiarity of data architecture and extraction & manipulation of data sets of various sizes. Position Responsibilities: Design and Methodology * Design, implement and operate medium to large-scale, high-volume, high-performance data structures for reporting, analytics, and data science. * Write and refine code to ensure performance and reliability of data extraction and processing. * Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging big data tools. * Create data products for analytics and Data Scientist team members to improve their productivity. * Document and test moderate data systems that bring together data from disparate sources, making it available to Data Scientists, and other users using scripting and/or programming languages. * Design, develop and build real-time data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages etc.) * Leverage the understanding of software architecture and software design patterns to write scalable, maintainable, well-designed, and future-proof software. * Manage existing pipelines and create new pipelines from a variety of sources (relational, XML, etc.) * Design and build solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations. * Document and test data processes including performance of through data validation and verification. Technical Consulting * Gather business and functional requirements and translate these requirements into robust, scalable operable solutions with a flexible and adaptable data architecture. * Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation. * Collaborate with Data Scientists to create fast and efficient algorithms that exploit our rich data sets for optimization, statistical analysis, prediction, clustering, and machine learning. * Coordination with other teams to design optimal patterns for data ingest and egress, as well as lead and coordinate data quality initiatives and troubleshooting. * Participate in sprint planning meetings as needed. * Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions. * Optimize support for ad-hod analysis across various data sources. Planning & Organizing * Ensure best practices are followed across architecture, codebase, and configuration. * Continually improve ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers. * In collaboration with the Data Engineer III, contribute to the exploration and understanding of new tools and techniques for improvements to the data pipeline. Risk Management * Review and are familiar with automated processes for performance and fault tolerance. * Review functional and technical designs to identify areas of risk and any missing requirements. * Design and implement security measures to protect data from unauthorized access or misuse. * In collaboration with the Data Engineer III, design backup and recovery procedures to ensure data integrity is maintained. Administration/Support * Keeps management informed of status of on activities through accurate, timely, and appropriate reporting. * Contribute to Data Governance, system documentation and sharing of data asset knowledge. * Actively participates in committees representing the department and/or planning unit. * Keeps abreast of leading-edge technologies in the Data Engineering space. Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabled

Principal Engineer The Principal Engineer role will provide engineering and architecture support for complex system management activities related to system software, hardware, performance, problem determination or resource management requiring communication and coordination with vendors, technicians, clients, and management. Provide technical input to management decision making in the areas of software, hardware, and performance. Responsibilities include: defining networking requirements; performing detailed analysis of various projects and requests; developing designs for projects that have medium to high complexity; formulating procedures; monitoring key performance indicators; and implementing advanced business solutions. This role may also integrate solutions or build via DevOps depending on the maturity of the organization and/or product. The Principal Engineer will collaborate with business partners, Chief Data Analytics Office team, and product managers to understand the data requirements and provide technical project requirements/solutions. Successful candidates will have excellent written and analytical skills; and be able to identify, recommend, improve and document the CICD and change management processes. The Principal Engineer must possess excellent communication and presentation skills to interact with all levels of technology and business teams. Candidates should be available to provide the off-hours support, coordinate with the data teams to lead the production and non-production deployment and validation efforts. Position Responsibilities: Design and Methodology * Work closely with business units, application teams, infrastructure areas and vendors to identity, review and evaluate the solution requirements. * Investigate and propose strategic fits for virtualization, consolidation and rationalization solution opportunities within the infrastructure or business. Propose changes to the technical architecture and design solutions as applicable. * Evaluate and align strategic fit solutions across infrastructure platforms and solutions specific to system hardware and software technologies. * Understand, participate, review and influence long term capacity planning and technology investments. Technical Consulting * Provide Client consulting and planning guidance as applicable for moderate to large highly complex projects/programs. * Provide consultation and works closely with other functional infrastructure areas/departments on multiple initiatives to meet common organizational / business goals and objectives. * Participate in and provides consulting to project teams on architectural, design development, integration opportunities, planning of highly complex systems and assures it is aligned to our established strategies, guiding principles, rationales and practices. Planning and Organizing * Identify and evaluate projects/programs/initiatives and design processes that enhance and rationalize existing and upcoming solutions. * Map requirements into standard services solution, identity opportunities for integrating to existing or reuse technology and provide cost effective solutions for moderate to large highly complex project/programs/initiatives. * Review, identify and manage requirements for moderate to complex solutions and do a cost value, feasibility and risk analysis. Risk Management * Review, participate, develop and update architectural standards, guiding principles, rationales and strategies. * Evaluate, review and approve highly complex design solutions for business and Infrastructure project or programs or initiatives. Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabled

Pay: $47.99-$79.13 - based on expereince Job Description: The following are Mandatory Job Specific Knowledge, Skills, and Experience •Building Data Pipelines with most of the following sources o Google Ad-Serving: CM360 o Google DSP: DV360 o Google Search: SA360 o Meta: Marketing API o Meta: Conversions API o TikTok: Marketing API o TikTok: Events API •Experience with most of the following technologies, tools, and platforms o Snowflake o PosgreSQL o Informatica/IICS o Mulesoft o Python o Cloud Composer o GCP o UC4 o Airflow •Experience shaping data for the following usecases (including how to calculate common KPIs and other metrics) o Marketing Mix Modelling o Real-Time Media Performance o Campaign Analytics Dashboards Description We are seeking a highly skilled and experienced Senior Data Engineer to join the Marketing Analytics and Technology team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining data infrastructure, systems, and frameworks to enable efficient and scalable data-driven marketing initiatives. You will collaborate closely with cross-functional teams including data scientists, analysts, software developers, machine learning engineers and IT teams to build robust and reliable data pipelines, data models (data domains), and analytics solutions (data products). This is an exciting opportunity to play a key role in driving the data-driven marketing initiative within our organization. Responsibilities •Designing, developing, and maintaining data infrastructure, systems, and frameworks for marketing data processing and analytics. •Building and managing ETL pipelines to efficiently handle large volumes of data from diverse sources. •Optimizing data storage and retrieval processes to ensure high performance and scalability. •Collaborating with data scientists and analysts to define and implement data models and transformations for marketing analytics. •Monitoring and troubleshooting data quality and integrity issues to ensure accurate and reliable insights. •Identifying and implementing innovative solutions for data processing, storage, and retrieval to improve overall efficiency and productivity. •Providing technical expertise and guidance to our offshore data engineering team Other Requirements •Solid understanding of data modeling, data warehousing, and ETL processes. •Excellent problem-solving and troubleshooting skills. •Ability to communicate clearly (workplace communication skills) communication and collaboration abilities. •Ability to work independently and as part of a team in a fast-paced and dynamic environment.

Data Engineer Jobs in Frisco, TX

Sr Data Engineer
November 18, 2024

Snowflake Lead Data Engineer
November 16, 2024

Python And Pyspark Data Engineer Remote
November 11, 2024

Python And Pyspark Data Engineer Remote
November 9, 2024

Sr Data Engineerdata Architect
November 6, 2024

Senior Data Engineer
November 6, 2024

Data Engineer
November 5, 2024

Principal Data Engineer
November 5, 2024

Principal Data Engineer Iics Snowflake Etl
November 4, 2024

Data Engineer
October 26, 2024

Quick filters

Top companies

Data Engineer Jobs in Frisco, TX

Sr Data EngineerNovember 18, 2024

Snowflake Lead Data EngineerNovember 16, 2024

Python And Pyspark Data Engineer RemoteNovember 11, 2024

Python And Pyspark Data Engineer RemoteNovember 9, 2024

Sr Data Engineerdata ArchitectNovember 6, 2024

Senior Data EngineerNovember 6, 2024

Data EngineerNovember 5, 2024

Principal Data EngineerNovember 5, 2024

Principal Data Engineer Iics Snowflake EtlNovember 4, 2024

Data EngineerOctober 26, 2024