The ZapLabs Data Engineer interview guide, interview questions, salary data, and interview experiences.

ZapLabs Data Engineer Interview Guide

Getting ready for an Data Engineer interview at ZapLabs? The ZapLabs Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for ZapLabs Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at ZapLabs.</li>
<li>Practice real ZapLabs Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the ZapLabs Data Engineer interview.


Getting ready for an Data Engineer interview at ZapLabs? The ZapLabs Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for ZapLabs Data Engineer roles.
- Gain insights into the Data Engineer interview process at ZapLabs.
- Practice real ZapLabs Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the ZapLabs Data Engineer interview.
        

Overview

ZapLabs Data Engineer Salary

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

A/B Testing

Algorithms

Analytics

Machine Learning

Probability

Product Metrics

Python

Statistics

ZapLabs Data Engineer Interview Process

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

Given a table called <code>employees</code>, get the largest salary of any employee by department

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>largest_salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Write a query to get the largest salary of any employee by department

Largest Salary by Department

You are given a dictionary with a key-value of <code>{string: number}</code> where values in the dictionary could be duplicates. You are required to extract the unique values from the dictionary where the value occurred only once.

Return a list of values where they occur only once.

Note: You can return the values in any order.

Input:

<pre tabindex="0" class="chroma"><code>dictionary = {&#34;key1&#34;: 1, &#34;key2&#34;: 1, &#34;key3&#34;: 7, &#34;key4&#34;: 3, &#34;key5&#34;: 4, &#34;key6&#34;: 7}
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_unique_values(dictionary) -&gt; [3,4]

#Only 3 and 4 occurred once.
</code></pre>

Dictionary Unique Values

ZapLabs Data Engineer Interview Questions

Data Engineer Engineer -Permanent???? Series B US blockchain Platform???? Competitive Salary +Other Benefits???? Location: Sunnyvale, California One of my clients who is a blockchain-powered platform (25M funded) that bridges the gap between telecommunications and fintech sectors, enabling unified mobile payment solutions with seamless cross-carrier interoperability and enhanced security protocols. The office is Currently based in Sunnyvale, California. They founded this company in order to use blockchain to create a decentralized value exchange network. Current team members are from PayPal, Goldman Sachs, JPMorgan, eBay, Visa... Has reached 1.3 M + users within their platform. ⚡Technical Excellence They Value:<ul><li>Amazon AWS Glue</li><li>Python </li><li>Strong SQL query </li><li>relational database skill (MySQL, PostgresDB)</li><li>Managed jobs and pipelines via deployment tools</li><li>Java skill preferred but not mandatory</li><li>Data warehouse experience</li><li>Analytics experience</li></ul> ⚡The role(Full time):<ul><li>Design, develop, and optimize data warehouse solutions to support analytical and business intelligence needs.</li><li>Work with AWS Glue to create and manage ETL pipelines.</li><li>Develop and maintain efficient Python scripts for data transformation and integration.</li><li>Write and optimize complex SQL queries to extract and manipulate data.</li><li>Manage relational databases such as MySQL and PostgresDB, ensuring data integrity and performance.</li><li>Implement and monitor and design data pipelines and workflows using deployment tools.</li><li>Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.</li></ul> ⚡Why apply:<ul><li>Competitive Salary + Stock Option</li><li>Great company culture</li><li>Open collaborative team to work around</li><li>Healthcare benefits</li><li>Great Career Progression</li></ul>

Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help drive advancements in digitized factories, mobility, and digital healthcare, combat climate change, and reliably connect humans and the world. With revenue of more than $12 billion in FY23 and approximately 26,000 people globally working alongside 125,000 global customers, ADI ensures today's innovators stay Ahead of What's Possible. Learn more at www.analog.com and on LinkedIn. Overview: As a Principal Data Engineer, you will be responsible for leading the design, development, and implementation of advanced data solutions that support our enterprise-wide data strategy. This role involves driving the architecture, development, and optimization of a scalable, secure master data platform that powers advanced analytics and data-driven decision-making across the organization. The successful candidate will be instrumental in shaping the master data ecosystem, providing thought leadership, and mentoring a team of skilled data engineers. Responsibilities Lead the design and development of the master data platform, ensuring it meets current and future business needs. Architect data models, storage, and processing solutions that balance performance, scalability, and maintainability. Perform hands-on development work on data analysis, data provisioning, data modeling, performance tuning, and optimization. Lead the design and development of Account Master, Contact master , Products Master, Parts Master and other similar entities . Integrating these entities with upstream and downstream business systems . Design and Development in TAMR and Stibo . Api and Microservices Design and Development Perform design and development in technologies like Fivetran, Snowflake, DBT, Python, SQL, Kubernetes, Kafka and utilize cloud technologies like Azure, AWS, and GCP. Experience working with large scale structured/semi-structured/unstructured data efficiently by designing, building and maintaining robust data processing frameworks for enabling actionable insights and analytics. Define and enforce best practices for data engineering, including coding standards, source control, and CI/CD processes to minimize technical debt and ensure high-quality code deployments. Create dashboards using enterprise tools such as Tableau and PowerBI. Experience in vector, graph and NoSQL databases for complex data use-cases. Ensure the reliability, performance, and security of data platforms and solutions. Provide technical guidance and support to team members, fostering a culture of collaboration, innovation, and continuous improvement. Work closely with business unit leaders, data scientists, and analysts to understand their requirements and translate them into robust technical solutions on the Enterprise Data Platform. Implement data quality and data governance practices, ensuring data security, compliance, and quality controls, especially when handling sensitive or high-risk data. Scope key business challenges, identify the right data, and provide direction to data analysts, product managers, data scientists, and data engineers. Drive innovation by creating new frameworks, standards, prototypes, and automation projects. Stay current with emerging trends and technologies in data engineering and analytics, driving the adoption of new tools and technologies. Qualifications: Bachelor's or master's degree in computer science, Engineering, or a related field. 15+ years of experience in data engineering, with a focus on designing and implementing large-scale master data solutions. Proven experience in a lead role, capable of driving projects and collaborating with cross-functional teams. Strong proficiency in SQL, Python, containerization (Kubernetes), and cloud technologies like Snowflake, DBT, Dagster, etc. Experience designing, building and maintaining frameworks to handle large data volumes, streaming data use-cases using technologies like Kafka, to handle IOT / sensor/edge device data. Experience building on at least one of the cloud technologies (AWS, GCP, Azure). Deep understanding of enterprise data management and master data concepts . Experience working on Master Data Platforms like Semarchy , Profisee, Tamr , Stibo , Informatica . Outstanding communication and interpersonal skills, with the ability to engage effectively with technical and non-technical stakeholders. Strong problem-solving skills and a proactive approach to identifying and addressing challenges. Strong Knowledge of data governance, security, and compliance best practices. Additional Qualifications (good to have): Experience in the manufacturing industry or a similar domain. Familiarity with handling IOT / edge device data. Certifications in cloud platforms or data engineering. For positions requiring access to technical data, Analog Devices, Inc. may have to obtain export licensing approval from the U.S. Department of Commerce - Bureau of Industry and Security and/or the U.S. Department of State - Directorate of Defense Trade Controls. As such, applicants for this position - except US Citizens, US Permanent Residents, and protected individuals as defined by 8 U.S.C. 1324b(a)(3) - may have to go through an export licensing review process. Analog Devices is an equal opportunity employer. We foster a culture where everyone has an opportunity to succeed regardless of their race, color, religion, age, ancestry, national origin, social or ethnic origin, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, parental status, disability, medical condition, genetic information, military or veteran status, union membership, and political affiliation, or any other legally protected group. EEO is the Law: Notice of Applicant Rights Under the Law. Job Req Type: Experienced Required Travel: No Shift Type: 1st Shift/Days The expected wage range for a new hire into this position is $154,400 to $212,300.<ul><li>Actual wage offered may vary depending on work location, experience, education, training, external market data, internal pay equity, or other bona fide factors.</li><li>This position qualifies for a discretionary performance-based bonus which is based on personal and company factors.</li><li>This position includes medical, vision and dental coverage, 401k, paid vacation, holidays, and sick time, and other benefits.</li></ul>

77 West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Spark, Scala, SQL)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,<a href="https://www.capitalone.com/diversity/business-resource-groups/" target="_blank"> </a>inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. Team Description: Join the team to lead the development and execution of strategies to convert retail partners by utilizing data driven insights and innovative technologies. This is a team of skilled data engineers that build robust data pipelines, ensuring data integrity accuracy and accessibility for all stakeholders. Spear head the design and implementation of scalable conversion solutions tailored to meet the needs of each retail partner. We design, build, and own services leveraging a wide list of technologies (Spark/Scala/Python), and use AWS infrastructure that hosts the solutions. Our CI/CD pipelines are implemented on top of Jenkins and deployed to AWS. Some of the other technologies we have in our ecosystem are Glue, S3, Lambdas, ALBs, Snowflake and Databricks . The team is organized as an agile team working in the SAFe construct and runs daily standups, 2-week sprints, and plans work with the rest of the platform in 3-sprint product increments.What Youll Do:<ul><li>Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>Utilize programming languages like Scala and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community</li><li>Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>Basic Qualifications: <ul><li>Bachelors Degree </li><li>At least 4 years of experience in application development (Internship experience does not apply)</li><li>At least 2 years of experience in big data technologies </li><li>At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</li></ul>Preferred Qualifications:<ul><li>7+ years of experience in application development including SQL or Scala</li><li>4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>4+ years experience with Distributed data/computing tools (Kafka or Spark)</li><li>4+ year experience working on real-time data and streaming applications </li><li>4+ years of experience with NoSQL implementation (Mongo or Cassandra) </li><li>4+ years of data warehousing experience (Redshift or Snowflake) </li><li>4+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>2+ years of experience with Agile engineering practices </li></ul>At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidates offer letter.This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<div><div><div><div>Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the <a href="https://www.capitalonecareers.com/benefits" target="_blank">Capital One Careers website</a>. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</div></div></div></div>This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at <a href="mailto:RecruitingAccommodation@capitalone.com" target="_blank">RecruitingAccommodation@capitalone.com</a>. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to <a href="mailto:Careers@capitalone.com" target="_blank">Careers@capitalone.com</a>Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

WSN is seeking a Data Engineer - New Products Enablement to place in an on-going consulting opportunity with our client, a global bank, based in New Jersey. Hybrid, 3 days onsite Responsibilities: <ul><li>The right candidate will be able to work independently in a fast-paced environment with minimal direction</li><li>As a key contributor, you will be expected to perform detailed analysis, develop and foster key operational relationships with stakeholders, and understand all facets of our technology planning, delivery and operational sustainment capability</li><li>Understands and/or performs physical modeling and metadata analysis efforts</li><li>Provides database design guidance and work with DBAs in Enterprise Database Management group to troubleshoot problems and optimize performance</li><li>Provides support for ongoing data management efforts in Development, QA and Production environments</li><li>Experience designing, modeling and developing Enterprise Data Warehouse solutions.</li><li>Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process</li><li>Provides guidance and direction to less experienced staff in resolution of escalated issues and/or complex production, application or system problems</li><li>Develops new documentation</li><li>Assures quality, security and compliance requirements are met for supported area and oversees updating and testing of the business continuation plan</li><li>6+ years of experience in development of high-availability, high volume transactional processing systems</li><li>Proficiency in working with systems required to effectively process large volumes of both real-time and batch transactions</li><li>Perform activities in order to sustain enhancements and release activities for Snowflake platform</li><li>Complex data analysis across all Software inventories with emphasis on understanding the financial and operational risks in order to drive recommendations and change</li></ul> Skills: <ul><li>Hands on experience designing, modeling and developing Enterprise Data Warehouse solutions.</li><li>Hands on experience coordinating and executing SIT and UAT testing for Enterprise Data Warehouse solutions.</li><li>Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process</li><li>Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend, SSIS etc) to develop data pipeline solutions to ingest and exploit new and existing data sources.</li><li>Proficient on data analysis and complex problems resolution</li><li>A significant contribution to an enterprise-wide Cloud Data Platform migration.</li><li>Participate in the improvement of our DevOps initiatives</li></ul> Nice to Have: <ul><li>Azure Cloud platform experience.</li><li>Azure Data Factory or similar ETL tool.</li><li>Azure Data Bricks experience.</li><li>Columnar Data Warehouse solution like Snowflake, RedShift, Vertica, Greenplum.</li><li>Any capital markets industry knowledge or experience.</li><li>Snowflake development experience</li><li>SQL Server development experience</li></ul>

Must Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+ Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and ETL (Extract, Transform, Load):Develop and implement data integration processes using Azure Data Factory.Extract data from various sources, transform it, and load it into data warehouses or data lakes.Big Data and Analytics:Utilize big data technologies such as Apache Spark.Create data processing workflows and pipelines to support data analytics and machine learning applications.Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function.Monitor and optimize data pipelines and database performance to ensure data processing efficiency.Build interfaces for supporting evolving and new applications and accommodating new data sources and types of data.Document data engineering processes, data models, and pipelines to ensure transparency and maintainability. Bachelor's degree Computer Science or a related field.5+ of experience in building data and analytics platform focused on Azure data and analytics solutions.Expertise in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Proficiency in:Software development and scripting languagesETL tools (e.g., SSIS, Azure Data Factory, Power BI Dataflow).Database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse).Knowledge of data modeling and data warehousing concepts.Excellent problem-solving and troubleshooting abilities.Attention to detail and commitment to data accuracy.Experience with cloud-based data migration.Strong analytical and problem-solving skills, with ability to conduct root cause analysis on system, process or production problems and ability to provide viable solutions.Experience working in an Agile environment with Scrum Master/Product owner and ability to deliver.3+ years of programming experience in Python/Pyspark. Knowledge of Jira, Confluence, SAFe development methodology & DevOps

Our top client in the travel/transportation industry is searching for a Sr. Cloud Data Engineer to join their team! Candidates must have 3+ years of experience with CosmosDB and Azure Cloud Workflows for this position. You will be responsible for migrating existing data platform solutions to the cloud, developing new data pipelines, and using Microsoft Azure Cloud PaaS technologies to engineer data solutions for a global, enterprise-level corporation. If you have a passion for engineering, working with massive amounts of data, and empowering smart business decisions, this is the role for you! *Please make sure your CosmosDB experience is clearly listed on your resume for consideration* 100% remote1+ year contract position with benefits available on contract Only able to hire from the following states at this time: MO, IL, VA, CO, KS, TX, NC, GA, TN, FL, MI, OK, IN, SC **Cannot work C2C** Required:<ul><li>Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future</li><li>3+ of related experience in Cosmos DB</li><li>Experience with Microsoft Azure Cloud workflows</li><li>Experience with configuration management and building automation capabilities such as Git/Jenkins/Bitbucket</li><li>Experience in T-SQL and scripting skills.</li><li>Knowledge on Microsoft cloud managed DBs/Systems (ie: managed SQL Instance, CosmosDB, Databricks, Delta Lake)</li><li>Experience with Big Data solutions such as Delta Lake and SQL DBMSs</li></ul> Preferred:<ul><li>Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, or related field preferred</li><li>Azure SQL DB etc. will be a big plus</li><li>Experience with Microsoft Azure platform technologies like Databricks applications, Event Hub, Data Factory, Azure SQL, Synapse Analytics, Delta Lake, Cosmos DB, or DevOps</li><li>Prior experience with large-scale projects</li></ul>

Plano 6 (31066), United States of America, Plano, Texas Senior Data Engineer (Python, Kafka, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking **Data Engineers** who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a data engineer for the Auto Lending Platform Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumption as well as building reports in Tableau, QuickSight, and other tools to provide insights to stakeholders which includes multiple VPs and Directors. If you are passionate about innovation in both engineering and analytics, come join our team! **What Youll Do:** + Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies + Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems + Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake + Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community + Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment + Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance **Basic Qualifications:** + Bachelors Degree + At least 3 years of experience in application development (Internship experience does not apply) + At least 1 year of experience in big data technologies **Preferred Qualifications:** + 5+ years of experience in application development including Python, SQL, Scala, or Java + 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) + 3+ years experience with Distributed data/computing tools (MapReduce, Eventbridge, EMR, Kafka, Spark, or PostgresQL) + 2+ year experience working on real-time data and streaming applications + 2+ years of experience with NoSQL implementation (Mongo, Cassandra) + 2+ years of data warehousing experience (Redshift or Snowflake) + 3+ years of experience with UNIX/Linux including basic commands and shell scripting + 2+ years of experience with Agile engineering practices **_At this time, Capital One will not sponsor a new applicant for employment authorization for this position._** Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website (https://www.capitalonecareers.com/benefits) . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Job ID: 679174BR Date posted: Oct. 23, 2024 Program: CDAODescription:We are hiring a Data Engineer Senior in Lockheed Martin's Enterprise Business and Digital Transformation (EBDT) organization to support Data Engineering development efforts in the Missiles & Fire Control business area (a $11B business) Chief Data and Analytics Office (CDAO). The data platform is a mix of SAP ERP, S4/HANA, AWS, IBM CP4D, and non-ERP applications for processes such as engineering, manufacturing, supply chain, finance, etc. The Data Engineering (DE) activities are part of larger data management initiatives within the digital and business transformation programs.The Data Engineer Senior is responsible for delivering full-stack data solutions across the entire data processing pipeline. This relies on systems engineering principles to design and implement solutions that span the data lifecycle to: collect, ingest, process, store, persist, access, and deliver data at scale and at speed. It includes knowledge of local, distributed, and cloud-based technologies; data virtualization and smart caching; and all security and authentication mechanisms required to protect the data. Build data pipelines that clean, transform, and aggregate unorganized data into databases or data sources that are ready for analysis; Requires experience in architecting, designing and developing highly scalable distributed data processing systems and Data Warehouse.Ability to gather and translate business requirements into analytical applications; Design and develop optimal code to maintain exceptional performance in processing large volumes of data across diverse sourcesMaintain data systems performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; Define standards, best practices, and certification processes for application development and deployment;What's In It For YouFrom onsite to remote, we offer flexible work schedules to comprehensive benefits investing in your future and security, Learn more about Lockheed Martin's comprehensive benefits package here.Do you want to be part of a company culture that empowers employees to think big, lead with a growth mindset, and make the impossible a reality? We provide the resources and give you the flexibility to enable inspiration and focus -if you have the passion and courage to dream big, work hard, and have fun doing what you love then we want to build a better tomorrow with you. Our Commitment to Diversity and Inclusion We Hear You, We See You. At LM Enterprise Operations we invest in people and promoting the sharing of ideas to create incredible solutions. We know that our success depends on the combined efforts of diverse-thinkers like you! At LM Enterprise Operations, we cultivate an inclusive environment that appreciates differences and unique thinking. Our global commitment to diversity and inclusion reflects our values of doing what's right, respecting others and performing with excellence.?Learn more here: Global DI.Basic Qualifications:This role requires a bachelor's degree in computer science, information systems or a related study. Ph.D. or master's degree in Data Engineering, Business Analysis Information Systems preferred.• 5+ years' combined experience in Data Engineering development in Aerospace & Defense or in large manufacturing industries primarily in SAP environment.• Experience & knowledge in SAP and related applications is required with high level business process knowledge.• Hands on development with SAP BODS, HANA data modelling and development using both SQL views and Calculation views, Stored Procedures,Python, IBM CP4D and SAP Business Objects (Webi, Crystal).• Experience with Integration technologies, such as Smart Data Access, SLT and virtual data modeling such as Tibco Data Virtualization.* US Citizenship is required for this role *Desired Skills:• Experience in Agile hands-on experience and knowledge is preferred.• Prefer experience in Data & Process knowledge of MES Systems - Apriso• Experience with Aerospace & Defense business applications, processes, and data sourcesClearance Level: NoneOther Important Information You Should KnowExpression of Interest: By applying to this job, you are expressing interest in this position and could be considered for other career opportunities where similar skills and requirements have been identified as a match. Should this match be identified you may be contacted for this and future openings.Ability to Work Remotely: Full-time Remote Telework: The employee selected for this position will work remotely full time at a location other than a Lockheed Martin designated office/job site. Employees may travel to a Lockheed Martin office for periodic meetings.Work Schedules: Lockheed Martin supports a variety of alternate work schedules that provide additional flexibility to our employees. Schedules range from standard 40 hours over a five day work week while others may be condensed. These condensed schedules provide employees with additional time away from the office and are in addition to our Paid Time off benefits.Schedule for this Position: 4x10 hour day, 3 days off per weekPay Rate:The annual base salary range for this position in most major metropolitan areas in California and New York is $103,100 - $194,300. Please note that the salary information is a general guideline only. Lockheed Martin considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/ training, key skills as well as market and business considerations when extending an offer.Benefits offered: Medical, Dental, Vision, Life Insurance, Short-Term Disability, Long-Term Disability, 401(k) match, Flexible Spending Accounts, EAP, Education Assistance, Parental Leave, Paid time off, and Holidays.This position is incentive plan eligible.Pay Rate:The annual base salary range for this position in California and New York (excluding most major metropolitan areas), Colorado, Hawaii, Washington or Washington DC is $89,600 - $171,800 . Please note that the salary information is a general guideline only. Lockheed Martin considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/ training, key skills as well as market and business considerations when extending an offer.Benefits offered: Medical, Dental, Vision, Life Insurance, Short-Term Disability, Long-Term Disability, 401(k) match, Flexible Spending Accounts, EAP, Education Assistance, Parental Leave, Paid time off, and Holidays.(Washington state applicants only) Non-represented full-time employees: accrue at least 10 hours per month of Paid Time Off (PTO) to be used for incidental absences and other reasons; receive at least 90 hours for holidays. Represented full time employees accrue 6.67 hours of Vacation per month; accrue up to 52 hours of sick leave annually; receive at least 96 hours for holidays. PTO, Vacation, sick leave, and holiday hours are prorated based on start date during the calendar year.This position is incentive plan eligible.Lockheed Martin is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.The application window will close in 90 days; applicants are encouraged to apply within 5 - 30 days of the requisition posting date in order to receive optimal consideration.At Lockheed Martin, we use our passion for purposeful innovation to help keep people safe and solve the world's most complex challenges. Our people are some of the greatest minds in the industry and truly make Lockheed Martin a great place to work. With our employees as our priority, we provide diverse career opportunities designed to propel, develop, and boost agility. Our flexible schedules, competitive pay, and comprehensive benefits enable our employees to live a healthy, fulfilling life at and outside of work. We place an emphasis on empowering our employees by fostering an inclusive environment built upon integrity and corporate responsibility.If this sounds like a culture you connect with, you're invited to apply for this role. Or, if you are unsure whether your experience aligns with the requirements of this position, we encourage you to search on Lockheed Martin Jobs, and apply for roles that align with your qualifications.Experience Level: Experienced ProfessionalBusiness Unit: ENTERPRISE BUSINESS SERVICESRelocation Available: NoCareer Area: Information TechnologyType: Full-TimeShift: First

Are you an Azure Data Engineer in search of your next opportunity? Our Plano-based client is in search of an Azure Data Engineer to provide business intelligence solutions to various business groups using a variety of software systems within Azure. This is an onsite, 6-month contract-to-hire opportunity. Please only apply if you can work 100% onsite. SALARY OFFERED: $130K-$160K total comp (base + bonus) WHAT CAN BCT OFFER YOU:<ul><li>BCT pays 60% of medical insurance for employees</li><li>$50k paid life insurance policy</li><li>Home, Auto & Pet Insurance along with Legal & Identity Theft</li><li>Dental & Vision, 401K match, and short & long-term disability insurance</li><li>Flexible Spending Account</li><li>Exceptional company values and culture with annual Anniversary Bonuses</li><li>Referral bonuses ranging from $500 to $2,000</li></ul> RESPONSIBILITIES:<ul><li>Design and implement scalable and secure data processing pipelines using Azure Data Factory, and other Azure services.</li><li>Manage and optimize data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and other Azure Storage applications.</li><li>Implement data security measures, including encryption, access controls, and auditing to protect sensitive information.</li><li>Develop data models and maintain data architecture to support data analytics and business intelligence reporting.</li><li>Develop and deliver training about data warehouses, data modeling techniques, pipelines development and stored procedure development, including continuing education and initial training for new users.</li></ul> QUALIFICATIONS:<ul><li>Bachelor's degree or equivalent combination of education/experience.</li><li>5 years’ experience with Data Engineering development including data models design, databases development, ETL, Stored procedures, and pipelines development.</li><li>3+ years' experience with Azure Data Engineering suite of tools including Azure Data Factory, Azure SQL, and Azure Data Lake.</li><li>Experience with building ODS databases and analytics data warehouses.</li><li>Experience with Azure, AWS, or other cloud platforms.</li><li>Experience with other Power Platform technologies is a plus.</li><li>Strong knowledge in data & analytics fundamentals including the various data modeling approaches.</li></ul> Apply now! CP #8406

Planet Technology has partnered with a northern Boston firm to locate a data engineer for a full-time role. The position will be hybrid onsite 2-3 days a week. This role will be responsible for collaborating across teams to meet business needs, manage key vendor relationships, and uphold data compliance standards. This is a unique opportunity to make a significant impact in a dynamic, data-driven environment. ResponsibilitiesData Architecture & Strategy<ul><li>Develop and maintain a scalable, high-performance data architecture.</li><li>Lead data integrations, ETL processes, and database management to ensure efficient data workflows.</li><li>Collaborate with stakeholders to translate business needs into actionable data models.</li><li>Create and maintain a shared data dictionary for consistent data usage across the company.</li><li>Establish data governance policies, ensuring accuracy, consistency, and security.</li></ul>Vendor Management<ul><li>Oversee relationships with key vendors, including Salesforce, FiveTran, and Azure SQL.</li><li>Manage vendor selection, contract negotiations, and service agreements.</li><li>Ensure vendor solutions align with business objectives and run smoothly within the ecosystem.</li><li>Monitor vendor performance to maintain compliance with service level agreements (SLAs).</li></ul>Data Governance & Compliance<ul><li>Ensure compliance with data privacy regulations (e.g., GDPR, CCPA) and industry standards.</li><li>Implement and oversee data security measures to safeguard sensitive information.</li><li>Conduct regular audits to ensure data accuracy and adherence to internal policies.</li><li>Keep the shared data dictionary up to date and accessible to relevant stakeholders.</li></ul>Performance Monitoring & Reporting<ul><li>Define and track KPIs to measure data management success.</li><li>Develop dashboards and reports for stakeholders, offering insights into data quality and system performance.</li></ul> Required Skills and Experience: <ul><li>Bachelor’s degree in Computer Science, Data Science, or a related field (Master’s preferred).</li><li>At least 3 years of experience in data engineering, architecture, or a similar role.</li><li>Proficiency with platforms like Salesforce, FiveTran, and Azure SQL.</li><li>Strong programming skills in SQL, Python, or R.</li><li>Deep knowledge of ETL processes, database management, and data warehousing.</li><li>Experience creating and managing a shared data dictionary.</li><li>Proven expertise in vendor management and negotiation.</li><li>Excellent communication and collaboration skills.</li><li>Familiarity with cloud-based data solutions and modern data stack architectures.</li></ul> Preferred Qualifications<ul><li>Hands-on experience with BI tools such as Tableau or CRM Analytics.</li><li>Relevant certifications (e.g., Salesforce, Azure) are a plus.</li><li>Background in data governance or compliance frameworks.</li></ul> Interested candidates can apply by clicking on the link or by sending a resume directly to Samantha Clements (sclements@planet-technology.com).

ZapLabs Data Engineer Interview Guide

Overview

ZapLabs Data Engineer Salary

ZapLabs Data Engineer Interview Process

ZapLabs Data Engineer Interview Questions

ZapLabs Data Engineer Jobs