The Made tech Data Engineer interview guide, interview questions, salary data, and interview experiences.

Made tech Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Made tech? The Made tech Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Made tech Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Made tech.</li>
<li>Practice real Made tech Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Made tech Data Engineer interview.


Getting ready for an Data Engineer interview at Made tech? The Made tech Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Made tech Data Engineer roles.
- Gain insights into the Data Engineer interview process at Made tech.
- Practice real Made tech Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Made tech Data Engineer interview.
        

Overview

Made tech Data Engineer Salary

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Made tech Data Engineer Interview Process

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

Given a table called <code>employees</code>, get the largest salary of any employee by department

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>largest_salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Write a query to get the largest salary of any employee by department

Largest Salary by Department

You are given a dictionary with a key-value of <code>{string: number}</code> where values in the dictionary could be duplicates. You are required to extract the unique values from the dictionary where the value occurred only once.

Return a list of values where they occur only once.

Note: You can return the values in any order.

Input:

<pre tabindex="0" class="chroma"><code>dictionary = {&#34;key1&#34;: 1, &#34;key2&#34;: 1, &#34;key3&#34;: 7, &#34;key4&#34;: 3, &#34;key5&#34;: 4, &#34;key6&#34;: 7}
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_unique_values(dictionary) -&gt; [3,4]

#Only 3 and 4 occurred once.
</code></pre>

Dictionary Unique Values

Made tech Data Engineer Interview Questions

Salary: £85,000 to £100,000 depending on experienceLocation: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms?Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applyingIf you need this job description in another format, or other support in applying, please email talent@madetech.com. We believe we can use tech to make public services better. We also believe this can happen best when our own team represents the society that actually uses the services we work on. We’re collectively continuing to grow a culture that is happy, healthy, safe and inspiring for people of all backgrounds and experiences, so we encourage people from underrepresented groups to apply for roles with us. When you apply, we’ll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Your role at Made Tech<ul><li>Define, shape and perfect data strategies in central and local government.</li><li>Help public sector teams understand the value of their data, and make the most of it.</li><li>Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.</li><li>As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities.</li></ul> What skills and experience are we looking for?We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.<ul><li>Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies.</li><li>Strong experience in IaC and able to guide how one could deploy infrastructure into different environments.</li><li>Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.</li><li>Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)</li><li>Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.</li><li>You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines.</li><li>Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment.</li><li>Some knowledge of how you would present diagrams (C4, UML, etc.)</li><li>Enthusiasm for learning and self-development.</li><li>You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban.</li><li>Can own the cloud infrastructure underpinning data systems through a DevOps approach.</li><li>Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.</li><li>You are a skilled Data Engineer who has delivered data platforms.</li><li>Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.</li><li>You can demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders.</li><li>You have the experience to improve resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit integration, data quality, etc)</li><li>You are skilled at offering guidance on how one would implement a robust DevOps approach in a data project.</li><li>You can comfortably talk about tools needed such as DataOps in areas such as orchestration, data integration and data analytics.</li></ul> Desirable experienceExperience in the following things isn’t essential, but it’s highly desirable!<ul><li>Working at a technology consultancy</li><li>Working with Docker and virtual environments as part of the development and CI/CD process.</li><li>Working with senior stakeholders to gather requirements and keep them engaged with</li><li>Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.</li><li>Working with data scientists to productionise advanced data deliverables, such as machine learning models</li><li>Working knowledge of statistics</li><li>Working with multidisciplinary digital and technology teams</li><li>Working within the public sector</li><li>Working with data scientists to productionise advanced data deliverables, such as machine learning models</li></ul> Life at Made TechWe’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from <a>our blog, where we talk about mental health, communities of practice and neurodiversity</a> (as well as our client work and best practice).Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you’d like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.The groups are:<ul><li>antiracist-activists</li><li>disability</li><li>lgbtqiaplus-allies-and-activists</li><li>neurodiversity</li><li>parents-carers</li><li>women-in-tech</li></ul>BenefitsWe are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.Here are some of our most popular benefits listed below:✈️ <a>30 days Holiday</a> - we offer 30 days of paid annual leave????️ <a>Flexible Working Hours</a> - we are flexible with what hours you work???? <a>Flexible Parental Leave</a> - we offer flexible parental leave options????‍???? <a>Remote Working</a> - we offer part time remote working for all our staff???? <a>Paid counselling</a> - we offer paid counselling as well as financial and legal advice. An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility.Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.

Salary range is £49,500 - £85,000 depending on experienceLocation: Hybrid working in either Bristol, Manchester, London or Swansea. Support in applyingIf you need this job description in another format, or other support in applying, please email talent@madetech.com. We believe we can use tech to make public services better. We also believe this can happen best when our own team represents the society that actually uses the services we work on. We’re collectively continuing to grow a culture that is happy, healthy, safe and inspiring for people of all backgrounds and experiences, so we encourage people from underrepresented groups to apply for roles with us. When you apply, we’ll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. Your role at Made TechAt Made Tech we want to positively impact the future of the country by using technology to improve society, for everyone. We want to empower the public sector to deliver and continuously improve digital services that are user-centric, data-driven and freed from legacy technology. A key component of this is developing modern data systems and platforms that drive informed decision-making for our clients. You will also work closely with clients to help shape their data strategy. Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands-on and you'll support as a senior contributor role for a project, focusing on both delivering engineering work as well as upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account. You’ll need to have a drive to deliver outcomes for users. You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution. What skills and experience are we looking for?We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.<ul><li>Enthusiasm for learning and self-development</li><li>Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies</li><li>Gathering and meeting the requirements of both clients and users on a data project</li><li>Strong experience in IaC and able to guide how one could deploy infrastructure into different environments</li><li>Owning the cloud infrastructure underpinning data systems through a DevOps approach</li><li>Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop</li><li>Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them</li><li>Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.</li><li>Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)</li><li>To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.</li><li>Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)</li><li>Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.</li><li>Agile practices such as Scrum, XP, and/or Kanban</li><li>Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases</li><li>Owning the cloud infrastructure underpinning data systems through a DevOps approach</li><li>Agile practices such as Scrum, XP, and/or Kanban</li><li>People skills such as mentoring, supportive team player and performing line management duties</li><li>To be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders</li></ul> Desirable experienceExperience in the following things isn’t essential, but it’s highly desirable!<ul><li>Working at a technology consultancy</li><li>Working with Docker and virtual environments as part of the development and CI/CD process.</li><li>Working with senior stakeholders to gather requirements and keep them engaged with</li><li>Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.</li><li>Working with data scientists to productionise advanced data deliverables, such as machine learning models</li><li>Working knowledge of statistics</li><li>Working with multidisciplinary digital and technology teams</li><li>Working within the public sector</li></ul> Life at Made TechWe’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from <a>our blog, where we talk about mental health, communities of practice and neurodiversity</a> (as well as our client work and best practice).Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you’d like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.The groups are:<ul><li>antiracist-activists</li><li>disability</li><li>lgbtqiaplus-allies-and-activists</li><li>neurodiversity</li><li>parents-carers</li><li>women-in-tech</li></ul> BenefitsWe are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.Here are some of our most popular benefits listed below:✈️ <a>30 days Holiday</a> - we offer 30 days of paid annual leave????️ <a>Flexible Working Hours</a> - we are flexible with what hours you work???? <a>Flexible Parental Leave</a> - we offer flexible parental leave options????‍???? <a>Remote Working</a> - we offer part time remote working for all our staff???? <a>Paid counselling</a> - we offer paid counselling as well as financial and legal advice. An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility. Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.

Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help drive advancements in digitized factories, mobility, and digital healthcare, combat climate change, and reliably connect humans and the world. With revenue of more than $12 billion in FY23 and approximately 26,000 people globally working alongside 125,000 global customers, ADI ensures today's innovators stay Ahead of What's Possible. Learn more at www.analog.com and on LinkedIn. Overview: As a Principal Data Engineer, you will be responsible for leading the design, development, and implementation of advanced data solutions that support our enterprise-wide data strategy. This role involves driving the architecture, development, and optimization of a scalable, secure master data platform that powers advanced analytics and data-driven decision-making across the organization. The successful candidate will be instrumental in shaping the master data ecosystem, providing thought leadership, and mentoring a team of skilled data engineers. Responsibilities Lead the design and development of the master data platform, ensuring it meets current and future business needs. Architect data models, storage, and processing solutions that balance performance, scalability, and maintainability. Perform hands-on development work on data analysis, data provisioning, data modeling, performance tuning, and optimization. Lead the design and development of Account Master, Contact master , Products Master, Parts Master and other similar entities . Integrating these entities with upstream and downstream business systems . Design and Development in TAMR and Stibo . Api and Microservices Design and Development Perform design and development in technologies like Fivetran, Snowflake, DBT, Python, SQL, Kubernetes, Kafka and utilize cloud technologies like Azure, AWS, and GCP. Experience working with large scale structured/semi-structured/unstructured data efficiently by designing, building and maintaining robust data processing frameworks for enabling actionable insights and analytics. Define and enforce best practices for data engineering, including coding standards, source control, and CI/CD processes to minimize technical debt and ensure high-quality code deployments. Create dashboards using enterprise tools such as Tableau and PowerBI. Experience in vector, graph and NoSQL databases for complex data use-cases. Ensure the reliability, performance, and security of data platforms and solutions. Provide technical guidance and support to team members, fostering a culture of collaboration, innovation, and continuous improvement. Work closely with business unit leaders, data scientists, and analysts to understand their requirements and translate them into robust technical solutions on the Enterprise Data Platform. Implement data quality and data governance practices, ensuring data security, compliance, and quality controls, especially when handling sensitive or high-risk data. Scope key business challenges, identify the right data, and provide direction to data analysts, product managers, data scientists, and data engineers. Drive innovation by creating new frameworks, standards, prototypes, and automation projects. Stay current with emerging trends and technologies in data engineering and analytics, driving the adoption of new tools and technologies. Qualifications: Bachelor's or master's degree in computer science, Engineering, or a related field. 15+ years of experience in data engineering, with a focus on designing and implementing large-scale master data solutions. Proven experience in a lead role, capable of driving projects and collaborating with cross-functional teams. Strong proficiency in SQL, Python, containerization (Kubernetes), and cloud technologies like Snowflake, DBT, Dagster, etc. Experience designing, building and maintaining frameworks to handle large data volumes, streaming data use-cases using technologies like Kafka, to handle IOT / sensor/edge device data. Experience building on at least one of the cloud technologies (AWS, GCP, Azure). Deep understanding of enterprise data management and master data concepts . Experience working on Master Data Platforms like Semarchy , Profisee, Tamr , Stibo , Informatica . Outstanding communication and interpersonal skills, with the ability to engage effectively with technical and non-technical stakeholders. Strong problem-solving skills and a proactive approach to identifying and addressing challenges. Strong Knowledge of data governance, security, and compliance best practices. Additional Qualifications (good to have): Experience in the manufacturing industry or a similar domain. Familiarity with handling IOT / edge device data. Certifications in cloud platforms or data engineering. For positions requiring access to technical data, Analog Devices, Inc. may have to obtain export licensing approval from the U.S. Department of Commerce - Bureau of Industry and Security and/or the U.S. Department of State - Directorate of Defense Trade Controls. As such, applicants for this position - except US Citizens, US Permanent Residents, and protected individuals as defined by 8 U.S.C. 1324b(a)(3) - may have to go through an export licensing review process. Analog Devices is an equal opportunity employer. We foster a culture where everyone has an opportunity to succeed regardless of their race, color, religion, age, ancestry, national origin, social or ethnic origin, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, parental status, disability, medical condition, genetic information, military or veteran status, union membership, and political affiliation, or any other legally protected group. EEO is the Law: Notice of Applicant Rights Under the Law. Job Req Type: Experienced Required Travel: No Shift Type: 1st Shift/Days The expected wage range for a new hire into this position is $154,400 to $212,300.<ul><li>Actual wage offered may vary depending on work location, experience, education, training, external market data, internal pay equity, or other bona fide factors.</li><li>This position qualifies for a discretionary performance-based bonus which is based on personal and company factors.</li><li>This position includes medical, vision and dental coverage, 401k, paid vacation, holidays, and sick time, and other benefits.</li></ul>

Must Have Technical/Functional Skills : Azure Data Engineer, Microsoft FabricExperience Required : 8+ Roles & ResponsibilitiesData Management and Storage:Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse.Ensure scalability, performance, and cost-effectiveness.Data Integration and ETL (Extract, Transform, Load):Develop and implement data integration processes using Azure Data Factory.Extract data from various sources, transform it, and load it into data warehouses or data lakes.Big Data and Analytics:Utilize big data technologies such as Apache Spark.Create data processing workflows and pipelines to support data analytics and machine learning applications.Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function.Monitor and optimize data pipelines and database performance to ensure data processing efficiency.Build interfaces for supporting evolving and new applications and accommodating new data sources and types of data.Document data engineering processes, data models, and pipelines to ensure transparency and maintainability. Bachelor's degree Computer Science or a related field.5+ of experience in building data and analytics platform focused on Azure data and analytics solutions.Expertise in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Proficiency in:Software development and scripting languagesETL tools (e.g., SSIS, Azure Data Factory, Power BI Dataflow).Database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse).Knowledge of data modeling and data warehousing concepts.Excellent problem-solving and troubleshooting abilities.Attention to detail and commitment to data accuracy.Experience with cloud-based data migration.Strong analytical and problem-solving skills, with ability to conduct root cause analysis on system, process or production problems and ability to provide viable solutions.Experience working in an Agile environment with Scrum Master/Product owner and ability to deliver.3+ years of programming experience in Python/Pyspark. Knowledge of Jira, Confluence, SAFe development methodology & DevOps

Data Engineer Engineer -Permanent???? Series B US blockchain Platform???? Competitive Salary +Other Benefits???? Location: Sunnyvale, California One of my clients who is a blockchain-powered platform (25M funded) that bridges the gap between telecommunications and fintech sectors, enabling unified mobile payment solutions with seamless cross-carrier interoperability and enhanced security protocols. The office is Currently based in Sunnyvale, California. They founded this company in order to use blockchain to create a decentralized value exchange network. Current team members are from PayPal, Goldman Sachs, JPMorgan, eBay, Visa... Has reached 1.3 M + users within their platform. ⚡Technical Excellence They Value:<ul><li>Amazon AWS Glue</li><li>Python </li><li>Strong SQL query </li><li>relational database skill (MySQL, PostgresDB)</li><li>Managed jobs and pipelines via deployment tools</li><li>Java skill preferred but not mandatory</li><li>Data warehouse experience</li><li>Analytics experience</li></ul> ⚡The role(Full time):<ul><li>Design, develop, and optimize data warehouse solutions to support analytical and business intelligence needs.</li><li>Work with AWS Glue to create and manage ETL pipelines.</li><li>Develop and maintain efficient Python scripts for data transformation and integration.</li><li>Write and optimize complex SQL queries to extract and manipulate data.</li><li>Manage relational databases such as MySQL and PostgresDB, ensuring data integrity and performance.</li><li>Implement and monitor and design data pipelines and workflows using deployment tools.</li><li>Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.</li></ul> ⚡Why apply:<ul><li>Competitive Salary + Stock Option</li><li>Great company culture</li><li>Open collaborative team to work around</li><li>Healthcare benefits</li><li>Great Career Progression</li></ul>

Planet Technology has partnered with a northern Boston firm to locate a data engineer for a full-time role. The position will be hybrid onsite 2-3 days a week. This role will be responsible for collaborating across teams to meet business needs, manage key vendor relationships, and uphold data compliance standards. This is a unique opportunity to make a significant impact in a dynamic, data-driven environment. ResponsibilitiesData Architecture & Strategy<ul><li>Develop and maintain a scalable, high-performance data architecture.</li><li>Lead data integrations, ETL processes, and database management to ensure efficient data workflows.</li><li>Collaborate with stakeholders to translate business needs into actionable data models.</li><li>Create and maintain a shared data dictionary for consistent data usage across the company.</li><li>Establish data governance policies, ensuring accuracy, consistency, and security.</li></ul>Vendor Management<ul><li>Oversee relationships with key vendors, including Salesforce, FiveTran, and Azure SQL.</li><li>Manage vendor selection, contract negotiations, and service agreements.</li><li>Ensure vendor solutions align with business objectives and run smoothly within the ecosystem.</li><li>Monitor vendor performance to maintain compliance with service level agreements (SLAs).</li></ul>Data Governance & Compliance<ul><li>Ensure compliance with data privacy regulations (e.g., GDPR, CCPA) and industry standards.</li><li>Implement and oversee data security measures to safeguard sensitive information.</li><li>Conduct regular audits to ensure data accuracy and adherence to internal policies.</li><li>Keep the shared data dictionary up to date and accessible to relevant stakeholders.</li></ul>Performance Monitoring & Reporting<ul><li>Define and track KPIs to measure data management success.</li><li>Develop dashboards and reports for stakeholders, offering insights into data quality and system performance.</li></ul> Required Skills and Experience: <ul><li>Bachelor’s degree in Computer Science, Data Science, or a related field (Master’s preferred).</li><li>At least 3 years of experience in data engineering, architecture, or a similar role.</li><li>Proficiency with platforms like Salesforce, FiveTran, and Azure SQL.</li><li>Strong programming skills in SQL, Python, or R.</li><li>Deep knowledge of ETL processes, database management, and data warehousing.</li><li>Experience creating and managing a shared data dictionary.</li><li>Proven expertise in vendor management and negotiation.</li><li>Excellent communication and collaboration skills.</li><li>Familiarity with cloud-based data solutions and modern data stack architectures.</li></ul> Preferred Qualifications<ul><li>Hands-on experience with BI tools such as Tableau or CRM Analytics.</li><li>Relevant certifications (e.g., Salesforce, Azure) are a plus.</li><li>Background in data governance or compliance frameworks.</li></ul> Interested candidates can apply by clicking on the link or by sending a resume directly to Samantha Clements (sclements@planet-technology.com).

Our top client in the travel/transportation industry is searching for a Sr. Cloud Data Engineer to join their team! Candidates must have 3+ years of experience with CosmosDB and Azure Cloud Workflows for this position. You will be responsible for migrating existing data platform solutions to the cloud, developing new data pipelines, and using Microsoft Azure Cloud PaaS technologies to engineer data solutions for a global, enterprise-level corporation. If you have a passion for engineering, working with massive amounts of data, and empowering smart business decisions, this is the role for you! *Please make sure your CosmosDB experience is clearly listed on your resume for consideration* 100% remote1+ year contract position with benefits available on contract Only able to hire from the following states at this time: MO, IL, VA, CO, KS, TX, NC, GA, TN, FL, MI, OK, IN, SC **Cannot work C2C** Required:<ul><li>Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future</li><li>3+ of related experience in Cosmos DB</li><li>Experience with Microsoft Azure Cloud workflows</li><li>Experience with configuration management and building automation capabilities such as Git/Jenkins/Bitbucket</li><li>Experience in T-SQL and scripting skills.</li><li>Knowledge on Microsoft cloud managed DBs/Systems (ie: managed SQL Instance, CosmosDB, Databricks, Delta Lake)</li><li>Experience with Big Data solutions such as Delta Lake and SQL DBMSs</li></ul> Preferred:<ul><li>Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, or related field preferred</li><li>Azure SQL DB etc. will be a big plus</li><li>Experience with Microsoft Azure platform technologies like Databricks applications, Event Hub, Data Factory, Azure SQL, Synapse Analytics, Delta Lake, Cosmos DB, or DevOps</li><li>Prior experience with large-scale projects</li></ul>

Plano 6 (31066), United States of America, Plano, Texas Senior Data Engineer (Python, Kafka, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking **Data Engineers** who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a data engineer for the Auto Lending Platform Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumption as well as building reports in Tableau, QuickSight, and other tools to provide insights to stakeholders which includes multiple VPs and Directors. If you are passionate about innovation in both engineering and analytics, come join our team! **What Youll Do:** + Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies + Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems + Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake + Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community + Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment + Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance **Basic Qualifications:** + Bachelors Degree + At least 3 years of experience in application development (Internship experience does not apply) + At least 1 year of experience in big data technologies **Preferred Qualifications:** + 5+ years of experience in application development including Python, SQL, Scala, or Java + 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) + 3+ years experience with Distributed data/computing tools (MapReduce, Eventbridge, EMR, Kafka, Spark, or PostgresQL) + 2+ year experience working on real-time data and streaming applications + 2+ years of experience with NoSQL implementation (Mongo, Cassandra) + 2+ years of data warehousing experience (Redshift or Snowflake) + 3+ years of experience with UNIX/Linux including basic commands and shell scripting + 2+ years of experience with Agile engineering practices **_At this time, Capital One will not sponsor a new applicant for employment authorization for this position._** Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website (https://www.capitalonecareers.com/benefits) . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

77 West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer (Spark, Scala, SQL)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,<a href="https://www.capitalone.com/diversity/business-resource-groups/" target="_blank"> </a>inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. Team Description: Join the team to lead the development and execution of strategies to convert retail partners by utilizing data driven insights and innovative technologies. This is a team of skilled data engineers that build robust data pipelines, ensuring data integrity accuracy and accessibility for all stakeholders. Spear head the design and implementation of scalable conversion solutions tailored to meet the needs of each retail partner. We design, build, and own services leveraging a wide list of technologies (Spark/Scala/Python), and use AWS infrastructure that hosts the solutions. Our CI/CD pipelines are implemented on top of Jenkins and deployed to AWS. Some of the other technologies we have in our ecosystem are Glue, S3, Lambdas, ALBs, Snowflake and Databricks . The team is organized as an agile team working in the SAFe construct and runs daily standups, 2-week sprints, and plans work with the rest of the platform in 3-sprint product increments.What Youll Do:<ul><li>Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>Utilize programming languages like Scala and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community</li><li>Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul>Basic Qualifications: <ul><li>Bachelors Degree </li><li>At least 4 years of experience in application development (Internship experience does not apply)</li><li>At least 2 years of experience in big data technologies </li><li>At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</li></ul>Preferred Qualifications:<ul><li>7+ years of experience in application development including SQL or Scala</li><li>4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>4+ years experience with Distributed data/computing tools (Kafka or Spark)</li><li>4+ year experience working on real-time data and streaming applications </li><li>4+ years of experience with NoSQL implementation (Mongo or Cassandra) </li><li>4+ years of data warehousing experience (Redshift or Snowflake) </li><li>4+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>2+ years of experience with Agile engineering practices </li></ul>At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.Illinois (Hybrid On-Site): $187,700 - $214,200 for Lead Data EngineerCandidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidates offer letter.This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.<div><div><div><div>Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the <a href="https://www.capitalonecareers.com/benefits" target="_blank">Capital One Careers website</a>. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.</div></div></div></div>This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at <a href="mailto:RecruitingAccommodation@capitalone.com" target="_blank">RecruitingAccommodation@capitalone.com</a>. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to <a href="mailto:Careers@capitalone.com" target="_blank">Careers@capitalone.com</a>Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Job ID: 679174BR Date posted: Oct. 23, 2024 Program: CDAODescription:We are hiring a Data Engineer Senior in Lockheed Martin's Enterprise Business and Digital Transformation (EBDT) organization to support Data Engineering development efforts in the Missiles & Fire Control business area (a $11B business) Chief Data and Analytics Office (CDAO). The data platform is a mix of SAP ERP, S4/HANA, AWS, IBM CP4D, and non-ERP applications for processes such as engineering, manufacturing, supply chain, finance, etc. The Data Engineering (DE) activities are part of larger data management initiatives within the digital and business transformation programs.The Data Engineer Senior is responsible for delivering full-stack data solutions across the entire data processing pipeline. This relies on systems engineering principles to design and implement solutions that span the data lifecycle to: collect, ingest, process, store, persist, access, and deliver data at scale and at speed. It includes knowledge of local, distributed, and cloud-based technologies; data virtualization and smart caching; and all security and authentication mechanisms required to protect the data. Build data pipelines that clean, transform, and aggregate unorganized data into databases or data sources that are ready for analysis; Requires experience in architecting, designing and developing highly scalable distributed data processing systems and Data Warehouse.Ability to gather and translate business requirements into analytical applications; Design and develop optimal code to maintain exceptional performance in processing large volumes of data across diverse sourcesMaintain data systems performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; Define standards, best practices, and certification processes for application development and deployment;What's In It For YouFrom onsite to remote, we offer flexible work schedules to comprehensive benefits investing in your future and security, Learn more about Lockheed Martin's comprehensive benefits package here.Do you want to be part of a company culture that empowers employees to think big, lead with a growth mindset, and make the impossible a reality? We provide the resources and give you the flexibility to enable inspiration and focus -if you have the passion and courage to dream big, work hard, and have fun doing what you love then we want to build a better tomorrow with you. Our Commitment to Diversity and Inclusion We Hear You, We See You. At LM Enterprise Operations we invest in people and promoting the sharing of ideas to create incredible solutions. We know that our success depends on the combined efforts of diverse-thinkers like you! At LM Enterprise Operations, we cultivate an inclusive environment that appreciates differences and unique thinking. Our global commitment to diversity and inclusion reflects our values of doing what's right, respecting others and performing with excellence.?Learn more here: Global DI.Basic Qualifications:This role requires a bachelor's degree in computer science, information systems or a related study. Ph.D. or master's degree in Data Engineering, Business Analysis Information Systems preferred.• 5+ years' combined experience in Data Engineering development in Aerospace & Defense or in large manufacturing industries primarily in SAP environment.• Experience & knowledge in SAP and related applications is required with high level business process knowledge.• Hands on development with SAP BODS, HANA data modelling and development using both SQL views and Calculation views, Stored Procedures,Python, IBM CP4D and SAP Business Objects (Webi, Crystal).• Experience with Integration technologies, such as Smart Data Access, SLT and virtual data modeling such as Tibco Data Virtualization.* US Citizenship is required for this role *Desired Skills:• Experience in Agile hands-on experience and knowledge is preferred.• Prefer experience in Data & Process knowledge of MES Systems - Apriso• Experience with Aerospace & Defense business applications, processes, and data sourcesClearance Level: NoneOther Important Information You Should KnowExpression of Interest: By applying to this job, you are expressing interest in this position and could be considered for other career opportunities where similar skills and requirements have been identified as a match. Should this match be identified you may be contacted for this and future openings.Ability to Work Remotely: Full-time Remote Telework: The employee selected for this position will work remotely full time at a location other than a Lockheed Martin designated office/job site. Employees may travel to a Lockheed Martin office for periodic meetings.Work Schedules: Lockheed Martin supports a variety of alternate work schedules that provide additional flexibility to our employees. Schedules range from standard 40 hours over a five day work week while others may be condensed. These condensed schedules provide employees with additional time away from the office and are in addition to our Paid Time off benefits.Schedule for this Position: 4x10 hour day, 3 days off per weekPay Rate:The annual base salary range for this position in most major metropolitan areas in California and New York is $103,100 - $194,300. Please note that the salary information is a general guideline only. Lockheed Martin considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/ training, key skills as well as market and business considerations when extending an offer.Benefits offered: Medical, Dental, Vision, Life Insurance, Short-Term Disability, Long-Term Disability, 401(k) match, Flexible Spending Accounts, EAP, Education Assistance, Parental Leave, Paid time off, and Holidays.This position is incentive plan eligible.Pay Rate:The annual base salary range for this position in California and New York (excluding most major metropolitan areas), Colorado, Hawaii, Washington or Washington DC is $89,600 - $171,800 . Please note that the salary information is a general guideline only. Lockheed Martin considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/ training, key skills as well as market and business considerations when extending an offer.Benefits offered: Medical, Dental, Vision, Life Insurance, Short-Term Disability, Long-Term Disability, 401(k) match, Flexible Spending Accounts, EAP, Education Assistance, Parental Leave, Paid time off, and Holidays.(Washington state applicants only) Non-represented full-time employees: accrue at least 10 hours per month of Paid Time Off (PTO) to be used for incidental absences and other reasons; receive at least 90 hours for holidays. Represented full time employees accrue 6.67 hours of Vacation per month; accrue up to 52 hours of sick leave annually; receive at least 96 hours for holidays. PTO, Vacation, sick leave, and holiday hours are prorated based on start date during the calendar year.This position is incentive plan eligible.Lockheed Martin is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.The application window will close in 90 days; applicants are encouraged to apply within 5 - 30 days of the requisition posting date in order to receive optimal consideration.At Lockheed Martin, we use our passion for purposeful innovation to help keep people safe and solve the world's most complex challenges. Our people are some of the greatest minds in the industry and truly make Lockheed Martin a great place to work. With our employees as our priority, we provide diverse career opportunities designed to propel, develop, and boost agility. Our flexible schedules, competitive pay, and comprehensive benefits enable our employees to live a healthy, fulfilling life at and outside of work. We place an emphasis on empowering our employees by fostering an inclusive environment built upon integrity and corporate responsibility.If this sounds like a culture you connect with, you're invited to apply for this role. Or, if you are unsure whether your experience aligns with the requirements of this position, we encourage you to search on Lockheed Martin Jobs, and apply for roles that align with your qualifications.Experience Level: Experienced ProfessionalBusiness Unit: ENTERPRISE BUSINESS SERVICESRelocation Available: NoCareer Area: Information TechnologyType: Full-TimeShift: First

Made tech Data Engineer Interview Guide

Overview

Made tech Data Engineer Salary

Made tech Data Engineer Interview Process

Made tech Data Engineer Interview Questions

Made tech Data Engineer Jobs