The Made tech Data Engineer interview guide, interview questions, salary data, and interview experiences.

Made tech Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Made tech? The Made tech Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Made tech Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Made tech.</li>
<li>Practice real Made tech Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Made tech Data Engineer interview.


Getting ready for an Data Engineer interview at Made tech? The Made tech Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Made tech Data Engineer roles.
- Gain insights into the Data Engineer interview process at Made tech.
- Practice real Made tech Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Made tech Data Engineer interview.
        

Overview

Made tech Data Engineer Salary

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Made tech Data Engineer Interview Process

Given a table called <code>employees</code>, get the largest salary of any employee by department

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>largest_salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Write a query to get the largest salary of any employee by department

Largest Salary by Department

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

You’re given a dataframe of students named <code>students_df</code>:

<code>students_df</code> table

<table>
<thead>
<tr>
<th>name</th>
<th>age</th>
<th>favorite_color</th>
<th>grade</th>
</tr>
</thead>

<tbody>
<tr>
<td>Tim Voss</td>
<td>19</td>
<td>red</td>
<td>91</td>
</tr>

<tr>
<td>Nicole Johnson</td>
<td>20</td>
<td>yellow</td>
<td>95</td>
</tr>

<tr>
<td>Elsa Williams</td>
<td>21</td>
<td>green</td>
<td>82</td>
</tr>

<tr>
<td>John James</td>
<td>20</td>
<td>blue</td>
<td>75</td>
</tr>

<tr>
<td>Catherine Jones</td>
<td>23</td>
<td>green</td>
<td>93</td>
</tr>
</tbody>
</table>
Write a function named <code>grades_colors</code> to select only the rows where the student’s favorite color is green or red and their grade is above 90.

Example:

Input:

<pre tabindex="0" class="chroma"><code>import pandas as pd

students = {&#34;name&#34; : [&#34;Tim Voss&#34;, &#34;Nicole Johnson&#34;, &#34;Elsa Williams&#34;, &#34;John James&#34;, &#34;Catherine Jones&#34;], &#34;age&#34; : [19, 20, 21, 20, 23], &#34;favorite_color&#34; : [&#34;red&#34;, &#34;yellow&#34;, &#34;green&#34;, &#34;blue&#34;, &#34;green&#34;], &#34;grade&#34; : [91, 95, 82, 75, 93]}

students_df = pd.DataFrame(students)
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def grades_colors(students_df) -&gt;
</code></pre>

<table>
<thead>
<tr>
<th>name</th>
<th>age</th>
<th>favorite_color</th>
<th>grade</th>
</tr>
</thead>

<tbody>
<tr>
<td>Tim Voss</td>
<td>19</td>
<td>red</td>
<td>91</td>
</tr>

<tr>
<td>Catherine Jones</td>
<td>23</td>
<td>green</td>
<td>93</td>
</tr>
</tbody>
</table>

Write a function to select only the rows where the student's favorite color is green or red and their grade is above 90.

Good Grades and Favorite Colors

Made tech Data Engineer Interview Questions

Salary range is £49,500 - £85,000 depending on experienceLocation: Hybrid working in either Bristol, Manchester, London or Swansea. Support in applyingIf you need this job description in another format, or other support in applying, please email talent@madetech.com. We believe we can use tech to make public services better. We also believe this can happen best when our own team represents the society that actually uses the services we work on. We’re collectively continuing to grow a culture that is happy, healthy, safe and inspiring for people of all backgrounds and experiences, so we encourage people from underrepresented groups to apply for roles with us. When you apply, we’ll put you in touch with a talent partner who can help with any needs or adjustments we may need to make to help with your application. This includes alternative formats for documents, the time allotted for interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. Your role at Made TechAt Made Tech we want to positively impact the future of the country by using technology to improve society, for everyone. We want to empower the public sector to deliver and continuously improve digital services that are user-centric, data-driven and freed from legacy technology. A key component of this is developing modern data systems and platforms that drive informed decision-making for our clients. You will also work closely with clients to help shape their data strategy. Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs. They develop, operate, and maintain these services. They make sure they provide maximum value to data consumers, including analysts, scientists, and business stakeholders. As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands-on and you'll support as a senior contributor role for a project, focusing on both delivering engineering work as well as upskilling members of the client team. At other points, you might play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account. You’ll need to have a drive to deliver outcomes for users. You’ll make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution. What skills and experience are we looking for?We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.<ul><li>Enthusiasm for learning and self-development</li><li>Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies</li><li>Gathering and meeting the requirements of both clients and users on a data project</li><li>Strong experience in IaC and able to guide how one could deploy infrastructure into different environments</li><li>Owning the cloud infrastructure underpinning data systems through a DevOps approach</li><li>Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop</li><li>Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them</li><li>Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.</li><li>Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)</li><li>To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.</li><li>Experience in improving resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit, integration, data quality etc.)</li><li>Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.</li><li>Agile practices such as Scrum, XP, and/or Kanban</li><li>Designing and implementing efficient data transformation processes at scale, both in batch and streaming use cases</li><li>Owning the cloud infrastructure underpinning data systems through a DevOps approach</li><li>Agile practices such as Scrum, XP, and/or Kanban</li><li>People skills such as mentoring, supportive team player and performing line management duties</li><li>To be able to demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders</li></ul> Desirable experienceExperience in the following things isn’t essential, but it’s highly desirable!<ul><li>Working at a technology consultancy</li><li>Working with Docker and virtual environments as part of the development and CI/CD process.</li><li>Working with senior stakeholders to gather requirements and keep them engaged with</li><li>Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.</li><li>Working with data scientists to productionise advanced data deliverables, such as machine learning models</li><li>Working knowledge of statistics</li><li>Working with multidisciplinary digital and technology teams</li><li>Working within the public sector</li></ul> Life at Made TechWe’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here from <a>our blog, where we talk about mental health, communities of practice and neurodiversity</a> (as well as our client work and best practice).Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you’d like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.The groups are:<ul><li>antiracist-activists</li><li>disability</li><li>lgbtqiaplus-allies-and-activists</li><li>neurodiversity</li><li>parents-carers</li><li>women-in-tech</li></ul> BenefitsWe are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.Here are some of our most popular benefits listed below:✈️ <a>30 days Holiday</a> - we offer 30 days of paid annual leave????️ <a>Flexible Working Hours</a> - we are flexible with what hours you work???? <a>Flexible Parental Leave</a> - we offer flexible parental leave options????‍???? <a>Remote Working</a> - we offer part time remote working for all our staff???? <a>Paid counselling</a> - we offer paid counselling as well as financial and legal advice. An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility. Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.

Join our Workplace Investing Data Conversion and Implementation team as a Data Engineer within our growing Health and Welfare organization. In this role, you will support client implementations and internal migration projects, working closely with lead data analysts to convert client data into Fidelity’s architecture. This position requires proficiency in data analysis and the ability to manage multiple implementations and evolving client requirements. Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $45 - $55 / hr. w2 Responsibilities<ul><li>Support client implementations and internal migration projects.</li><li>Work with lead data analysts to convert client data into Fidelity’s architecture.</li><li>Analyze client source data to identify issues, potential causes, and suggest remediation.</li><li>Navigate the organization to bring together interested parties, negotiate differences, and draw effective conclusions.</li><li>Ask appropriate questions to extract information, follow up, and bring closure to issues.</li><li>Learn and apply Workplace Investing’s systems and processes related to data analysis and data loading.</li></ul> Experience Requirements<ul><li>Minimum 6-9 years of experience in a data analysis/programming role</li><li>Health and Welfare knowledge required</li><li>Broad application/technology experience is a plus</li><li>Demonstrated leadership skills</li><li>Highly organized and self-motivated</li><li>Strong time management skills and ability to handle various tasks simultaneously</li><li>Ability to thrive in a matrix-managed environment across multiple locations and functions</li></ul> Key Technical Skills:<ul><li>SQL</li><li>ETL Tools (Snaplogic)</li><li>Data Analysis</li><li>Data Exchange knowledge</li><li>Experience with programming languages and relational databases</li></ul> Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range. W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality. Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact InfoSec@eliassen.com. Job ID: JN -122024-92005

REQ ID – 33915592ROLE – Data Engineer, Battery TechnologyLOCATION – Cupertino - Hybrid MAIN SKILLS – We need someone with Snowflake, Python, SQL, Tableau, Airflow, DBT, Conductor, developing machine learning solutions using Python and its associated ecosystem — numpy, pandas, TensorFlow, PyTorch Key Qualifications: <ul><li>6+ years as data scientist, data engineer or analyst. Battery Engineering experience desired. Working knowledge and experience with big data.</li><li>Strong working knowledge of Snowflake, Python, SQL, Airflow and Tableau.</li><li>Solid competency in statistics and the ability to provide value-added analysis.</li><li>Familiar with machine learning algorithm and capable to use proper metrics to evaluate model results.</li><li>Proficiency developing machine learning solutions using Python and its associated ecosystem — numpy, pandas, TensorFlow, PyTorch, etc.</li><li>Experience working with large-scale data processing pipelines is a must.</li></ul> Job Description: <ul><li>Deliver high quality analytic insights from a large data warehouse, especially time series data</li><li>Experience working in a cloud-native environment such as Snowflake</li><li>Demonstrated abilities in problem formulation, algorithm design, and model building, including statistical analysis and evaluation.</li><li>Compare the results of predicted values and actual values, based on historical data availability</li><li>Write Python programs to implement Machine Learning functions and maintain revision in Github. Utilize advanced technologies, for modeling enhancements</li><li>Understand end to end nature of Apple DB to organize proper sample size, proper key pull and minimize SQA issues with maximum efficiency</li><li>Drive development of data products in collaboration with data scientists and analysts. Automate reporting where possible to make team more efficient</li><li>Be able to analyze factory, user, and failure data and use engineering understanding mechanisms to resolve battery problems</li><li>Work with diverse teams including data scientists, engineers, product managers and executives</li><li>Write programs for data filtering, organization, reporting. Write programs for uploading to and maintaining data in SQL database. Develop basic data management and selection programs on SQL.</li><li>Maintain software traceability through GitHub</li></ul> Education: MS or Ph.D. in Computer Science, Software Engineer, Data Science, Machine Learning, Statistics, Operations Research or related field.

Senior Data EngineerLondon office x3 days per weekUp to £85,000 Salary OVERVIEW Successful AI Scale Up in Medical Technology/ Digital Health are hiring for a Data Engineer with a focus on optimising the data architecture and building reliable and scalable data pipelines for the application of advanced analytics and machine learning. You will be joining a strong Data team and reporting directly into the Head of Engineering. YOUR RESPONSIBILITIES: The Data Engineer’s responsibilities will include, but not be limited to: <ul><li>Design, build and maintain scalable Data pipelines.</li><li>Maintain Data dashboards through data visualisation.</li><li>Ensure the quality and security of data processes.</li><li>Work closely and collaborate with the Machine Learning, Application and Analytics teams to understand data requirements and deliver projects.</li></ul> YOUR SKILLS & EXPERIENCE A successful Data Engineer will have the following: <ul><li>Min 3+ years proven commercial experience as a Data Engineer.</li><li>Experience working with Image Data is highly desirable.</li><li>Experienced in building ETL processes and scalable data pipelines.</li><li>Experience in Python/ Java, SQL and cloud data infrastructure (AWS, Azure of GCP).</li><li>Familiarity with tools or similar technologies such as Kafka, Airflow, Apache Spark.</li></ul> HOW TO APPLYPlease register your interest by sending your CV to luke.frost@xcede.com for more info!

Plano 7 (31067), United States of America, Plano, Texas Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a Data Engineer for the Originations Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumptions as well as building reports in Tableau, ThoughtSpot and other tools to provide insights to stakeholders which includes multiple VPs and Directors. You will have a lot of exposure to AWS services on your day to day job. If you are passionate about innovation in both engineering and analytics, come join our team What You’ll Do: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights Build the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, Python Be part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasets Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor’s Degree At least 3 years of experience in application development (Internship experience does not apply) At least 1 year of experience in big data technologies Preferred Qualifications: 5 years of experience in application development including Python, SQL, Scala, or Java 2 years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 3 years experience with Distributed data computing tools (Kafka, Spark, Flink) 2 year experience working on real-time data and streaming applications 2 years of experience with NoSQL implementation (DynamoDB, OpenSearch) 2 years of data warehousing experience (Redshift or Snowflake) At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization). Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodationcapitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careerscapitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Plano 6 (31066), United States of America, Plano, Texas Lead Data Engineer (Python, Kafka, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a data engineer for the Auto Lending Platform Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumption as well as building reports in Tableau, Quicksight , and other tools to provide insights to stakeholders which includes multiple VPs and Directors. If you are passionate about innovation in both engineering and analytics, come join our team What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor’s Degree At least 4 years of experience in application development (Internship experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications: 7 years of experience in application development including Python, SQL, Scala, or Java 4 years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4 years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4 year experience working on real-time data and streaming applications 4 years of experience with NoSQL implementation (Mongo, Cassandra) 4 years of data warehousing experience (Redshift or Snowflake) 4 years of experience with UNIX/Linux including basic commands and shell scripting 2 years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodationcapitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careerscapitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

NO THIRD PARTIES, NO LLC/INC/CTC, MUST BE ABLE TO CONVERT WITHOUT SPONSORSHIP. MUST ALREADY BE LOCATED IN DALLAS, TX OR SAN FRANCISCO, CA. THIS IS A 100% ONSITE POSITION. Sr. Business Intelligence Developer / Data EngineerLocation: North Dallas, 75251, or San Francisco, CA, 94103 JOB SUMMARYWe are an innovative FinTech/InsurTech that is changing the global insurance industry ingest, transform, validate and analyze its big data. We are seeking a skilled Sr. Business Intelligence & Data Engineer (MS Fabric) who can enhance our platform using modern technologies while ensuring reliable and high-performance operations.This position be in the Data Insights & Analytics team to help drive analytics in the world of complex and big data Our portfolio of products are part of the Microsoft business intelligence stack, including Microsoft Fabric, Azure SQL, PostgreSQL, Azure Data Factory, Azure Synapse Analytics, and Power BI. Our platform delivers valuable insights to executives, claims operations, and finance teams at our insurance carrier clients.Our mission is to build the leading insurance data platform, powering a new class of data-first applications and driving a data culture. Leveraging Azure data, our Insights and Analytics team is dedicated to building and maintaining analytics and reporting platform hosted in Azure, including on Microsoft Fabric.Our Azure Insights and Analytics team is tasked with maintaining and advancing our comprehensive data platform. This platform encompasses traditional DAX/MQuery design and more recently Spark development, with an emphasis on PySpark and Spark SQL within Microsoft Fabric notebooks. Our team places high importance on code optimization, metadata-driven orchestration, and implementing best practices in DevOps.You will be in charge of maintaining, designing and developing our Fabric platform, including Power BI dashboards, further implementing complex data models, data flows, and data transformations to support company and client requirements. You will be developing and maintaining complex data pipelines and notebooks for information processing and analysis.You will have the autonomy to define your area of expertise and cultivate skills that will propel your career forward. Your daily routine will include participating in standup meetings, managing work items based on your capacity, collaborating with the team’s growing technology department to define new projects or initiatives, and engage in development activities. In addition to traditional data engineering tasks, you will directly interact with the teams developing the tools we utilize, enabling you to provide direct product feedback and witness your input driving changes in the products over time.Our mission is to empower our team to achieve their potential. We come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our founder’s values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.The position is office-based in either in the Dallas, TX Headquarters or its San Francisco Office.Key Expertise • Microsoft Fabric: Demonstrated experience in developing and maintaining complex data pipelines with Microsoft Fabric• PowerBI / Synapse: Senior level expertise in dashboard design and development• Data Engineering / Azure Data Factory: Solid experience in data warehousing, ETL/ELT processes, and data modeling (dimensional, normalized)• Azure Full Stack Knowledge: Strong working knowledge of Azure services, especially Data Factory, Synapse Analytics, and Azure SQL Database• Coding fluency: Expert proficiency in DAX, MQuery, SQL, Python, PySpark and Spark SQL or similar languages for data scripting, transformation, and automation related to data transformation and analysis Requirements • Apply industry best practice transformation and modeling techniques – validating the output to ensure reliable and accurate results for consumption by downstream data teams, and end users.• Extract and transform disparate data into actionable insights that drive our client’s business decisions.• Drive development projects to evolve our platform and operations, leveraging the newest Azure and Fabric technologies available to us.• Contribute to the success of our data in Azure by introducing new Azure products and features to our company and clients• Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver working proofs of concept, and develop final data solution.• Live site and on call duty for maintaining high availability of our analytics solutions.• Collaborate with your peers and maintain flexibility on domain ownership as business priorities evolve.• Work with other teams and understanding their data products and onboarding them. QUALIFICATIONS: • Bachelor’s degree in engineering, computer science, or similar technical area• Master’s degree in data engineering or business intelligence a plus• 7+ years’ experience with Data Science and analytics using Power BI for data modeling, data visualization, and data management using Power BI and MS SQL. Recent exposure to MS Fabric a plus.• 5+ plus years of Business Intelligence Engineering, specifically with PowerBI• 5+ years' experience with DAX, Power Query, and MD• 3+ years’ experience with Azure cloud services, including Azure SQL, Full Azure Stack, DevOps

Centurion is looking for a Secret cleared Data Engineer for a hybrid opportunity out of the DC area. (3 days a month onsite) Required Skills: <ul><li>Tech Stack (must haves): Python, SQL, SQL Server, Azure (Data Factory), Databricks, PowerBI (especially back-end programming for PowerBI)</li><li>Working Style: GitHub collaboration, SharePoint experience (moderate user), ability to work onsite at Foggy Bottom and/or collaborate at Rosslyn, 5 – 8 days a month</li><li>Above average experience with Power Point (deck creation and presentation)</li><li>8 Years of Experience (total)</li><li>8+ years hands-on-keyboard experience</li><li>5+ years data analysis experience</li><li>Cloud certification (i.e. AWS, Databricks)</li><li>Basic understanding of LLM-based tools such as model inference API and RAG methods.</li><li>Bachelor’s Degree</li><li>Secret clearance</li></ul>Experience Breakdowns <ul><li>3+ years of experience in the private sector with a cloud migration</li><li>2+ years defining cloud architecture requirements and gathering user stories for analytic product outputs</li><li>2+ years managing cloud migrations and setting milestones and timelines.</li><li>2+ years in end-to-end design, develop and implement of cloud data architecture.</li><li>2+ years of stakeholder management in a low-data maturity environment.</li><li>2+ years of experience with data governance, data security and compliance.</li><li>3+ years providing technical mentorship to junior team members.</li><li>2+ years developing and managing data stacks and dataflow layer using metadata</li><li>2+ years creating SOPs and process documentation"</li></ul>Preferred Skills: <ul><li>Experience in the State Department with DT (aka IRM)</li><li>Experience in DoD or State Department with security assistance data</li><li>Experience with political-military lingo/jargon, OR, experience in the armed forces or reserves</li><li>Experience with government financial data (e.g. appropriations, obligations, etc.)</li><li>Experience supporting a Chief Data Officer or a Chief Analytics Officer</li><li>Experience using/developing data inventories and data catalogs</li><li>Working knowledge of AWS</li></ul>Expected Deliverables: <ul><li>Migration from SQL Server and Python-based workflows to Azure and Databricks</li></ul>Education: <ul><li>Bachelors</li></ul>Position Details: Clearance: Current Active Secret ClearanceUS Citizenship is requiredTravel: < 10% (CONUS)Centurion Consulting Group, LLC is an Equal Opportunity Employer EOE M/F/D/V<ul><li>No third parties or subcontractors</li></ul>

Data Engineer <ul><li>Direct Hire</li><li>1 day onsite in Durant OK</li></ul> Our Durant, Oklahoma based client is looking for a Data Engineer II. In this role, the candidate will establish data management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. They will participate in development of interfaces and design of user interface and business application prototypes. Job Responsibilities<ul><li>Work on problems of moderate scope where analysis of situations or data requires a review of a variety of factors.</li><li>Exercise judgment within defined procedures and practices to determine appropriate action and escalates to manager as needed.</li><li>Build productive internal/external working relationships.</li><li>Participate, and in some cases take the lead on, formulating and monitoring data architecture policies, procedures and standards.</li><li>Build moderate level complexity data interfaces, both internal and external sources</li><li>Participate in design of data architecture standards.</li><li>Design and implement database logical and physical models</li><li>Provide development and production support to troubleshoot all data interfaces and data model related issues.</li><li>Perform other duties as may be assigned.</li></ul> Job Requirements<ul><li> Bachelor’s degree in computer science, electronic engineering, computer information systems or related field, and minimum of 3 years of equivalent experience, 5 years preferred.</li><li>Professional ETL or data modeling focused Certifications preferred.</li><li>3 years exposure to database conceptual design and logical data modeling. 2 years of experience with conceptual design using data modeling tools preferred.</li><li>2 years of hands-on experience developing internal and external data interfaces and data loading plans.</li><li>Some experience with implementing and managing data security policies. Working knowledge of Data Governance concepts preferred.</li><li>3 years of converting business requirements into data, data warehouse specifications and loading plans.</li><li>3 years of hands-on experience with data Integration tools (SSIS, Informatica, SQL Stored Procedures etc.)</li><li>Some experience working with development teams on data used in user interfaces and backend data requirements, and on data used in user-based interfaces and backend data requirements preferred.</li><li>4 years of converting business requirements into data, database specifications and loading plans preferred.</li><li>4 years of data migration experience preferred.</li><li>Experience with managing multiple Service Requests and competing priorities preferred.</li><li>Minimum of 1 years of experience with programming languages (SQL, Python etc.) 2 years preferred.</li><li>3 years of experience supporting a data warehouse preferred.</li><li>Informatica experience desired.</li></ul>

Career Opportunity: Data Engineer We will consider in-office, hybrid, or remote candidates and it does not require regular travel. What We Do: At PESI we reach millions of professionals daily, offering them advanced training so that they can help others to achieve hope and healing. Our work has a deeper purpose; one that contributes to improving the quality of life of others. Our mission is to connect knowledge with need; we help clinicians, in the mental health and healthcare fields, throughout the world expand their knowledge through delivering innovative and cutting-edge training that helps them to improve the outcomes of their clients’ lives. PESI has offices on three continents and is continuing to expand. Join a company with a culture that embraces inquisitiveness, responsibility, collaboration, and continual learning and growth. How We Do It: We aim for innovation and creativity: Continuous improvement and falling forward is what facilitates our ability to meet our mission of connecting knowledge with need. Our people create our success: We listen, we learn, and we strive to meet or exceed the expectations of our customers, associates and vendors. We go direct and assume competence: We expect open, honest and ethical relationships both internally and externally. We encourage you to be an entrepreneur: Our associates view their position or area as if it were their own business and make decisions accordingly. Overview of the Information Technology Team:The PESI Information Technology Team is responsible for supporting the efforts of all PESI organizations –from business development to fulfillment. From desktop support to building, implementing, and supporting enterprise-scale systems, we work together to change how we reach our customers by developing new and innovative solutions to create efficiencies, expand our capabilities, and provide our customers with a best-in-class experience. What You Will Be Doing: (responsibilities)<ul><li>Collaborating with IT and business teams to develop and execute robust enterprise data strategies, empowering decision-makers across marketing and other business functions.</li><li>Designing and implementing a scalable Azure-based Data Warehouse, enabling seamless access to critical data for informed decision-making. Partnering with report writers and analysts to deliver actionable datasets and insightful reports.</li><li>Developing, maintaining, and optimizing ETL processes using modern cloud and on-premises tools. Documenting datasets comprehensively to ensure accessibility and ease of use for data warehouse consumers.</li><li>Acting as a trusted technical resource for business and IT teams on data-related challenges and solutions.</li><li>Writing and optimizing complex SQL queries for seamless data retrieval from multiple systems.</li></ul> What You Bring to the Team: (skills and requirements)<ul><li>2+ years of experience in building ETL processes using tools like SSIS, Azure Synapse Analytics, or Azure Data Factory.</li><li>1+ years of experience with cloud-hosted databases, preferably in Azure (e.g., Azure Synapse Analytics).</li><li>Strong grasp of ETL principles and best practices for efficient data processing. Proficiency in SQL, with the ability to write, debug, and optimize complex queries. </li><li>Familiarity with REST services and other APIs for data integration. Exceptional analytical thinking and conceptual problem-solving skills.</li><li>Passion for working with clean, structured, and meaningful data.</li><li>Excellent organizational and time management skills, with attention to detail and the ability to handle multiple tasks.</li><li>Proficient in Microsoft Office Suite for documentation, presentation, and reporting.</li><li>Experience with Power BI or similar reporting tools. </li><li>Knowledge of data warehousing best practices and dimensional modeling. </li><li>Basic understanding of data governance, privacy, and security best practices.</li></ul> What Would Thrill Us:<ul><li>Experience in eCommerce or marketing organizations, working with datasets such as customer, transaction, or product data.</li><li>Hands-on experience with Azure Data Platform technologies, such as Azure Data Lake, Azure CosmosDB, or Azure Fabric.</li><li>Experience with Microsoft Fabric.</li><li>Knowledge of Azure Active Directory (AAD) and Role-Based Access Control (RBAC).</li><li>Familiarity with third-party ETL tools to complement cloud-based solutions.</li><li>Proficiency in scripting languages such as PowerShell or Python.</li><li>Experience in programming with C#.Expertise in managing and processing semi-structured data (e.g., JSON, XML).Experience with Google Analytics data and working with Google BigQuery.</li><li>Experience with marketing platforms like HubSpot or similar email/campaign systems.</li><li>Experience building data integrations with NetSuite or other financial/accounting systems.</li></ul> What Else You Should Know About UsWe are an organization that loves to play the game of business, and we are unapologetically driven and dedicated to creating world-class educational solutions for our customers. By doing so, we get to help people around the world find comfort and healing. Candidates must be able to provide proof of eligibility to work in the United States following an offer of employment. Equal Employment Opportunity PESI is committed to creating a diverse environment and is proud to be an equal opportunity employer. All employment decisions are based on business needs without regard to race, color, ethnicity, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status or any other applicable legally protected status. All qualified candidates are encouraged to apply.

Made tech Data Engineer Interview Guide

Overview

Made tech Data Engineer Salary

Made tech Data Engineer Interview Process

Made tech Data Engineer Interview Questions

Made tech Data Engineer Jobs