The Qio Data Engineer interview guide, interview questions, salary data, and interview experiences.

Qio Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Qio? The Qio Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Qio Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Qio.</li>
<li>Practice real Qio Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Qio Data Engineer interview.


Getting ready for an Data Engineer interview at Qio? The Qio Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Qio Data Engineer roles.
- Gain insights into the Data Engineer interview process at Qio.
- Practice real Qio Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Qio Data Engineer interview.
        

Overview

Qio Data Engineer Salary

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Qio Data Engineer Interview Process

Given a table called <code>employees</code>, get the largest salary of any employee by department

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>largest_salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Write a query to get the largest salary of any employee by department

Largest Salary by Department

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

You are given a dictionary with a key-value of <code>{string: number}</code> where values in the dictionary could be duplicates. You are required to extract the unique values from the dictionary where the value occurred only once.

Return a list of values where they occur only once.

Note: You can return the values in any order.

Input:

<pre tabindex="0" class="chroma"><code>dictionary = {&#34;key1&#34;: 1, &#34;key2&#34;: 1, &#34;key3&#34;: 7, &#34;key4&#34;: 3, &#34;key5&#34;: 4, &#34;key6&#34;: 7}
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_unique_values(dictionary) -&gt; [3,4]

#Only 3 and 4 occurred once.
</code></pre>

Dictionary Unique Values

Qio Data Engineer Interview Questions

Plano 7 (31067), United States of America, Plano, Texas Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a Data Engineer for the Originations Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumptions as well as building reports in Tableau, ThoughtSpot and other tools to provide insights to stakeholders which includes multiple VPs and Directors. You will have a lot of exposure to AWS services on your day to day job. If you are passionate about innovation in both engineering and analytics, come join our team What You’ll Do: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights Build the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, Python Be part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasets Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor’s Degree At least 3 years of experience in application development (Internship experience does not apply) At least 1 year of experience in big data technologies Preferred Qualifications: 5 years of experience in application development including Python, SQL, Scala, or Java 2 years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 3 years experience with Distributed data computing tools (Kafka, Spark, Flink) 2 year experience working on real-time data and streaming applications 2 years of experience with NoSQL implementation (DynamoDB, OpenSearch) 2 years of data warehousing experience (Redshift or Snowflake) At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization). Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodationcapitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careerscapitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Plano 6 (31066), United States of America, Plano, Texas Lead Data Engineer (Python, Kafka, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a data engineer for the Auto Lending Platform Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumption as well as building reports in Tableau, Quicksight , and other tools to provide insights to stakeholders which includes multiple VPs and Directors. If you are passionate about innovation in both engineering and analytics, come join our team What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor’s Degree At least 4 years of experience in application development (Internship experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications: 7 years of experience in application development including Python, SQL, Scala, or Java 4 years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4 years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4 year experience working on real-time data and streaming applications 4 years of experience with NoSQL implementation (Mongo, Cassandra) 4 years of data warehousing experience (Redshift or Snowflake) 4 years of experience with UNIX/Linux including basic commands and shell scripting 2 years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodationcapitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careerscapitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Data Engineer <ul><li>Direct Hire</li><li>1 day onsite in Durant OK</li></ul> Our Durant, Oklahoma based client is looking for a Data Engineer II. In this role, the candidate will establish data management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. They will participate in development of interfaces and design of user interface and business application prototypes. Job Responsibilities<ul><li>Work on problems of moderate scope where analysis of situations or data requires a review of a variety of factors.</li><li>Exercise judgment within defined procedures and practices to determine appropriate action and escalates to manager as needed.</li><li>Build productive internal/external working relationships.</li><li>Participate, and in some cases take the lead on, formulating and monitoring data architecture policies, procedures and standards.</li><li>Build moderate level complexity data interfaces, both internal and external sources</li><li>Participate in design of data architecture standards.</li><li>Design and implement database logical and physical models</li><li>Provide development and production support to troubleshoot all data interfaces and data model related issues.</li><li>Perform other duties as may be assigned.</li></ul> Job Requirements<ul><li> Bachelor’s degree in computer science, electronic engineering, computer information systems or related field, and minimum of 3 years of equivalent experience, 5 years preferred.</li><li>Professional ETL or data modeling focused Certifications preferred.</li><li>3 years exposure to database conceptual design and logical data modeling. 2 years of experience with conceptual design using data modeling tools preferred.</li><li>2 years of hands-on experience developing internal and external data interfaces and data loading plans.</li><li>Some experience with implementing and managing data security policies. Working knowledge of Data Governance concepts preferred.</li><li>3 years of converting business requirements into data, data warehouse specifications and loading plans.</li><li>3 years of hands-on experience with data Integration tools (SSIS, Informatica, SQL Stored Procedures etc.)</li><li>Some experience working with development teams on data used in user interfaces and backend data requirements, and on data used in user-based interfaces and backend data requirements preferred.</li><li>4 years of converting business requirements into data, database specifications and loading plans preferred.</li><li>4 years of data migration experience preferred.</li><li>Experience with managing multiple Service Requests and competing priorities preferred.</li><li>Minimum of 1 years of experience with programming languages (SQL, Python etc.) 2 years preferred.</li><li>3 years of experience supporting a data warehouse preferred.</li><li>Informatica experience desired.</li></ul>

Join our Workplace Investing Data Conversion and Implementation team as a Data Engineer within our growing Health and Welfare organization. In this role, you will support client implementations and internal migration projects, working closely with lead data analysts to convert client data into Fidelity’s architecture. This position requires proficiency in data analysis and the ability to manage multiple implementations and evolving client requirements. Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance. Rate: $45 - $55 / hr. w2 Responsibilities<ul><li>Support client implementations and internal migration projects.</li><li>Work with lead data analysts to convert client data into Fidelity’s architecture.</li><li>Analyze client source data to identify issues, potential causes, and suggest remediation.</li><li>Navigate the organization to bring together interested parties, negotiate differences, and draw effective conclusions.</li><li>Ask appropriate questions to extract information, follow up, and bring closure to issues.</li><li>Learn and apply Workplace Investing’s systems and processes related to data analysis and data loading.</li></ul> Experience Requirements<ul><li>Minimum 6-9 years of experience in a data analysis/programming role</li><li>Health and Welfare knowledge required</li><li>Broad application/technology experience is a plus</li><li>Demonstrated leadership skills</li><li>Highly organized and self-motivated</li><li>Strong time management skills and ability to handle various tasks simultaneously</li><li>Ability to thrive in a matrix-managed environment across multiple locations and functions</li></ul> Key Technical Skills:<ul><li>SQL</li><li>ETL Tools (Snaplogic)</li><li>Data Analysis</li><li>Data Exchange knowledge</li><li>Experience with programming languages and relational databases</li></ul> Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range. W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality. Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact InfoSec@eliassen.com. Job ID: JN -122024-92005

REQ ID – 33915592ROLE – Data Engineer, Battery TechnologyLOCATION – Cupertino - Hybrid MAIN SKILLS – We need someone with Snowflake, Python, SQL, Tableau, Airflow, DBT, Conductor, developing machine learning solutions using Python and its associated ecosystem — numpy, pandas, TensorFlow, PyTorch Key Qualifications: <ul><li>6+ years as data scientist, data engineer or analyst. Battery Engineering experience desired. Working knowledge and experience with big data.</li><li>Strong working knowledge of Snowflake, Python, SQL, Airflow and Tableau.</li><li>Solid competency in statistics and the ability to provide value-added analysis.</li><li>Familiar with machine learning algorithm and capable to use proper metrics to evaluate model results.</li><li>Proficiency developing machine learning solutions using Python and its associated ecosystem — numpy, pandas, TensorFlow, PyTorch, etc.</li><li>Experience working with large-scale data processing pipelines is a must.</li></ul> Job Description: <ul><li>Deliver high quality analytic insights from a large data warehouse, especially time series data</li><li>Experience working in a cloud-native environment such as Snowflake</li><li>Demonstrated abilities in problem formulation, algorithm design, and model building, including statistical analysis and evaluation.</li><li>Compare the results of predicted values and actual values, based on historical data availability</li><li>Write Python programs to implement Machine Learning functions and maintain revision in Github. Utilize advanced technologies, for modeling enhancements</li><li>Understand end to end nature of Apple DB to organize proper sample size, proper key pull and minimize SQA issues with maximum efficiency</li><li>Drive development of data products in collaboration with data scientists and analysts. Automate reporting where possible to make team more efficient</li><li>Be able to analyze factory, user, and failure data and use engineering understanding mechanisms to resolve battery problems</li><li>Work with diverse teams including data scientists, engineers, product managers and executives</li><li>Write programs for data filtering, organization, reporting. Write programs for uploading to and maintaining data in SQL database. Develop basic data management and selection programs on SQL.</li><li>Maintain software traceability through GitHub</li></ul> Education: MS or Ph.D. in Computer Science, Software Engineer, Data Science, Machine Learning, Statistics, Operations Research or related field.

Career Opportunity: Data Engineer We will consider in-office, hybrid, or remote candidates and it does not require regular travel. What We Do: At PESI we reach millions of professionals daily, offering them advanced training so that they can help others to achieve hope and healing. Our work has a deeper purpose; one that contributes to improving the quality of life of others. Our mission is to connect knowledge with need; we help clinicians, in the mental health and healthcare fields, throughout the world expand their knowledge through delivering innovative and cutting-edge training that helps them to improve the outcomes of their clients’ lives. PESI has offices on three continents and is continuing to expand. Join a company with a culture that embraces inquisitiveness, responsibility, collaboration, and continual learning and growth. How We Do It: We aim for innovation and creativity: Continuous improvement and falling forward is what facilitates our ability to meet our mission of connecting knowledge with need. Our people create our success: We listen, we learn, and we strive to meet or exceed the expectations of our customers, associates and vendors. We go direct and assume competence: We expect open, honest and ethical relationships both internally and externally. We encourage you to be an entrepreneur: Our associates view their position or area as if it were their own business and make decisions accordingly. Overview of the Information Technology Team:The PESI Information Technology Team is responsible for supporting the efforts of all PESI organizations –from business development to fulfillment. From desktop support to building, implementing, and supporting enterprise-scale systems, we work together to change how we reach our customers by developing new and innovative solutions to create efficiencies, expand our capabilities, and provide our customers with a best-in-class experience. What You Will Be Doing: (responsibilities)<ul><li>Collaborating with IT and business teams to develop and execute robust enterprise data strategies, empowering decision-makers across marketing and other business functions.</li><li>Designing and implementing a scalable Azure-based Data Warehouse, enabling seamless access to critical data for informed decision-making. Partnering with report writers and analysts to deliver actionable datasets and insightful reports.</li><li>Developing, maintaining, and optimizing ETL processes using modern cloud and on-premises tools. Documenting datasets comprehensively to ensure accessibility and ease of use for data warehouse consumers.</li><li>Acting as a trusted technical resource for business and IT teams on data-related challenges and solutions.</li><li>Writing and optimizing complex SQL queries for seamless data retrieval from multiple systems.</li></ul> What You Bring to the Team: (skills and requirements)<ul><li>2+ years of experience in building ETL processes using tools like SSIS, Azure Synapse Analytics, or Azure Data Factory.</li><li>1+ years of experience with cloud-hosted databases, preferably in Azure (e.g., Azure Synapse Analytics).</li><li>Strong grasp of ETL principles and best practices for efficient data processing. Proficiency in SQL, with the ability to write, debug, and optimize complex queries. </li><li>Familiarity with REST services and other APIs for data integration. Exceptional analytical thinking and conceptual problem-solving skills.</li><li>Passion for working with clean, structured, and meaningful data.</li><li>Excellent organizational and time management skills, with attention to detail and the ability to handle multiple tasks.</li><li>Proficient in Microsoft Office Suite for documentation, presentation, and reporting.</li><li>Experience with Power BI or similar reporting tools. </li><li>Knowledge of data warehousing best practices and dimensional modeling. </li><li>Basic understanding of data governance, privacy, and security best practices.</li></ul> What Would Thrill Us:<ul><li>Experience in eCommerce or marketing organizations, working with datasets such as customer, transaction, or product data.</li><li>Hands-on experience with Azure Data Platform technologies, such as Azure Data Lake, Azure CosmosDB, or Azure Fabric.</li><li>Experience with Microsoft Fabric.</li><li>Knowledge of Azure Active Directory (AAD) and Role-Based Access Control (RBAC).</li><li>Familiarity with third-party ETL tools to complement cloud-based solutions.</li><li>Proficiency in scripting languages such as PowerShell or Python.</li><li>Experience in programming with C#.Expertise in managing and processing semi-structured data (e.g., JSON, XML).Experience with Google Analytics data and working with Google BigQuery.</li><li>Experience with marketing platforms like HubSpot or similar email/campaign systems.</li><li>Experience building data integrations with NetSuite or other financial/accounting systems.</li></ul> What Else You Should Know About UsWe are an organization that loves to play the game of business, and we are unapologetically driven and dedicated to creating world-class educational solutions for our customers. By doing so, we get to help people around the world find comfort and healing. Candidates must be able to provide proof of eligibility to work in the United States following an offer of employment. Equal Employment Opportunity PESI is committed to creating a diverse environment and is proud to be an equal opportunity employer. All employment decisions are based on business needs without regard to race, color, ethnicity, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status or any other applicable legally protected status. All qualified candidates are encouraged to apply.

Job Summary: The Data Engineer will design, implement, and maintain scalable data solutions to empower data-driven decision-making across True Venture Group, True Care, and POD Health. This role involves building efficient data pipelines, optimizing data storage, and integrating enterprise systems to support advanced analytics, operational needs, and reporting. The Data Engineer will work closely with Data Analysts to create reports and data visualizations that drive actionable insights and business outcomes. The ideal candidate will possess strong technical expertise, a collaborative mindset, extensive experience with tools and platforms used across the organization, and a deep understanding of the end-to-end data lifecycle. Key Responsibilities:Data Pipeline Development: <ul><li>Build, maintain, and optimize ETL/ELT pipelines for seamless data ingestion and processing from multiple systems, including Sage Accounting, Viventium, and HHAExchange.</li><li>Ensure data pipelines are reliable, efficient, and capable of scaling with the business.</li></ul>Data Infrastructure and Warehousing: <ul><li>Design, implement, and manage data warehouses and lakes to support advanced analytics and operational reporting.</li><li>Optimize data models and storage solutions to handle large-scale data.</li></ul>System Integration:<ul><li>Integrate data across platforms, including Salesforce, HubSpot, Tableau, HHAExchange, Google Analytics, SEMrush, and Brandwatch.</li><li>Bridge interoperability between different systems, ensuring unified data access and usability.</li></ul>Data Quality and Compliance:<ul><li>Develop and enforce processes to ensure data accuracy, consistency, and reliability across all platforms.</li><li>Maintain compliance with relevant data regulations, including HIPAA and GDPR.</li></ul>Collaboration and Reporting: <ul><li>Partner with cross-functional teams to understand data requirements and provide infrastructure to support analytics and KPI reporting.</li><li>Support the marketing and operations teams with actionable insights drawn from integrated data sources.</li></ul>Innovation and Automation: <ul><li>Automate repetitive data tasks and identify opportunities for process improvement using advanced scripting and tools.</li><li>Research and implement new tools and technologies to optimize data management.</li></ul> Qualifications:<ul><li>Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.</li><li>Experience: 5+ years of experience in data engineering with a strong focus on building and managing data warehouses and lakes. Proven expertise in designing and optimizing scalable ETL/ELT pipelines.</li></ul> Technical Skills:<ul><li>Programming Languages: Proficiency in Python, SQL, and/or Java.</li><li>Cloud Platforms: Hands-on experience with AWS (e.g., Redshift), Azure, or Google Cloud Platform.</li><li>Data Tools: Experience with tools like Snowflake, BigQuery, Apache Spark, and Kafka.</li><li>Systems Integration: Expertise in:</li><li>Accounting and Payroll Systems: Sage Accounting, Viventium.</li><li>CRM & Marketing Platforms: Salesforce, HubSpot, Mailchimp.</li><li>Operations Tools: HHAExchange, Google Analytics, SEMrush, Tableau, and Brandwatch.</li><li>Data Governance: In-depth understanding of HIPAA, GDPR, and data security protocols.</li></ul> Soft Skills:<ul><li>Strong analytical and problem-solving skills.</li><li>Excellent communication skills for effective collaboration across team.</li></ul>

Senior Data EngineerLondon office x3 days per weekUp to £85,000 Salary OVERVIEW Successful AI Scale Up in Medical Technology/ Digital Health are hiring for a Data Engineer with a focus on optimising the data architecture and building reliable and scalable data pipelines for the application of advanced analytics and machine learning. You will be joining a strong Data team and reporting directly into the Head of Engineering. YOUR RESPONSIBILITIES: The Data Engineer’s responsibilities will include, but not be limited to: <ul><li>Design, build and maintain scalable Data pipelines.</li><li>Maintain Data dashboards through data visualisation.</li><li>Ensure the quality and security of data processes.</li><li>Work closely and collaborate with the Machine Learning, Application and Analytics teams to understand data requirements and deliver projects.</li></ul> YOUR SKILLS & EXPERIENCE A successful Data Engineer will have the following: <ul><li>Min 3+ years proven commercial experience as a Data Engineer.</li><li>Experience working with Image Data is highly desirable.</li><li>Experienced in building ETL processes and scalable data pipelines.</li><li>Experience in Python/ Java, SQL and cloud data infrastructure (AWS, Azure of GCP).</li><li>Familiarity with tools or similar technologies such as Kafka, Airflow, Apache Spark.</li></ul> HOW TO APPLYPlease register your interest by sending your CV to luke.frost@xcede.com for more info!

NO THIRD PARTIES, NO LLC/INC/CTC, MUST BE ABLE TO CONVERT WITHOUT SPONSORSHIP. MUST ALREADY BE LOCATED IN DALLAS, TX OR SAN FRANCISCO, CA. THIS IS A 100% ONSITE POSITION. Sr. Business Intelligence Developer / Data EngineerLocation: North Dallas, 75251, or San Francisco, CA, 94103 JOB SUMMARYWe are an innovative FinTech/InsurTech that is changing the global insurance industry ingest, transform, validate and analyze its big data. We are seeking a skilled Sr. Business Intelligence & Data Engineer (MS Fabric) who can enhance our platform using modern technologies while ensuring reliable and high-performance operations.This position be in the Data Insights & Analytics team to help drive analytics in the world of complex and big data Our portfolio of products are part of the Microsoft business intelligence stack, including Microsoft Fabric, Azure SQL, PostgreSQL, Azure Data Factory, Azure Synapse Analytics, and Power BI. Our platform delivers valuable insights to executives, claims operations, and finance teams at our insurance carrier clients.Our mission is to build the leading insurance data platform, powering a new class of data-first applications and driving a data culture. Leveraging Azure data, our Insights and Analytics team is dedicated to building and maintaining analytics and reporting platform hosted in Azure, including on Microsoft Fabric.Our Azure Insights and Analytics team is tasked with maintaining and advancing our comprehensive data platform. This platform encompasses traditional DAX/MQuery design and more recently Spark development, with an emphasis on PySpark and Spark SQL within Microsoft Fabric notebooks. Our team places high importance on code optimization, metadata-driven orchestration, and implementing best practices in DevOps.You will be in charge of maintaining, designing and developing our Fabric platform, including Power BI dashboards, further implementing complex data models, data flows, and data transformations to support company and client requirements. You will be developing and maintaining complex data pipelines and notebooks for information processing and analysis.You will have the autonomy to define your area of expertise and cultivate skills that will propel your career forward. Your daily routine will include participating in standup meetings, managing work items based on your capacity, collaborating with the team’s growing technology department to define new projects or initiatives, and engage in development activities. In addition to traditional data engineering tasks, you will directly interact with the teams developing the tools we utilize, enabling you to provide direct product feedback and witness your input driving changes in the products over time.Our mission is to empower our team to achieve their potential. We come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our founder’s values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.The position is office-based in either in the Dallas, TX Headquarters or its San Francisco Office.Key Expertise • Microsoft Fabric: Demonstrated experience in developing and maintaining complex data pipelines with Microsoft Fabric• PowerBI / Synapse: Senior level expertise in dashboard design and development• Data Engineering / Azure Data Factory: Solid experience in data warehousing, ETL/ELT processes, and data modeling (dimensional, normalized)• Azure Full Stack Knowledge: Strong working knowledge of Azure services, especially Data Factory, Synapse Analytics, and Azure SQL Database• Coding fluency: Expert proficiency in DAX, MQuery, SQL, Python, PySpark and Spark SQL or similar languages for data scripting, transformation, and automation related to data transformation and analysis Requirements • Apply industry best practice transformation and modeling techniques – validating the output to ensure reliable and accurate results for consumption by downstream data teams, and end users.• Extract and transform disparate data into actionable insights that drive our client’s business decisions.• Drive development projects to evolve our platform and operations, leveraging the newest Azure and Fabric technologies available to us.• Contribute to the success of our data in Azure by introducing new Azure products and features to our company and clients• Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver working proofs of concept, and develop final data solution.• Live site and on call duty for maintaining high availability of our analytics solutions.• Collaborate with your peers and maintain flexibility on domain ownership as business priorities evolve.• Work with other teams and understanding their data products and onboarding them. QUALIFICATIONS: • Bachelor’s degree in engineering, computer science, or similar technical area• Master’s degree in data engineering or business intelligence a plus• 7+ years’ experience with Data Science and analytics using Power BI for data modeling, data visualization, and data management using Power BI and MS SQL. Recent exposure to MS Fabric a plus.• 5+ plus years of Business Intelligence Engineering, specifically with PowerBI• 5+ years' experience with DAX, Power Query, and MD• 3+ years’ experience with Azure cloud services, including Azure SQL, Full Azure Stack, DevOps

Centurion is looking for a Secret cleared Data Engineer for a hybrid opportunity out of the DC area. (3 days a month onsite) Required Skills: <ul><li>Tech Stack (must haves): Python, SQL, SQL Server, Azure (Data Factory), Databricks, PowerBI (especially back-end programming for PowerBI)</li><li>Working Style: GitHub collaboration, SharePoint experience (moderate user), ability to work onsite at Foggy Bottom and/or collaborate at Rosslyn, 5 – 8 days a month</li><li>Above average experience with Power Point (deck creation and presentation)</li><li>8 Years of Experience (total)</li><li>8+ years hands-on-keyboard experience</li><li>5+ years data analysis experience</li><li>Cloud certification (i.e. AWS, Databricks)</li><li>Basic understanding of LLM-based tools such as model inference API and RAG methods.</li><li>Bachelor’s Degree</li><li>Secret clearance</li></ul>Experience Breakdowns <ul><li>3+ years of experience in the private sector with a cloud migration</li><li>2+ years defining cloud architecture requirements and gathering user stories for analytic product outputs</li><li>2+ years managing cloud migrations and setting milestones and timelines.</li><li>2+ years in end-to-end design, develop and implement of cloud data architecture.</li><li>2+ years of stakeholder management in a low-data maturity environment.</li><li>2+ years of experience with data governance, data security and compliance.</li><li>3+ years providing technical mentorship to junior team members.</li><li>2+ years developing and managing data stacks and dataflow layer using metadata</li><li>2+ years creating SOPs and process documentation"</li></ul>Preferred Skills: <ul><li>Experience in the State Department with DT (aka IRM)</li><li>Experience in DoD or State Department with security assistance data</li><li>Experience with political-military lingo/jargon, OR, experience in the armed forces or reserves</li><li>Experience with government financial data (e.g. appropriations, obligations, etc.)</li><li>Experience supporting a Chief Data Officer or a Chief Analytics Officer</li><li>Experience using/developing data inventories and data catalogs</li><li>Working knowledge of AWS</li></ul>Expected Deliverables: <ul><li>Migration from SQL Server and Python-based workflows to Azure and Databricks</li></ul>Education: <ul><li>Bachelors</li></ul>Position Details: Clearance: Current Active Secret ClearanceUS Citizenship is requiredTravel: < 10% (CONUS)Centurion Consulting Group, LLC is an Equal Opportunity Employer EOE M/F/D/V<ul><li>No third parties or subcontractors</li></ul>

Qio Data Engineer Interview Guide

Overview

Qio Data Engineer Salary

Qio Data Engineer Interview Process

Qio Data Engineer Interview Questions

Qio Data Engineer Jobs