The 605 Data Engineer interview guide, interview questions, salary data, and interview experiences.

605 Data Engineer Interview Guide

Getting ready for an Data Engineer interview at 605? The 605 Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for 605 Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at 605.</li>
<li>Practice real 605 Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the 605 Data Engineer interview.


Getting ready for an Data Engineer interview at 605? The 605 Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for 605 Data Engineer roles.
- Gain insights into the Data Engineer interview process at 605.
- Practice real 605 Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the 605 Data Engineer interview.
        

Overview

605 Data Engineer Salary

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

605 Data Engineer Interview Process

Given a table called <code>employees</code>, get the largest salary of any employee by department

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>largest_salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Write a query to get the largest salary of any employee by department

Largest Salary by Department

You are given a dictionary with a key-value of <code>{string: number}</code> where values in the dictionary could be duplicates. You are required to extract the unique values from the dictionary where the value occurred only once.

Return a list of values where they occur only once.

Note: You can return the values in any order.

Input:

<pre tabindex="0" class="chroma"><code>dictionary = {&#34;key1&#34;: 1, &#34;key2&#34;: 1, &#34;key3&#34;: 7, &#34;key4&#34;: 3, &#34;key5&#34;: 4, &#34;key6&#34;: 7}
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_unique_values(dictionary) -&gt; [3,4]

#Only 3 and 4 occurred once.
</code></pre>

Dictionary Unique Values

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

605 Data Engineer Interview Questions

Salary: $68,348.80 - $90,708.80 Annually Location : Republic, MO Job Type: Full-Time Job Number: 09042024 Department: GIS Opening Date: 09/04/2024 Closing Date: 9/11/2024 5:00 PM Central FLSA: Non-Exempt FLSA Status: Non-Exempt Job Type: Full Time Description *The entire pay range for this position is as posted. Typical starting pay will be at the beginning of the range, depending on qualifications.* Primary Purpose A dynamic and forward-thinking member of a team responsible for transforming technology workflows and environments, creating software and data integration across all platforms within our organization. This role has the primary responsibility of establishing and maintaining a standard that unifies data and creates streamlined technology processes using automation and development skills. The engineer discovers integration opportunities to connect city software to one another and to a central environment. Will also explore the use of artificial intelligence and machine learning tools that can be incorporated while considering potential data insights and key performance indicators that drive decisions during solution design. Microsoft Fabric will be the primary data analytics, engineering, and integration platform leveraged by the Data Engineer. Supervision Under the direct supervision of the Data Analytics Director. Essential Duties & Responsibilities <ol><li>Establish a collaborative project environment for IT and Data Team use. </li><li>Develop and implement software and data integration across various platforms within the organization. </li><li>Collaborate with internal teams to understand business requirements and translate them into technical solutions. </li><li>Utilize Microsoft Fabric and other tools to develop and implement software and data integration across various platforms within the organization. </li><li>Utilize your expertise in Python, SQL, JavaScript, JSON, and APIs to design and execute integration strategies. </li><li>Work with software-as-a-service (SaaS) platforms and ERP/CRM systems to optimize data exchange and functionality. </li><li>Analyze applications for compliance with security policy, addressing any discovered vulnerabilities. </li><li>Assists in training staff on software and application usage. </li><li>Automate processes to improve efficiency and reduce manual intervention. </li><li>Proactively identify opportunities for improvement and innovation in integration processes. </li><li>Troubleshoot and resolve application and integration issues in a timely manner. </li><li>Leverage business intelligence platforms, developing integrations aimed at extracting valuable insights and key performance indicators. </li><li>Utilize geographic information system software and data structures to enhance integration capabilities, where applicable. </li><li>Demonstrate interest, knowledge, and abilities to develop and implement Artificial Intelligence and machine learning technologies into integration processes. </li><li>Deals effectively and courteously with fellow employees and the public. </li><li>Performs other duties as assigned. </li> </ol>Important Duties <ol> <li>Attends training sessions deemed appropriate by supervisor or department head. </li><li>Maintains a neat and orderly work area. </li><li>Maintains appropriate supplies for assigned area. </li> </ol> Minimum Qualifications Education & Experience <ul> <li>At least five (5) years of related, demonstrated experience in coding, development, data analysis, data science, data management, or data intelligence tools, preferably Python, PHP, JavaScript, or JSON. Direct working experience in Microsoft Fabric and Azure strongly preferred. </li><li>Bachelor's degree or higher in business management, data science, information systems, or related field preferred. </li> </ul>Knowledge, Skills, & Abilities Must possess a working knowledge of data analysis and visualization and modeling tools. Must possess Relational and Object-Oriented Database Management skills, including but not limited to software comparable to SQL, Postgres, Azure, etc. Must be able to construct and communicate data automation, modeling, and visualization. Modern technology platform standards. Must be able to perform and coordinate platform and data integrations with use of application program interfaces (APIs). Must have a working knowledge of various web-based data formats, including data manipulation abilities in both enterprise and web-based environments. Must possess people management skills, communication skills, critical thinking, and collaborative skills. Must have a working knowledge of software integration and data design. Must have familiarity with ETL processes and data warehousing, Business Intelligence concepts and platforms, and developing with Jupyter Notebooks and in cloud environments. Must be able to perform effectively as a member of a team in carrying out the City's Mission, Vision, & Values as well as the Trust Edge Experience©, which further establishes the foundation for our Mission, Vision, & Values through the 8-Pillars of trust, which are: Clarity, Compassion, Character, Competency, Commitment, Connection, Contribution and Consistency. Overall professionalism displaying the utmost integrity, discretion, courtesy, cooperation, discipline, and behavior. Licensing/Certification Requirements <ul> <li>Must possess a valid Missouri driver's license. </li><li>Must currently possess certification in one or more application development software, including or related to Microsoft, Google, Oracle, AWS, Azure, etc. Other related certifications are preferred. </li> </ul>Miscellaneous Requirements <ul> <li>May be required to work a variety of shifts including nights, weekends, or holidays. </li><li>Must work a rotating on-call schedule, and subject to emergency call-in. </li><li>Must be a dependable person due to the small size of the work force. </li> </ul> Supplemental Information Physical Demands Performs bending and reaching to both ground level and overhead; lifts, carries, pushes, and pulls up to 30 pounds; must be able to hold and grip objects and possess the ability to operate a computer keyboard and mouse; must be able to sit for prolonged periods. Work Environment Primarily indoors with heating and cooling regulated, May be exposed to extreme weather, dust or pollen, toxic fumes, chemicals or smoke, contagious diseases, electrical or mechanical hazards and extreme noise. May be asked to work in confined spaces. Selection Guidelines Formal application, rating of education and experience, oral interview, reference check and job-related tests may be required. The duties listed above are intended only as illustrations of the various types of work that may be performed. The omission of specific statements of duties does not exclude them from the position if the work is similar, related or a logical assignment to the position. The job description does not constitute an employment agreement between the employer and employee and is subject to change by the employer as the needs of the employer and requirements of the job change. The City of Republic is an Equal Opportunity Employer. Individuals with disabilities should request reasonable accommodations in accordance with the Americans with Disabilities Act prior to testing or appointment. Proof of United States Citizenship/Authorization to Work in the United States as established by the immigration Reform Act of 1986 is a condition of employment. We are committed to diversity and a drug-free workplace. Pre-employment drug testing is required. to visit our City's benefits website to view up-to-date information on our competitive benefits for all Regular, Full-Time employees. For any questions, please email us at HumanResources@RepublicMo.com. Thank you! 01 Which of the following data intelligence tools do you have direct work experience with? <ul> <li>Python</li> <li>PHP</li> <li>JavaScript</li> <li>JSON</li> <li>Azure</li> <li>Microsoft Fabric</li> <li>Other, or None of the Above</li> </ul> 02 Please elaborate on your response to the question above. If you selected a software, please share how much experience you've had in working within that program. If you selected Other, please share those details. If you selected None, please simply skip this question and proceed with filling out your application. Required Question

Senior Data Engineer - W2 or 1099 Location: Boston - 3 days on-site per week (only looking for local candidates for now) Contract: Length: 6 months Rate: $85 - $110 per hour Need to be a US citizen or GC Holder for this position - No third parties. We are looking for a Senior Data Engineer with deep expertise in building scalable data solutions, Snowflake, DBT, AWS services, and MLOps. The ideal candidate will have previous experience working with start-ups and a passion for implementing data engineering best practices to support machine learning pipelines.Key Responsibilities:<ul><li>Design, implement, and maintain scalable data pipelines using Snowflake and AWS services (S3, Redshift, Glue, Lambda, etc.).</li><li>Collaborate with data scientists and ML engineers to develop and operationalize MLOps pipelines, ensuring efficient deployment and monitoring of machine learning models.</li><li>Utilize DBT (Data Build Tool) to manage and transform data, ensuring data quality, consistency, and governance.</li><li>Work with various structured and unstructured datasets to deliver reliable data solutions for real-time analytics and reporting.</li><li>Collaborate with cross-functional teams to ensure alignment on data architecture and strategy.</li><li>Continuously improve data pipeline performance, scalability, and reliability.</li><li>Implement data security best practices, ensuring compliance with company and industry standards.</li><li>Participate in code reviews, mentoring, and knowledge sharing within the team.</li></ul>Required Qualifications:<ul><li>5+ years of experience as a Data Engineer, working with modern data platforms and tools.</li><li>Hands-on experience with Snowflake for data warehousing and analytics.</li><li>Strong knowledge and practical experience with DBT for data transformation.</li><li>Proficiency with AWS services (S3, Redshift, Glue, Lambda, etc.).</li><li>Experience in MLOps: working knowledge of deploying and monitoring machine learning models in production.</li><li>Prior experience working with start-ups or in a fast-paced environment.</li><li>Strong understanding of data warehousing concepts, ETL/ELT processes, and performance optimization.</li><li>Solid programming skills in Python or similar languages.</li><li>Excellent communication and problem-solving skills, with a passion for scaling and optimizing data systems.</li></ul>Preferred Qualifications:<ul><li>Experience with Kubernetes, Docker, and CI/CD pipelines.</li><li>Familiarity with orchestration tools such as Airflow.</li><li>Knowledge of data governance and privacy frameworks (GDPR, CCPA, etc.).</li></ul>

Sr Data Engineer Location-Dallas, TX (3 days a week)Only Local The teamAs a part of Product Engineering Services practice, we are looking for a talented Sr. Data Engineer to join us to contribute to practice initiatives and keep current in the latest technology developments in the Cloud and Product Engineering space. The role<ul><li>Assembling large, complex sets of data that meet non-functional and functional business requirements</li><li>Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes</li><li>Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies</li><li>Working with stakeholders including data, design, product and application teams and assisting them with data-related technical issues</li><li>Working with stakeholders including the Application, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues</li><li>Build and optimize data sets, ‘big data’ data pipelines and architectures</li><li>Perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions</li><li>Apply analytic skills associated with working on unstructured datasets</li><li>Build processes that support data transformation, workload management, data structures, dependency and metadata</li><li>Demonstrated understanding and experience using software and tools including data tools like AWS Glue; NoSQL and SQL databases including DynamoDB and Postgres; and object function/object-oriented scripting languages including nodeJS, Java and Python.</li></ul> What you’ll bring<ul><li>Experienced on Creating, Configuring and Subscribing to the API's (Rest, SOAP XML)</li><li>Experienced in Analyzing structured and unstructured data from different sources based on project needs and demonstrating the Analysis to the business for the Sign off</li><li>Demonstrated understanding and experience using software and tools including data tools like AWS Glue; NoSQL and SQL databases including DynamoDB and Postgres; and object function/object-oriented scripting languages including nodeJS, Java and Python.</li><li>Knowledge on the Cloud Technologies</li><li>Excellent Communication Skills</li><li>Strong knowledge of and experience with reporting packages (Business Objects etc), databases (SQL etc), programming (XML, Javascript, or ETL frameworks)</li><li>Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy</li><li>Expert in writing database queries, analyze output and presenting findings</li><li>Experienced on working with OAuth, IAM User, Security Tokens</li><li>Excellent interpersonal, business communication and writing skills</li><li>Detail-oriented and Customer service focused</li><li>Experience with agile methodologies</li><li>Experienced on Postman, Jira, Confluence</li></ul>

Innova Solutions is immediately hiring for a Data Engineer(Python)Position type: Contract(W2) Duration: Long Term Location: Pennington, NJ/NYC/Plano, TX (Hybrid 3 days Onsite)As a Data Engineer(Python) you will:Develop and deliver data ETL solutions to accomplish technology and business goals. Code solutions to ingest, curate, aggregate, integrate, clean, transform, and control data in operational and/or analytics data systems per the defined acceptance criteria. Assemble large, complex data sets to meet functional reporting requirements. Build processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management. Define and build reporting applications that enable better data-informed decision-making. Contribute to existing test suites (integration, regression, performance), analyze test reports, identify any test issues/errors, and triage the underlying cause. Developed, design, and document ETL Process based on established standards and guidelines and CI/CD toolset such as JIRA, Confluence, BitBucket, Jenkins Automate ETL processes leveraging enterprise tools such as AutoSyst Provide operational and escalation support when required Document and communicate required information for deployment, maintenance, support, and business functionality. Work closely with business partners to help translate functional requirements into technical approach, design, and decisions. Create SQL schema objects, complex attributes / metrics, conditional and level metrics, and their use within a report Using SQL, Python, Hadoop/Hive and data warehouse concepts /architecture, dimensional modeling, and ETL solution design. Tune and optimize query performance for large datasets-cubes, caching, aggregate structures within MicroStrategy, Tableau and various RDBMS, Hadoop backend systems. Top MUST Have: * Bachelors degree or equivalent in Computer Science, Computer Information Systems, Management Information Systems, Engineering (any) or related; and * 5 years of progressively responsible experience in the Job offered or a related IT occupation. * Working closely with business partners to help translate functional requirements into technical approach, design, and decisions- Banking & Markets business acumen; * Creating SQL schema objects, complex attributes / metrics, conditional and level metrics, and their use within a report; * Developing Excel & Tableau dashboards and 3rd party application report integration; * Using SQL, Python, Hadoop/Hive and data warehouse concepts /architecture, dimensional modeling, and ETL solution design. * Tuning and optimizing query performance for large datasets-cubes, caching, aggregate structures within MicroStrategy, Tableau and various RDBMS, Hadoop backend systems.Qualified candidates should APPLY NOW for immediate consideration! Please hit APPLY to provide the required information, and we will be back in touch as soon as possible.We are currently interviewing to fill this and other similar positions. If this role is not a fit for you, we do offer a referral bonus program for referrals that we successfully place with our clients, subject to program guidelines. ASK ME HOW.Thank you!Shobhit BhardwajLead - Talent AcquisitionPAY RANGE AND BENEFITS:Pay Range*: $65/hr - $75/hr on W2.*Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centres across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields.Recent Recognitions:<ul><li>One of Largest IT Consulting Staffing firms in the USA - Recognized as #4 by Staffing Industry Analysts (SIA 2022) · Clearly Rated® Client Diamond Award Winner (2020) · One of the Largest Certified MBE Companies in the NMSDC Network (2022) · Advanced Tier Services partner with AWS and Gold with MS</li></ul>Website: https://www.innovasolutions.com/Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at or (770) 493-5588. Please indicate the specifics of the assistance needed. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. § 1324b. The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws. American Cybersystems, Inc is acting as an Employment Agency in relation to this vacancy.

Required Skills/Experience: <ul><li>In-depth knowledge of Teradata architecture and components (e.g., AMP, Nodes, Parsing Engines, etc.).</li><li>Proficiency in Teradata SQL and Teradata utilities. </li><li>Strong SQL skills for querying and managing relational databases.</li><li>Scripting experience (e.g., Shell, Python) for automating tasks.</li><li>Know tools like Teradata Utilities (e.g., BTEQ, Fast Load, Multiload, TPT, etc.).</li><li>Experience with ETL tools and technologies used in Teradata environments.</li><li>Knowledge of query optimization techniques, indexing, partitioning, and workload management in Teradata.</li><li>Strong understanding of data warehousing principles, including star/snowflake schemas, OLAP, and ETL processes.</li><li>EC2, S3, RDS, Lambda, CloudWatch, CloudFormation, etc.</li><li>Experience with AWS networking (VPC, subnets, security groups, NACLs) and security management.</li><li>Familiarity with AWS storage options, such as S3, EFS, and Glacier, in the context of large-scale data storage and retrieval.</li><li>Experience deploying and managing Teradata in AWS cloud environments.</li><li>Knowledge of AWS services that enhance Teradata performance, such as using S3 for staging data or integrating with Redshift for analytics.</li><li>Hands-on experience with AWS CloudFormation, Terraform, or similar tools for automating infrastructure deployment.</li><li>Proficiency in automating ETL pipelines and data processing workflows using AWS Lambda, Step Functions, or AWS Glue.</li><li>Understanding of encryption and security protocols for data stored and processed in AWS.</li><li>Experience implementing compliance standards such as GDPR, HIPAA, or other data protection regulations in cloud environments.</li></ul>

Position Details:Title: Big Data EngineerLocation: Chicago, IL/ Denver, CO- Hybrid - 3x/week onsiteCompensation: $65-$68.26/hour on W2Interview Process: One Inperson round Why open: New project Scope of role: Experience with Kafka, Pyspark and real-time data processing, Elastic Search, Kibana (nice to have) Project: Dealing with streaming data Expected to accomplish: <ul><li>Processing Data in Real-time</li><li>Building a system from scratch</li><li>Designing abstract layers</li></ul> Must have: <ul><li>Strong communication skills</li><li>Kafka</li><li>Pyspark</li><li>Real time data processing</li><li>SQL</li><li>Spark </li><li>Coding/ development in Python</li></ul> Nice to have: <ul><li>Elastic Search</li><li>Kibana</li><li>Designing system from scratch/ designing abstract layers</li></ul> Required Skills:<ul><li>Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL</li><li>Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml</li><li>Experience working with SPARK Structured steaming</li><li>Experience working with Hadoop/Big Data and Distributed Systems</li><li>Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc.</li><li>Hands on programming experience in at least one of Scala, Python, PHP, or Shell Scripting, to name a few</li><li>Performance tuning experience with spark /MapReduce or SQL jobs</li><li>Experience and proficiency with Linux operating system is a must</li><li>Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines</li><li>Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle</li><li>Experience using Source Code and Version Control systems like SVN, Git, Bit Bucket etc.</li><li>Experience working with Jenkins and Jar management</li><li>Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets</li><li>Ability to comprehend customer requests and provide the correct solution</li><li>Strong analytical mind to help take on complicated problems</li><li>Desire to resolve issues and dive into potential issues</li><li>Ability to adapt and continue to learn new technologies is important</li></ul>

Specialty/Competency: Oracle Industry/Sector: Not Applicable Time Type: Full time Travel Requirements: Up to 60% A career in Oracle consulting will provide you with the opportunity to help organisations use enterprise technology to achieve their digital technology goals and capitalise on business opportunities. We help our clients implement and effectively use Oracle offerings to solve their business problems and fuel success in the areas of finance, operations, human capital, customer, and governance, risk and compliance. The Oracle Data and Analytics team, within Oracle consulting, provides you with the opportunity to help our clients transform their organization through better use of data and analytics to drive profitable growth, reduce operational costs, improve customer experience, empower employees, reduce operational risk, and address regulatory requirements. We help our clients define their Data and Analytics strategy and effectively see the strategy through execution. We help implement and effectively use broad technology offerings including Oracle Analytics and Data solutions along with enhanced Data Governance and Data Management capabilities to solve their business problems and achieve their strategic business goals. To really stand out and make us fit for the future in a constantly changing world, each and every one of us at PwC needs to be a purpose-led and values-driven leader at every level. To help us achieve this we have the PwC Professional; our global leadership development framework. It gives us a single set of expectations across our lines, geographies and career paths, and provides transparency on the skills we need as individuals to be successful and progress in our careers, now and in the future. As a Manager, you'll work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. PwC Professional skills and responsibilities for this management level include but are not limited to: <ul><li>Develop new skills outside of comfort zone. </li><li>Act to resolve issues which prevent the team working effectively. </li><li>Coach others, recognise their strengths, and encourage them to take ownership of their personal development. </li><li>Analyse complex ideas or proposals and build a range of meaningful recommendations. </li><li>Use multiple sources of information including broader stakeholder views to develop solutions and recommendations. </li><li>Address sub-standard work or work that does not meet firm's/client's expectations. </li><li>Use data and insights to inform conclusions and support decision-making. </li><li>Develop a point of view on key global trends, and how they impact clients. </li><li>Manage a variety of viewpoints to build consensus and create positive outcomes for all parties. </li><li>Simplify complex messages, highlighting and summarising key points. </li><li>Uphold the firm's code of ethics and business conduct. </li> </ul>Basic Qualifications : Minimum Degree Required : Bachelor Degree Minimum Years of Experience : 6 year(s) Preferred Qualifications : Degree Preferred : Bachelor Degree Preferred Knowledge/Skills : Demonstrates intimate abilities and/or a proven record of success as a team leader in the following areas: <ul><li>Managing data strategy, data roadmap, data governance, and data solution implementation projects; </li><li>Leading a team of on and off-shore resources, including business analysts, data analysts, solution architects and developers to deliver a data focused engagement; </li><li>Analyzing end-to-end data flows and conduct hands-on data analysis; </li><li>Leading the design of improved data flows, data architecture, and data solutions in partnership with the subject matter experts and client counterparts / team members; </li><li>Driving technology and data solution assessments to provide point-of-view and recommendations; </li><li>Overseeing project timelines, risks and issues, and escalate when appropriate </li><li>Experience utilizing, designing and leading data programs with one or more of the following products: Oracle OFSAA, Oracle ADW, Oracle FAW, OAC , Power BI, Power Query, Amazon AWS (Redshift and Related Toolsets) and/or Microsoft Azure; </li><li>Managing consulting engagements pertaining to Data Architecture, Data Models design and implementation leveraging agile data modeling techniques; </li><li>Designing of cloud-based data and analytical solutions, Finance Data Models that are part of technology modernization initiatives based on standard industry practices; </li><li>Understanding of the functionality of finance systems, such as General Ledgers, Sub-Ledgers, Hyperion, Finance Data Warehouse/Repositories, and other related applications; </li><li>Experience executing as part of large finance, enterprise and/or data architecture transformation programs; </li><li>Understanding various data domains industry specific but required by finance organizations within the enterprise; </li><li>Understanding common data and reporting issues facing clients within the financial services industry; </li><li>Managing efforts with identifying and addressing client needs by building, maintaining, and utilizing networks of client relationships and community involvement; communicating value propositions; managing resource requirements, project workflow, budgets, billing, and collections; and, preparing and/or coordinating complex written and verbal materials; </li><li>Supervising teams to create an atmosphere of trust; seeking diverse views to encourage improvement and innovation; and coaching staff including providing timely meaningful written and verbal feedback; </li><li>Automating of processes and analytics and the technologies that enable automation (Alteryx, UiPath, Power BI, etc.); and, </li><li>Utilizing technical skills in MS Office, G-suite. </li> </ul>Learn more about how we work: https://pwc.to/how-we-work PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy: https://pwc.to/H-1B-Lottery-Policy. All qualified applicants will receive consideration for employment at PwC without regard to race; creed; color; religion; national origin; sex; age; disability; sexual orientation; gender identity or expression; genetic predisposition or carrier status; veteran, marital, or citizenship status; or any other status protected by law. PwC is proud to be an affirmative action and equal opportunity employer. For positions based in San Francisco, consideration of qualified candidates with arrest and conviction records will be in a manner consistent with the San Francisco Fair Chance Ordinance. Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines: https://pwc.to/us-application-deadlines The salary range for this position is: $100,000 - $232,000, plus individuals may be eligible for an annual discretionary bonus. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation and more. To view our benefits at a glance, please visit the following link: https://pwc.to/benefits-at-a-glance #LI-Remote

Title: Senior GCP (Google Cloud Platform) Data EngineerDescription: STG is a fast-growing Digital Transformation services company providing Fortune 500 companies with Digital Transformation, Mobility, Analytics and Cloud Integration services in both information technology and engineering product lines. STG has a 98% repeat business rate from existing clients and have achieved industry awards and recognition for our services. Crain’s Detroit Business named STG to Michigan’s Fastest Growing Companies list in both 2020 and 2019, Top IT Services Company’s List in 2020, 2019, 2018, and Top Minority Business Enterprise List in 2020, 2019, and 2018.STG puts company CULTURE at the forefront of every business decision and employees are EMPOWERED and MEASURED for RESULTS. Both TEAMWORK and INDIVIDUAL Performance is recognized and rewarded.This is a full-time position that includes responsibilities of Senior GCP (Google Cloud Platform) Data EngineerThe right person for this position will have high energy, a positive attitude, and a high attention to detail, and an unwavering commitment to teamwork. Responsibilities:<ul><li>Design and implement data-centric solutions on Google Cloud Platform (GCP) using various GCP tools like Big Query, Google Cloud Storage, Cloud SQL, Memory Store, Dataflow, Dataproc, Artifact Registry, Cloud Build, Cloud Run, Vertex AI, Pub/Sub, GCP APIs. </li><li>Build ETL pipelines to ingest the data from heterogeneous sources into our system • Develop data processing pipelines using programming languages like Java and Python to extract, transform, and load (ETL) data </li><li>Create and maintain data models, ensuring efficient storage, retrieval, and analysis of large datasets </li><li>Deploy and manage databases, both SQL and NoSQL, such as Bigtable, Firestore, or Cloud SQL, based on project requirements </li><li>Optimize data workflows for performance, reliability, and cost-effectiveness on the GCP infrastructure. </li><li>Implement version control and CI/CD practices for data engineering workflows to ensure reliable and efficient deployments. </li><li>Utilize GCP monitoring and logging tools to proactively identify and address performance bottlenecks and system failures </li><li>Troubleshoot and resolve issues related to data processing, storage, and retrieval. • Promptly address code quality issues using SonarQube, Checkmarx, Fossa, and Cycode throughout the development lifecycle </li><li>Implement security measures and data governance policies to ensure the integrity and confidentiality of data </li><li>Collaborate with stakeholders to gather and define data requirements, ensuring alignment with business objectives. </li><li>Develop and maintain documentation for data engineering processes, ensuring knowledge transfer and ease of system maintenance. </li><li>Participate in on-call rotations to address critical issues and ensure the reliability of data engineering systems. </li><li>Provide mentorship and guidance to junior team members, fostering a collaborative and knowledge-sharing environment. </li></ul>Skills Required: 8 years of professional experience in: o Data engineering, data product development and software product launches o At least three of the following languages: Java, Python, Spark, Scala, SQL and experience performance tuning. 4 years of cloud data/software engineering experience building scalable, reliable, and cost-effective production batch and streaming data pipelines using: o Data warehouses like Google BigQuery. o Workflow orchestration tools like Airflow. o Relational Database Management System like MySQL, PostgreSQL, and SQL Server. o Real-Time data streaming platform like Apache Kafka, GCP Pub/Sub o Microservices architecture to deliver large-scale real-time data processing application. o REST APIs for compute, storage, operations, and security. o DevOps tools such as Tekton, GitHub Actions, Git, GitHub, Terraform, Docker. o Project management tools like Atlassian JIRA Skills Preferred:Experience in IDOC processing, APIs and SAP data migration projects. Experience working in SAP S4 Hana environment Resume Submittal Instructions: Interested/qualified candidates should email their word formatted resumes to Ms. Sharmli Somaskandan at sharmli.somaskandan@stgit.com and /or contact at 248.712.6709. In the subject line of the email please include: First and Last Name GCP Data Engineer – (MI).

Job Summary:As a Senior Manager of Data Engineering, you will be a key leader in designing, implementing, and overseeing the data architecture. You will play a critical role in ensuring data solutions are scalable, secure, and aligned with the organisation's strategic goals. Your expertise will be crucial in guiding the team and collaborating with various stakeholders to drive innovation and deliver data-driven insights.Responsibilities:<ul><li>Team Leadership : Lead, mentor, and inspire a high-performing team of data engineers. Provide technical guidance and support to team members, ensuring their professional development.</li><li>Solution Design: Design and implement robust, scalable, and cost-effective data solutions on cloud platforms, encompassing data ingestion, storage, processing, and access layers.</li><li>Project Management: Define project scope, timelines, and deliverables and track project progress and ensure timely completion.</li><li>Stakeholder Management : Collaborate with business stakeholders to understand their data needs. Communicate project status, risks, and mitigation plans effectively to them.</li><li>Technology Evaluation & Selection: Stay updated of new services and technologies, evaluate their potential, and make recommendations for adoption.</li><li>Data Modeling & Design: Lead the design and implementation of dimensional data models (star schema, snowflake schema, etc.) to support efficient querying and reporting.</li><li>Data Governance: Establish and enforce data governance policies, standards, and procedures to ensure data quality, integrity, and security.</li><li>Performance Optimization: Proactively monitor and optimize data pipelines and queries for optimal performance and cost efficiency.</li><li>Documentation: Create and maintain comprehensive documentation for data architectures, data models, and processes.</li></ul>Qualifications:<ul><li>Proven experience as a Data Engineering manager, with a track record of successfully designing and implementing ETL/ELT data pipelines and systems.</li><li>Exceptional communication and presentation skills to interact with both technical and non-technical stakeholders.</li><li>Experience in SQL proficiency, specifically on Google Big Query is a plus.</li><li>Proficiency in programming languages such as Python/pySpark is a plus.</li><li>Strong knowledge of data warehousing and data modelling concepts.</li><li>Experience with big data technologies (e.g., Hadoop, Spark) is a plus.</li><li>Familiarity with Google Cloud Platform (GCP) services is an advantage.</li><li>Knowledge of data governance, data security, and compliance practices.</li><li>Certifications in relevant technologies (e.g., AWS, Azure, Google Cloud, Snowflake) will be beneficial.</li></ul> At LatentView Analytics, we value a diverse, inclusive workforce and we provide equal employment opportunities for all applicants and employees. All qualified applicants for employment will be considered without regard to an individual’s race, color, sex, gender identity, gender expression, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other basis protected by federal, state or local laws.

Senior Data Engineer Dallas, TX (Onsite)Longterm Job Description Looking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be responsible for not only understanding data pipelines but, event streaming applications, and how to build systems that handle massive amounts of data while making it consumable by other application teams, users and data scientists. You will also be assisting in the design and architecture of highly scalable, fault tolerant infrastructure capable of processing millions of operations per minute coming from millions of TVs, efficiently store petabytes of data and provide fast insights from the data. You will also be working with teams across the client enterprise to bring their data into our Big Data ecosystem, monitor data quality for cleanliness and fix discrepancies. Ensure data accuracy through validation tasks, perform root cause analysis and implement solutions for data prep and cleanliness, review data at all granular/aggregate levels, and versioning. About You<ul><li>You have a BS or MS in Computer Science or similar relevant field</li><li>You work well in a collaborative, team-based environment</li><li>You are an experienced engineering with 5+ years of experience</li><li>You have a passion for big data structures</li><li>You possess strong organizational and analytical skills related to working with structured and unstructured data operations</li><li>You have experience implementing and maintaining high performance / high availability data structures</li><li>You are most comfortable operating within cloud based eco systems</li><li>You enjoy leading projects and mentoring other team members</li></ul>Specific Skills<ul><li>Experience or knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.</li><li>Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)</li><li>Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS</li><li>Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.</li><li>Experience or knowledge of object-oriented/object function scripting languages: i.e., Python, Java, Scala, R, SQL.</li><li>Experience or knowledge of data pipeline and workflow management tools: i.e., AWS Data Pipeline, Apache Airflow, Argo.</li><li>Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.</li><li>Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD</li><li>Hands-on experience in designing and maintaining data schema life-cycles.</li></ul>

605 Data Engineer Interview Guide

Overview

605 Data Engineer Salary

605 Data Engineer Interview Process

605 Data Engineer Interview Questions

605 Data Engineer Jobs