The Tsmc Data Engineer interview guide, interview questions, salary data, and interview experiences.

Tsmc Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Tsmc? The Tsmc Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Tsmc Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Tsmc.</li>
<li>Practice real Tsmc Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Tsmc Data Engineer interview.


Getting ready for an Data Engineer interview at Tsmc? The Tsmc Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Tsmc Data Engineer roles.
- Gain insights into the Data Engineer interview process at Tsmc.
- Practice real Tsmc Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Tsmc Data Engineer interview.
        

Overview

Tsmc Data Engineer Salary

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Tsmc Data Engineer Interview Process

You are given a dictionary with a key-value of <code>{string: number}</code> where values in the dictionary could be duplicates. You are required to extract the unique values from the dictionary where the value occurred only once.

Return a list of values where they occur only once.

Note: You can return the values in any order.

Input:

<pre tabindex="0" class="chroma"><code>dictionary = {&#34;key1&#34;: 1, &#34;key2&#34;: 1, &#34;key3&#34;: 7, &#34;key4&#34;: 3, &#34;key5&#34;: 4, &#34;key6&#34;: 7}
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_unique_values(dictionary) -&gt; [3,4]

#Only 3 and 4 occurred once.
</code></pre>

Dictionary Unique Values

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

You’re given a dataframe of students named <code>students_df</code>:

<code>students_df</code> table

<table>
<thead>
<tr>
<th>name</th>
<th>age</th>
<th>favorite_color</th>
<th>grade</th>
</tr>
</thead>

<tbody>
<tr>
<td>Tim Voss</td>
<td>19</td>
<td>red</td>
<td>91</td>
</tr>

<tr>
<td>Nicole Johnson</td>
<td>20</td>
<td>yellow</td>
<td>95</td>
</tr>

<tr>
<td>Elsa Williams</td>
<td>21</td>
<td>green</td>
<td>82</td>
</tr>

<tr>
<td>John James</td>
<td>20</td>
<td>blue</td>
<td>75</td>
</tr>

<tr>
<td>Catherine Jones</td>
<td>23</td>
<td>green</td>
<td>93</td>
</tr>
</tbody>
</table>
Write a function named <code>grades_colors</code> to select only the rows where the student’s favorite color is green or red and their grade is above 90.

Example:

Input:

<pre tabindex="0" class="chroma"><code>import pandas as pd

students = {&#34;name&#34; : [&#34;Tim Voss&#34;, &#34;Nicole Johnson&#34;, &#34;Elsa Williams&#34;, &#34;John James&#34;, &#34;Catherine Jones&#34;], &#34;age&#34; : [19, 20, 21, 20, 23], &#34;favorite_color&#34; : [&#34;red&#34;, &#34;yellow&#34;, &#34;green&#34;, &#34;blue&#34;, &#34;green&#34;], &#34;grade&#34; : [91, 95, 82, 75, 93]}

students_df = pd.DataFrame(students)
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def grades_colors(students_df) -&gt;
</code></pre>

<table>
<thead>
<tr>
<th>name</th>
<th>age</th>
<th>favorite_color</th>
<th>grade</th>
</tr>
</thead>

<tbody>
<tr>
<td>Tim Voss</td>
<td>19</td>
<td>red</td>
<td>91</td>
</tr>

<tr>
<td>Catherine Jones</td>
<td>23</td>
<td>green</td>
<td>93</td>
</tr>
</tbody>
</table>

Write a function to select only the rows where the student's favorite color is green or red and their grade is above 90.

Good Grades and Favorite Colors

Tsmc Data Engineer Interview Questions

Overview of Role Taiwan Semiconductor Manufacturing Company (TSMC) is seeking applications for skilled Artificial Intelligence (AI) Research Scientists for their Artificial Intelligence for Business Intelligence (AI4BI) Center. Applicants should have graduated with a Ph.D. in the past 1-2 years in computer science, information systems, information science, statistics, systems and industrial engineering, or related AI or machine learning field. The AI4BI Center is a global and international team that seeks to develop advanced AI-enabled analytics techniques to facilitate important business intelligence applications highly relevant to TSMC. This role will be based in our San Jose office in a hybrid working environment (working four days in the office). Individuals in this position may be responsible for tasks across two technical areas. The first is designing and implementing significant machine learning, deep learning, text mining, Large Language Model (LLM), foundation model, and/or network science-based approaches to extract insights from structured (e.g., transactional) and unstructured data sources (e.g., 10K reports, social media posts, news) for various BI applications. Second, the position may require efforts in developing time series modelling and/or reinforcement learning-based approaches for analyzing fab tool productivity and facilitating effective wafer start strategies. This role requires close interaction and coordination with international teams of research scientists, data engineers, and business stakeholders to gather requirements, oversee development, evaluate the outputs of technical solutions, produce internal reports, and co-author publications at top-tier AI venues. Responsibilities <ul> <li>Create and manage advanced machine learning, deep learning, LLM, foundation models, time-series modelling, and/or reinforcement learning algorithms to develop data-driven solutions for complex business problems</li> <li>Analyze and interpret complicated data sets to provide actionable insights that aid in enhancing decision-making processes for business stakeholders</li> <li>Work with cross-functional and international teams to identify and prioritize data-driven opportunities, including the development and deployment of predictive models to drive business outcomes</li> <li>Work with teams with senior data scientists, other junior data scientists, and data engineers to develop and uphold efficient procedures for gathering, retaining, and scrutinizing data</li> <li>Work in teams with data engineers</li> <li>Consistently assess and refine model performance to ensure precision and dependability</li> <li>Communicate insights and recommendations via internal reports to technical and non-technical stakeholders</li> <li>Design and implement the latest AI, machine learning and data science tools and techniques to enhance existing processes based on feedback and guidance from senior data scientists</li></ul> Minimum Qualifications <ul> <li>Ph.D. in computer science, information systems, information science, statistics, or related AI or machine learning field in the past 1-2 years</li> <li>4-5 years of AI/ML experience</li> <li>Proficient in Python, GitHub, and Markdown for data wrangling, pre-processing, and extraction from structured and unstructured data sources</li> <li>Strong conceptual and practical knowledge and experience of classical machine learning algorithms and learning paradigms, including supervised learning and unsupervised learning</li> <li>Strong skills in fundamental deep learning implementation, including data encodings, processing units, and learning paradigms</li> <li>Proficiency in adapting machine learning or deep learning algorithms based on unique dataset characteristics and business requirements</li> <li>Strong practical network science skills and experience</li> <li>Hands-on experience with text analytics for named entity recognition, sentiment analysis, and topic modelling</li> <li>Hands-on research experience with time series modeling and forecasting with statistical, machine learning, deep learning-based, and/or foundation model (TimesFM) approaches</li> <li>Hands-on research experience with reinforcement learning approaches, including value-based, policy-based, actor-critic, and/or multi-objective</li> <li>Hands-on research experience, including literature review, model design, implementation, evaluation, and publication</li> <li>Experience fine-tuning LLMs and other foundation models with strategies such as low rank adaptation, few shot learning, and others</li> <li>Experience with prompt engineering on LLMs and other foundation models with techniques such as reinforcement learning (e.g., Direct Preference Optimization (DPO), Proximal Policy Optimization (PPO)), prompt tuning, and others</li> <li>Knowledge about deploying models into user interface tools for dashboarding (e.g., PowerBI), Python frameworks for rapid prototyping and interaction (e.g., Streamlit, Dash), and/or JavaScript frameworks (e.g., React)</li> <li>Must be willing to travel to Taiwan for at least 1-3 months each year for training, team building, and project coordination</li></ul> Preferred Qualifications <ul> <li>Knowledge on processing text in financial, accounting, and market analysis reports</li> <li>Multi-lingual text analysis using packages like Stanza, Polyglot, or Textflint.</li> <li>Knowledge of graph embedding techniques such as graph convolutional networks, graph attention networks, and graph transformers using packages such as stellargraph, PyG, or Deep Graph Library.</li> <li>Understanding of neural information retrieval methods, including deep structured semantic models, entity resolution, and retrieval augmented generation (RAG).</li> <li>Familiarity and practical experience with learning paradigms such as adversarial learning, knowledge distillation, and self-supervised learning.</li> <li>Experience working with foundation models for language (e.g., LLaMA), time (e.g., TimesFM), and other data modalities</li> <li>Publications in leading AI conferences (e.g., NeurIPS, ICLR, ICML, KDD) and/or journals (e.g., IEEE TKDE, ACM TOIS)</li></ul> Company Description As a trusted technology and capacity provider, TSMC is driven by the desire to be: <ul> <li>The world's leading dedicated semiconductor foundry</li> <li>The technology leader with a strong reputation for manufacturing excellence</li> <li>Advancing semiconductor manufacturing innovations to enable the future of technology</li></ul> TSMC pioneered the pure-play foundry business model when it was founded in 1987 and has been the world's leading dedicated semiconductor foundry ever since. The Company supports a thriving ecosystem of global customers and partners with the industry's leading process technologies and a portfolio of design enablement solutions to unleash innovation for the global semiconductor industry. With global operations spanning Asia, Europe, and North America, TSMC serves as a committed corporate citizen around the world. In North America, TSMC has a strong sales and service organization that works with customers by helping them achieve silicon success with cutting-edge technologies and manufacturing excellence. The Company has continued to accelerate its R&D investment and staffing in recent years and is expanding its manufacturing footprint to support customer innovation with 3D IC technologies and optimal manufacturing capacity. Diversity statement TSMC Technology, Inc. is committed to employing a diverse workforce and provides Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, or any other characteristic protected by applicable law. TSMC is an equal opportunity employer prizing diversity and inclusion. We are committed to treating all employees and applicants for employment with respect and dignity. If you require reasonable accommodation due to a disability during the application or the recruiting process, please feel free to notify us at G_Accomodations@tsmc.com. TSMC confirms to all applicants its commitment to meet TSMC's obligations under applicable employment law. Reasonable accommodations will be determined on a case-by-case basis. Pay Transparency Statement At TSMC, your base pay is only part of your overall total compensation package. At the time of this posting, this role typically pays a base salary between $150,000 and $230,000 per year. The range displayed reflects the minimum and maximum target for new hires. Actual pay may be more or less than the posted range. Factors that influence pay include the individual's skills, qualifications, education, experience and the position level and location. TSMC's total compensation package consists of market competitive pay, allowances, bonuses, and comprehensive benefits. We also offer extensive development opportunities and programs. Date: Nov 1, 2024 Country/Region: US City: San Jose Company: TSMC Technology, Inc.

Overview of Role Taiwan Semiconductor Manufacturing Company (TSMC) is seeking applications for skilled Senior Artificial Intelligence (AI) Research Scientists for their Artificial Intelligence for Business Intelligence (AI4BI) Center. The AI4BI Center is a global and international team that seeks to develop advanced AI-enabled analytics techniques to facilitate important business intelligence applications highly relevant to TSMC. This role will be based in our San Jose office in a hybrid working environment (working four days in the office). Individuals in this position may be responsible for tasks across two technical areas. The first is designing and implementing significant machine learning, deep learning, text mining, Large Language Model (LLM), foundation model, and/or network science-based approaches to extract insights from structured (e.g., transactional) and unstructured data sources (e.g., 10K reports, social media posts, news) for various BI applications. Second, the position may require efforts in developing time series modelling and/or reinforcement learning-based approaches for analyzing fab tool productivity and facilitating effective wafer start strategies. This role requires close interaction and coordination with international teams of junior AI research scientists, data engineers, and business stakeholders to gather requirements, oversee development, evaluate the outputs of technical solutions, produce internal reports, and lead co-authored publications at top-tier AI venues. Responsibilities Create and manage advanced machine learning, deep learning, LLM, foundation models, time-series modelling, and/or reinforcement learning algorithms to develop data-driven solutions for complex business problems Analyze and interpret complicated data sets to provide actionable insights that aid in enhancing decision-making processes for business stakeholders Work with cross-functional and international teams to identify and prioritize data-driven opportunities, including the development and deployment of predictive models to drive business outcomes Lead teams of junior data scientists and data engineers to develop efficient procedures, follow best practices, and provide implementation guidance (e.g., code reviews, demos) for gathering, retaining, and scrutinizing data Consistently assess and refine model performance to ensure precision and dependability Communicate insights and recommendations via internal reports to technical and non-technical stakeholders Design and implement the latest AI, machine learning, and data science tools and techniques to enhance existing processes Produce publications in leading AI conference and/or journal venues Minimum Qualifications Ph.D. in computer science, information systems, information science, statistics, or related AI or machine learning field At least 7-10 years of significant AI, machine learning, and data science-related working and research experience Experience gathering requirements from business stakeholders and developing technical machine learning designs for implementation Strong practical experience with data wrangling, pre-processing, and extraction from structured and unstructured data sources Strong conceptual and practical knowledge and experience of classical machine learning algorithms and learning paradigms, including supervised learning and unsupervised learning Strong skills in deep learning implementation, including data encodings, processing units, and learning paradigms Proficiency in developing novel machine learning or deep learning algorithms based on unique dataset characteristics and business requirements Strong practical network science skills and experience Experience with text analytics for named entity recognition, sentiment analysis, and topic modelling. Hands-on research experience with time series modeling and forecasting with statistical, machine learning, deep learning-based, and/or foundation model (TimesFM) approaches Hands-on research experience with reinforcement learning approaches, including value-based, policy-based, actor-critic, and/or multi-objective Hands-on research experience, including literature review, model design, implementation, evaluation, and publication Experience fine-tuning LLMs and other foundation models with strategies such as low rank adaptation, few shot learning, and others Experience with prompt engineering on LLMs and other foundation models with techniques such as reinforcement learning (e.g., Direct Preference Optimization (DPO), Proximal Policy Optimization (PPO)), prompt tuning, and others Knowledge about deploying models into user interface tools for dashboarding (e.g., PowerBI), Python frameworks for rapid prototyping and interaction (e.g., Streamlit, Dash), and/or JavaScript frameworks (e.g., React) Must be willing to travel to Taiwan for at least 1-3 months each year for training, team building, and project coordination Preferred Qualifications Knowledge on processing text in financial, accounting, and market analysis reports Multi-lingual text analysis using packages like Stanza, Polyglot, or Textflint. Knowledge of graph embedding techniques such as graph convolutional networks, graph attention networks, and graph transformers using packages such as stellargraph, PyG, or Deep Graph Library. Understanding of neural information retrieval methods, including deep structured semantic models, entity resolution, and retrieval augmented generation (RAG). Familiarity and practical experience with learning paradigms such as adversarial learning, knowledge distillation, and self-supervised learning. Experience working with foundation models for language (e.g., LLaMA), time (e.g., TimesFM), and other data modalities Proven and extensive track record publishing in leading AI conferences (e.g., NeurIPS, ICLR, ICML, KDD) and/or journals (e.g., IEEE TKDE, ACM TOIS) Company Description As a trusted technology and capacity provider, TSMC is driven by the desire to be: The world's leading dedicated semiconductor foundry The technology leader with a strong reputation for manufacturing excellence Advancing semiconductor manufacturing innovations to enable the future of technology TSMC pioneered the pure-play foundry business model when it was founded in 1987 and has been the world's leading dedicated semiconductor foundry ever since. The Company supports a thriving ecosystem of global customers and partners with the industry's leading process technologies and a portfolio of design enablement solutions to unleash innovation for the global semiconductor industry. With global operations spanning Asia, Europe, and North America, TSMC serves as a committed corporate citizen around the world. In North America, TSMC has a strong sales and service organization that works with customers by helping them achieve silicon success with cutting-edge technologies and manufacturing excellence. The Company has continued to accelerate its R&D investment and staffing in recent years and is expanding its manufacturing footprint to support customer innovation with 3D IC technologies and optimal manufacturing capacity. Diversity statement TSMC Technology, Inc. is committed to employing a diverse workforce and provides Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, or any other characteristic protected by applicable law. Pay Transparency Statement At TSMC, your base pay is only part of your overall total compensation package. At the time of this posting, this role typically pays a base salary between $170,000 and $270,000 per year. The range displayed reflects the minimum and maximum target for new hires. Actual pay may be more or less than the posted range. Factors that influence pay include the individual's skills, qualifications, education, experience and the position level and location. TSMC's total compensation package consists of market competitive pay, allowances, bonuses, and comprehensive benefits. We also offer extensive development opportunities and programs. Date: Oct 30, 2024 Country/Region: US City: San Jose Company: TSMC Technology, Inc.

REQ ID – 33915592ROLE – Data Engineer, Battery TechnologyLOCATION – Cupertino - Hybrid MAIN SKILLS – We need someone with Snowflake, Python, SQL, Tableau, Airflow, DBT, Conductor, developing machine learning solutions using Python and its associated ecosystem — numpy, pandas, TensorFlow, PyTorch Key Qualifications: <ul><li>6+ years as data scientist, data engineer or analyst. Battery Engineering experience desired. Working knowledge and experience with big data.</li><li>Strong working knowledge of Snowflake, Python, SQL, Airflow and Tableau.</li><li>Solid competency in statistics and the ability to provide value-added analysis.</li><li>Familiar with machine learning algorithm and capable to use proper metrics to evaluate model results.</li><li>Proficiency developing machine learning solutions using Python and its associated ecosystem — numpy, pandas, TensorFlow, PyTorch, etc.</li><li>Experience working with large-scale data processing pipelines is a must.</li></ul> Job Description: <ul><li>Deliver high quality analytic insights from a large data warehouse, especially time series data</li><li>Experience working in a cloud-native environment such as Snowflake</li><li>Demonstrated abilities in problem formulation, algorithm design, and model building, including statistical analysis and evaluation.</li><li>Compare the results of predicted values and actual values, based on historical data availability</li><li>Write Python programs to implement Machine Learning functions and maintain revision in Github. Utilize advanced technologies, for modeling enhancements</li><li>Understand end to end nature of Apple DB to organize proper sample size, proper key pull and minimize SQA issues with maximum efficiency</li><li>Drive development of data products in collaboration with data scientists and analysts. Automate reporting where possible to make team more efficient</li><li>Be able to analyze factory, user, and failure data and use engineering understanding mechanisms to resolve battery problems</li><li>Work with diverse teams including data scientists, engineers, product managers and executives</li><li>Write programs for data filtering, organization, reporting. Write programs for uploading to and maintaining data in SQL database. Develop basic data management and selection programs on SQL.</li><li>Maintain software traceability through GitHub</li></ul> Education: MS or Ph.D. in Computer Science, Software Engineer, Data Science, Machine Learning, Statistics, Operations Research or related field.

Job Summary: The Data Engineer will design, implement, and maintain scalable data solutions to empower data-driven decision-making across True Venture Group, True Care, and POD Health. This role involves building efficient data pipelines, optimizing data storage, and integrating enterprise systems to support advanced analytics, operational needs, and reporting. The Data Engineer will work closely with Data Analysts to create reports and data visualizations that drive actionable insights and business outcomes. The ideal candidate will possess strong technical expertise, a collaborative mindset, extensive experience with tools and platforms used across the organization, and a deep understanding of the end-to-end data lifecycle. Key Responsibilities:Data Pipeline Development: <ul><li>Build, maintain, and optimize ETL/ELT pipelines for seamless data ingestion and processing from multiple systems, including Sage Accounting, Viventium, and HHAExchange.</li><li>Ensure data pipelines are reliable, efficient, and capable of scaling with the business.</li></ul>Data Infrastructure and Warehousing: <ul><li>Design, implement, and manage data warehouses and lakes to support advanced analytics and operational reporting.</li><li>Optimize data models and storage solutions to handle large-scale data.</li></ul>System Integration:<ul><li>Integrate data across platforms, including Salesforce, HubSpot, Tableau, HHAExchange, Google Analytics, SEMrush, and Brandwatch.</li><li>Bridge interoperability between different systems, ensuring unified data access and usability.</li></ul>Data Quality and Compliance:<ul><li>Develop and enforce processes to ensure data accuracy, consistency, and reliability across all platforms.</li><li>Maintain compliance with relevant data regulations, including HIPAA and GDPR.</li></ul>Collaboration and Reporting: <ul><li>Partner with cross-functional teams to understand data requirements and provide infrastructure to support analytics and KPI reporting.</li><li>Support the marketing and operations teams with actionable insights drawn from integrated data sources.</li></ul>Innovation and Automation: <ul><li>Automate repetitive data tasks and identify opportunities for process improvement using advanced scripting and tools.</li><li>Research and implement new tools and technologies to optimize data management.</li></ul> Qualifications:<ul><li>Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.</li><li>Experience: 5+ years of experience in data engineering with a strong focus on building and managing data warehouses and lakes. Proven expertise in designing and optimizing scalable ETL/ELT pipelines.</li></ul> Technical Skills:<ul><li>Programming Languages: Proficiency in Python, SQL, and/or Java.</li><li>Cloud Platforms: Hands-on experience with AWS (e.g., Redshift), Azure, or Google Cloud Platform.</li><li>Data Tools: Experience with tools like Snowflake, BigQuery, Apache Spark, and Kafka.</li><li>Systems Integration: Expertise in:</li><li>Accounting and Payroll Systems: Sage Accounting, Viventium.</li><li>CRM & Marketing Platforms: Salesforce, HubSpot, Mailchimp.</li><li>Operations Tools: HHAExchange, Google Analytics, SEMrush, Tableau, and Brandwatch.</li><li>Data Governance: In-depth understanding of HIPAA, GDPR, and data security protocols.</li></ul> Soft Skills:<ul><li>Strong analytical and problem-solving skills.</li><li>Excellent communication skills for effective collaboration across team.</li></ul>

Senior Data EngineerLondon office x3 days per weekUp to £85,000 Salary OVERVIEW Successful AI Scale Up in Medical Technology/ Digital Health are hiring for a Data Engineer with a focus on optimising the data architecture and building reliable and scalable data pipelines for the application of advanced analytics and machine learning. You will be joining a strong Data team and reporting directly into the Head of Engineering. YOUR RESPONSIBILITIES: The Data Engineer’s responsibilities will include, but not be limited to: <ul><li>Design, build and maintain scalable Data pipelines.</li><li>Maintain Data dashboards through data visualisation.</li><li>Ensure the quality and security of data processes.</li><li>Work closely and collaborate with the Machine Learning, Application and Analytics teams to understand data requirements and deliver projects.</li></ul> YOUR SKILLS & EXPERIENCE A successful Data Engineer will have the following: <ul><li>Min 3+ years proven commercial experience as a Data Engineer.</li><li>Experience working with Image Data is highly desirable.</li><li>Experienced in building ETL processes and scalable data pipelines.</li><li>Experience in Python/ Java, SQL and cloud data infrastructure (AWS, Azure of GCP).</li><li>Familiarity with tools or similar technologies such as Kafka, Airflow, Apache Spark.</li></ul> HOW TO APPLYPlease register your interest by sending your CV to luke.frost@xcede.com for more info!

Plano 6 (31066), United States of America, Plano, Texas Lead Data Engineer (Python, Kafka, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a data engineer for the Auto Lending Platform Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumption as well as building reports in Tableau, Quicksight , and other tools to provide insights to stakeholders which includes multiple VPs and Directors. If you are passionate about innovation in both engineering and analytics, come join our team What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor’s Degree At least 4 years of experience in application development (Internship experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications: 7 years of experience in application development including Python, SQL, Scala, or Java 4 years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4 years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4 year experience working on real-time data and streaming applications 4 years of experience with NoSQL implementation (Mongo, Cassandra) 4 years of data warehousing experience (Redshift or Snowflake) 4 years of experience with UNIX/Linux including basic commands and shell scripting 2 years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodationcapitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careerscapitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Centurion is looking for a Secret cleared Data Engineer for a hybrid opportunity out of the DC area. (3 days a month onsite) Required Skills: <ul><li>Tech Stack (must haves): Python, SQL, SQL Server, Azure (Data Factory), Databricks, PowerBI (especially back-end programming for PowerBI)</li><li>Working Style: GitHub collaboration, SharePoint experience (moderate user), ability to work onsite at Foggy Bottom and/or collaborate at Rosslyn, 5 – 8 days a month</li><li>Above average experience with Power Point (deck creation and presentation)</li><li>8 Years of Experience (total)</li><li>8+ years hands-on-keyboard experience</li><li>5+ years data analysis experience</li><li>Cloud certification (i.e. AWS, Databricks)</li><li>Basic understanding of LLM-based tools such as model inference API and RAG methods.</li><li>Bachelor’s Degree</li><li>Secret clearance</li></ul>Experience Breakdowns <ul><li>3+ years of experience in the private sector with a cloud migration</li><li>2+ years defining cloud architecture requirements and gathering user stories for analytic product outputs</li><li>2+ years managing cloud migrations and setting milestones and timelines.</li><li>2+ years in end-to-end design, develop and implement of cloud data architecture.</li><li>2+ years of stakeholder management in a low-data maturity environment.</li><li>2+ years of experience with data governance, data security and compliance.</li><li>3+ years providing technical mentorship to junior team members.</li><li>2+ years developing and managing data stacks and dataflow layer using metadata</li><li>2+ years creating SOPs and process documentation"</li></ul>Preferred Skills: <ul><li>Experience in the State Department with DT (aka IRM)</li><li>Experience in DoD or State Department with security assistance data</li><li>Experience with political-military lingo/jargon, OR, experience in the armed forces or reserves</li><li>Experience with government financial data (e.g. appropriations, obligations, etc.)</li><li>Experience supporting a Chief Data Officer or a Chief Analytics Officer</li><li>Experience using/developing data inventories and data catalogs</li><li>Working knowledge of AWS</li></ul>Expected Deliverables: <ul><li>Migration from SQL Server and Python-based workflows to Azure and Databricks</li></ul>Education: <ul><li>Bachelors</li></ul>Position Details: Clearance: Current Active Secret ClearanceUS Citizenship is requiredTravel: < 10% (CONUS)Centurion Consulting Group, LLC is an Equal Opportunity Employer EOE M/F/D/V<ul><li>No third parties or subcontractors</li></ul>

Data Engineer <ul><li>Direct Hire</li><li>1 day onsite in Durant OK</li></ul> Our Durant, Oklahoma based client is looking for a Data Engineer II. In this role, the candidate will establish data management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy. They will participate in development of interfaces and design of user interface and business application prototypes. Job Responsibilities<ul><li>Work on problems of moderate scope where analysis of situations or data requires a review of a variety of factors.</li><li>Exercise judgment within defined procedures and practices to determine appropriate action and escalates to manager as needed.</li><li>Build productive internal/external working relationships.</li><li>Participate, and in some cases take the lead on, formulating and monitoring data architecture policies, procedures and standards.</li><li>Build moderate level complexity data interfaces, both internal and external sources</li><li>Participate in design of data architecture standards.</li><li>Design and implement database logical and physical models</li><li>Provide development and production support to troubleshoot all data interfaces and data model related issues.</li><li>Perform other duties as may be assigned.</li></ul> Job Requirements<ul><li> Bachelor’s degree in computer science, electronic engineering, computer information systems or related field, and minimum of 3 years of equivalent experience, 5 years preferred.</li><li>Professional ETL or data modeling focused Certifications preferred.</li><li>3 years exposure to database conceptual design and logical data modeling. 2 years of experience with conceptual design using data modeling tools preferred.</li><li>2 years of hands-on experience developing internal and external data interfaces and data loading plans.</li><li>Some experience with implementing and managing data security policies. Working knowledge of Data Governance concepts preferred.</li><li>3 years of converting business requirements into data, data warehouse specifications and loading plans.</li><li>3 years of hands-on experience with data Integration tools (SSIS, Informatica, SQL Stored Procedures etc.)</li><li>Some experience working with development teams on data used in user interfaces and backend data requirements, and on data used in user-based interfaces and backend data requirements preferred.</li><li>4 years of converting business requirements into data, database specifications and loading plans preferred.</li><li>4 years of data migration experience preferred.</li><li>Experience with managing multiple Service Requests and competing priorities preferred.</li><li>Minimum of 1 years of experience with programming languages (SQL, Python etc.) 2 years preferred.</li><li>3 years of experience supporting a data warehouse preferred.</li><li>Informatica experience desired.</li></ul>

Career Opportunity: Data Engineer We will consider in-office, hybrid, or remote candidates and it does not require regular travel. What We Do: At PESI we reach millions of professionals daily, offering them advanced training so that they can help others to achieve hope and healing. Our work has a deeper purpose; one that contributes to improving the quality of life of others. Our mission is to connect knowledge with need; we help clinicians, in the mental health and healthcare fields, throughout the world expand their knowledge through delivering innovative and cutting-edge training that helps them to improve the outcomes of their clients’ lives. PESI has offices on three continents and is continuing to expand. Join a company with a culture that embraces inquisitiveness, responsibility, collaboration, and continual learning and growth. How We Do It: We aim for innovation and creativity: Continuous improvement and falling forward is what facilitates our ability to meet our mission of connecting knowledge with need. Our people create our success: We listen, we learn, and we strive to meet or exceed the expectations of our customers, associates and vendors. We go direct and assume competence: We expect open, honest and ethical relationships both internally and externally. We encourage you to be an entrepreneur: Our associates view their position or area as if it were their own business and make decisions accordingly. Overview of the Information Technology Team:The PESI Information Technology Team is responsible for supporting the efforts of all PESI organizations –from business development to fulfillment. From desktop support to building, implementing, and supporting enterprise-scale systems, we work together to change how we reach our customers by developing new and innovative solutions to create efficiencies, expand our capabilities, and provide our customers with a best-in-class experience. What You Will Be Doing: (responsibilities)<ul><li>Collaborating with IT and business teams to develop and execute robust enterprise data strategies, empowering decision-makers across marketing and other business functions.</li><li>Designing and implementing a scalable Azure-based Data Warehouse, enabling seamless access to critical data for informed decision-making. Partnering with report writers and analysts to deliver actionable datasets and insightful reports.</li><li>Developing, maintaining, and optimizing ETL processes using modern cloud and on-premises tools. Documenting datasets comprehensively to ensure accessibility and ease of use for data warehouse consumers.</li><li>Acting as a trusted technical resource for business and IT teams on data-related challenges and solutions.</li><li>Writing and optimizing complex SQL queries for seamless data retrieval from multiple systems.</li></ul> What You Bring to the Team: (skills and requirements)<ul><li>2+ years of experience in building ETL processes using tools like SSIS, Azure Synapse Analytics, or Azure Data Factory.</li><li>1+ years of experience with cloud-hosted databases, preferably in Azure (e.g., Azure Synapse Analytics).</li><li>Strong grasp of ETL principles and best practices for efficient data processing. Proficiency in SQL, with the ability to write, debug, and optimize complex queries. </li><li>Familiarity with REST services and other APIs for data integration. Exceptional analytical thinking and conceptual problem-solving skills.</li><li>Passion for working with clean, structured, and meaningful data.</li><li>Excellent organizational and time management skills, with attention to detail and the ability to handle multiple tasks.</li><li>Proficient in Microsoft Office Suite for documentation, presentation, and reporting.</li><li>Experience with Power BI or similar reporting tools. </li><li>Knowledge of data warehousing best practices and dimensional modeling. </li><li>Basic understanding of data governance, privacy, and security best practices.</li></ul> What Would Thrill Us:<ul><li>Experience in eCommerce or marketing organizations, working with datasets such as customer, transaction, or product data.</li><li>Hands-on experience with Azure Data Platform technologies, such as Azure Data Lake, Azure CosmosDB, or Azure Fabric.</li><li>Experience with Microsoft Fabric.</li><li>Knowledge of Azure Active Directory (AAD) and Role-Based Access Control (RBAC).</li><li>Familiarity with third-party ETL tools to complement cloud-based solutions.</li><li>Proficiency in scripting languages such as PowerShell or Python.</li><li>Experience in programming with C#.Expertise in managing and processing semi-structured data (e.g., JSON, XML).Experience with Google Analytics data and working with Google BigQuery.</li><li>Experience with marketing platforms like HubSpot or similar email/campaign systems.</li><li>Experience building data integrations with NetSuite or other financial/accounting systems.</li></ul> What Else You Should Know About UsWe are an organization that loves to play the game of business, and we are unapologetically driven and dedicated to creating world-class educational solutions for our customers. By doing so, we get to help people around the world find comfort and healing. Candidates must be able to provide proof of eligibility to work in the United States following an offer of employment. Equal Employment Opportunity PESI is committed to creating a diverse environment and is proud to be an equal opportunity employer. All employment decisions are based on business needs without regard to race, color, ethnicity, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status or any other applicable legally protected status. All qualified candidates are encouraged to apply.

Plano 7 (31067), United States of America, Plano, Texas Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. As a Data Engineer for the Originations Data Engineering and Analytics team, you will get to work on the most cutting-edge Fintech products that Capital One is building for its customers. You will be working on creating One Stream data pipelines for real time consumptions as well as building reports in Tableau, ThoughtSpot and other tools to provide insights to stakeholders which includes multiple VPs and Directors. You will have a lot of exposure to AWS services on your day to day job. If you are passionate about innovation in both engineering and analytics, come join our team What You’ll Do: Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights Build the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, Python Be part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasets Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor’s Degree At least 3 years of experience in application development (Internship experience does not apply) At least 1 year of experience in big data technologies Preferred Qualifications: 5 years of experience in application development including Python, SQL, Scala, or Java 2 years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 3 years experience with Distributed data computing tools (Kafka, Spark, Flink) 2 year experience working on real-time data and streaming applications 2 years of experience with NoSQL implementation (DynamoDB, OpenSearch) 2 years of data warehousing experience (Redshift or Snowflake) At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization). Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodationcapitalone.com . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careerscapitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Tsmc Data Engineer Interview Guide

Overview

Tsmc Data Engineer Salary

Tsmc Data Engineer Interview Process

Tsmc Data Engineer Interview Questions

Tsmc Data Engineer Jobs