Job Title: Data Engineer Job Summary We are seeking a skilled Data Engineer to join our Data Science team. The ideal candidate will design, build, and maintain scalable data pipelines and infrastructure to support analytics, machine learning, and Retrieval-Augmented Generation (RAG) type Large Language Model (LLM) workflows. This role requires strong technical expertise, problem-solving skills, and the ability to collaborate effectively with data scientists, analysts, and other stakeholders. Key Responsibilities Data Pipeline Development: •Design, develop, and maintain robust and scalable ETL (Extract, Transform, Load) processes. •Ensure efficient and accurate data collection, processing, and storage. Data Integration: •Integrate data from various sources, including databases, APIs, and third-party providers. •Maintain data consistency and integrity across different systems. RAG Type LLM Workflows: •Develop and maintain pipelines tailored for RAG-type LLM workflows. •Ensure efficient data retrieval and augmentation for LLM training and inference. •Collaborate with data scientists to optimize data pipelines for performance and accuracy. Semantic/Ontology Data Layers: •Develop and maintain semantic and ontology data layers to enhance integration and retrieval. •Enrich data semantically to support analytics and machine learning models. Collaboration: •Work closely with data scientists, analysts, and other stakeholders to understand requirements. •Provide technical support and guidance on data-related issues. Data Quality and Governance: •Implement data quality checks and validation processes. •Adhere to data governance policies and best practices. Performance Optimization: •Monitor and optimize the performance of data pipelines and infrastructure. •Troubleshoot and resolve data-related issues efficiently. Support for Analysis: •Provide quick, reliable data access for ad-hoc analysis. •Contribute to longer-term goals with scalable and maintainable data solutions. Documentation: •Maintain detailed documentation of data pipelines, processes, and infrastructure. •Ensure knowledge transfer and continuity within the team. Required Qualifications •Bachelor's or Master's degree in Computer Science, Engineering, or a related field. •3+ years of experience in data engineering or a related role. •Proficiency in Python (mandatory). •Experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB). •Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka). •Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services. •Experience building and maintaining data pipelines for LLM workflows, including data retrieval and augmentation. •Familiarity with natural language processing (NLP) techniques and tools. •Understanding of semantic and ontology data layers for integration and retrieval. •Hands-on experience with ETL tools (e.g., Apache NiFi, Airflow, Talend). •Strong analytical and problem-solving skills. •Excellent communication and collaboration abilities. Preferred Qualifications •Experience with machine learning and data science workflows. •Knowledge of data governance and compliance standards. •Familiarity with data visualization tools (e.g., Tableau, Power BI). •Certification in cloud platforms or data engineering. Education: Bachelors Degree Certification: IBM Data Engineering

A large financial organization is seeking a Data Engineer that will sit onsite 4 days a week in downtown Cincinnati for a long term contract. We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in SQL, DB2, Snowflake. Nice to have is someone that's worked at Fifth Third Bank. They should have understanding of our account/customer data, Data Stage, and Switchboard/ELevate. Squad Outcomes: This squad is a key partner to Retail branch network. This team prepares and puts data in the hands of our branch teams so they can better provide a better experience for our customers. Technically, they are currently in the process of moving their data warehouse and ETL from DB2/Data Stage to Snowflake/DBT which will be the biggest imitative in 2025. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Required Skills & Experience Advanced SQL DB2 Snowflake Nice to Have Skills & Experience DBT Power BI Data Stage Financial Data Knowledge Familiarity with Switchboard/Elevate Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Outlier helps the worlds most innovative companies improve their AI models by providing human feedback. Are you an experienced software engineer who would like to lend your coding expertise to train AI models? We partner with organizations to train AI large language models, helping cutting-edge generative AI models write better code. Projects typically include discrete, highly variable problems that involve engaging with these models as they learn to code. There is no requirement for previous AI experience. About the opportunity: <ul> <li>Outlier is looking for talented coders to help train generative artificial intelligence models </li> <li>This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you </li> </ul> You may contribute your expertise by <ul> <li>Crafting and answering questions related to computer science in order to help train AI models </li> <li>Evaluating and ranking code generated by AI models </li> </ul> Examples of desirable expertise: <ul> <li>Currently enrolled in or completed a bachelor's degree or higher in computer science at a selective institution </li> <li>Proficiency working with one or more of the the following languages: Java, Python, JavaScript / TypeScript, C++ </li> <li>Ability to articulate complex concepts fluently in English </li> <li>Excellent attention to detail, including grammar, punctuation, and style guidelines </li> </ul> Payment: <ul> <li>Currently, pay rates for core project work by Tier 2 coding experts in the U.S. average USD $30 per hour. </li> <li>Rates vary based on expertise, skills assessment, location, project need, and other factors. For example, higher rates may be offered to PhDs. For non-core work, such as during initial project onboarding or project overtime phases, lower rates may apply. Certain projects offer incentive payments. Please review the payment terms for each project. </li> </ul> PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with the Outlier Privacy Policy and our internal policies and programs designed to protect personal data. This is a 1099 contract opportunity on the Outlier.ai platform. Because this is a freelance opportunity, we do not offer internships, sponsorship, or employment. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if you are on a visa. You should contact your tax and/or immigration advisor with specific questions regarding your circumstances.

Data Engineer - DataStage ETL II Primary Location: Cincinnati, Ohio V-Soft Consulting is currently hiring for a Data Engineer - DataStage ETL II for our premier client in Cincinnati, Ohio. Education and Experience " <ul> <li> Technical Degree or related work experience. </li> <li> Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.). </li> <li> Experience with ETL Tools: DataStage. </li> </ul> Knowledge, Skills and Abilities " Must Have: <ul> <li> Advanced SQL. </li> <li> Data Extraction. </li> <li> Data Modeling. </li> <li> DB2/UDB Structures and Formats. </li> <li> ETL - DataStage. </li> <li> JSON. </li> </ul> Nice To Have: <ul> <li> IBM Safer Payments. </li> <li> Snowflake. </li> <li> Unix or Linux. </li> </ul> WHAT YOU'LL DO: Job Responsibilities: <ul> <li> Install/update disaster recovery procedures. </li> <li> Create custom software components and analytics applications. </li> <li> Design, construct, install, test and maintain data management systems. </li> <li> Ensure that all systems meet the business/company requirements as well as industry practices. </li> <li> Develop set processes for data mining, data modeling, and data production. </li> <li> Integrate up-and-coming data management and software engineering technologies into existing data structures. </li> <li> Research new uses for existing data. </li> <li> Employ an array of technological languages and tools to connect systems together. </li> <li> Collaborate with members of your team (e.g., data architects, the IT team, data scientists) on the project's goals. </li> <li> Recommend different ways to constantly improve data reliability and quality. </li> </ul> Interested? Qualified candidates should send their resumes to skhatun@vsoftconsulting.com V-Soft Consulting Group is recognized among the top 100 fastest growing staffing companies in North America, V-Soft Consulting Group is headquartered in Louisville, KY with strategic locations in India, Canada and the U.S. V-Soft is known as an agile, innovative technology services company holding several awards and distinctions and has a wide variety of partnerships across diverse technology stacks. As a valued V-Soft Consultant, you're eligible for full benefits (Medical, Dental, Vision), a 401(k) plan, competitive compensation and more. V-Soft is partnered with numerous Fortune 500 companies, exceptionally positioned to advance your career growth. V-Soft Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. For more information or to view all our open jobs, please visit www.vsoftconsulting.com or call (844) 425-8425. #LI-SK10 #INDSP

Lead Azure Data Engineer (SC Product Funding) Primary Location : Cincinnati Ohio V-Soft Consulting is currently hiring for a Lead Azure Data Engineer (SC Product Funding) for our premier client in Los Cincinnati Ohio. Nice to have in Cincinnati, OH - local candidates would be preferred - hybrid ..willing to do remote for strong candidate Education and Experience " <ul> <li> Proven experience in a similar role, with a strong track record as Sr. Data Engineer and has helped/lead development teams in delivering high-quality data orchestration solutions with min 7+ years' experience. </li> </ul> Knowledge, Skills and Abilities " Top 3 skills: Azure data factory, data bricks, and CICD Technical skill: - <ul> <li> Python, PySpark, ADF, SQL, ADLS, Microsoft Azure, Azure Databricks, Azure Synapse. </li> </ul> GitHub Actions: <ul> <li> Familiarity with setting up and managing CI/CD pipelines using GitHub Actions, ensuring smooth and automated deployment processes. </li> </ul> Agile Methodology: <ul> <li> Experience working in an Agile/Scrum environment, with a focus on iterative development, continuous feedback, and delivery. </li> </ul> WHAT YOU'LL DO: Job Responsibilities: Development : - <ul> <li> Working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation, Terraform scripting and DevOps process. </li> </ul> Lead Development Initiatives: <ul> <li> Develop code with FTR and of quality. Also to take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards. </li> </ul> Collaboration: <ul> <li> Work closely with cross-functional teams, including product management, Cloud Security, LOB, Network security, and DevOps, to integrate different features into broader solutions. </li> </ul> Problem Solving: <ul> <li> Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience. </li> </ul> Documentation: <ul> <li> Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance. </li> </ul> Team Leadership: <ul> <li> Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment. </li> </ul> Stakeholder Communication : <ul> <li> Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives. </li> </ul> Interested? Qualified candidates should send their resumes to sbandi@vsoftconsulting.com V-Soft Consulting Group is recognized among the top 100 fastest growing staffing companies in North America, V-Soft Consulting Group is headquartered in Louisville, KY with strategic locations in India, Canada and the U.S. V-Soft is known as an agile, innovative technology services company holding several awards and distinctions and has a wide variety of partnerships across diverse technology stacks. As a valued V-Soft Consultant, you're eligible for full benefits (Medical, Dental, Vision), a 401(k) plan, competitive compensation and more. V-Soft is partnered with numerous Fortune 500 companies, exceptionally positioned to advance your career growth. V-Soft Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. For more information or to view all our open jobs, please visit www.vsoftconsulting.com or call (844) 425-8425. #LI-SR3

Data Engineer Jobs in Union, KY

Azure Data Engineer
November 17, 2024

Data Engineer
November 16, 2024

Data Engineer Iii
November 15, 2024

Big Data Engineer For Ai Training
November 12, 2024

Data Engineer Datastage Etl Ii
November 2, 2024

Lead Azure Data Engineer Sc Product Funding
October 27, 2024

Solutions Architect Oracle Data Analytics Manager
October 24, 2024

Lead Azure Data Engineer Sc Product Funding
October 24, 2024

Quick filters

Top companies

Data Engineer Jobs in Union, KY

Azure Data EngineerNovember 17, 2024

Data EngineerNovember 16, 2024

Data Engineer IiiNovember 15, 2024

Big Data Engineer For Ai TrainingNovember 12, 2024

Data Engineer Datastage Etl IiNovember 2, 2024

Lead Azure Data Engineer Sc Product FundingOctober 27, 2024

Solutions Architect Oracle Data Analytics ManagerOctober 24, 2024

Lead Azure Data Engineer Sc Product FundingOctober 24, 2024