**MUST BE A US CITIZEN OR GREEN CARD HOLDER** Hybrid: Mondays & Fridays - RemoteTuesdays, Wednesdays & Thursdays - On-site The Data Engineer will be responsible for supporting the design, development, and maintenance of data pipelines and data processing systems. They will utilize technologies such as Azure, Spark SQL, SQL Server, Azure Data Factory, Azure Databricks, Azure DevOps, Data build Tool (DBT), Git, Power BI, Azure Synapse Analytics, and Azure Databricks. Working under the guidance of senior data engineers, they will play a crucial role in ensuring the availability, reliability, and scalability of the data infrastructure and in supporting the organizational data-products within the company.

Insight Global is looking for a Data Engineer to support our client's Quality Data Analytics & Telemetry organization. This person will work as part of a team to define, develop, and test architectures and processes for collecting, storing, transforming, and managing big data into optimized views for business intelligence and modeling. On a daily basis, this person will receive customer requirements from the team Lead and client management. Use SQL to create views based on business requirements. They will be responsible for data integration preparation, data integration, and maintenance as well as build, maintain, and update internal data structures for current and new data sources. They must also communicate issues that arise proactively without waiting to be contacted. Additionally, they will be supporting the move to a Databricks environment that will help them more efficiently manage their data. This role will be hybrid, but with the expectation to work on-site one day a week, plus for any occasional team collaborations (workshops, whiteboard sessions, etc.). Compensation range: $48-55/hr We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Required Skills & Experience 4+ years of experience in a Data Engineering type role Well versed in Databricks (understand workflows) Python, SQL, Machine Learning experience. Experience with building ETL pipelines and ETL best practices Nice to Have Skills & Experience DBA background Power BI experience Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Data Engineer Description - About Us: HP's Data and Analytics organization is seeking experienced Data Engineers to join our "Data Engineering for Data Science" team. As a forward-thinking and innovative organization, we are dedicated to harnessing data to drive impactful business decisions. Role Description: In this role, you will engage in some of the most exciting and cutting-edge projects in Data Engineering, AI/ML, and Generative AI within HP. The Data Engineer will be instrumental in designing and building robust data engineering solutions that support our AI/ML initiatives. You will collaborate closely with data scientists, data architects, and data product owners to develop these solutions. We seek dynamic professionals with a strong foundation in computer programming, experience in large enterprise platforms, and a willingness to learn new technologies. Key Responsibilities: <ul><li>Design, develop, and maintain scalable data pipelines and ETL processes using Python, SQL, Databricks and Azure Data Factory.</li><li>Implement and optimize complex SQL queries and Python scripts for data processing.</li><li>Develop and maintain data models and architecture to ensure high data quality and performance.</li><li>Work closely with cross-functional teams to understand data requirements and provide technical solutions.</li><li>Monitor, troubleshoot, and improve data pipelines to ensure data accuracy and reliability.</li><li>Collaborate with teams across different time zones (Americas and Asia) to ensure seamless project execution and delivery.</li><li>Stay up-to-date with the latest industry trends and technologies to continuously improve data engineering practices.</li></ul> Qualifications: <ul><li>5-8 years of experience as a Data Engineer or in a similar role.</li><li>Strong proficiency in ETL, Data processing using Python programming and SQL.</li><li>Extensive experience working in the Databricks environment.</li><li>Solid understanding of Apache Spark and its applications in data processing.</li><li>Proven experience in data warehousing, data modeling, data architecture, and building data pipelines.</li><li>Hands-on experience with Azure Data Factory.</li><li>Excellent problem-solving skills and the ability to troubleshoot data-related issues.</li><li>Strong communication and collaboration skills to work effectively with global teams.</li><li>A proactive mindset and willingness to learn new technologies and methodologies.</li><li>Four-year or Graduate Degree in Computer Science, Software Engineering or any other related discipline or commensurate work experience or demonstrated competence.</li></ul> Preferred Qualifications: <ul><li>Experience with cloud platforms such as Microsoft Azure.</li><li>Familiarity with other big data technologies and tools.</li><li>Understanding of data governance and security best practices.</li><li>Knowledge of Agile and DevOps practices.</li><li>Familiarity with latest AI/ML, Generative AI technologies</li></ul> Why Join Us: <ul><li>Opportunity to work with cutting-edge technologies and tools.</li><li>Collaborative and inclusive work environment.</li><li>Professional growth and development opportunities.</li><li>Competitive salary and benefits package.</li></ul> Disclaimer: This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management. Job - Software Schedule - Full time Shift - No shift premium (United States of America) Travel - No Relocation - Equal Opportunity Employer (EEO) - HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s). Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence. If you'd like more information about HP's EEO Policy or your EEO rights as an applicant under the law, please click here: Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law - Supplement

An Oil & Gas customer of Insight Global is looking for a Master Data Engineer to join their team full-time to sit in The Woodlands, TX, on a hybrid schedule 3 days a week and as needed with travel up to 5% within the Texas area. The IT division's primary goal over the next few years is focused on their Data Transformation efforts that will support all of the company's domains for midstream assets. This person will be designing, developing, and deploying innovative data and analytical solutions to enhance current operations and shape the future of the organization. The salary range for this role is dependent on level of experience with a flexible range of $150,000-$200,000 annually. Responsibilities: * Collaborate with data stewards to design, develop and prioritize capabilities to accurately capture high quality data. * Maintain and improve existing master data management systems while evaluating and implementing future improvements and solutions. * Review integration complexities of current and future systems and understand the effects of combining data from different systems. * Design, build, and manage data pipelines to ingest, transform, and distribute master data between enterprise systems and Azure destinations. * Write complex system queries into operational systems to extract datasets that meet master data source ingestion requirements. * Employ programming languages like Java and Python in relation to enhancing master data applications. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Required Skills & Experience Previous experience in administration and design of Master Data applications (ex. SAP Master Data Governance, Profisee, Tibco EBX) 8+ years of experience as a Data Engineer and/or Software Developer with proficiency in Java In-depth knowledge with Azure cloud services (ex. ADF, Onelake, PowerBI, PowerQuery), relational database design principles, data warehousing and data modeling, performance tuning, and optimization Proficiency in T-SQL, ETL/ELT processes/tooling, data modeling, and database design principles High level knowledge of Microsoft Purview Excellent communication skills with the ability to interact with developers and business usupporting requirements gathering Nice to Have Skills & Experience Oil and Gas/Midstream industry experience Heavy Data Transformation experience Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

An employer is seeking a Data Engineer to join their team in Spring, TX. He or she will be joining the Commercial Architecture team to help optimize data and increase productivity while utilizing AI. The Data Scientist/Engineer will o Collaborate with AI engineers to implement and evaluate AI optimization techniques, utilizing insights from the data analysis. o Contribute to the development and refinement of algorithms for dynamic resource allocation, task scheduling, and model optimization. o Explore and implement new approaches to enhance the efficiency and effectiveness of AI models on diverse hardware configurations. In addition, her or she will provide data modeling by: o Analyze performance, usage, and user behavior data to identify patterns, trends, and optimization opportunities. o Develop and evaluate machine learning models to predict performance, personalize experiences, and optimize resource allocation for various AI workloads. o Use statistical methods and visualization tools to communicate findings effectively to stakeholders. Lastly, the Data Engineer aspect will include: o Design and implement robust data collection pipelines to gather relevant metrics from the companies devices, ensuring data quality and integrity. o Build and maintain scalable data infrastructure for storing, processing, and analyzing large volumes of data, both on-premises and in the cloud. o Collaborate with software engineers to integrate data pipelines and tools into existing and emerging AI-powered products and services. This role is hybrid onsite 3 days a week and pay range is from $70 - $100/hr based on experience. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Required Skills & Experience 3+ years of experience in data science or data engineering, preferably with exposure to AI or machine learning projects Strong programming skills in Python or R, with experience in data manipulation and analysis libraries (e.g., Pandas, NumPy, Scikit-learn) Experience with an IoT background extracting data from hardware devices Demonstrated ability to integrate with and leverage existing data lakes and telemetry systems Nice to Have Skills & Experience Experience with cloud computing platforms (e.g., AWS, Azure, GCP) and big data technologies Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Seeking a highly skilled and motivated Data Engineer to join a dynamic team. As a key contributor, you will be responsible for integrating into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.Required Skills -• SQL• Databricks, Collibra, and/or Alteryx.• Familiarity with cloud-based data platforms, particularly AWS.Job Duties -Responsibilities:• Integrate into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.• Perform data engineering and analytics tasks, including data ingestion, SQL orchestration, and data modeling.• Troubleshoot and resolve issues during testing and validation activities.• Design and build data ingestion pipelines.• Participate in Agile methodology, delivering assigned stories according to engineering standards and guidelines.• Collaborate in pair programming, code reviews, and documentation of data models.• Implement automated tests, logging, and alerting for data processes.• Provide data engineering consulting expertise, especially in Starburst and Immuta.• Support data migration activities. Key Deliverables:• Completion of assigned stories, including design, data ingestion pipeline builds, data modeling, coding, analytics solutions, and documentation.• Jira Stories and Epics for each Agile program increment.• Deliver high-quality solutions accepted by the CDP Program Team’s product owners, adhering to FRS engineering standards and guidelines.Job Requirements -• 5+ years of experience in data engineering.• Experience with Databricks, Collibra, and/or Alteryx.• Strong SQL skills and experience in building data ingestion pipelines.• Familiarity with cloud-based data platforms, particularly AWS.• Proficiency in Agile methodologies and tools such as Jira.• Excellent troubleshooting and problem-solving skills.• Ability to work collaboratively within a team and communicate effectively with stakeholders.• Experience in Immuta and Starburst preferred.Desired Skills & Experience -Experience in Immuta and Starburst preferred. Required Skills : Data WarehouseAdditional Skills : Data Engineer

Data Engineer Jobs in Spring, TX

Azure Data Engineer
September 1, 2024

Data Engineer
August 23, 2024

Data Engineer
August 19, 2024

Master Data Engineer
August 19, 2024

Data Engineer
August 18, 2024

Data Engineer
August 11, 2024

Quick filters

Top companies

Data Engineer Jobs in Spring, TX

Azure Data EngineerSeptember 1, 2024

Data EngineerAugust 23, 2024

Data EngineerAugust 19, 2024

Master Data EngineerAugust 19, 2024

Data EngineerAugust 18, 2024

Data EngineerAugust 11, 2024