<h3>Job Title: Data Engineer</h3>
Job ID: 2022-11695
Job Location: Remote (hybrid in Secaucus, NJ or NYC, NY preferred) *EST and CST time zones only
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:US Permanent eligibility to work required
Duration:Long Term
# of Layers:0
Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers
Key Technology:Python, Data Bricks, and Snowflake and Azure
Job Responsibilities:
<ul>
<li>Analysis, design, coding, performance tuning, and implementation of new BI solutions.</li>
<li>Evaluation, maintenance, and enhancement of existing ETL processes and model/cube structures.</li>
<li>Creation of BI dashboards and workbooks using Power BI, Tableau, and Excel.</li>
<li>Code data ingest solutions (C#, NodeJS) leveraging 3rd party APIs.</li>
<li>Daily triage of bugs and tasks.</li>
<li>Create documentation for applications and processes.</li>
<li>Enforce best practices in all aspects of work and evaluate new data warehousing platforms and solutions.</li>
</ul>
Skills and Experience Required:
<ul>
<li>5+ years’ experience in a data warehouse team environment.</li>
<li>Python, Data Bricks, and Snowflake and Azure (and/or GCP, AWS) experience</li>
<li>Advanced level of experience with Microsoft SQL Server, SSAS and SSMS (Management Studio)</li>
<li>Hands-on experience with SSIS or other similar ETL tools</li>
<li>Demonstrated strength with T-SQL for database queries, procedures, tables, views, etc.</li>
<li>Proven skills with data visualization tools: Microsoft Excel (PowerPivot, Pivot Tables, Slicers) Power BI and Tableau (dashboard design, configuration and advanced calculations)</li>
<li>Ability to work with .Net development tool Visual Studio 2017 to write code, make changes, and deploy updates.</li>
<li>Experience with cloud platforms such as Azure, AWS, or GCP and their storage devices and connectivity tools such as AWS development tools: NodeJS and Lambda Functions.</li>
<li>Experience with SSAS and/or Tabular data warehouse design experience including: an understanding of MDX/DAX, calculated measures, hierarchies, slowly changing dimensions, and date/time dimension analysis.</li>
<li>A basic understanding of HTML, CSS, and web page deployment.</li>
<li>Excellent written and verbal skills and the ability to present to upper management.</li>
</ul>
Educational Background: 
<ul>
<li>Bachelor’s Degree in Computer Science or related field preferred</li>
</ul>
#J-18808-Ljbffr

<h3>Job Title :- Senior Data Engineer</h3>
Employment Type :- W2
Duration :- Long Term
Visa Type :- All Visa applicable which are ready for W2
Location- Bellevue, WA (Day-1 Onsite)
Exp required :- 8-10+ years
Key Skills :- Python , Shell scripting , Data Framework , Cloud platform (AWS/Azure)
<h3>Job Description:</h3>
We are seeking an experienced Data Engineer with a strong background in data frameworks, scripting, and cloud platforms. The ideal candidate will have 8-10+ years of hands-on experience in data engineering, with expertise in Python, Shell scripting, and familiarity with Google Cloud Platform (GCP) or other cloud environments like AWS or Azure.
<h3>Responsibilities:</h3>
<ul>
<li>Design, develop, and optimize scalable data pipelines to support data integration and analytics.</li>
<li>Work with large datasets, transforming and preparing data for analysis and reporting.</li>
<li>Develop scripts using Python and Shell to automate data processing tasks.</li>
<li>Utilize data frameworks effectively to build, maintain, and support data infrastructure.</li>
<li>Collaborate with cross-functional teams to ensure data quality and system reliability.</li>
<li>Implement best practices for data management and governance on cloud platforms (GCP, AWS, or Azure).</li>
</ul>
<h3>Qualifications:</h3>
<ul>
<li>Experience: 8-10+ years in data engineering, with demonstrated ability to manage complex data environments.</li>
<li>Technical Skills:
<ul>
<li>Python & Shell Scripting: Advanced proficiency in scripting for automation and data processing.</li>
<li>Data Frameworks: Strong knowledge of data frameworks (e.g., Spark, Hadoop, Apache Beam).</li>
<li>Cloud Platforms: Familiarity with Google Cloud Platform (GCP); experience with AWS or Azure is a plus.</li>
</ul>
</li>
<li>Analytical Skills: Strong problem-solving and analytical skills for handling large-scale data environments.</li>
<li>Collaboration: Ability to work effectively within a team, with excellent communication and documentation skills.</li>
</ul>
<h3>Preferred Qualifications:</h3>
<ul>
<li>Experience with Big Data tools and platforms, including Apache Spark, Hadoop, or BigQuery.</li>
<li>Knowledge of data governance, security, and compliance standards.</li>
</ul>
#J-18808-Ljbffr

Job Title: Data Engineer
Job ID: 2023-11994
Job Location: Morris Plains, NJ (remote to start)
Job Travel Location(s):
# Positions: 2
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:All Work Authorizations are Permitted
Key Technology:Spark, Py-Spark, Shell scripting, Teradata, Hive and Hadoop
Job Responsibilities:
<ul>
<li>Work with business and technical leadership to understand requirements.</li>
<li>Design to the requirements and document the designs.</li>
<li>Ability to write product-grade performant code for data extraction, transformations and loading using Spark, Py-Spark</li>
<li>Do data modeling as needed for the requirements.</li>
<li>Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and Hive</li>
<li>Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS or Hadoop Edge Nodes</li>
<li>Implement Hadoop job orchestration using Shell scripting, Apache Oozie, CA7 Enterprise Scheduler and Airflow</li>
<li>Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment</li>
<li>Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives.</li>
</ul>
Skills and Experience Required:
<ul>
<li>Strong development experience in Spark, Py-Spark, Shell scripting, Teradata, Hive and Hadoop</li>
<li>Experience of Ab Initio is a bonus.</li>
<li>Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures</li>
<li>Excellent work experience on Hadoop as data warehouse/Data Lake implementations</li>
<li>Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory)</li>
<li>Unix/Linux Shell scripting (KSH) and basic administration of Unix servers</li>
<li>CA7 Enterprise Scheduler</li>
<li>Experience with AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)</li>
<li>Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration)</li>
<li>Experience in Jira and Confluence</li>
<li>Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.</li>
<li>Health care domain knowledge is a plus.</li>
</ul>
#J-18808-Ljbffr

<h3>Job Title: Test Data Engineer</h3>
Job ID: 2022-11844
Job Location: Milwaukee, WI preferred or Remote
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:US Permanent Eligibility to Work Required
Key Technology:ETL, Informatica, PL/SQL
Job Responsibilities:
<ul>
<li>Fully test the product(s) or system(s) to ensure it functions properly and meets the business needs</li>
<li>Set up of test environments, designing test plans, developing test cases/scenarios/usage cases, and executing these cases</li>
</ul>
Skills and Experience Required:
<ul>
<li>Minimum 3 years experience with setting up of test environments, designing test plans, developing test cases/scenarios/usage cases, and executing test cases</li>
<li>Knowledge and current working experience on ETL, Informatica and PL/SQL</li>
<li>Strong experience in SQL Scripting required</li>
<li>Good written and verbal communications</li>
</ul>
#J-18808-Ljbffr

<h3>Job Title: Data Engineer</h3>Job ID: 2022-11751Job Location: Milwaukee, WI or RemoteJob Travel Location(s):# Positions: 1Employment Type: W2Candidate Constraints:US Permanent eligibility to work requiredDuration:Long Term# of Layers:0Work Eligibility:All Work Authorizations are Permitted – No Visa TransfersKey Technology:SQL, JS, Unix, cloud, Kafka, Gitlab, AnsibleJob Responsibilities:<ul><li>This position is responsible for designing and coding in Informatica and Unix scripting to extract, load, and transform data from multiple sources and load it into targets.</li><li>The role also includes mentoring other developers as well as reviewing code and testing from other developers on the team.</li><li>The ideal candidate will be adept at writing queries and extracting data to populate downstream databases and should have technical curiosity to expand his or her technology horizons beyond traditional ETL.</li><li>The candidate will take ownership of ETL creation, possess strong technical skills, and must have the ability to learn quickly.</li><li>This role supports new and existing data ﬂows for the Client Experience and Field Experience team. You will be responsible for supporting Enterprise ﬂows that transform and load data in near real-time and the replication process to the Cloud while maintaining and enhancing existing workﬂows and building new workﬂows which interact with enterprise data.</li></ul>Skills and Experience Required:<ul><li>4+ years of experience</li><li>Adept at writing SQL queries</li><li>Adept at using JavaScript or Unix scripting</li><li>Strong knowledge and working experience with Informatica</li><li>Technical aptitude with data ﬂow design and ability to easily extract from enterprise databases</li><li>Ability to gather and interpret needs from stakeholders.</li><li>Designing, building, and testing new/updated data ﬂows while ensuring the data meets the business needs.</li><li>Reviewing code, designs, and testing for peers</li><li>Developing integrated data solutions, modernizing, consolidating, and coordinating business needs across several applications.</li><li>Analyzing business and functional speciﬁcations to deliver high-quality data solutions while maintaining development best practices and optimizing maintainability and supportability.</li><li>Education: Bachelor’s degree in Computer Science, Information Systems, or related ﬁeld</li></ul>Nice to have:<ul><li>Java</li><li>Data security experience</li><li>Previous experience working with cloud data solutions</li><li>Kafka</li><li>GitLab</li><li>Ansible</li><li>ELK Stack</li><li>Data Streaming (Spark, Kafka Streams, Flink)</li><li>Scheduling (Autosys)</li></ul>
#J-18808-Ljbffr

<h3>Job Title: Senior Data Engineer</h3>Job ID: 2022-11506Job Location: Bloomfield, CT, Denver, CO, Austin TX, NYC, NY, virtual work is possible for the right candidatesJob Travel Location(s):# Positions: 3Employment Type: W2Candidate Constraints:Duration: Long Term# of Layers:0Work Eligibility:All Work Authorizations are Permitted – No Visa TransfersKey Technology:cloud, OO language, database systems, devops, machine learningJob Responsibilities:The Senior Data Engineer is responsible for the delivery of a business need end-to-end starting from understanding the requirements to deploying the software into production. This role requires you to be fluent in some of the critical technologies with proficiency in others and have a hunger to learn on the job and add value to the business. Critical attributes of being a Senior Data Engineer, among others, is Ownership & Accountability.In addition to Delivery, the Senior Data Engineer should have an automation first and continuous improvement mindset. They should drive the adoption of CI/CD tools and support the improvement of the tools sets/processes.Behaviors of a Full Stack Engineer:Senior Data Engineer is able to articulate clear business objectives aligned to technical specifications and work in an iterative, agile pattern daily. They have ownership over their work tasks, and embrace interacting with all levels of the team and raise challenges when necessary. We aim to be cutting-edge engineer – not institutionalized developers.Key Characteristics and duties you will perform:<ul><li><ul><li>Analyze source data and data flows, working with structured and unstructured data.</li><li>Build data pipelines to extract, transform, crunch and store data in various target systems</li><li>Write reference-able & modular code</li><li>Design and architect the solution independently</li><li>Have a passion to learn, Take ownership and accountability</li><li>Deep desire for automation using devops practices and toolsets</li><li>Have a desire to simplify, Be entrepreneurial / business minded</li></ul></li></ul>Skills and Experience Required:Mandatory:<ul><li>2+ years being part of Agile teams – Scrum or Kanban</li><li>2+ years of solution architecting in cloud technology (eg. AWS, Azure, google cloud)</li><li>6+ years of working in an object-oriented language: Java or Scala and Python</li><li>3+ years of working experience in Apache Spark, PySpark, Apache Airflow</li><li>3+ years of database systems like Hadoop, Teradata, Redshift, Oracle, MySQL, PostgreSQL, MongoDB, Neo4j, Cassandra</li><li>3+ years of devops tool chain: Jenkins, Maven, Artifactory, Docker, Terraform, Ansible</li><li>3+ years of experience in AWS Glue, SNS, SQS, S3, ECS, LAMBDA</li><li>2+ years of working experience with operationalizing Machine learning models</li></ul>Desired:<ul><li>Understanding of Machine learning frame works (e.g. Scikit learning, Scipy)</li><li>Understanding and 1+ yrs of working experience with Deep learning frameworks</li></ul>Education:<ul><li>Minimum degree required for position (bachelor’s degree):</li><li>Acceptable Major(s) or Field(s) of Study: Data Science, Computer Science or any related field</li></ul>Skills/Certifications/Licenses:<ul><li>Nice to have AWS solution architecture and developer certification</li><li>Nice to have data science and Machine learning certification from a reputed institution</li></ul>
#J-18808-Ljbffr

Job DescriptionEducation and Experience· Bachelor's degree in Computer Science, Data Science, Engineering, or a related field. A Master's degree or relevant certifications (e.g., Google Professional Data Engineer) is a plus.· 5+ years of experience in data engineering, with at least 2-3 years of experience in machine learning engineering or deploying ML models in production.· Proven experience in building and maintaining scalable data pipelines, data warehouses, and infrastructure to support ML workflows.Technical Skills:· Proficiency in big data frameworks and tools such as Apache Spark, Hadoop, Kafka, and Airflow.· Advanced skills in data modeling, ETL processes, and data pipeline automation, with a focus on performance and scalability.· Experience with cloud platforms (AWS, GCP, Azure) and their data services, such as AWS Glue, Google BigQuery, or Azure Data Lake.· Strong programming skills in Python, SQL, and experience with data query optimization.· Familiarity with ML frameworks (e.g., TensorFlow, PyTorch, Scikit-Learn) and libraries for building and testing machine learning models.· Knowledge of containerization and orchestration tools (Docker, Kubernetes) for deploying and managing ML models in production.Machine Learning Engineering Skills· Experience in feature engineering, data preprocessing, and building data pipelines to support ML training and inference.· Knowledge of MLOps best practices for continuous integration, deployment, and monitoring of ML models in production.· Familiarity with model lifecycle management tools such as MLflow, TFX, or Databricks to streamline ML workflows.· Strong understanding of data versioning, reproducibility, and monitoring of ML models to ensure model integrity over time.· Ability to work with structured and unstructured data, with hands-on experience in NLP, computer vision, or time-series data for machine learning applications.Data Engineering Skills:· Proficiency in data storage and warehousing solutions (e.g., Snowflake, Redshift, BigQuery) for scalable data architecture.· Understanding of data governance, quality, and security best practices, including data lineage and compliance with regulations.· Experience with data lake architecture and data partitioning strategies to support large-scale data analysis.· Ability to optimize data infrastructure for low-latency access and high throughput, especially for real-time ML applications.Communication and Collaboration Skills:· Strong communication skills with the ability to work closely with data scientists, ML engineers, and product teams to align data infrastructure with business requirements.· Collaborative mindset, with experience working in cross-functional teams to deliver end-to-end data and ML solutions.· Ability to document data workflows, pipelines, and ML infrastructure, ensuring transparency and ease of knowledge sharing.· Proven ability to understand and respond to the needs of diverse stakeholders, from technical teams to business leaders.Additional Qualifications:· Familiarity with A/B testing, experimentation frameworks, and data-driven evaluation of ML models.· Knowledge of data privacy and security regulations (e.g., GDPR, CCPA) for responsible data management and ML practices.· Experience in specific industries like Telcomunications is a plus. · Passion for staying up-to-date on the latest in data engineering, ML tools, and techniques, with a proactive approach to continuous learning.

Data Engineer Highbrow Llc Jobs

Data Engineer
December 11, 2024

Senior Data Engineer
December 11, 2024

Data Engineer
December 10, 2024

Test Data Engineer
December 8, 2024

Data Engineer
December 8, 2024

Senior Data Engineer
December 8, 2024

Data Engineer With Ml Engineering Experience
December 1, 2024

Quick filters

Top companies

Data Engineer Highbrow Llc Jobs

Data EngineerDecember 11, 2024

Senior Data EngineerDecember 11, 2024

Data EngineerDecember 10, 2024

Test Data EngineerDecember 8, 2024

Data EngineerDecember 8, 2024

Senior Data EngineerDecember 8, 2024

Data Engineer With Ml Engineering ExperienceDecember 1, 2024