About the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: <ul><li>3 days a week, hybrid</li><li>Locations: Iselin, NJ, Charlotte, NC, N Y, NY</li><li>Data Engineering 60-70 %.</li><li>Infrastructure 30-40%. (Moving Data in & Out of cloud)</li><li>Snowflake exp is preferred</li></ul><ul><li>Masters or Bachelor's degree in computer science or related discipline</li></ul><ul><li>Manage and ensure delivery of project tasks as required</li></ul><ul><li>Excellent documentation skills to create and manage design, implementation and automation related documentation</li></ul><ul><li>Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR.</li></ul><ul><li>Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc.</li></ul><ul><li>Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc.</li></ul><ul><li>Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc.</li></ul><ul><li>Must be ability to multi-task and prioritize tasks for self</li></ul><ul><li>Must experience working in agile environment with multiple priorities</li></ul> Preferred Skills: <ul> <li>5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.</li> <li>5+ year support experience of Big Data technologies in Hadoop ecosystem Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.</li> <li>5+ years experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.</li> <li>5+ years experience with Orchestration tools such as Airflow, Autosys etc.</li> <li>Experience with Jira and Agile methodology is a plus;</li> <li>Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities</li></ul> Cloud Data Platform Engineer duties: <ul> <li>Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems</li> <li>Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.</li> <li>Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.</li> <li>Identifies and documents all system constraints, implications, and consequences of various proposed system changes.</li> <li>Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.</li> <li>Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform.</li></ul>

Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join their growing team. THE COMPANYThis renowned pharmaceutical manufacturing company is conducting life-changing work in its innovative solutions for vaccines and specialty medicines. Their data & analytics practice is essential to their development and global reach! THE ROLE<ul><li>Deliver high-performing, high-impact data framework products and services</li><li>Mentor junior engineers and coordinate their work on large projects</li><li>Devise useful metrics to ensure customers' demands are met</li><li>Deliver and improve on metrics in an agile manner</li><li>Individually contribute to the role while simultaneously communicating to managers and developers about performance and projects</li></ul> YOUR SKILLS AND EXPERIENCEA successful Data Platform Engineer within this role will likely have the following skills and experience: <ul><li>5+ years' experience as a Data Engineer with a background in Software Development</li><li>Experience in writing production with programming languages (Python, Scala, Java)</li><li>Background in building data solutions and complex software and writing queries within SQL</li><li>Deep understanding in utilizing production data tools like Kafka, Spark, Airflow, and Redshift</li></ul> NICE TO HAVE<ul><li>Experience with Hadoop/Hive</li><li>GCP Certified (Data Engineer or Cloud)</li></ul> HOW TO APPLYPlease register your interest by sending your resume via the Apply link on this page.

Data Platform Engineer SaaS $180,000 - $200,000 + Equity New York, NY (three days in office) Are you a dynamic Data Engineer and want to work for one of the most innovative AI + Construction companies in the United States? If you are a senior individual contributor in the domain and can ultimately contribute cross-functionally to an all-inclusive environment, then this might be the best career move for you! THE ROLE- Data Platform Engineer As a Data Platform Engineer, you will be responsible for designing, developing, and maintaining the infrastructure that supports our client's machine learning and data-driven solutions. You'll ensure the smooth orchestration of data flow across various sources, including industry storage platforms and external APIs while implementing data quality checks and monitoring the health of the pipelines. Additionally, you will collaborate closely with the machine learning team to enhance the efficiency of the data pipelines, making a direct impact on optimizing their solutions for the construction industry. KEY RESPONSIBILITIES: <ul><li>Design, develop, and maintain a robust data pipeline infrastructure</li><li>Orchestrate data flow through various stages of processing</li><li>Ensure pipeline observability and monitor health</li><li>Integrate data from industry storage platforms, project management tools, and external APIs</li><li>Implement data quality checks and error-handling mechanisms</li><li>Collaborate with the machine learning team to enhance pipeline efficiency</li></ul> YOUR SKILLS AND EXPERIENCE: <ul><li>BS/MS in Computer Science, Information Systems, or a related field</li><li>Ample experience in ETL development and data engineering</li><li>Proficient in Python, SQL, and NoSQL databases</li><li>Experience with pipeline orchestration tools (e.g., Prefect), infrastructure-as-code (e.g., Terraform), and observability/monitoring tools</li><li>Knowledge of serverless architectures (e.g., AWS Lambda)</li><li>Familiarity with ML workflows</li><li>Knowledge of data modeling and warehouse concepts</li><li>Startup experience is strongly preferred</li></ul> BENEFITS - Data Platform Engineer As a Data Platform Engineer, you can expect to earn up to $200,000 (depending on experience), Equity, and highly competitive benefits HOW TO APPLY?: Please register your interest by sending your Resume to Greffen George via the Apply link on this page KEYWORDS: Data, Platform, Engineer, Engineering, Infrastructure, Python, SQL, NoSQL, Pipeline, Orchestration, Architecture, ML, Machine Learning, Workflows, Modeling, Warehousing, API

Data Platform Engineer Jobs in New York, NY

Senior Data Platform Engineer
November 12, 2024

Data Platform Engineer
November 10, 2024

Data Platform Engineer
November 10, 2024

Data Platform Engineer Fi Pricing Data Team
November 6, 2024

Senior Data Platform Engineer Vp
November 6, 2024

Cloud Data Platform Engineer
November 5, 2024

Senior Data Platform Engineer
October 27, 2024

Cloud Data Platform Engineer
October 27, 2024

Data Platform Engineer
October 26, 2024

Quick filters

Top companies

Data Platform Engineer Jobs in New York, NY

Senior Data Platform EngineerNovember 12, 2024

Data Platform EngineerNovember 10, 2024

Data Platform EngineerNovember 10, 2024

Data Platform Engineer Fi Pricing Data TeamNovember 6, 2024

Senior Data Platform Engineer VpNovember 6, 2024

Cloud Data Platform EngineerNovember 5, 2024

Senior Data Platform EngineerOctober 27, 2024

Cloud Data Platform EngineerOctober 27, 2024

Data Platform EngineerOctober 26, 2024

Quick filters

Top companies

Senior Data Platform Engineer
November 12, 2024

Data Platform Engineer
November 10, 2024

Data Platform Engineer
November 10, 2024

Data Platform Engineer Fi Pricing Data Team
November 6, 2024

Senior Data Platform Engineer Vp
November 6, 2024

Cloud Data Platform Engineer
November 5, 2024

Senior Data Platform Engineer
October 27, 2024

Cloud Data Platform Engineer
October 27, 2024

Data Platform Engineer
October 26, 2024