Senior Data Platform EngineerFully Remote9-Month Contract$75-$100/hr It's time to utilize your skills in software and data engineering to drive scientific and technological life-changing solutions within the pharmaceutical industry. This global company is seeking an individual who is ready to combine their data ops experience with their software to join their growing team. THE COMPANYThis renowned pharmaceutical manufacturing company is conducting life-changing work in its innovative solutions for vaccines and specialty medicines. Their data & analytics practice is essential to their development and global reach! THE ROLE<ul><li>Deliver high-performing, high-impact data framework products and services</li><li>Mentor junior engineers and coordinate their work on large projects</li><li>Devise useful metrics to ensure customers' demands are met</li><li>Deliver and improve on metrics in an agile manner</li><li>Individually contribute to the role while simultaneously communicating to managers and developers about performance and projects</li></ul> YOUR SKILLS AND EXPERIENCEA successful Data Platform Engineer within this role will likely have the following skills and experience: <ul><li>5+ years' experience as a Data Engineer with a background in Software Development</li><li>Experience in writing production with programming languages (Python, Scala, Java)</li><li>Background in building data solutions and complex software and writing queries within SQL</li><li>Deep understanding in utilizing production data tools like Kafka, Spark, Airflow, and Redshift</li></ul> NICE TO HAVE<ul><li>Experience with Hadoop/Hive</li><li>GCP Certified (Data Engineer or Cloud)</li></ul> HOW TO APPLYPlease register your interest by sending your resume via the Apply link on this page.

Data Platform Engineer SaaS $180,000 - $200,000 + Equity New York, NY (three days in office) Are you a dynamic Data Engineer and want to work for one of the most innovative AI + Construction companies in the United States? If you are a senior individual contributor in the domain and can ultimately contribute cross-functionally to an all-inclusive environment, then this might be the best career move for you! THE ROLE- Data Platform Engineer As a Data Platform Engineer, you will be responsible for designing, developing, and maintaining the infrastructure that supports our client's machine learning and data-driven solutions. You'll ensure the smooth orchestration of data flow across various sources, including industry storage platforms and external APIs while implementing data quality checks and monitoring the health of the pipelines. Additionally, you will collaborate closely with the machine learning team to enhance the efficiency of the data pipelines, making a direct impact on optimizing their solutions for the construction industry. KEY RESPONSIBILITIES: <ul><li>Design, develop, and maintain a robust data pipeline infrastructure</li><li>Orchestrate data flow through various stages of processing</li><li>Ensure pipeline observability and monitor health</li><li>Integrate data from industry storage platforms, project management tools, and external APIs</li><li>Implement data quality checks and error-handling mechanisms</li><li>Collaborate with the machine learning team to enhance pipeline efficiency</li></ul> YOUR SKILLS AND EXPERIENCE: <ul><li>BS/MS in Computer Science, Information Systems, or a related field</li><li>Ample experience in ETL development and data engineering</li><li>Proficient in Python, SQL, and NoSQL databases</li><li>Experience with pipeline orchestration tools (e.g., Prefect), infrastructure-as-code (e.g., Terraform), and observability/monitoring tools</li><li>Knowledge of serverless architectures (e.g., AWS Lambda)</li><li>Familiarity with ML workflows</li><li>Knowledge of data modeling and warehouse concepts</li><li>Startup experience is strongly preferred</li></ul> BENEFITS - Data Platform Engineer As a Data Platform Engineer, you can expect to earn up to $200,000 (depending on experience), Equity, and highly competitive benefits HOW TO APPLY?: Please register your interest by sending your Resume to Greffen George via the Apply link on this page KEYWORDS: Data, Platform, Engineer, Engineering, Infrastructure, Python, SQL, NoSQL, Pipeline, Orchestration, Architecture, ML, Machine Learning, Workflows, Modeling, Warehousing, API

About the job Cloud Data Platform Engineer Cloud Data Platform Engineer needs 5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. 5+ year support experience of Big Cloud Data Platform Engineer requires: <ul> <li>3 days a week, hybrid </li><li>Locations: Iselin, NJ, Charlotte, NC, N Y, NY </li><li>Data Engineering 60-70 %. </li><li>Infrastructure 30-40%. (Moving Data in & Out of cloud) </li><li>Snowflake exp is preferred </li></ul> <ul><li>Masters or Bachelor's degree in computer science or related discipline </li></ul> <ul><li>Manage and ensure delivery of project tasks as required </li></ul> <ul><li>Excellent documentation skills to create and manage design, implementation and automation related documentation </li></ul> <ul><li>Implementation experience for Hadoop distribution platforms like Cloudera or AWS EMR. </li></ul> <ul><li>Extensive experience in designing, engineering and managing data lake ingestion, validation, transformation and consumption services leveraging cloud data tools like Hive, Spark, EMR, Glue ETL and Catalog, Snowflake etc. </li></ul> <ul><li>Experience on implementing solutions with Worflow orchestration/scheduling tools such as Airflow, Autosys etc. </li></ul> <ul><li>Experience building CI/CD pipelines for infrastructure implementations with Teraform, Gitlab etc. </li></ul> <ul><li>Must be ability to multi-task and prioritize tasks for self </li></ul> <ul><li>Must experience working in agile environment with multiple priorities </li></ul>Preferred Skills: <ul> <li>5+ years implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc.</li> <li>5+ year support experience of Big Data technologies in Hadoop ecosystem Hive, HDFS, MapReduce, Spark, Yarn, Kafka, Pig, HBase, Sqoop, Elastic Search, Kerberos.</li> <li>5+ years experience with ETL/ELT tools such as AWS Glue ETL, Talend, Datastage etc.</li> <li>5+ years experience with Orchestration tools such as Airflow, Autosys etc.</li> <li>Experience with Jira and Agile methodology is a plus;</li> <li>Experience with understanding DevOps or CI/CD process w.r.t to infrastructure management activities </li></ul>Cloud Data Platform Engineer duties: <ul> <li>Design, develop and deliver cloud datastore solutions and develop automation pipelines to migrate data sets from On-prem to Cloud platforms. Practice Infrastructure as code to develop automation routines and integration flows to manage state of the datastore platform systems</li> <li>Provision secures from start datastores and enable them with required security controls including encryption, masking, certificate/keys rotation etc.</li> <li>Collaborates with developers, analysts, various system administrators to identify business requirements in designing efficient datastore solutions and interfaces.</li> <li>Identifies and documents all system constraints, implications, and consequences of various proposed system changes.</li> <li>Reviews technical documentation to guide system users and to assist with the ongoing operation, maintenance, and development of the system. Evaluates the efficiency and effectiveness of application operations and troubleshooting problems.</li> <li>Provide expert level IT technical lead services, including the direction, evaluation, selection, configuration, implementation, and integration of new and existing technologies and tools in a cloud platform. </li> </ul>

Data Platform Engineer SaaS $180,000 - $200,000 + Equity New York, NY (three days in office) Are you a dynamic Data Engineer and want to work for one of the most innovative AI + Construction companies in the United States? If you are a senior individual contributor in the domain and can ultimately contribute cross-functionally to an all-inclusive environment, then this might be the best career move for you! THE ROLE– Data Platform Engineer As a Data Platform Engineer, you will be responsible for designing, developing, and maintaining the infrastructure that supports our client's machine learning and data-driven solutions. You’ll ensure the smooth orchestration of data flow across various sources, including industry storage platforms and external APIs while implementing data quality checks and monitoring the health of the pipelines. Additionally, you will collaborate closely with the machine learning team to enhance the efficiency of the data pipelines, making a direct impact on optimizing their solutions for the construction industry. KEY RESPONSIBILITIES:<ul><li>Design, develop, and maintain a robust data pipeline infrastructure</li><li>Orchestrate data flow through various stages of processing</li><li>Ensure pipeline observability and monitor health</li><li>Integrate data from industry storage platforms, project management tools, and external APIs</li><li>Implement data quality checks and error-handling mechanisms</li><li>Collaborate with the machine learning team to enhance pipeline efficiency</li></ul> YOUR SKILLS AND EXPERIENCE:<ul><li>BS/MS in Computer Science, Information Systems, or a related field</li><li>Ample experience in ETL development and data engineering</li><li>Proficient in Python, SQL, and NoSQL databases</li><li>Experience with pipeline orchestration tools (e.g., Prefect), infrastructure-as-code (e.g., Terraform), and observability/monitoring tools</li><li>Knowledge of serverless architectures (e.g., AWS Lambda)</li><li>Familiarity with ML workflows</li><li>Knowledge of data modeling and warehouse concepts</li><li>Startup experience is strongly preferred </li></ul> BENEFITS – Data Platform EngineerAs a Data Platform Engineer, you can expect to earn up to $200,000 (depending on experience), Equity, and highly competitive benefits HOW TO APPLY?:Please register your interest by sending your Resume to Greffen George via the Apply link on this page KEYWORDS:Data, Platform, Engineer, Engineering, Infrastructure, Python, SQL, NoSQL, Pipeline, Orchestration, Architecture, ML, Machine Learning, Workflows, Modeling, Warehousing, API

Bloombergs Evaluated Pricing service, BVAL, supplies independent and transparent evaluated pricing daily for over 2.5 million securities across all fixed income asset classes, including thinly-traded and hard-to-price fixed income securities. Our customers rely on us to understand markets and analyze complex structures which allow them to make thoughtful investment decisions, which ultimately builds more value for you, the investor. The value of retirement accounts, pension funds, etc, are measured against our data. Our mission is to drive greater transparency, liquidity and safety in global fixed income markets. To produce this pricing data, we absorb billions of data points from hundreds of financial markets every day using highly scalable and fault tolerant streaming technology (think Kafka, Redis, Argo, Flink, Hadoop). We pipe this data through pricing algorithms which employ quantitative and machine learning techniques derived by working closely with market experts. This process produces the high quality pricing that the market and our customers need. We also develop applications that provide intelligent analytics and transparency into these prices. **How we give back:** This team will make extensive use of open source software. As part of that, we make a commitment to upstreaming features we'll be developing. Whether pushing bug-fixes upstream, developing new features, giving presentations at conferences and meetups, or collaborating with industry leaders, open source will be at the heart of this team. It's not just something we do in our free time, it is how we work. **What's in it for you:** You will help the platform grow by bringing on new datasets and enhancing tooling for onboarding new datasets quickly. You'll be able to apply your existing knowledge while gaining experience from working with specialists in stream processing, data lake technologies, query engines and more. You'll help achieve the vision of the team Accelerate usage of data within Fixed Income Pricing`. **Well trust you to:** + Design and implement new features and tools following software development best practices + Work with team members and other engineering teams to design scalable and robust systems + Proactively recommend and contribute improvements to the platform + Work with a variety of technologies to develop innovative solutions **Youll need to have:** + 4+ years working with an object-oriented programming language (C/C++, Python, Java, etc.) + A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience + Experience working with any Big Data technologies from storing of data at large scale, to processing of data at large scale. + Strong software development skills and ability to quickly learn **We would love to see experience with or passion for:** + Experience with Big data streaming technologies like Spark, Flink etc. + Experience with Lake house technologies like Iceberg, Delta Lake, Hudi etc. + Experience with Data governance, Data Observability & Distributed systems **Check out some of Fixed Income Pricings content:** + A walkthrough of the FI Pricing Organization - https://mediaspace.blpvideohub.com/playlist/dedicated/515/0_u18tu5tl/0_llibwm5h + The FI Pricing Documentation Hub - http://bburl/fipricingdoc + The FI Pricing ELRN Channel https://mediaspace.blpvideohub.com/channel/FI+Pricing/515 + {SHOW 12003921 } If interested, please apply! To learn more, please contact {FON Shalin Shah} directly or our Internal Mobility Partner, {FON Isaac Moran}. Salary: 160000,240000,USD,AnnualBloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law. Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email amer_recruit@bloomberg.net

We're Celonis, the global leader in Process Mining technology and one of the world's fastest-growing SaaS firms. We believe there is a massive opportunity to unlock productivity by placing data and intelligence at the core of business processes - and for that, we need you to join us. The Team: The Cloud Platform and Infrastructure Engineering team provides the foundation to run our core product in the cloud. We operate our services using different cloud providers, hosted in many regions across the world, running 24/7. The scale of our environment provides us with many interesting engineering challenges that we love to solve and optimize for future growth. The Role: You'll be part of a distributed team across Europe and the US and responsible for the architecture of our growing data services infrastructure, which powers our cloud products. You will collaborate closely with the development teams as well as our cloud platform teams to define and drive the future architecture. As we are growing rapidly, this offers unique challenges and a great experience for even the most seasoned engineers. While you have a good understanding of data persistence and messaging technologies, your core expertise is in the realm of RDBMS systems, specifically PostgreSQL. You will provide advice to the teams on the optimal usage and on pitfalls to avoid, and help junior engineers to level up their expertise. While the role is strategic in nature, you will also have the ability to step in and support hands-on where the team needs you. The work you'll do: <ul><li>Design and manage the PostgreSQL infrastructure for a large scale cloud environment.</li><li>Build out our observability capabilities to provide DevOps teams insight into their consumption details. </li><li>Collaborate with development teams and stakeholders.</li><li>Drive architectural initiatives that evolve our environments.</li><li>Provide advice and guidance to data service consumer teams and junior engineers. </li></ul> The qualifications you need: <ul><li>Bachelor's degree in information systems, information technology, computer science, or similar.</li><li>6+ years in managing RDBMS databases at a large scale.</li><li>2+ years experience with PostgreSQL.</li><li>In-depth knowledge of Structured Query Language (SQL) and SQL statement performance tuning.</li><li>Sound knowledge of best practices in database administration and modeling and data security.</li><li>Strong organizational skills and attention to detail.</li><li>Exceptional problem-solving and critical thinking skills.</li><li>Excellent collaboration and communication skills.</li></ul> Visa sponsorship is not offered for this role. The base salary range below is for the role in the specified location, based on a Full Time Schedule. Total compensation package will include base salary + bonus/commission + equity + benefits (health, dental, life, 401k, and paid time off). Please note that the base salary range is a guideline, and that the actual total compensation offer will be determined based on various factors, including, but not limited to, applicant's qualifications, skills, experiences, and location. The base salary range below is for the role in New York, based on a Full Time Schedule. $192,000-$234,000 USD What Celonis can offer you: <ul><li>The unique opportunity to work with industry-leading process mining technology</li><li>Investment in your personal growth and skill development (clear career paths, internal mobility opportunities, L&D platform, mentorships, and more)</li><li>Great compensation and benefits packages (equity (restricted stock units), life insurance, time off, generous leave for new parents from day one, and more). For intern and working student benefits, click here.</li><li>Physical and mental well-being support (subsidized gym membership, access to counseling, virtual events on well-being topics, and more)</li><li>A global and growing team of Celonauts from diverse backgrounds to learn from and work with</li><li>An open-minded culture with innovative, autonomous teams</li><li>Business Resource Groups to help you feel connected, valued and seen (Black@Celonis, Women@Celonis, Parents@Celonis, Pride@Celonis, Resilience@Celonis, and more)</li><li>A clear set of company values that guide everything we do: Live for Customer Value, The Best Team Wins, We Own It, and Earth Is Our Future</li></ul> About Us Since 2011, Celonis has helped thousands of the world's largest and most valued companies deliver immediate cash impact, radically improve customer experience and reduce carbon emissions. Its Process Intelligence platform uses industry-leading process mining technology and AI to present companies with a living digital twin of their end-to-end processes. For the first time, everyone in an organisation has a common language about how the business works, visibility into where value is hidden and the ability to capture it. Celonis is headquartered in Munich (Germany) and New York (USA) and has more than 20 offices worldwide. Get familiar with the Celonis Process Intelligence Platform by watching this video. Join us as we make processes work for people, companies and the planet. Celonis is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Different makes us better. Accessibility and Candidate Notices

Data Platform Engineer Jobs in New York, NY

Senior Data Platform Engineer
October 27, 2024

Cloud Data Platform Engineer
October 27, 2024

Data Platform Engineer
October 26, 2024

Cloud Data Platform Engineer
October 22, 2024

Data Platform Engineer
October 20, 2024

Data Platform Engineer Fi Pricing Data Team
October 19, 2024

Data Platform Engineer Enterprise Architecture
October 14, 2024

Staff Data Platform Engineer
October 6, 2024

Quick filters

Top companies

Data Platform Engineer Jobs in New York, NY

Senior Data Platform EngineerOctober 27, 2024

Cloud Data Platform EngineerOctober 27, 2024

Data Platform EngineerOctober 26, 2024

Cloud Data Platform EngineerOctober 22, 2024

Data Platform EngineerOctober 20, 2024

Data Platform Engineer Fi Pricing Data TeamOctober 19, 2024

Data Platform Engineer Enterprise ArchitectureOctober 14, 2024

Staff Data Platform EngineerOctober 6, 2024