Our client, a US Fortune 250 company and a global Medical technology corporation serving customers in Clinical Labs, Health care research & Pharmaceutical industry, seeks an Lead Cloud Data Engineer_______________________________________________ NOTE: THIS IS REMOTE ROLE & ONLY W2 CANDIDATES (NO C2C/1099) *** Candidate must be authorized to work in USA without requiring sponsorship *** Position Title – Lead Cloud Data Engineer (Job ID – CFNJP00049660)Location: San Diego CA 92130 (100% Remote acceptable)Duration: 6 months Contract to Hire__________________________________________________________ As the Senior Engineer, you will lead a team of data engineers in designing, building, and maintaining high-performance software system to manage analytical data pipelines that fuel the organization’s data strategy using software engineering best practices. Beyond technical expertise, you will also serve as a change leader, guiding teams through adopting new tools, technologies, and workflows to improve data management and processing. This position requires extensive hands-on data system design and coding experience, as well as the development of modern data pipelines (AWS Step functions, Prefect, Airflow, Luigi, Python, Spark, SQL) and associated code in AWS. You will work closely with stakeholders across the business to understand their data needs, ensure scalability, and foster a culture of innovation and learning within the data engineering team and beyond. Key Responsibilities: <ul><li>Be responsible for the overall architecture of a specific module within a product (e.g., Data-ingestion, near-real-time-data-processor, etc.), perform design and assist implementation considering system characteristics to produce optimal performance, reliability and maintainability.</li><li>Provide technical guidance to team members, ensuring they are working towards the product's architectural goals.</li><li>Create and manage RFCs (Request for Comments) and ADRs (Architecture Decision Records), Design notes and technical documentation for your module, following the architecture governance processes.</li><li>Lead a team of data engineers, providing mentorship, setting priorities, and ensuring alignment with business goals.</li><li>Architect, design, and build scalable data pipelines for processing large volumes of structured and unstructured data from various sources.</li><li>Collaborate with software engineers, architects, and product teams to design and implement systems that enable real-time and batch data processing at scale.</li><li>Be the go-to person for PySpark-based solutions, ensuring optimal performance and reliability for distributed data processing.</li><li>Ensure that data engineering systems adhere to the best data security, privacy, and governance practices in line with industry standards.</li><li>Perform code reviews for the product, ensuring adherence to company coding standards and best practices.</li><li>Develop and implement monitoring and alerting systems to ensure timely detection and resolution of data pipeline failures and performance bottlenecks.</li><li>Act as a champion for new technologies, helping ease transitions and addressing concerns or resistance from team members.</li></ul> Ideal Candidate: <ul><li>Experience leading a data engineering team with a strong focus on software engineering principles such as KISS, DRY, YAGNI etc.</li><li>Candidate MUST have experience in owning large, complex system architecture and hands-on experience designing and implementing data pipelines across large-scale systems.</li><li>Experience implementing and optimizing data pipelines with AWS is a must.</li><li>Production delivery experience in Cloud-based PaaS Big Data related technologies (EMR, Snowflake, Data bricks etc.)</li><li>Experienced in multiple Cloud PaaS persistence technologies, and in-depth knowledge of cloud- based ETL offerings and orchestration technologies (AWS Step Function, Airflow etc.)</li><li>Experienced in stream-based and batch processing, applying modern technologies</li><li>Working experience with distributed file systems (S3, HDFC, ADLS), table formats (HUDI, Iceberg), and various open file formats (JSON, Parquet, Csv, etc.)</li><li>Strong programming experience in PySpark, SQL, Python, etc.</li><li>Database design skills including normalization/de-normalization and data warehouse design</li><li>Knowledge and understanding of relevant legal and regulatory requirements, such as SOX, PCI, HIPAA, Data Protection</li><li>Experience in the healthcare industry, a plus</li><li>A collaborative and informative mentality is a must!</li></ul> Toolset: <ul><li>AWS, preferably AWS certified Data Engineer and AWS certified Solutions Architect.</li><li>Proficiency in at least one programming language C#, GoLang, JavaScript or ReactJs</li><li>Spark / Python / SQL</li><li>Snowflake/ Databricks / Synapse / MS SQL Server</li><li>ETL / Orchestration Tools (Step Function, DBT etc.)</li><li>ML / Notebooks</li></ul> Education and experience required <ul><li>Bachelors or Master’s in Computer Science, Information Systems, or an engineering field or relevant experience.</li><li>10+ years of related experience in developing data solutions and data movement.</li></ul> ________________________________________________ If you're looking for rewarding employment and a company that puts its employees first, we'd like to work with you. We're driven, people driven. Bhupesh KhuranaSenior Technical RecruiterEmail: bkhurana@ameritconsulting.com Amerit Consulting is an extremely fast-growing staffing and consulting firm. Amerit Consulting was founded in 2002 to provide consulting, temporary staffing, direct hire, and payrolling services to Fortune 500 companies nationally; as well as small to mid-sized organizations on a local & regional level. Currently, Amerit has over 2,000 employees in 47 states. We develop and implement solutions that help our clients operate more efficiently, deliver greater customer satisfaction, and see a positive impact on their bottom line. We create value by bringing together the right people to achieve results. Our clients and employees say they choose to work with Amerit because of how we work with them - with service that exceeds their expectations and a personal commitment to their success. Our deep expertise in human capital management has fueled our expansion into direct hire placements, temporary staffing, contract placements, and additional staffing and consulting services that propel our clients’ businesses forward. Amerit Consulting provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.Applicants, with criminal histories, are considered in a manner that is consistent with local, state and federal laws.

The Data Engineer - REMOTE provides operational support for the coordination and execution of data extraction activities from all source systems and lines of business to machine readable formats. They will also implement processes and methods to improve data quality. This position requires the ability to effectively collaborate within his/her own department and across broad parts of the organization. Rush Enterprises, Inc. opens the door to the world of opportunity. We are a part of the largest network of commercial vehicle dealerships in North America representing truck and trailer manufacturers. Our franchises include Peterbilt, International, Hino, Isuzu, Ford, IC Bus and Blue Bird. We offer a rewarding career as a leader in the transportation industry. Grow with us as we continue to expand our network of locations and services. Responsibilities:<ul><li>Responsible for gathering information requirements, developing domain data glossaries, , and enforcement of policy to ensure master data is compliant with defined quality requirements within the assigned domain.</li><li>Responsible for build and maintenance of the Extract and Load of data from source to target</li><li>Maintain data quality and metadata processes, adhere to all of data quality rules, thresholds, and standard metrics/quality expectations for data elements that support critical business processes.</li><li>Profiles and reviews statistical analysis and assessment of data to determine effectiveness of data quality controls and metadata capture so as to identify improvement opportunities.</li><li>Perform impact analysis of regulatory, business, and system changes to respective data domains and relevant data governance policies and procedures.</li><li>Responsible for building and sustaining the day-to-day relationships and communications with business partners at various levels of the organization, including Data Steward(s), Line of Business stakeholders, other team members, as well as other internal and external resources.</li><li>Participate in regular Data Analytics team, project, and leadership meetings as needed.</li><li>Development of program artifacts for data analytics including compliance with existing enterprise policies and standards.</li><li>Promote participation and buy-in from business areas for data governance activities.</li><li>Monitor adherence to Data Governance policies and standards, drive continuous improvement, manage non-compliance issue escalations, and provide training and communication.</li></ul> Benefits:<ul><li>We offer exceptional compensation and benefits, 401K and stock purchase, incentives for performance, training, and opportunity for advancement - all in a culture that appreciates and rewards excellence, a positive attitude and integrity.</li></ul> Basic Qualifications:<ul><li>2-5 years of combined experience and knowledge in: data engineering, data extraction, data governance, data management, data quality, data profiling, business analysis/requirements gathering, query/report writing.</li><li>Bachelor's degree preferred.</li><li>Experience with SAP Business Objects, Information Steward, Data Services, or Data Intelligence preferred.</li><li>Experience with SQL extraction both cloud or on-prem, SSIS, Azure SQL extraction and/or Data Factory preferred.</li><li>Knowledge of Data Governance / Data Quality processes and procedures.</li><li>Capable of performing conflict resolution and skilled in problem solving</li></ul> Equal Opportunity Employer Minorities/Women/Protected Veterans/Disabled This job posting does not state or imply that these are the only duties to be performed by this employee. The employee will be required to follow any other instructions and to perform any other duties requested by their leader.

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments. We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at <a>experianplc.com </a>Job Description We are thrilled to announce that NeuroID has been acquired by Experian, a global leader in identity verification and fraud prevention. Experian's solutions helped clients avoid an estimated $15 billion in fraud losses last year. Since 2023, NeuroID has partnered with Experian to provide the latest behavioral analytics, combating identity theft and advanced fraud attacks. Now, as part of Experian's CrossCore® on the Experian Ascend Technology Platform™, we continue to lead the charge in proactive fraud detection and seamless user experiences. Be part of a team that's pioneering the future of fraud prevention! Qualifications NeuroID is looking for a Senior Data Engineer to manage and transform our data pipeline. We are a Snowflake and DBT shop with lots of semi-structured data. The job combines aspects of both product and research so there are several projects and operational aspects of the job. NeuroID detects fraud by analyzing how people type data on web forms and mobile apps (how cool is that?). We are powered by data, and you will be at the heart of what we do. You will report to NeuroID's Chief Data Science Officer, and is remote in the US. You Will: <ul><li>Handle the daily management of data pipeline using DBT</li><li>Implement changes to Snowflake guided by product changes and research needs</li><li>Monitor and make changes to manage pipeline costs</li><li>Troubleshoot and resolve data, system, and performance issues</li></ul>Experience <ul><li>3+ years of experience as a Data/Analytics Engineer using DBT</li><li>DBT experience should include working with semi-structured data, custom macros, incremental models, and job scheduling</li><li>Experience working with Snowflake or other cloud data warehouses. Understand clones, pipes, external stages and optimizing queries.</li><li>Terraform, Python, and AWS experience is strongly preferred</li><li>Very comfortable with modern SQL (cte, window functions)</li><li>Bachelor's Degree in Data Science / Analytics, Computer Science, Information Systems, or Math or an equivalent combination of education and experience</li></ul>Benefits/Perks: <ul><li>Great compensation package and bonus plan</li><li>Core benefits including medical, dental, vision, and matching 401K</li><li>Flexible work environment, ability to work remote, hybrid or in-office</li><li>Flexible time off including volunteer time off, vacation, sick and 12-paid holidays </li></ul>Additional Information Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why. Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Data Engineer Jobs in North Philadelphia, PA

Lead Cloud Data Engineer 100 Remoteno C2C
November 6, 2024

Data Engineer Remote
October 24, 2024

Data Engineer Remote
October 24, 2024

Quick filters

Top companies

Data Engineer Jobs in North Philadelphia, PA

Lead Cloud Data Engineer 100 Remoteno C2CNovember 6, 2024

Data Engineer RemoteOctober 24, 2024

Data Engineer RemoteOctober 24, 2024

Quick filters

Top companies

Lead Cloud Data Engineer 100 Remoteno C2C
November 6, 2024

Data Engineer Remote
October 24, 2024

Data Engineer Remote
October 24, 2024