Resp & Qualifications

PURPOSE:

The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on leading the development of solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company. This is a hands-on admin position and not a developer position.

ESSENTIAL FUNCTIONS:

Lead the team to design, configure, implement, monitor, and manage all aspects of Data Integration Framework. Defines and develop the Data Integration best practices for the data management environment of optimal performance and reliability.

Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using Hadoop or equivalent MapReduce platform.

Provides detailed guidance and performs work related to Modeling Data Warehouse solutions in the cloud OR on-premise. Understands Dimensional Modeling, De-normalized Data Structures, OLAP, and Data Warehousing concepts.

Oversees the delivery of engineering data initiatives and projects. Supports long term data initiatives as well as Ad-Hoc analysis and ELT/ETL activities. Creates data collection frameworks for structured and unstructured data. Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.

Enforces the implementation of best practices for data auditing, scalability, reliability and application performance. Develop and apply data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.

Interprets data, analyzes results using statistical techniques, and provides ongoing reports. Executes quantitative analyses that translate data into actionable insights. Provides analytical and data-driven decision-making support for key projects. Designs, manages, and conducts quality control procedures for data sets using data from multiple systems.

Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.

SUPERVISORY RESPONSIBILITY:

Position does not have direct reports but is expected to assist in guiding and mentoring less experienced staff. May lead a team of matrixed resources.

QUALIFICATIONS:

Education Level:  Bachelor's Degree in Computer Science, Information Technology or Engineering or related field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.

Experience:  8 years' Experience in leading data engineering and cross functional team to implement scalable and fine-tuned ETL/ELT solutions for optimal performance. Experience developing and updating ETL/ELT scripts. Hands-on experience with application development, relational database layout, development, data modeling.

Preferred Qualifications:

At least 6 years of Experienced with leading a team of 5 or more team members.

Experienced with managing the project of migration or infrastructure build without supervisor.

Lead the team to design, configure, implement, monitor, and manage all aspects of Data Integration Framework.

Defines and develop the Data Integration best practices for the data management environment of optimal performance and reliability.

At least 8 years of Experienced with all the hands-on tasks involved in administration of ETL Tool (Ab Initio).

At least 8 years of Experienced with hands-on with Advance knowledge of Ab Initio Graphical Development Environment (GDE), Meta Data Hub, Operational Console.

Experience with Ab Initio, EMR, S3, Dynamo DB, Mongo DB, ProgreSQL, RDS, DB2.

Created Big Data pipelines (ETL) from on-premise to Data Factories, Data Lakes, and Cloud Storage such as EBS or S3.

DevOps (CI/CD Pipeline).

Experience with Advance knowledge of UNIX and SQL.

Experience with manage metadata hub-MDH, Operational Console and troubleshoot environmental issues which affect these components.

Experience with scripting and automation such as design and develop automated ETL process and architecture and unit testing of the ETL code.

Strongly demonstrated knowledge of DB2.

Experience with working on the break fix and continuous development items, review, and inspection for the production changes.

Perform the code review for the ETL code developed by the development team and guide to resolve an issue.

Service Oriented Architecture (SOA) knowledge and demonstrated knowledge and best practices of testing environments and processes.

Demonstrated experience working in an Enterprise environment with crossed team interaction and collaboration and policies.

Strong testing skills.

Excellent problem-solving skills.

Strong analytical skills.

Excellent verbal and written communications skills.

Familiar with structured programming techniques.

Knowledge, Skills and Abilities (KSAs)

Knowledge and understanding of at least one programming language (i.e., SQL, NoSQL, Python).

Knowledge and understanding of database design and implementation concepts.

Knowledge and understanding of data exchange formats.

Knowledge and understanding of data movement concepts.

Strong technical and analytical and problem-solving skills to troubleshoot to solve a variety of problems.

Requires strong organizational and communication skills, written and verbal, with the ability to handle multiple priorities.

Able to effectively provide direction to and lead technical teams.

Must be able to meet established deadlines and handle multiple customer service demands from internal and external customers, within set expectations for service excellence. Must be able to effectively communicate and provide positive customer service to every internal and external customer, including customers who may be demanding or otherwise challenging.

Salary Range:  $108,936 - $216,359

Salary Range Disclaimer

The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the work is being performed. This compensation range is specific and considers factors such as (but not limited to) the scope and responsibilites of the position, the candidate's work experience, education/training, internal peer equity, and market and business consideration. It is not typical for an individual to be hired at the top of the range, as compensation decisions depend on each case's facts and circumstances, including but not limited to experience, internal equity, and location. In addition to your compensation, CareFirst offers a comprehensive benefits package, various incentive programs/plans, and 401k contribution programs/plans (all benefits/incentives are subject to eligibility requirements).

Department

Informatics Database Administration

Equal Employment Opportunity

CareFirst BlueCross BlueShield is an Equal Opportunity (EEO) employer. It is the policy of the Company to provide equal employment opportunities to all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information.

Where To Apply

Please visit our website to apply: www.carefirst.com/careers

Federal Disc/Physical Demand

Note: The incumbent is required to immediately disclose any debarment, exclusion, or other event that makes him/her ineligible to perform work directly or indirectly on Federal health care programs.

PHYSICAL DEMANDS:

The associate is primarily seated while performing the duties of the position. Occasional walking or standing is required. The hands are regularly used to write, type, key and handle or feel small controls and objects. The associate must frequently talk and hear. Weights up to 25 pounds are occasionally lifted.

Sponsorship in US

Must be eligible to work in the U.S. without Sponsorship

#LI-ZW1

REQNUMBER: 20816

Resp & Qualifications

PURPOSE:

This is an administrator role and not a developer role.  The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premises infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on leading the development of solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.

ESSENTIAL FUNCTIONS:

Lead the team to design, configure, implement, monitor, and manage all aspects of Data Integration Framework. Defines and develop the Data Integration best practices for the data management environment of optimal performance and reliability.

Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using Hadoop or equivalent MapReduce platform.

Provides detailed guidance and performs work related to Modeling Data Warehouse solutions in the cloud OR on-premises. Understands Dimensional Modeling, De-normalized Data Structures, OLAP, and Data Warehousing concepts.

Oversees the delivery of engineering data initiatives and projects. Supports long term data initiatives as well as Ad-Hoc analysis and ELT/ETL activities. Creates data collection frameworks for structured and unstructured data. Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.

Enforces the implementation of best practices for data auditing, scalability, reliability and application performance. Develop and apply data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.

Interprets data, analyzes results using statistical techniques, and provides ongoing reports. Executes quantitative analyses that translate data into actionable insights. Provides analytical and data-driven decision-making support for key projects. Designs, manages, and conducts quality control procedures for data sets using data from multiple systems.

Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.

QUALIFICATIONS:

Education Level:  Bachelor's degree in computer science, Information Technology or Engineering or related field OR in lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.

Experience:  8 years' Experience in leading data engineering and cross functional team to implement scalable and fine-tuned ETL/ELT solutions for optimal performance. Experience developing and updating ETL/ELT scripts. Hands-on experience with application development, relational database layout, development, data modeling.

Preferred Qualifications:

Advanced (expert preferred) level experience in administrating and engineering relational databases (ex. MySQL, PostgreSQL, Mongo DB, RDS, DB2), Big Data systems (ex. Cloudera Data Platform Private Cloud and Public Cloud), automation tools (ex. Ansible, Terraform, Bit Bucket) and experience working cloud solutions (specifically data products on AWS) are necessary.

Require prior experience with AWS Cloud.

At least 10 years of Experienced with all the tasks involved in administration of ETL Tool (Ab Initio)

At least 10 years of Experienced with Advance knowledge of Ab Initio Graphical Development Environment (GDE), Meta Data Hub, Operational Console

Created Big Data pipelines (ETL) from on-premises to Data Factories, Data Lakes, and Cloud Storage such as EBS or S3.

Experience with Advance knowledge of UNIX, Linux, Shell scripting and SQL.

Experience working and troubleshooting issues related to Hive, ICFF, HDFS.

Experience with manage metadata hub-MDH, Operational Console and troubleshoot environmental issues which affect these components

Experience with scripting and automation such as design and develop automated ETL process and architecture and unit testing of the ETL code

Troubleshoot potential issues with Kerberos, TLS/SSL, Models, and Experiments, as well as other workload issues that data scientists might encounter once the application is running.

Strong knowledge of Cloudera (Hadoop, HDFS, YARN, Hive, Spark) administration and management.

Hands-on experience with AWS services (EC2, S3, RDS, VPC, IAM, etc.).

Familiarity with scripting languages (Python, Shell, etc.)

Experience with CI/CD tools (Jenkins, GitLab CI, etc.).

Understanding of containerization technologies (Docker, Kubernetes) is a plus.

Strongly demonstrated knowledge of DB2

Represents team in all architectural and design discussions. Knowledgeable in the end-to-end process and able to act as an SME providing credible feedback and input in all impacted areas. Require tracking and monitoring projects and tasks as the lead.

Knowledge, Skills and Abilities (KSAs)

Knowledge and understanding of at least one programming language (i.e., SQL, NoSQL, Python).

Knowledge and understanding of database design and implementation concepts.

Knowledge and understanding of data exchange formats.

Knowledge and understanding of data movement concepts.

Strong technical and analytical and problem-solving skills to troubleshoot to solve a variety of problems.

Requires strong organizational and communication skills, written and verbal, with the ability to handle multiple priorities.

Able to effectively provide direction to and lead technical teams., Expert  Salary Range  : $108,936 - $216,359

Salary Range Disclaimer

The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the work is being performed. This compensation range is specific and considers factors such as (but not limited to) the scope and responsibilites of the position, the candidate's work experience, education/training, internal peer equity, and market and business consideration. It is not typical for an individual to be hired at the top of the range, as compensation decisions depend on each case's facts and circumstances, including but not limited to experience, internal equity, and location. In addition to your compensation, CareFirst offers a comprehensive benefits package, various incentive programs/plans, and 401k contribution programs/plans (all benefits/incentives are subject to eligibility requirements).

Department

Informatics Database Administrator

Equal Employment Opportunity

CareFirst BlueCross BlueShield is an Equal Opportunity (EEO) employer. It is the policy of the Company to provide equal employment opportunities to all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veteran or disabled status, or genetic information.

Where To Apply

Please visit our website to apply: www.carefirst.com/careers

Federal Disc/Physical Demand

Note: The incumbent is required to immediately disclose any debarment, exclusion, or other event that makes him/her ineligible to perform work directly or indirectly on health care programs.

PHYSICAL DEMANDS:

The associate is primarily seated while performing the duties of the position. Occasional walking or standing is required. The hands are regularly used to write, type, key and handle or feel small controls and objects. The associate must frequently talk and hear. Weights up to 25 pounds are occasionally lifted.

Sponsorship in US

Must be eligible to work in the U.S. without Sponsorship.

#LI-KT1

REQNUMBER: 20636

About Blue Cross and Blue Shield of Minnesota

At Blue Cross and Blue Shield of Minnesota, we are committed to paving the way for everyone to achieve their healthiest life. We are looking for dedicated and motivated individuals who share our vision of transforming health care. As a Blue Cross associate, you are joining a culture that is built on values of succeeding together, finding a better way, and doing the right thing. If you are ready to make a difference, join us.

How Is This Role Important to Our Work?
This position is responsible for providing technical and resource leadership to enable data analytics with structured and unstructured data. Responsibilities includes leading or executing user story development, data design and architecture, data integration development, testing or BI application delivery in the data analytics framework including surrounding enablement environments. This lead senior role will collaborate and/or partner with business areas, project teams, IT technical teams, as well as outsourced vendors to ensure high quality delivery of data architecture and data integration applications focusing on business analytical enablement for medium to large project or support efforts.
A Day in the Life:   As a technical expert, leads creation and review of highly complex data solutions enforcing best practices, processes and standards for user story development, data analysis, architecture, modeling, design, coding, testing, deployment and scheduling.
Advocates for the broad education and understanding of the corporate data strategy within the department and enterprise including varying levels of leadership within the organization as needed seeking collaborative opportunities as appropriate.
Leads or oversees the execution of the data management lifecycle to enable business data analytics.
Performing lead functions (e.g., providing work direction, monitoring work, providing feedback, coaching/mentoring as needed).
Design and develop prototypes or final data solutions to enable the measurement or monitoring of key performance indicators.
Responsible for identifying and/or making significant improvement enhancements to existing artifacts to align with enterprise strategy or to improve user experience.
Ensure test environment and data readiness is appropriate for support and project deliverables.
Accountable for complex test cases in interdependent enterprise systems based on system requirements and technical design documentation, using automation to the fullest extent.
Execution and maintenance of manual and/or automated test cases and scripts, as assigned.
Analyzes test results and documents defects and issues using the Incident Management Process.
Nice to Have:   Bachelor's degree.
Practical and relevant experience with two or more data warehouse and big data technical tools
Experience with storage, ETL/ELT processes and orchestration with AWS Cloud Technologies
Teradata, Informatica, Wherescape Red, Power experience with Agile/Scrum project methodology
Knowledge of the health care/health insurance industry
Working knowledge of UNIX environment including shell scripting and scheduler (ideally StoneBranch)
Required Skills and Experiences:   5+ years of related professional experience. All relevant experience including work, education, transferable skills, and military experience will be considered.
Experience developing medium complex data integration solutions using two or more of data management software tools.
Experienced knowledge in data analysis using SQL, user story development, data warehouse design and modeling (3rd normal form or dimensional modeling), data integration design and development and/or performance tuning.
Knowledgeable in data warehouse market best practices, development standards and methodologies.
Demonstrated ability and willingness to play multiple roles for different projects, e.g., planning/architecting and overseeing development for some projects, being a hands-on technical resource for others.
Not only leading and working on strategic and tactical projects, but also understand the importance of details and remaining hands-on to data applications/solution business enablement.
Experienced in work estimation, design review and code review.
Strong skills in cross team coordination for project execution and issue resolution, as well as working with contracting vendor onsite and offshore.
Demonstrated oral/written communication and presentation skills to effectively communicate medium complexity technical information.
Demonstrated ability to influence, motivate and lead teams with diverse cultural and professional background.
Experience in mentoring and coaching junior developers in problem solving and critical thinking efforts.
Compensation and Benefits:
Pay Range:  $100,000.00 - $135,000.00 - $170,000.00 Annual
Pay is based on several factors which vary based on position, including skills, ability, and knowledge the selected individual is bringing to the specific job.
We offer a comprehensive benefits package which may include:
Medical, dental, and vision insurance
Life insurance
401k
Paid Time Off (PTO)
Volunteer Paid Time Off (VPTO)
And more

To discover more about what we have to offer, please review our benefits page.
Equal Employment Opportunity Statement

Blue Cross is an Equal Opportunity and Affirmative Action employer that values diversity. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on race, color, creed, religion, sex, national origin, genetic information, marital status, status with regard to public assistance, disability, age, veteran status, sexual orientation, gender identity, gender expression, or any other legally protected characteristic.

Reasonable Accommodation for Job Seekers with a Disability: If you require reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to talent.acquisition@bluecrossmn.com.

All roles require a high school diploma (or equivalency) and legal authorization to work in the U.S.

Blue Cross and Blue Shield of Minnesota and Blue Plus are nonprofit independent licensees of the Blue Cross and Blue Shield Association.

Data Engineer Blue Cross Blue Shield Association Jobs

Search for Job title, position, company and/or location…

Lead Data Engineer Ab Initio Hybrid
March 11, 2025

Lead Data Engineer Ab Initio Administrator Hybrid
February 25, 2025

Senior Lead Data Engineer
February 25, 2025

Quick filters

Top companies