Data Engineer - AWS Glacier

US-IL-Bloomington

Job ID:  2024-38948
Type:  Regular Full Time
# of Openings:  2
Category:  Technology and UX
Bloomington, IL

Overview

We are not just offering a job but a meaningful career! Come join our passionate team!
As a Fortune 50 company, we hire the best employees to serve our customers, making us a leader in the insurance and financial services industry. State Farm embraces diversity and inclusion to ensure a workforce that is engaged, builds on the strengths and talents of all associates, and creates a Good Neighbor culture.
We offer competitive benefits and pay with the potential for an annual financial award based on both individual and enterprise performance. Our employees have an opportunity to participate in volunteer events within the community and engage in a learning culture. We offer programs to assist with tuition reimbursement, professional designations, employee development, wellness initiatives, and more!
Visit our Careers page for more information on our benefits, locations and the process of joining the State Farm team!
Responsibilities

We are excited to announce the formation of a dynamic new product team dedicated to the development and implementation of cloud-based big data solutions. We are seeking an experienced Data Engineer with a strong background in Python, Scala, and AWS services to join our team. Ideal candidates will have deep experience moving large datasets for long term storage, and record retention on Cloud/AWS. The primary purpose of this service is to facilitate data archival and retention deletion, but it will also involve transforming and ingesting legacy data. In this role you will contribute to the team by assisting in the design, development, and support of solutions on AWS. Additionally, this role will involve enhancing and resolving any defects in the products and services created by the team. The ideal candidate for this position will have a passion for continuous learning and applying new technical and business skills. A strong product mindset and the ability to thrive in an agile, fast-paced, and ever-evolving environment will greatly benefit this team.
SPONSORSHIP:  Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization now or in the future (e.g. H-1B visa) for this opportunity.
Qualifications

Required Skills:
Proven expertise in managing large-scale Big Data datasets, specifically utilizing  AWS S3 Glacier  for long-term storage,  AWS Glue  for data integration,  Apache Spark  for data processing, and  Terraform  for infrastructure as code, with hands-on experience working with terabyte-sized structured and unstructured datasets.
4+ years of professional work experience programming with  Python , focusing on data engineering and migration tasks.
2+ years of professional work experience programming with  Scala , contributing to data processing and transformation projects.
Proficient in  data analysis , with the ability to write complex queries using  Amazon Athena  to ensure data accuracy across various integration points in data pipelines, while effectively handling different data formats.
Desired Skills:
Strong  SQL  skills, with the ability to extract and manipulate data from diverse sources effectively.
Familiarity with  test-driven development  (TDD) and continuous integration/continuous deployment ( CI/CD ) practices, preferably using GitLab CI.
Proficient in utilizing  testing frameworks  such as JUnit and Cucumber to maintain high-quality software development standards.
Experience with  Containers-as-a-Service  (CaaS) architecture, enhancing application deployment and scalability.
Extensive experience in  ETL  (extract, transform, load) processes, facilitating data preparation for analytics and the deployment of production solutions across multiple platforms.
The selection process:
Qualified candidates may be invited to participate in an on demand video interview consisting of behavior based interview questions to include a coding challenge.
Our hiring team will evaluate on demand video interview submissions and competitive candidates may be invited to a live video interview with our hiring team.
SPONSORSHIP:  Applicants are required to be eligible to lawfully work in the U.S. immediately; employer  will not  sponsor applicants for U.S. work authorization (e.g. H-1B visa, OPT) for this opportunity.
HYBRID:  Qualified candidates (in or near hub locations listed below) should plan to spend time working from home and some time working in the office as part of our hybrid work environment.
HUB LOCATIONS:   Dunwoody, GA; Richardson, TX; Tempe, AZ; or Bloomington, IL
REMOTE:  Qualified candidates (outside of hub locations listed below) may be considered for 100% remote work arrangements based on where a candidate currently resides or is currently located.
For Colorado, Maryland and Washington State:  (geographic differential may apply): Salary Range: $119,750 - $152,375 | Potential yearly incentive pay up to 15% of base salary
For California, New York, and CT residents  (geographic differential may apply): Salary Range: $105,380 - $152,375 | Potential yearly incentive pay up to 125% of base salary
For Illinois, Hawaii & Vermont residents:  Salary Range: Salary Range: $90,600-$116,300 | Potential yearly incentive pay up to 15% of base salary
For Los Angeles candidates:  Pursuant to the Los Angeles Fair Chance Initiative for Hiring, we will consider for employment qualified applicants with criminal histories.
For San Francisco candidates:  Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Application deadline: 11:59 PM CDT 12/9.  Applicant volume and hiring needs may result in early closure or extension beyond the listed deadline. To submit an application, click "Apply" on the job listing page on the State Farm career site.
Competitive Benefits including:
401k Plan
Health Insurance
Dental/Vision plans
Life Insurance
Paid Time Off
Annual Merit Increases
Tuition Reimbursement
Health Initiatives
For more details visit our benefits summary page!-ca1
#LI-CA1
Please see job description

PI256229369

Senior Data Engineer Our client is looking for a Data Engineer that is willing to be hands on with their pipelines. As a Data Engineer you will also be required to support the data application teams to help design, implement and support analytical solutions. They also would prefer this candidate is very comfortable with Azure or willing to learn Azure software. Required Skills & Experience
Bachelor's degree in computer science, Computer Engineering, or Technology.
Hands-on experience in Data Engineering
8+ years of working experience in a commercial software development environment
3+ years of data analytics with SQL
2+ years of hands-on experience in Python and Spark
Desired Skills & Experience    5+ years working in an agile environment
2+ years of Azure experience
What You Will Be Doing Tech Breakdown    90% Data Engineering
10% DevOps
Daily Responsibilities    100% Hands On
The Offer You will receive the following benefits:    Medical Insurance
Dental Benefits
Vision Benefits
Paid Time Off (PTO)
401(k)

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Posted by:  Nicholas Wray

Specialization:   Python

Senior Data Engineer / BI Developer

Location: Tempe, AZ - work is hybrid so candidates MUST be local already

Start: ASAP

Contract Length: 12 months to start, likely to extend

Pay: $55.00 - $65.35 per hour (depending on experience)

Job Description:

The Senior Developer position will perform duties related to the design, build, test and deployment of analytical solutions in support of Power Generation customers. The position will perform troubleshooting, support of existing solutions, maintain databases, build requested custom analytics, data analysis, recommend solutions and provide fixes to technical issues encountered by team customers.

Education:

Completion of a Bachelor’s Degree from an accredited institution that prepares the employee for the assignment.

Experience:

The ideal candidate will:

· Possess skills in SQL, SSIS packages, Oracle, Python

· Have experience in Power BI, Tableau, and SSRS

· Write high quality code that is robust and easy to maintain.

· Have knowledge and experience with Maximo

· Build flexible systems choosing simple, straightforward solutions over more complex ones.

· Have a strong understanding of relational databases, SQL, and Oracle.

· Have strong analytical and troubleshooting skills.

· Have experience in compiling comprehensive and accurate documentation to represent design and code.

· Have experience in ETL and data engineering best practices

· Have strong customer focus and communication skills.

Pay Details: $55.00 to $65.35 per hour

Benefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, EAP program, commuter benefits and a 401K plan. Our benefit offerings provide employees the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable.

Equal Opportunity Employer/Veterans/Disabled

To read our Candidate Privacy Information Statement, which explains how we will use your information, please navigate to https://www.pdstech.com/candidate-privacy

The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:

The California Fair Chance Act

Los Angeles City Fair Chance Ordinance

Los Angeles County Fair Chance Ordinance for Employers

San Francisco Fair Chance Ordinance

Sponsorship: Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.Minimum Qualifications:<ul><li>6-7 years' work experience as a Data Engineer</li><li>Experience with AWS services such as AWS Glue, Lambda, SQS, SNS, Cloud Watch, S3, Event Bridge, RDS, EC2</li><li>Experience with various databases (e.g., AWS Redshift, AWS DynamoDB, DB2, Postgres, Oracle, MS SQL, MongoDB)</li><li>Experience or ability to rapidly gain enterprise data domain knowledge, including agency and product line data</li><li>Experience designing, developing, and deploying production applications in AWS: S3, DynamoDB, Redshift, API Gateway, Glue, Lambda, EKS, SageMaker</li><li>Ability to learn and adopt new technologies and languages</li><li>Critical thinking skills to challenge current thinking and apply the right technology to solve problems</li><li>Experience architecting and engineering data pipelines and optimizing them for performance and scalability</li><li>Experience taking initiative in shaping and driving solutions with teams and business partners</li><li>Prior work with 'legacy' type data structures</li><li>Experience with gathering and creating analytic business requirements, researching potential data sources (both internal and external sources), designing, developing, and maintaining data assets</li><li>Experience in large, complex data environments both highly coupled and highly decoupled</li><li>Comfortable communicating technical content to both technical and non-technical audiences over static documentation and live presentations</li></ul><h3>Responsibilities</h3><ul><li>Agency Analytics will be developing data products using emerging AWS technologies and capabilities.</li><li>Team responsibilities include analyzing detailed enterprise transactional data across product lines to help foster a compliant culture and promote consistency.</li><li>This is a dynamic process where new metrics and factors for consideration will continue to evolve.</li><li>The methods of evaluation will also be reviewed to ensure we are identifying and addressing new risks that may emerge.</li><li>Work closely with Enterprise Technology, other data engineers in other functions, and others on the Agency Analytics team to develop data products to support business needs.</li><li>Design analytic data asset solutions to meet Agency and enterprise needs, including focused validation and testing to ensure data is of the highest quality.</li><li>Develop, test, implement, execute, validate, and monitor logic to build and maintain data products.</li><li>Prepare and manipulate data for use in development of data analytics solutions.</li><li>Provide data pipeline solutions for the development, implementation, containerization, execution, validation, monitoring, and improvement of data analytics solutions.</li><li>Conformance with State Farm data management and governance policies.</li><li>Identify critical and emerging technologies, techniques, tools, data sources, and platforms in the data engineering field, including cloud-based solutions, that support and extend data solutions.</li><li>Drive the establishment of this new role within Agency Analytics.</li></ul>We offer competitive benefits and pay with the potential for an annual financial award based on both individual and enterprise performance. Our employees have an opportunity to participate in volunteer events within the community and engage in a learning culture. We offer programs to assist with tuition reimbursement, professional designations, employee development, wellness initiatives, and more!
#J-18808-Ljbffr

Remote - Lead Data Engineer - Neo4j

US-IL-Bloomington

Job ID:  2024-38794
Type:  Regular Full Time
# of Openings:  1
Category:  Technology and UX
Bloomington, IL

Overview

Do you crave innovation and want to work for a company that is the BEST at what they do in the industry? Does the opportunity to work remote and maintaining a work life balance appeal to you? Then we have the perfect job for you! We are seeking data engineers who push the envelope and strive to create the best product possible. This position will allow you to utilize different technologies, languages, and frameworks to drive solutions while working on inclusive teams that foster diversity of thought. You will be provided opportunities via in house training programs for upskilling to support your development and career goals!
Responsibilities

Our Enterprise Technology department is seeking an experienced Data Engineer to work on our Accountability, Interactions & Experience Measurement team. As a Data Engineer, you will play a crucial role in leveraging Customers graphs to drive data-driven decision-making in relation to customers interaction experience and digital marketing etc. Primary responsibilities will include designing, modelling, and implementing complex data structures as labelled property graphs, ensuring efficient data storage and retrieval, developing scalable solutions using graph databases, and applying graph algorithms for advanced analytics. This is an AWESOME opportunity to closely collaborate with business partners, data analysts and software engineers to transform data into actionable insights through graph technology.
Graph Development: Create and maintain graphs by modelling structured and unstructured data into graph representations, enabling efficient traversal and analysis
Data Modeling: Develop data models to define the structure and relationships within the graph, ensuring data accuracy and consistency
Graph Database Implementation/Deployment: Lead the implementation and deployment of graph databases (e.g., Neo4j, Amazon Neptune) within our infrastructure, optimizing performance and scalability
Graph Algorithms: Apply graph algorithms (e.g., PageRank, community detection, shortest path) to extract valuable insights and patterns from the knowledge graph, driving data-driven decision-making
General Data Engineering Skills: Collaborate with cross-functional teams to ingest, transform, and load data from various sources into the knowledge graph, ensuring data quality and reliability
Query Optimization: Optimize graph queries to enhance query performance and reduce response times for complex analytical tasks

Qualifications

Competitive Candidates MUST Have The Following 3 Skills:
Knowledge and working experience with Neo4j and Cypher for graph database management system. Also using Neo4j Graph Data Science Libraries.
AWS services (e.g; AWS Glue, API gateway, Lambda, SQS and SNS etc.)
Work experience as a Data Engineer in a business environment (Apache Spark, Python, ETL, SQL)
Other Skills:
Knowledgeable with CI/CD, and experience with Gitlab
Knowledgeable with infrastructure as code using Terraform
Strong business analysis, communication (both verbal and written), collaboration, and technical competence skills
Customer focused, learning agility and ability to adapt to change
Develops an understanding of product dependencies and navigates the organization to facilitate decision making, issue resolution, and continuous improvement
Participates in research and recommends appropriate solutions
____________
Join State Farm!
As a Fortune 50 company, we hire the best employees to serve our customers, making us a leader in the insurance and financial services industry. State Farm embraces diversity and inclusion to ensure a workforce that is engaged, builds on the strengths and talents of all associates, and creates a Good Neighbor culture.
We offer competitive benefits and pay with the potential for an annual financial award based on both individual and enterprise performance. Our employees have an opportunity to participate in volunteer events within the community and engage in a learning culture. We offer programs to assist with tuition reimbursement, professional designations, employee development, wellness initiatives, and more!
Visit our Careers page for more information on our benefits, locations and the process of joining the State Farm team!
REMOTE:  Qualified candidates (outside of hub locations listed below) may be considered for 100% remote work arrangements based on where a candidate currently resides or is currently located.
HYBRID:  Qualified candidates (in or near hub locations listed below) should plan to spend time working from home and some time working in the office as part of our hybrid work environment.
HUB LOCATIONS:   Dunwoody, GA; Richardson, TX; Tempe, AZ; or Bloomington, IL
SPONSORSHIP:   Applicants for this position are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity.
_________
For Los Angeles candidates: Pursuant to the Los Angeles Fair Chance Initiative for Hiring, we will consider for employment qualified applicants with criminal histories.
For San Francisco candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
For NY(state), CT, CA candidates: Potential salary range: $85,460.00- $198,750.00
For Hawaii and Vermont candidates: Potential salary range: $85,460- $168,000
For Colorado, Washington DC, Washington (state), and Maryland candidates: Compensation Range: $85,460.00-$184,800.00
Potential yearly incentive pay: up to 15% of base salary
Competitive Benefits for all states:
401k Plan
Health Insurance
Dental/Vision plans
Life Insurance
Paid Time Off
Annual Merit Increases
Tuition Reimbursement
Health Initiatives
For more details visit our benefits summary page
#LI-LG1
#LI-Remote
SFARM
Please see job description

PI255780183

Data Engineer - Analytics

US-IL-Bloomington

Job ID:  2024-38588
Type:  Regular Full Time
# of Openings:  3
Category:  Research and Data Analytics
Bloomington, IL

Overview

We are not just offering a job but a meaningful career! Come join our passionate team!
As a Fortune 50 company, we hire the best employees to serve our customers, making us a leader in the insurance and financial services industry. State Farm embraces diversity and inclusion to ensure a workforce that is engaged, builds on the strengths and talents of all associates, and creates a Good Neighbor culture.
We offer competitive benefits and pay with the potential for an annual financial award based on both individual and enterprise performance. Our employees have an opportunity to participate in volunteer events within the community and engage in a learning culture. We offer programs to assist with tuition reimbursement, professional designations, employee development, wellness initiatives, and more!
Visit our Careers page for more information on our benefits, locations and the process of joining the State Farm team!
This is a "Hybrid" position, which means selected candidates will be assigned to a facility and will spend some time working both in office and from their home.
Office Locations:
Bloomington, Illinois; Dunwoody, Georgia; Richardson, Texas; Tempe Arizona
*****Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity****
Responsibilities

P&C Actuarial and Underwriting Modeling is at the forefront of developing cutting-edge predictive models by harnessing emerging technologies and capabilities. Our focus is on creating innovative solutions that leverage the power of data. We are actively building robust data capabilities to empower our machine learning teams in constructing high-quality and efficient datasets. This enables us to accelerate the delivery of predictive models to the market.
Your contributions to our team are invaluable as we strive to enable data-driven decision-making in the cloud. You will play a crucial role in exploring new and groundbreaking services, as well as devising creative solutions. Our aim is to establish a single, seamless data retrieval ML platform, providing a streamlined experience for our data scientists.
As a member of P&C Actuarial and Underwriting Modeling, you will find yourself continually challenged and empowered to grow professionally. We strongly believe in fostering the development of each engineer to their fullest potential. Our supportive environment and focus on personal growth will enable you to excel in your role and make a significant impact on our team's success.
Qualifications

Required Skills:
Possess a strong engineering background with a keen interest in data.
Hands-on experience with AWS, demonstrating proficiency in leveraging its services.
Proficiency in object-oriented and/or functional programming languages such as Python, Java/Scala, and Terraform.
Experience working with big data technologies such as Spark and Hadoop.
Familiarity with various file formats, including csv, parquet, json, xml, and avro.
Understanding of testing strategies and frameworks.
Hands-on experience building CI/CD pipelines, preferably with GitLab.
Preferred Skills:
Understanding of machine learning lifecycle, and including the role of data at each stage.
Experience working with AWS SageMaker, Glue, EMR, Athena, RDS, Redshift, Lambdas, and IAM.
Prior exposure to property & casualty insurance data, providing you with domain knowledge.
*****Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity****
Please see job description

PI255458211

NO H1b Candidate required Job Description: Data Engineer Responsibilities<ul><li>Design, build, and maintain scalable, reliable data pipelines and systems to support data ingestion, transformation, and storage.</li><li>Develop and optimize ETL (Extract, Transform, Load) processes to handle large datasets efficiently.</li><li>Collaborate with data scientists, analysts, and software engineers to implement robust data solutions.</li><li>Implement and manage databases, data warehouses, and data lakes (e.g., Redshift, Snowflake, BigQuery).</li><li>Create and maintain data architecture documentation and workflows.</li><li>Monitor and troubleshoot performance and data-related issues.</li><li>Ensure data quality and governance by implementing validation mechanisms and compliance standards.</li><li>Work with cloud-based platforms (AWS, Azure, GCP) for data processing and storage.</li><li>Drive continuous improvement in data engineering practices and processes.</li></ul>QualificationsRequired Skills<ul><li>Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent work experience).</li><li>3+ years of experience as a Data Engineer or in a similar role.</li><li>Strong experience with SQL and relational databases.</li><li>Proficiency in programming languages such as Python, Java, or Scala.</li><li>Experience building and optimizing ETL pipelines and workflows.</li><li>Familiarity with big data technologies like Hadoop, Spark, or Kafka.</li><li>Knowledge of cloud-based data services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow).</li><li>Strong understanding of data modeling, data warehousing, and data lakes.</li><li>Hands-on experience with data visualization tools (e.g., Tableau, Power BI).</li></ul>Preferred Skills<ul><li>Experience with containerization and orchestration tools like Docker and Kubernetes.</li><li>Familiarity with real-time data processing.</li><li>Experience with CI/CD pipelines for data engineering.</li><li>Knowledge of data governance and compliance (e.g., GDPR, CCPA).</li><li>Certification in cloud technologies like AWS Certified Data Analytics, Azure Data Engineer, or GCP Data Engineer.</li></ul>

Data Engineer Jobs in Tempe, AZ

Data Engineer Aws Glacier
December 14, 2024

Senior Data Engineer
December 14, 2024

Senior Data Engineer Bi Developer
December 14, 2024

Aws Data Engineer
December 11, 2024

Remote Lead Data Engineer Neo4J
December 9, 2024

Data Engineer Analytics
November 28, 2024

Data Engineer
November 24, 2024

Quick filters

Top companies

Data Engineer Jobs in Tempe, AZ

Data Engineer Aws GlacierDecember 14, 2024

Senior Data EngineerDecember 14, 2024

Senior Data Engineer Bi DeveloperDecember 14, 2024

Aws Data EngineerDecember 11, 2024

Remote Lead Data Engineer Neo4JDecember 9, 2024

Data Engineer AnalyticsNovember 28, 2024

Data EngineerNovember 24, 2024