For Earth For Life

BASIC PURPOSE AND SCOPE OF POSITION

The Data Engineer is responsible for designing and building systems for the purpose of collecting, validating, and preparing high quality data. This role strives to make data easily accessible to optimize Kubota's big data ecosystem.

PRINCIPAL ACTIVITIES: This position does the following in accordance with all applicable Federal, State and local laws / regulations and the Company's policies, procedures and guidelines:

Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Experience in application development using Python or Java.
Create and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Design and develop data pipelines using Python, Spark and AWS technologies.
Experience with Distributed data/computing tools Spark, Kafka etc.
Develop and maintain data models to support data analysis and reporting.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Additional duties assigned by management
MINIMUM QUALIFICATIONS     Bachelor's Degree in Computer Science, Software Engineering, Information Technology or related field required.
5 years of Data, BI or related experience required.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow.
Strong analytical skills, problem solving and strategic thinking.
EQUIPMENT OPERATION (% of time, description, nature of service):
Office equipment including computer, copier, fax, phone, printer

PHYSICAL REQUIREMENTS:
Typical office environment.

ADDITIONAL INFORMATION:
This position is a great learning opportunity, as the successful candidate will be cross trained on a wide range of Treasury functions.

DISCLAIMER:

The information provided in the description has been designed to indicate the general nature and level of work performed by incumbents within the classification. This description is not intended to be a comprehensive inventory of all duties, responsibilities, qualifications and working conditions required of employees assigned to this job/classification. This job is intended to include the current essential functions of the job. Management reserves the right to add or modify the duties and responsibilities and to designate other functions as essential at any time.

Kubota is an equal opportunity at will employer and does not discriminate against any employee or applicant for employment because of age, race, religion, color, disability, sex, sexual orientation or national origin.

Other details    Job Family Non-Warehouse Exempt
Pay Type Salary
Employment Indicator Telecommuting Eligible
Travel Required Yes
Travel % 10
Required Education Bachelor's Degree

Apply Now

11 West 19th Street (22008), United States of America, New York, New YorkSenior Data Engineer (Remote Eligible)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you''ll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you''ll have the opportunity to be on the forefront of driving a major transformation within Capital One. What You''ll Do:Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in distributed microservices, and full stack systemsUtilize programming languages like Java, Go, Scala, Python and Open Source RDBMS and NoSQL databases and AWS as our main cloud service providerShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance''Capital One is open to hiring a Remote Employee for this opportunity.'' Basic Qualifications: Bachelor''s Degree At least 4 years of experience in application development (Internship experience does not apply)At least 1 year of experience in big data technologies Preferred Qualifications: 5+ years of experience in application development including Java, Python, SQL, or Scala2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)2+ year experience working on real-time data and streaming applications 2+ years of experience with NoSQL implementation (Mongo, Cassandra) 3+ years of experience with UNIX/Linux including basic commands and shell scripting2+ years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position.No agencies please. Capital One is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex, race, color, age, national origin, religion, physical and mental disability, genetic information, marital status, sexual orientation, gender identity/assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by applicable national, federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City''s Fair Chance Act; Philadelphia''s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at [Click Here to Email Your Resum]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One''s recruiting process, please send an email to [Click Here to Email Your Resum]Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Job DescriptionCompany Description “We’re not in the shipping business; we’re in the information business” -Peter Rose, Expeditors FounderGlobal supply chain management is what we do, but at the heart of Expeditors you will find professionalism, leadership, and a friendly environment, all of which foster an innovative, customer service-based approach to logistics.<ul><li>15,000 trained professionals</li><li>250+ locations worldwide</li><li>Fortune 500</li><li>Globally unified systems</li></ul>Job Description As a Senior Data Engineer, you will play a pivotal role in our agile analytics team, leading the design, development, and optimization of complex data infrastructure and pipelines. Your expertise will be crucial in delivering high-impact reporting, analytics, and machine learning solutions that drive business success. You will leverage your extensive experience to not only build and maintain critical data systems but also to mentor and guide junior engineers, ensuring the seamless translation of intricate business requirements into robust and scalable data solutions.This position is for a role within GEO-IS Data Platforms Product Development team. This team supports our entire GEO-IS Solutions data infrastructure.Successful candidates must understand or be able to translate complex business requirements into scalable and trusted data pipelines and models. At the core, a successful Senior Data Engineer will excel at the following:<ol><li>Serve as the subject matter expert for data and systems.</li><li>Design, develop, and maintain scalable data pipelines and models, driving architecture and best practices for high performance.</li><li>Identify and lead data quality improvements, standardizing and enriching data to solve complex challenges and provide insights.</li><li>Collaborate with cross-functional teams to enhance data models and support advanced BI and analytics.</li><li>Mentor junior data engineers, lead code reviews, and promote best practices and skill development.</li><li>Optimize data pipelines for performance and scalability while staying updated on industry trends and technologies.</li></ol>Major Duties and Responsibilities<ul><li>Translate complex business needs into aligned data models and architecture.</li><li>Design and implement scalable, high-performance data pipelines and models.</li><li>Optimize data infrastructure to meet evolving business and tech needs.</li><li>Monitor and enhance data pipelines for performance and integrity.</li><li>Lead testing and troubleshooting for complex data issues.</li><li>Drive data quality initiatives and enforce standards.</li><li>Manage version control, backups, and disaster recovery with rigorous documentation.</li><li>Create and maintain up-to-date technical documentation.</li><li>Document and communicate data lineage and governance.</li><li>Establish and promote best practices for data pipeline and model development.</li><li>Train and mentor end-users on data models and business logic.</li><li>Refine data models in collaboration with stakeholders for optimal performance.</li><li>Support agile practices and maintain current work management systems.</li></ul>Qualifications Minimum Qualifications<ul><li>Bachelor's degree in an IT-related field or equivalent experience, with at least 5-7 years of progressive experience in data engineering.</li><li>Extensive expertise in schema design, dimensional data modeling, and data warehousing, including experience with cloud-based platforms (e.g., AWS, Azure, Google Cloud).</li><li>Proven ability to lead and collaborate effectively with cross-functional development teams, including stakeholders and executive leadership.</li><li>Demonstrated capability to independently manage and prioritize complex projects, driving team commitments and meeting strategic objectives.</li><li>Expert-level proficiency in writing, optimizing, and troubleshooting complex SQL queries across multiple databases.</li><li>Advanced skills in data processing and manipulation using programming such as Python, with a focus on developing scalable data solutions.</li><li>Experience with on-prem data engineering tools such as dbt core.</li><li>Proven track record in automating complex data tasks and workflows, with experience in designing and implementing automation frameworks.</li></ul>Desired Qualifications<ul><li>Master’s degree or higher in Computer Science, Data Engineering, or a related field.</li><li>Relevant certifications in cloud platforms (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer, Microsoft Azure Data Engineer Associate).</li><li>Proven experience in migrating data infrastructures from on-premises to cloud environments, including strategy development, execution, and post-migration optimization.</li><li>Experience with big data technologies such as PySpark or Kafka for processing and analyzing large-scale datasets.</li><li>Experience with modern data warehousing solutions (e.g., Azure Synapse, Databricks) and their integration with BI tools.</li><li>Knowledge of data governance, data privacy regulations (e.g., GDPR, CCPA), and best practices for ensuring data security and compliance.</li><li>Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes) for deploying and managing data pipelines in a CI/CD environment.</li><li>Proficiency with advanced ETL (Extract, Transform, Load) tools and frameworks (e.g., Apache NiFi, Talend).</li><li>Experience with managing and optimizing MS SQL Server environments (e.g., advanced T-SQL, performance tuning, linked servers, proactive maintenance).</li></ul> Additional Information The annual salary for this position is between $130,000 to $160,000.Position is full time (40 hours per week) Monday through Friday (in office). We are an office business attire company.Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not transfer or sponsor applicants for U.S. work authorization (such as an H-1B visa) for this opportunity.Expeditors offers excellent benefits:<ul><li>Paid Vacation, Holiday, Sick Time</li><li>Health Plan: Medical, Prescription Drug, Dental and Vision</li><li>Life and Long Term Insurance</li><li>401(k) Retirement Savings Plan (US only)</li><li>Employee Stock Purchase Plan</li><li>Training and Personnel Development Program</li></ul>All your information will be kept confidential according to EEO guidelines.
#J-18808-Ljbffr

Automotive Financial Group is a values-centric, technology-first company seeking a Senior Data Engineer with development experience in Big Data, leveraging cloud computing services to manage, process, and analyze large amounts of data from disparate data sources. We are looking for a high energy, team-oriented self-starter that demonstrates adept problem-solving skills and can collaborate in a fast-paced agile development environment. Automotive Financial Group is looking for a high-trust, highly collaborative team member capable of delivering extraordinary results and accelerating speed to market. Founded in 1994, on the premise of delivering superior service, Automotive Financial Group has been on a mission to improve the automotive industry by developing people and building a company based on values that dealerships and contract holders can trust. Our tech team includes some of the best data scientists, technology experts, industry subject matter experts, and system integrators, working together to build custom business intelligence solutions for our partner customers. Are you a person who loves new challenges, embodies integrity, care, and trust, while looking for a company willing to invest in you? Are you looking for growth & stability in today’s not so stable environment? Then Automotive Financial Group is the place for you! Position Summary: The Senior Data Engineer works on the Data Engineering team. This team is responsible for delivering a big data platform, large-scale data pipelines, and streaming systems in the cloud. You’ll also be responsible for assisting in developing strategies to improve this process's efficiency over time. Duties and Responsibilities:<ol><li>Constructs business-facing datasets from a variety of sources, internal and external, to enable and perform analysis based on requests from project teams or senior leadership.</li><li>Breaks down business opportunities to identify business facing datasets to align to organizational needs through a business perspective appropriately.</li><li>Integrates data from multiple data sources or functional areas, evaluates data quality and transforms data as needed.</li><li>Analyzes and interprets data to identify business trends, conduct root cause analysis of business problems, or suggest areas for process improvement.</li><li>Growth-oriented mindset with a strong desire to learn and stay current on best practices and emerging capabilities to analyze data.</li><li>Collaborates with cross-functional teams to extract, transform, and load (ETL) data according to requirements and design. Identify, recommend, and implement ETL process and architecture improvements.</li><li>Good knowledge with data collection methods, data models, types, and will own the transformation process.</li><li>Owns the Data warehousing process from end-to-end.</li></ol> Qualifications:<ol><li>Bachelor’s degree or equivalent years of experience.</li><li>5-7+ years of experience of hands-on data engineering experience.</li><li>Strong understanding of AWS data services such as S3, DynamoDB, RDS, Kinesis, Redshift, Glue, Athena.</li><li>Strong programming skills in Python, C#, or a language for processing data – preferred.</li><li>Proficiency in SQL and NoSQL databases.</li><li>Knowledge of data governance and data security best practices.</li><li>Experience with big data and the understanding of how to organize it using industry standards.</li><li>Strong communication and problem-solving skills.</li><li>Experience with infrastructure-as-code tools such as Terraform.</li><li>Familiarity with DevOps methodologies and tools such as Git, AWS Codepipeline, and Containerization.</li><li>Strong understanding of networking, security, and PII governance concepts.</li><li>Experience in the automotive industry (TPAs/DMS/CAS systems) is a plus.</li><li>Experience in an Agile/Waterfall team preferred.</li></ol> Benefits offered:<ol><li>Professional Development.</li><li>Health/Dental/Vision insurance.</li><li>Company provided Life Insurance & Short-Term Disability.</li><li>Nine Paid Holidays.</li><li>Weekends off.</li><li>Paid Time off.</li><li>Company 'Happy Hours', Birthday, and Holiday Celebrations.</li></ol>
#J-18808-Ljbffr

“We’re not in the shipping business; we’re in the information business” -Peter Rose, Expeditors FounderGlobal supply chain management is what we do, but at the heart of Expeditors you will find professionalism, leadership, and a friendly environment, all of which foster an innovative, customer service-based approach to logistics.<ul><li>15,000 trained professionals</li><li>250+ locations worldwide</li><li>Globally unified systems</li></ul><h3>Job Description</h3>As a Senior Data Engineer, you will play a pivotal role in our agile analytics team, leading the design, development, and optimization of complex data infrastructure and pipelines. Your expertise will be crucial in delivering high-impact reporting, analytics, and machine learning solutions that drive business success. You will leverage your extensive experience to build and maintain critical data systems and mentor junior engineers, ensuring the seamless translation of intricate business requirements into robust and scalable data solutions.This position is for a role within GEO-IS Data Platforms Product Development team. This team supports our entire GEO-IS Solutions data infrastructure.Successful candidates must understand or be able to translate complex business requirements into scalable and trusted data pipelines and models. At the core, a successful Senior Data Engineer will excel at the following:<ol><li>Serve as the subject matter expert for data and systems.</li><li>Design, develop, and maintain scalable data pipelines and models, driving architecture and best practices for high performance.</li><li>Identify and lead data quality improvements, standardizing and enriching data to solve complex challenges and provide insights.</li><li>Collaborate with cross-functional teams to enhance data models and support advanced BI and analytics.</li><li>Mentor junior data engineers, lead code reviews, and promote best practices and skill development.</li><li>Optimize data pipelines for performance and scalability while staying updated on industry trends and technologies.</li></ol><h3>Qualifications</h3>Minimum QualificationsBachelor's degree in an IT-related field or equivalent experience, with at least 5-7 years of progressive experience in data engineering.Extensive expertise in schema design, dimensional data modeling, and data warehousing, including experience with cloud-based platforms (e.g., AWS, Azure, Google Cloud).Proven ability to lead and collaborate effectively with cross-functional development teams, including stakeholders and executive leadership.Demonstrated capability to independently manage and prioritize complex projects, driving team commitments and meeting strategic objectives.Expert-level proficiency in writing, optimizing, and troubleshooting complex SQL queries across multiple databases.Advanced skills in data processing and manipulation using programming languages such as Python, with a focus on developing scalable data solutions.Experience with on-prem data engineering tools such as dbt core.Proven track record in automating complex data tasks and workflows, with experience in designing and implementing automation frameworks.Desired QualificationsMaster’s degree or higher in Computer Science, Data Engineering, or a related field.Relevant certifications in cloud platforms (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer, Microsoft Azure Data Engineer Associate).Proven experience in migrating data infrastructures from on-premises to cloud environments, including strategy development, execution, and post-migration optimization.Experience with big data technologies such as PySpark or Kafka for processing and analyzing large-scale datasets.Experience with modern data warehousing solutions (e.g., Azure Synapse, Databricks) and their integration with BI tools.Knowledge of data governance, data privacy regulations (e.g., GDPR, CCPA), and best practices for ensuring data security and compliance.Familiarity with DevOps practices and tools (e.g., Docker, Kubernetes) for deploying and managing data pipelines in a CI/CD environment.Proficiency with advanced ETL (Extract, Transform, Load) tools and frameworks (e.g., Apache NiFi, Talend).Experience with managing and optimizing MS SQL Server environments (e.g., advanced T-SQL, performance tuning, linked servers, proactive maintenance).<h3>Additional Information</h3>The annual salary for this position is between $130,000 to $160,000.Position is full time (40 hours per week) Monday through Friday (in office). We are an office business attire company.Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not transfer or sponsor applicants for U.S. work authorization (such as an H-1B visa) for this opportunity.Expeditors offers excellent benefits:<ul><li>Paid Vacation, Holiday, Sick Time</li><li>Health Plan: Medical, Prescription Drug, Dental and Vision</li><li>Life and Long-Term Disability Insurance</li><li>401(k) Retirement Savings Plan (US only)</li><li>Employee Stock Purchase Plan</li><li>Training and Personnel Development Program</li></ul>All your information will be kept confidential according to EEO guidelines.
#J-18808-Ljbffr

Data Engineer Jobs in Grapevine, TX

Data Engineer Sales Operations Reporting
December 14, 2024

Senior Data Engineer Remote Eligible
December 13, 2024

Senior Data Engineer
December 10, 2024

Senior Data Engineer
December 9, 2024

Senior Data Engineer
December 8, 2024

Lead Data Engineer Remoteeligible
November 24, 2024

Senior Data Engineer
November 24, 2024

Senior Data Engineer Principal Associate
November 24, 2024

Senior Data Engineer Remote Eligible
November 24, 2024

Quick filters

Top companies

Data Engineer Jobs in Grapevine, TX

Data Engineer Sales Operations ReportingDecember 14, 2024

Senior Data Engineer Remote EligibleDecember 13, 2024

Senior Data EngineerDecember 10, 2024

Senior Data EngineerDecember 9, 2024

Senior Data EngineerDecember 8, 2024

Lead Data Engineer RemoteeligibleNovember 24, 2024

Senior Data EngineerNovember 24, 2024

Senior Data Engineer Principal AssociateNovember 24, 2024

Senior Data Engineer Remote EligibleNovember 24, 2024