Job Title: Azure Data Engineer (Databricks & Data Lakehouse Specialist) Location: Fully Remote Employment Type: Permanent, Full-Time Are you a data-driven professional with a passion for building and optimising cloud-based data solutions? Do you have a knack for designing seamless ETL processes and working with Azure’s cutting-edge data tools? Join us as an Azure Data Engineer and become a key player in a fully remote team committed to building a robust data lakehouse environment using Azure Databricks.This is an exciting opportunity to get hands-on with Azure data engineering while contributing to a large-scale AWS to Azure migration program. If you’re ready to innovate and build resilient data systems in the cloud, we want to hear from you! What You’ll Be Doing as the Azure Data Engineer:<ul><li>Design & Build Data Pipelines: Create and maintain ETL/ELT pipelines to ingest, cleanse, and transform data from multiple sources, using Azure Databricks, Azure Data Factory, and more.</li><li>Develop Azure Data Lakehouse: Set up and manage the data lakehouse environment on Azure, optimising it for analytics and supporting both structured and unstructured data.</li><li>AWS to Azure Migration: Be a pivotal part of the migration program, helping to transfer and transform data assets from AWS S3 and Redshift to Azure Data Lake Storage and Synapse.</li><li>Ensure Data Quality & Governance: Implement data quality checks, ensure regulatory compliance, and support data governance practices.</li><li>Optimise for Performance: Monitor and fine-tune data pipelines, cluster management, and data storage to ensure optimal performance and scalability.</li></ul> What We’re Looking For from our Azure Data Engineer:<ul><li>Azure Data Expertise: Proficiency in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Delta Lake.</li><li>Databricks & Spark: Experience with Databricks notebooks, Spark, and Delta Lake for data transformation and analytics.</li><li>ETL/ELT Skills: Strong background in building ETL/ELT workflows, with knowledge of Python, SQL, and Spark SQL.</li><li>Cloud Migration Experience is advantageous: Direct experience with AWS to Azure data migrations, including data replication and re-platforming strategies.</li><li>Data Quality & Governance: Familiarity with data validation techniques and security standards within cloud environments.</li><li>Collaboration & Communication: A team player who can translate technical concepts for stakeholders and collaborate effectively with data analysts and data scientists.</li></ul> Ready to take the next step in your data engineering career? Apply today and join a team that’s transforming data infrastructure in the cloud!

BI Engineer (Azure, Python, SQL) Location: Birmingham (4 days a week on-site)Salary: £45k - £48k Opportunity A fantastic opportunity has come up to work for a genuine market leader in an exciting and innovative industry. They plan to build a newly created BI and Data Engineering division to work alongside other Data and Analytics teams across the group. For this role, they need someone to serve as a central resource from within their Strategy and Analytics department, also working with, but not exclusive to, the Commercial, Finance, and Operational business functions, to help advance the group’s data infrastructure and support in transforming data into actionable insights and triggered events for Business Intelligence (BI) and Customer Relationship Management (CRM) system purposes. This role will be instrumental in leveraging data to ensure a fully integrated approach to data-driven decision-making and also business strategy. Day-to-day tasks <ul><li>Work across the group and with the devisions data partners to leverage all available data, building out the groups database, reporting and insights capabilities to enable data-led decision making.</li><li>Design, develop and maintain scalable, user-friendly and automated systems, data solutions and reporting that will support our analytical and business needs.</li><li>Support the insight team with visualisations, reporting and stakeholder engagement through monthly/quarterly/annual departmental reviews</li><li>Use data science/statistical modelling tools in collaboration with the analyst team and departmental stakeholders to develop Artificial Intelligence (AI) and Machine Learning (ML) functions and analytics.</li><li>Create and manage a knowledge-base, including documentation of your designs (e.g., system design, functional design, data flow design) ensuring there is version control and contingency processes for all aspects.</li></ul> Required skills and experience for the role <ul><li>Demonstrable experience or certification(s) within the field of data engineering, data science, and/or business analysis.</li><li>Practical experience of database design and data transformation, supported by ETL processing.</li><li>Managing data pipelines & orchestration that enable the transfer and processing of data. (Databricks, Microsoft Fabric, Alteryx. Snowflake, Apache)</li><li>Coding and programming, capable of working through complex problems with others from the team, adapting quickly to changing market trends and business needs. (SQL, Python or R)</li><li>Utilising cloud-based services and corresponding toolsets. (Microsoft Azure, GCP, AWS or similar).</li><li>Comfortable handling structured and unstructured data, from 1st, 2nd, and 3rd party data sources, combining multiple data sets, to produce a cohesive picture of performance and derive insights and recommendations.</li><li>Experience working directly with business stakeholders ensuring complex information is articulated in a meaningful way.</li></ul> Applying for the opportunity If you feel you have the required skills and experience and want to be considered for this opportunity, please forward an up-to-date version of your CV. If we feel your profile is a suitable match, someone will contact you within 48 hours.

The ideal candidate is a self-motivated, multi-tasker, and demonstrated team-player. You will be a Data Engineer responsible for the development of new software products and enhancements to existing products. You should excel in working with large-scale applications and frameworks and have outstanding communication and leadership skills. You’ll be responsible for:<ul><li>Producing high quality, maintainable code</li><li>Supporting in the design and development of complex software solutions</li><li>Partnering effectively with client project teams</li><li>A natural ability to mentor junior developers</li></ul> You’ll have:<ul><li>Very good hands-on experience in Java and OOP.</li><li>Should be hands on using Spark and Big Data technologies.</li><li>Experience with Maven/Gradle and or Spring</li><li>Experienced in SQL (we use SyBase and single store DB’s primarily)</li><li>Has worked on Data Pipelines previously and is familiar with the basic concepts</li><li>Familiar with building REST APIs</li><li>Should be used to Git/JIRA</li><li>Experience with debugging, exception handling, logging best practices etc</li><li>Enterprise coding ability</li><li>Experience writing unit and integration tests</li></ul> It would be great if you have experience in:<ul><li>Kafka</li><li>Single store experience</li><li>Cryptography experience</li><li>Authorisation/authentication experience</li><li>Parquet files</li><li>DB session management, transaction handling etc</li><li>TDD or BDD experience</li></ul>

About the job Senior Data Engineer Are you self-motivated with an innovative mind, a passion for technology, and a good understanding of object orientated development? Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients’ toughest technology problems, and a commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence. The ideal candidate is a self-motivated, multi-tasker, and demonstrated team-player. You will be a Data Engineer responsible for the development of new software products and enhancements to existing products. You should excel in working with large-scale applications and frameworks and have outstanding communication and leadership skills. You’ll be responsible for:<ul><li>Producing high quality, maintainable code</li><li>Supporting in the design and development of complex software solutions</li><li>Partnering effectively with client project teams</li><li>A natural ability to mentor junior developers</li></ul> You’ll have:<ul><li>Very good hands-on experience in Java and OOP.</li><li>Should be hands on using Spark and Big Data technologies.</li><li>Experience with Maven/Gradle and or Spring</li><li>Experienced in SQL (we use SyBase and single store DB’s primarily)</li><li>Has worked on Data Pipelines previously and is familiar with the basic concepts</li><li>Familiar with building REST APIs</li><li>Should be used to Git/JIRA</li><li>Experience with debugging, exception handling, logging best practices etc</li><li>Enterprise coding ability</li><li>Experience writing unit and integration tests</li></ul> It would be great if you have experience in:<ul><li>Kafka</li><li>Single store experience</li><li>Cryptography experience</li><li>Authorisation/authentication experience</li><li>Parquet files</li><li>DB session management, transaction handling etc</li><li>TDD or BDD experience</li></ul> We’re committed to providing our people with a great environment to work in. You can expect ongoing skills-based development, career progression as well as health & well-being benefits and support. You’ll work within a friendly and supportive team, working on a variety of projects and the chance to obtain relevant certifications along the way! We also offer:<ul><li>Up to 10% bonus (based on company and personal performance).</li><li>An employer pension scheme</li><li>25 days holiday + 8 bank holidays, with the option to carry forward or 'cash-in' 5 days each year</li><li>Access to YuLife wellness platform, subscription to Meditopia App, premium subscription to Fiit, life coaching & emotional wellbeing sessions, 24 / 7 virtual GP Access, Employee Assistance Programme</li><li>Life Insurance & Income protection</li><li>Enhanced Maternity Pay & Paternity Pay</li><li>Cycle to work scheme</li><li>Travel loan scheme</li><li>A Tech Scheme which lets you choose from over 5000 tech products at up to a 12% discount</li><li>Free unlimited Udemy account for every employee to support their continuous learning and improvement</li><li>Support in obtaining relevant certifications</li></ul>

Senior Data Engineer: I'm hiring on behalf of my client for a Senior Data Engineer to work in a remote-first position. This will be their first Data Engineer sitting within a strong software engineering team, so it's crucial that the candidate come armed with good communication and stakeholder engagement skills. At the heart of their business is a unique dataset of cost data, which supports informed decision-making on client projects such as cost forecasting, insurance valuations, and carbon impact reporting. They are currently enhancing a modern, scalable, and automated data architecture and are seeking an experienced Senior Data Engineer to contribute to this initiative. The successful candidate will work with Azure services, including Data Lake, Data Factory, Databricks, and Synapse Analytics, to develop efficient data pipelines and processing systems. Responsibilities:<ul><li>Design, build, and maintain scalable data pipelines using Azure services</li><li>Collaborate with teams to fully understand data requirements and provide tailored solutions</li><li>Automate manual processes and optimise data delivery</li><li>Ensure the data architecture is robust, cost-effective, and future-ready</li><li>Build analytics tools to provide actionable business insights</li></ul> Key Skills:<ul><li>Hands-on experience with Azure Data Factory, Data Lake, Databricks, and Synapse</li><li>Strong understanding of data architecture and database management (SQL, Python)</li><li>Experience with ELT/ETL pipelines and real-time data ingestion</li><li>Proficiency in DevOps practices, including CI/CD, Docker, Kubernetes, and Terraform</li></ul> Benefits: <ul><li>Private medical</li><li>Remote-first working</li><li>25-days annual leave rising to 30+</li><li>Life Insurance x 3 of annual salary</li><li>Matched pension up to 5%</li><li>Salary: £75,000 - £90,000 </li></ul> This role cannot offer visa sponsorship now or in the future.

Data Engineer Jobs in Birmingham, England

Data Engineer
November 15, 2024

Data Engineer
November 13, 2024

Data Engineer
November 8, 2024

Senior Data Engineer
October 27, 2024

Senior Data Engineer
October 26, 2024

Senior Data Engineer
October 26, 2024

Quick filters

Top companies

Data Engineer Jobs in Birmingham, England

Data EngineerNovember 15, 2024

Data EngineerNovember 13, 2024

Data EngineerNovember 8, 2024

Senior Data EngineerOctober 27, 2024

Senior Data EngineerOctober 26, 2024

Senior Data EngineerOctober 26, 2024

Quick filters

Top companies

Data Engineer
November 15, 2024

Data Engineer
November 13, 2024

Data Engineer
November 8, 2024

Senior Data Engineer
October 27, 2024

Senior Data Engineer
October 26, 2024

Senior Data Engineer
October 26, 2024