My Client a leading powerhouse within London are looking to add an Azure Data Engineer to their team. The Azure Data Engineer will support our software developers, PowerBI developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Job Title: Lead Data EngineerLocation: London (Hybrid)Salary: £60,000 - £70,000 (Dependent on experience)Job Type: PermanentStart: ASAP Experience Building Data Pipelines<ul><li>Designed and managed data pipelines for complex systems (ETL/ELT)</li><li>Experience with cloud-based data platforms for data modelling</li></ul> Technical Skills<ul><li>Proficient in SQL Server and relational database management</li><li>Experience with cloud platforms like Azure (Synapse, Data Lake)</li><li>Programming in Python, PySpark, and T-SQL</li></ul> Additional Skills<ul><li>Familiarity with data analysis tools and workflows</li><li>Strong communication and collaboration skills</li><li>Experience in fast-paced, team-oriented environments</li></ul> If you are an experience Data Engineer and interested in this opportunity please apply Please do note my client is unable to provide any sponsorship - so the successful candidate must have the full right to work in the UK.

Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.).With the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning and, as well as a requirement to design, build and implement robust ETL pipelines for effective integration with the wider business. As a Lead Engineer, you will also be responsible for overseeing a small team of Data Engineers, setting and driving best practises and standards, ensuring project delivery is kept on track and regularly engaging with stakeholders up to C-suite for feedback/updates.This will also involve working directly alongside the Head of Data Platforms to ensure ongoing engineering work is aligned to overall architecture and roadmap, as well as future project planning. If you demonstrate the following skillset, please do apply!<ul><li>7/8 years’ experience in Python programming, particularly around data analysis, automation and the building of data pipelines (as well as an understanding of data warehousing concepts)</li><li>Strong SQL skills, especially in relation to ETL processes and data management (querying, cleaning, storing)</li><li>Experience working with and deploying to AWS cloud (having worked with any/all of S3, Glue, Lambda, Step Functions etc.)</li><li>Usage of PowerBI for data visualization</li><li>Experience of both Dremio and Data Mesh Architecture</li><li>Prior experience of leading software engineering teams (including line management)</li><li>Clear, confident communications with previous experience of working directly with business users</li></ul>

Data Engineer, Azure, DataBricksLondon/hybrid£90K + bonus and benefits SQL, DataBricks, Azure Data Factory (ADF), Data Lakehouse Data Engineer with extensive experience in Data Lakehousing practices, using SQL, DataBricks, and Azure Data Factory (ADF) is required to join a vibrant and growing insurance organisation with offices in the heart of the city. This is a pivotal role that will see you working collaboratively with stakeholders and wider data teams to develop key data platforms including a new Data Lakehouse. This is a fantastic opportunity to join a forward-thinking, people-centric organisation with excellent scope for long term career development. Key Responsibilities:<ul><li>Develop and enhance the Group Data Lakehouse and other data platforms.</li><li>Collaborate with key business, data and tech teams to understand data requirements and deliver solutions.</li><li>Set and enforce data management standards, ensuring best practices across the organisation.</li><li>Conduct solution reviews and designs, providing assurance on development approaches.</li><li>Manage multiple project deliveries simultaneously with outstanding attention to detail.</li><li>Provide guidance and support to wider data teams as required</li></ul> Key Skills and Experience:<ul><li>Extensive experience in Data Lakehousing practices, particularly using SQL, DataBricks, and Azure Data Factory (ADF).</li><li>Strong data management background with hands-on experience.</li><li>Proven ability to manage multiple projects in a fast-paced, agile, and dynamic working environment.</li><li>Excellent attention to detail and ability to maintain high standards.</li><li>Strong problem-solving skills and ability to provide technical guidance and support.</li><li>Excellent communication skills, both written and verbal, with the ability to influence stakeholders.</li><li>Experience working within an MGA (Managing General Agent) or (re)insurance carrier is highly desirable.</li></ul> For a full consultation, please send your CV to Arc IT Recruitment.

Senior Data Engineer – Insurance – Hybrid Senior Data EngineerSnowflake & DBT, SQL and Azure DevOpsCity, London/ Hybrid (2 days per week in the office)PermanentUp to £85,000 per annum + 15 % bonus + benefits A fantastic opportunity has arisen for a Senior Data Engineer with solid skills in Snowflake, SQL and Azure DevOps to join their existing team and support the definition and delivery of an enterprise data platform with engineering best practices. Specifically, this role will help the divisional data team (DDT) to understand, manage, and prioritise data engineering and transformation activities. The role is reporting to the AVP Data engineering, who is responsible for prioritising, planning, and driving forward the data engineering and transformation tasks required.This is an exciting opportunity to join this new team. The Senior Data engineer would fill a critical role within the organisation tasked with analysis, design, implementation, testing, maintenance, and support for data-intensive pipelines.Also, you will play an integral role in enhancing system quality, identifying issues, and transforming applications through innovation. This role will suit a tech-savvy individual with a strong drive for creativity, excellence, and ambition! Duties <ul><li>Manage and lead the junior data engineers (1 direct report) who will assist with the delivery of data engineering activities.</li><li>Prepare technical design specifications based on functional requirements and analysis documents.</li><li>Implement, test, maintain, and support software, as outlined in technical design specifications.</li><li>Enhance system quality through identification of issues, common patterns, and formulation of standard operating procedures.</li></ul> Qualifications & Experience <ul><li>Proven experience in the market as an experienced Data engineer.</li><li>Extensive experience with SQL cloud databases like Snowflake, and MS SQLServer. Experience with NoSQL databases like AWS DynamoDB and Azure Cosmos is a plus.</li><li>Solid experience and clear understanding of one ETL tool (For eg: Matillion, SNP Glue, Fivetran, Informatica) and DBT.</li><li>Experience working with AWS and/or Azure DevOps and extensive debugging experience.</li><li>Clear understanding of data modeling, data curation, and orchestration</li><li>Experience with Business Intelligence tools like PowerBI is a plus.</li><li>Sound understanding of unit testing, test-driven development, functional testing, and performance aspects.</li><li>Knowledge of at least one shell scripting language.</li></ul> Senior Data EngineerSnowflake & DBT, SQL and Azure DevOpsCity, London/ Hybrid (2 days per week in the office)PermanentUp to £85,000 per annum + 15 % bonus + benefits

Data Engineer Jobs in City of London, England

Azure Data Engineer
November 16, 2024

Lead Data Engineer
November 15, 2024

Data Engineer
November 6, 2024

Senior Data Engineer
October 27, 2024

Quick filters

Top companies

Data Engineer Jobs in City of London, England

Azure Data EngineerNovember 16, 2024

Lead Data EngineerNovember 15, 2024

Data EngineerNovember 6, 2024