Data EngineerLondon1 day a month in officeUp to £70k depending on experienceTHE COMPANYThis is a global insurance company which was founded in the early 2000s and has been growing rapidly ever since. This company has around 15000 employees and is looking to continually expand. They are an extremely fast paced company who are constantly acquiring new businesses. They are looking for a Data Engineer to join their team and scale up their data platforms. Additionally, they have a huge emphasise on work/ life balance.THIS ROLEAs a Data Engineer you will be…<ul><li>Building ETL pipelines</li><li>Migrating from on prem to the cloud</li><li>Actually, owning the ETL process while working with the migration analyst to ensure all the migrations run into the data warehouse smoothly</li><li>Utilising best practices- CI/CD pipelines</li></ul> SKILLS AND EXPERIENCEThe successful Data Engineer will have the following skills and experience:<ul><li>2/3 years of data engineering experience</li><li>Experience with building Python pipelines</li><li>Have good knowledge of cloud environments</li><li>Extensive SQL experience</li></ul> Please note this role does not offer sponsorshipHOW TO APPLY:Please register your interest by sending your CV via the Apply link on this page.

I am seeking a Data Engineer focused on infrastructure tasks, with a contract running until the end of March and a POC completion deadline by the end of January. This role is INSIDE IR35 and would be hybrid 1-2 times a week on-site in London OR Birmingham. The role involves working within an AWS environment, using the BBT framework, configuring and integrating with GitHub, and setting up a CI/CD pipeline. Responsibilities include performing basic plumbing and DevOps tasks, ensuring the environment is prepared for development, and collaborating on the same project as the analytics/modelling team. Required skills include strong expertise in AWS, experience with the BBT framework, proficiency in GitHub configuration, knowledge of CI/CD pipeline setup, and basic DevOps and infrastructure skills. Both roles require contractors who can start immediately and work until the end of March, with no room for learning on the job. The project involves setting up pipelines, performing data quality checks, and ensuring the environment is ready for development. Responsibilities * Collaborate on designing and implementing scalable data solutions using a range of new and emerging technologies from the AWS platform. * Demonstrate AWS Data expertise when communicating with stakeholders and translating requirements into technical data solutions. * Manage both real-time and batch data pipelines. Our technology stack includes a wide variety of technologies such as Spark, Kafka, AWS Kinesis, Redshift, and DBT. * Work independently with minimal supervision in remote team configurations. * Automate existing manual processes. Requirements * Expertise in the main components of continuous data delivery: set up, design, and delivery of data pipelines (testing, deploying, monitoring, and maintaining). * Expertise in data architecture across Software-as-a-Service, Platforms-a-Service, Infrastructure-as-a-Service, and cloud productivity suites. * Strong engineering background with experience in Python, SQL, and DBT, or similar frameworks used to ship data processing pipelines at scale. * Demonstrated experience with and solid knowledge of AWS: AWS Glue, AWS EMR, Amazon S3, Redshift. * Familiarity with Infrastructure-as-code (IaC) using Terraform or AWS Cloud Formation. * Demonstrated experience in data migration projects. * Ability to work with, communicate effectively, and influence stakeholders on internal/external engineering teams, product development teams, sales operations teams, and external partners and consumers. ...

Data EngineerPermanentLocation: Remote working with some onsite working Salary: Up to £75KSkills: SQL, Power BI, ETL, SSIS, Data Factory, Azure We are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer will design, develop and maintain robust data infrastructure and ETL pipelines that support the data needs of projects, services and customers. To create insightful data visualisations and dashboards in PowerBI to enable data-driven decision-making. Collaborate with Data Consultants, Architects and other professionals to offer seamless and effective data solutions to customers. Due to the nature of the work valid SC Clearance is essential. Key Responsibilities: <ul><li>Build data pipelines for data throughout the Azure Data Platform stages, integrating data management best practices at all stage transitions suitable for their use case, e.g., reporting, or archival of data from operational systems or unstructured data stores</li><li>Strong proficiency in SQL and SSIS for ETL processes.</li><li>Experience in Azure data platforms, including Azure Data Factory, Azure SQL Database, Fabric.</li><li>Experience in designing and building data warehouses.</li><li>Advanced skills in Power BI for data visualization and reporting.</li><li>Knowledge of data modeling, data warehousing concepts, and ETL best practices.</li><li>Design and implement data integrations between data platforms and operational systems both on premises and in the cloud</li><li>Develop data sets which are optimised for their given use case, e.g., self-service analytics, paginated reports or machine learning and advanced analytics</li><li>Migrate data from legacy reporting solutions on the azure data platforms to ensuring that data integrity and service levels are maintained</li></ul> Essential Skills: <ul><li>SQL including T-SQL (Queries, views, stored procedures, functions)</li><li>Microsoft BI experience / Data visualisation (SSAS, SSRS, Power BI)</li><li>Integration and ETL design and delivery Including (SSIS, Azure Data Factory)</li><li>Azure Data Services (including Data Factory, Databricks, Synapse Analytics, Data Lake)</li><li>Relational and multi-dimensional data modelling</li><li>Designing and delivering Testing including Regression, Unit, integration, and system for data solutions</li><li>Understanding of industry best practice and trends together with their application within a business context</li><li>Broad knowledge of the financial services industry and key regulatory requirements together with an understanding of business processes</li><li>Strong understanding of data management and data governance best practices</li><li>Experience in defining and delivering solutions to handle sensitive data including data obfuscation, cascade deletion of data, anonymisation</li></ul>

Company DescriptionTechserve is a managed hybrid workplace management provider in the UK.We are a digitally driven customer-focused, Workplace SME services company.At Techserve, integrity is at the heart of everything we do. We identify our customers' unique challenges with managing workspaces and we help by delivering tailored, effective solutions. Role DescriptionThis is a contract role based in London with the flexibility for some remote work for a Data Engineer at TechServe. The Data Engineer will be responsible for designing, constructing, and maintaining data architecture, as well as analyzing and visualizing data to help drive key business decisions. Qualifications<ul><li>Proficiency in programming languages like Python, Java, or Scala</li><li>Experience with database technologies such as SQL, NoSQL, and Big Data platforms</li><li>Strong understanding of data warehousing, ETL processes, and data modeling</li><li>Knowledge of data visualization tools like Tableau, Power BI, or Qlik</li><li>Experience working with cloud technologies such as AWS, Azure, or Google Cloud</li><li>Excellent problem-solving skills and analytical thinking</li><li>Bachelor's degree in Computer Science, Engineering, or related field</li><li>Effective communication skills and ability to work in a team</li><li>Relevant certifications in data engineering or related fields are a plus</li></ul>

Data Engineer - Hybrid (London) - £550/Day Currently working with a client who is looking to build a team of data enigneers with an opportunity to join a market leader within the UK, you will be joining on an inital 6 month contract with a view to extend further! Responsibilities<ul><li>Analyze and organize raw data</li><li>Build data systems and pipelines</li><li>Evaluate business needs and objectives</li><li>Interpret trends and patterns</li><li>Conduct complex data analysis and report on results</li><li>Prepare data for prescriptive and predictive modeling</li><li>Build algorithms and prototypes</li><li>Combine raw information from different sources</li><li>Explore ways to enhance data quality and reliability</li><li>Identify opportunities for data acquisition</li><li>Develop analytical tools and programs</li><li>Collaborate with data scientists and architects on several projects</li></ul>Requirements and skills<ul><li>Previous experience as a data engineer or in a similar role</li><li>Technical expertise with data models, data mining, and segmentation techniques</li><li>Knowledge of programming languages (e.g. Java and Python)</li><li>Hands-on experience with SQL database design</li><li>Great numerical and analytical skills</li><li>Data engineering certification (e.g IBM Certified Data Engineer) is a plus</li></ul>If this sounds like you then please do reach out and let's have a chat!

Senior Data Engineer (AWS, Snowflake, Spark) Licensing & IP Rights - Mayfair, London (Hybrid, 1-2 days per week) Up to £80,000 + BenefitsOVERVIEWWe're partnered with a SaaS company pioneering data solutions within the IP licensing industry. For the past 6-7 years, they have been tackling the challenge of data transparency in licensing, providing companies with essential insights to manage intellectual property and licensing rights. As they expand, they're seeking a Senior Data Engineer to develop a powerful platform for consolidating licensing data, making it accessible and actionable for clients.THE COMPANYFocused on IP and licensing rights, this SaaS provider empowers clients to manage large, complex data sets. From tracking licensed content to supporting global IP rights, they enable clients to ensure proper licensing across diverse industries. Their robust platform leverages big data to transform the licensing space, enabling effective brand management in fields ranging from merchandise to media.THE ROLEAs a Senior Data Engineer, you will: - Lead the development of APIs and manage the data platform infrastructure. - Design scalable solutions for managing billions of data points on licensing, consolidated into a single, user-friendly platform. - Collaborate with the team to implement efficient data pipelines and storage for big data.YOUR SKILLS AND EXPERIENCE- Strong experience with AWS, Snowflake, and Spark. - Proficient in Python, big data tools, and data engineering principles. - Hands-on experience with dbt and large-scale data storage, particularly for high-volume data environments.SALARY- Up to £80,000 + benefitsHOW TO APPLYTo be considered for this opportunity, please register your interest via the apply link on this page or send your CV

Lead Data Engineer - Global Tech Scale-up - Remote - UK/EU The BusinessA genuinely 'cutting-edge' Global tech scale-up who leverage advanced Data & AI to provide real-time insights that have a positive real-world impact. Why Join?<ul><li>Rapid growth = bags of opportunity (x3 increase in the size of their team).</li><li>Data & AI Leader of 15+ years with a proven track record.</li><li>Your work will have a real-world impact.</li></ul> The OpportunityYou would play both a technical and strategic role in the design and implementation of their Data Platform, pipelines and infrastructure. You would also manage a team of Data Engineers and Data Architects. Experience of Interest:<ul><li>7+ years of experience in Data Engineering & Data Architecture (Data Mesh, Lambda)</li><li>3+ years within a Leadership role</li><li>Big Data (Spark, Hadoop) & Real-time/streaming environments (Kafka)</li><li>Data Warehousing (Snowflake, Redshift)</li><li>Database Management (SQL, NoSQL)</li><li>Data Integration (Talend, Informatica, Apache Nifi</li><li>DevOps, Terraform, Docker, Airflow</li><li>Cloud - GCP (preferred), AWS or Azure</li></ul> This opportunity will suit those who have proven experience from both a tech and team leadership perspective. You can work remotely from anywhere in the UK or EU. In return they can offer a salary of £90,000 - £120,000 dependent on experience + 25 days holiday+BH + private medical. Reach out to Richard James, Business Manager at Darwin Recruitment for the full details - 07789858764 / https://www.linkedin.com/in/thedatarecruiter/ Darwin Recruitment is acting as an Employment Agency in relation to this vacancy.

About Us:Our client is a leading global consulting organisation, deeply embedded in the UK public sector, driving transformation through innovative technology solutions. Successful candidates will receive generous packages along with great opportunities for career progression...! The Role:We are seeking a skilled Senior Data Engineer/Architect with SC Clearance to lead the design, development, and implementation of data-driven solutions for our public sector clients. You will be responsible for architecting robust data pipelines, ensuring efficient data storage, and leveraging advanced data processing techniques to deliver valuable insights. This is an exciting opportunity to work on high-impact projects in a fast-paced, collaborative environment. Key Responsibilities:<ul><li>Lead the design, development, and architecture of end-to-end data solutions in the public sector.</li><li>Design and manage scalable data storage systems using Azure Data Lake Storage and PostgreSQL.</li><li>Develop and optimize data processing frameworks, leveraging Databricks, Azure ML, and Graph DB (Neo4j) for advanced analytics and machine learning.</li><li>Architect and implement data integration pipelines using Azure Data Factory and APIs to ensure seamless data flow and accessibility.</li><li>Ensure the security, scalability, and reliability of data solutions while adhering to public sector regulations and standards.</li></ul> Skills and Qualifications:<ul><li>Active SC Clearance is essential.</li><li>Proven experience as a Senior Data Engineer/Architect in a consulting environment.</li><li>Strong expertise in Azure Data Lake Storage and PostgreSQL for data storage and management.</li><li>Proficiency in Databricks, Azure ML, and Neo4j for data processing and analysis.</li><li>Hands-on experience with PowerBI, Plotly, and React for data visualization and reporting.</li><li>In-depth knowledge of Azure Data Factory and building API-based integrations.</li><li>Ability to design secure, scalable, and high-performance data architectures.</li><li>Strong problem-solving skills with a focus on delivering innovative solutions for public sector challenges.</li></ul> Why Join Us?<ul><li>Be part of a leading global consulting organisation driving real change in the public sector.</li><li>Work with a talented and diverse team on high-impact projects.</li><li>Enjoy flexible working arrangements with a mix of remote and on-site work.</li><li>Competitive salary package and benefits.</li></ul> If you’re a seasoned data professional with the technical expertise and a passion for public service, we’d love to hear from you. Apply now to make a lasting impact in the UK public sector.

Data Engineer Jobs in London, England

Data Engineer
November 17, 2024

Data Engineer Pythonawsredshift
November 17, 2024

Sc Data Engineer Power Bi
November 14, 2024

Data Engineer
November 13, 2024

Data Engineer
November 12, 2024

Data Engineer
November 10, 2024

Data Engineer
November 10, 2024

Lead Data Engineer
November 9, 2024

Senior Data Engineer Architect Sc Cleared
October 27, 2024

Quick filters

Top companies

Data Engineer Jobs in London, England

Data EngineerNovember 17, 2024

Data Engineer PythonawsredshiftNovember 17, 2024

Sc Data Engineer Power BiNovember 14, 2024

Data EngineerNovember 13, 2024

Data EngineerNovember 12, 2024

Data EngineerNovember 10, 2024

Data EngineerNovember 10, 2024

Lead Data EngineerNovember 9, 2024

Senior Data Engineer Architect Sc ClearedOctober 27, 2024

Quick filters

Top companies

Data Engineer
November 17, 2024

Data Engineer Pythonawsredshift
November 17, 2024

Sc Data Engineer Power Bi
November 14, 2024

Data Engineer
November 13, 2024

Data Engineer
November 12, 2024

Data Engineer
November 10, 2024

Data Engineer
November 10, 2024

Lead Data Engineer
November 9, 2024

Senior Data Engineer Architect Sc Cleared
October 27, 2024