Data Engineer (Python/AWS)  Overview  LRH is on a mission to create a truly data-driven repo market. Backed by the Kaizen RegTech Group, our startup works with the world’s leading banks, asset managers and hedge funds to develop a pioneering data solution designed to enhance trading activities in the €23 trillion UK and European repo markets. Our innovation provides these financial institutions with an unprecedented perspective on market dynamics.  https://londonreportinghouse.com   Job summary  We are looking for a motivated Data Engineer to join our team starting immediately! You will be a core part of our data & engineering teams, specialising in developing performant, scalable data pipelines and deploying cloud infrastructure to support our web applications and analytics dashboards. This is an exciting opportunity to work with a truly unique financial markets data source and shape our data infrastructure and analytical capabilities.  You will be applying your skills cross-company on vital and impactful projects, operating at every stage of the Software Development Lifecycle and developing serverless solutions using AWS. The role is on-site and you will be exposed to the business side of the organisation, as well as having an opportunity to get in front of clients and partners (quite a rare opportunity in the industry).  Key Activities and Responsibilities:  <ul><li>Develop and maintain scalable, performant data pipelines. </li><li>Optimising existing pipelines for speed, reliability and security. </li><li>Interface with cloud infrastructure (AWS Glue, Lambda, SQS, CloudFormation, RDS/Aurora etc.). </li><li>Design and maintain databases and data warehouses. </li><li>Monitor data pipelines in production and develop tools to facilitate that. </li><li>Work collaboratively with team members and cross-company. </li></ul> Experience and Qualifications:  <ul><li>Proficient with Python and SQL. </li><li>Experience with cloud services (e.g. AWS Lambda, AWS Glue, AWS RDS). </li><li>Deep knowledge of ETL processes and data modelling </li><li>Experience with data orchestration (e.g., Step Functions). </li><li>Proficient with version control systems (e.g., Git). </li><li>3-5 years of professional experience within a team. </li><li>Strong problem-solving skills and attention to detail. </li><li>Excellent communication and teamwork skills. </li><li>A strong self-starting attitude, you love a challenge! </li><li>Great written and verbal communication skills. </li><li>Software development lifecycle best practices. </li><li>Agile principles, processes and tools. </li></ul> Nice-to-haves:  <ul><li>Experience with containerisation (e.g. Docker). </li><li>Experience with infrastructure-as-code (e.g. AWS CloudFormation). </li><li>Familiarity with CI/CD pipelines and tools (e.g. CodePipeline, GitLab CI). </li><li>Understanding of data privacy and security best practices, and fundamental cryptographic principles. </li><li>Knowledge of machine learning and data science concepts. </li><li>Familiarity with GenAI frameworks (e.g., Bedrock). </li><li>Knowledge of the financial markets would be an asset. </li></ul> What you’ll get in return:  <ul><li>A competitive salary package. </li><li>Office in the heart of The City: 5-minute walking distance from Bank, Cannon Street and St. Paul's stations. </li><li>Access to additional office space in London’s iconic Gherkin ???? 5 minutes from Liverpool Street Station. </li><li>25 days’ holiday ????️, as well as UK bank holidays. </li><li>Well-being ???????? allowance. </li><li>Build-your-skills ????️ allowance. </li><li>Private healthcare ❤️ + dental. </li><li>Working within a fast-growing company that has a culture of empowerment, innovation and collaboration. </li><li>Awesome team of financial markets experts, data analysts and engineers. </li><li>Opportunity to play a key role in an exciting startup backed by the Kaizen RegTech Group. </li><li>Opportunities for continuous career growth and learning. </li></ul>

Data Engineer - Music StartupSalary: £70,000Location: Central LondonWFH: 3 days a week in office About Our ClientOur client is transforming the music industry with a platform that combines music streaming and direct-to-fan engagement, creating a transparent and innovative ecosystem. Role OverviewAs a Data Engineer, you'll design and maintain data infrastructure, ensuring high-quality, scalable pipelines and collaborating with product and analytics teams to deliver impactful insights. Key Responsibilities<ul><li>Build and manage scalable data pipelines (e.g., Airflow/Cloud Composer).</li><li>Develop data transformations (e.g., dbt/DataForm).</li><li>Ensure data quality and troubleshoot issues.</li><li>Manage cloud infrastructure (GCP preferred).</li></ul> Required Skills & Experience<ul><li>Strong in Python, SQL, and data modeling.</li><li>Hands-on experience with Airflow, dbt, and cloud platforms (GCP preferred).</li><li>2+ years in data engineering with CI/CD pipeline experience.</li></ul> Apply now to help reshape the music industry!

My Client a leading powerhouse within London are looking to add an Azure Data Engineer to their team. The Azure Data Engineer will support our software developers, PowerBI developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Job Title: Lead Data EngineerLocation: London (Hybrid)Salary: £60,000 - £70,000 (Dependent on experience)Job Type: PermanentStart: ASAP Experience Building Data Pipelines<ul><li>Designed and managed data pipelines for complex systems (ETL/ELT)</li><li>Experience with cloud-based data platforms for data modelling</li></ul> Technical Skills<ul><li>Proficient in SQL Server and relational database management</li><li>Experience with cloud platforms like Azure (Synapse, Data Lake)</li><li>Programming in Python, PySpark, and T-SQL</li></ul> Additional Skills<ul><li>Familiarity with data analysis tools and workflows</li><li>Strong communication and collaboration skills</li><li>Experience in fast-paced, team-oriented environments</li></ul> If you are an experience Data Engineer and interested in this opportunity please apply Please do note my client is unable to provide any sponsorship - so the successful candidate must have the full right to work in the UK.

Job Title: Senior Data EngineerLocation: London - Hybrid - 1 day a week in the office Contract Type: 6 Month contract with possible extension The Company: This company is an incredible commercial broadcaster with a diverse range of content. At the heart of their operations is a commitment to using cutting-edge technology to transform how they engage with their audiences. To make this happen, they have a Data Centre in London with a team who plays an imperative role in enabling data-driven decision-making across the organisation.The Role:Are you a Senior Data Engineer with passion to join an innovative Data Centre team?Do you want to be involved in building and optimizing large-scale data solutions in AWS Databricks, GCP Dataproc, Airflow, and PySpark?As a Senior Data Engineer in this Data Centre, you will lead efforts to design, develop, and deploy robust data pipelines that power key business insights.You will have an opportunity to work closely with cross-functional teams, including data scientists, analysts, and software engineers, to deliver solutions that enable seamless data access and drive decision-making across the entire Organisation.Skills:Essentials: AWS Databricks - Pyspark - GCP - AirflowNice to Have: Python - Data modelling - Scala - Previous Media - Broadcasting exp - CI/CD Responsibilities:<ul><li>Design, implement, and manage scalable data pipelines using AWS Databricks, GCP Dataproc, and PySpark.</li><li>Optimize workflows for batch and real-time data processing using Airflow.</li><li>Collaborate with the Head of Engineering and CTO to translate business needs into effective data engineering solutions.</li><li>Ensure data quality and reliability through robust testing, monitoring, and documentation practices.</li><li>Lead the integration of structured and unstructured data sources into data lake and warehouse solutions.</li><li>Drive innovation by exploring and implementing best practices in cloud-based data engineering.</li><li>Provide mentorship and technical guidance to junior team members.</li></ul>How to Apply: If all of this resonates with you, and it made you excited to learn more about the opportunity, then we'd love to hear from you! Please submit your CV and other relevant information regarding the role ! Desired Skills and Experience Essentials: AWS Databricks - Pyspark - GCP - Airflow Nice to Have: Python - Data modelling - Scala - Previous Media - Broadcasting exp - CI/CD

Data Engineer Jobs in City of London, England

Data Engineer Pythonaws
December 26, 2024

Data Engineer
December 26, 2024

Azure Data Engineer
December 20, 2024

Senior Data Engineer
December 17, 2024

Quick filters

Top companies

Data Engineer Jobs in City of London, England

Data Engineer PythonawsDecember 26, 2024

Data EngineerDecember 26, 2024

Azure Data EngineerDecember 20, 2024