We are redirecting you to the source. If you are not redirected in 3 seconds, please click here.

Lead Data Engineer at Pogust Goodhead. Overview:. We are seeking a Lead Data Engineer to join our data function. The ideal candidate will possess strong expertise in data engineering and data warehousing, driving forward our Quantum modelling efforts. There are large amounts of data available internally and externally to model for the purposes of Quantification and this role will be key in structuring the data for reporting and analytics.. The role is working primarily on our Latin American cases. The data engineering team will build out Quantification data marts on our Azure data platform, sourcing data from our Case Management system (Litify/Salesforce), from Client questionnaires and evidence submissions, and from third party data sources.. You will work closely with the global Technology & Data team, leveraging the existing data platform architecture and Pogust Goodhead datasets. The wider team will share best practices, data governance and business knowledge helping both teams deliver more for our colleagues.. Key Responsibilities:. · Data Pipeline Development: Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other Azure data services.. · Database Management: Implement and manage scalable data storage solutions, including Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake.. · Data Integration: Integrate data from various sources, ensuring data consistency, quality, and security across different systems.. · Performance Optimisation: Monitor and optimise data processes for performance, scalability, and reliability. Troubleshoot and resolve any data-related issues.. · Collaboration: Work closely with data scientists, data analysts, and other stakeholders to understand data needs and provide technical solutions. Ensure seamless data flow and accessibility for analytical and reporting purposes.. · Data Governance: Implement and maintain data governance practices, ensuring data privacy, security, and compliance with relevant regulations.. · Documentation: Document data processes, architectures, and workflows to ensure knowledge sharing and maintainability.. · Team management: Coach and mentor a team of data analysts, and data engineers.. Experience:. Minimum of 5-7 years of experience in data engineering/data warehousing.. · Technical Skills:. o Proficiency in SQL and experience with relational databases (Azure SQL Database, SQL Server).. o Experience with big data technologies and frameworks (Azure Synapse Analytics, Azure Data Lake, Hadoop, Spark, Azure Databricks).. o Proficiency in CI/CD (Azure DevOps). o Version Control (GIT). o Strong programming skills in SQL, Python/Pyspark, Java, or Scala.. o Familiarity with data integration tools and platforms (Azure Data Factory, Apache NiFi).. o Knowledge of cloud computing and data services, particularly Azure.. · . Analytical Skills:. Strong problem-solving skills with the ability to analyse complex data systems and processes.. · . Communication Skills:. Excellent verbal and written communication skills, with the ability to collaborate effectively with both technical and non-technical stakeholders.. · . Attention to Detail:. High attention to detail and a commitment to data quality and accuracy.. · . Team Player: . Ability to work collaboratively in a team environment and manage multiple projects simultaneously.. Qualifications:. · Education: Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field.. Please note that this role is only open to individuals who already have the legal right to work in the UK. Unfortunately, we are unable to offer visa sponsorship, and applications from candidates without existing UK work authorisation will not be considered and will be automatically disqualified from the process.. Company Location: United Kingdom.