Data Engineer – Zoopla at Houseful- United Kingdom(Hybrid)

Job Description

Description

We’re hiring a mid-level Data Engineer for Zoopla (a Houseful brand) to join our data platform team, help us build our next-generation data platform and pipelines, and inspire best practices for data within Zoopla.

As a Data Engineer at Zoopla, you will:

•  Design, build, and maintain ETL/ELT Pipelines, ensuring efficient data flow and transformation from various sources using AWS technologies and other tools.
• Enhance Data Quality: implement robust validation checks, monitor data accuracy, and resolve inconsistencies. Proactively suggest improvements to data quality processes in collaboration with senior engineers.
• Develop and Scale Data Warehousing Solutions: e.g., AWS Redshift, and Databricks, ensuring they align with evolving business requirements and scalability needs.
• Collaborate Across Functions such as analytics engineers, software engineers, data analysts, and data scientists, ensuring timely and accurate data access for analytics, model training, and evaluation needs.
• Monitor and Optimise Pipeline Performance, diagnosing and resolving bottlenecks. Work alone or with senior engineers to enhance system efficiency and responsiveness.
• Implement Monitoring and Alerting Systems for data infrastructure health, enabling quick identification and response to potential issues.
• Develop Documentation for data systems, workflows, and processes, ensuring clarity and accessibility for team members and stakeholders.

Requirements

• Proficiency in Python and SQL for data manipulation and transformation. Familiarity with Spark and DBT is a plus.
• Cloud Experience with AWS, data storage, processing, and orchestration services in cloud environments.
  Data Pipeline Development and maintaining data pipelines or working with data warehouses, ensuring efficient data flow and reliability.
  Experience with SQL and NoSQL Databases, enabling effective data storage solutions based on use cases.
  Data warehousing and/or data lake experience.
  Infrastructure as Code (IaC) such as Terraform with a willingness to expand expertise in infrastructure management and automation.