Job title: Lead Data Engineer
Job type: Permanent
Emp type: Full-time
Industry: Data Science
Expertise: Data Engineering
Skills: Data Engineer
Salary: GBP £90,000.00
Job published: 31/05/2022
Job ID: 33853

Job Description

A global publishing business is seeking a new Lead Data Engineer to develop their data platform in a scalable and cost-efficient way, whilst acting as a role model for the wider team to adopt best practice software engineering principles.

You will become a key member of the Data Engineering team that’s responsible for ensuring that internal customers can produce effective analysis, models and reports through accurate and timely data. You will collaborate with team members and others in their wider tech organisation to develop their vision of migrating legacy batch-based data warehousing processes to modern streaming-based approaches in a scalable, robust and distributed way to serve ever greater SLAs.

Key Responsibilities:

  • Responsible for the successful implementation of data projects and new features on the data platform
  • Responsible for reliable and cost-effective operation of the data platform
  • Support the Data team in the design, implementation and support of the data platform
  • Work with senior team members across Tech and Data to architect a best-in-class data platform that supports the companies growing aspirations
  • Lead by example while using established software engineering practices and principles

What do I need to succeed?

Required:

  • Bachelor’s degree in computer science, engineering, mathematics, or a related field
  • 4+ years of experience building and operating big data platforms
  • Proficiency in Python or another general purpose language
  • 2+ years of experience in cloud based technologies (AWS/GCP/Azure)
  • Strong written and verbal communication skills including an ability to effectively communicate with both business and technical audiences

Desired:

  • Experience providing technical leadership and mentoring other engineers for best practices
  • Experience in working and delivering end-to-end projects independently
  • Experience of using Python on Google Cloud Platform for Big Data projects
  • Hands on experience developing, maintaining or interacting with an events streaming platform (PubSub,Kinesis,Kafka)
  • Proven in developing integrations to 3rd party APIs for data ingestion, and developing APIs to expose access to data
  • Demonstrated strength in data modelling, ETL development, and data warehousing
  • Knowledge of data management fundamentals and data storage principles
  • Familiarity with statistical models and/or data mining algorithms and practical experience of applying these to business problems

Benefits

  • Unlimited paid time off (yes you read that right)
  • A share in our success - every member of staff receives a profit pool bonus at the end of our financial year and access to our unique Value Creation Plan
  • Central office locations with safe working spaces and flexibility to work remotely as required
  • Discounted digital magazine subscriptions and access to back copies of our print magazines and bookazines
  • Huge opportunities to learn and develop whether through professional qualifications, exposure to incredible business projects or informal lunch & learns, hosted by your colleagues