Associate Data Engineer

A day in the life

As an Associate Data Engineer at ManyPets, one of the key areas of work will be enhancing and refactoring our data platform. As a team, we will be reviewing the current infrastructure and identifying areas where improvements can be made. This could involve optimising existing data pipelines or collaborating with Senior Engineers to design new components that will ensure the platform is scalable, reliable, and efficient. A key focus of your work will be on data ingestion, where you’ll integrate data from a variety of sources, including internal systems, partner networks, and third-party vendors. Collaboration is central to this role, as you’ll work hand-in-hand with upstream teams to understand the nuances of incoming data, ensuring it meets the highest quality standards. You’ll also work closely with downstream teams, including analysts and data scientists, transforming raw data into valuable insights that support critical business operations.

Data modelling will be another part of your responsibilities, where you’ll contribute to designing clean, organised, and accessible models that empower our reporting and operational needs. These models will also play a key role in preparing the groundwork for ManyPets’ expansion into AI-driven initiatives. Each day, your contributions will be integral to maintaining a robust data platform and ensuring seamless data flow across the team, ultimately helping to drive smarter business decisions.

Your responsibilities

• Optimise data pipelines to ensure efficiency and scalability.
• Collaborate with Senior Engineers to design and implement new components for the data platform.
• Manage the ingestion of data from first-party systems, second-party partners, and third-party vendors.
• Work with upstream teams to ensure smooth data ingestion and maintain high-quality data standards.
• Integrate data from various sources to align with organisational needs and objectives.
• Collaborate with downstream teams, including analysts and data scientists, to ensure data is properly transformed for analysis.
• Create efficient and accessible data models for reporting, analytics, and operational use.
• Assist in preparing the data platform for future AI initiatives and advanced analytics projects.
• Ensure seamless data flow across the organisation by monitoring and resolving potential bottlenecks.
• Identify potential issues and contribute to resolving them under the guidance of senior team members.
• Maintain thorough documentation of data pipelines, data models, and infrastructure for development and troubleshooting.
• Identify and resolve issues within the data platform to minimise downtime and ensure reliable data delivery.
• Ensure data handling meets security and compliance standards.
• Identify opportunities for automation within data ingestion and transformation processes.
• Provide input on enhancing the scalability, reliability, and performance of the data platform.
• Support the implementation of data governance policies, including data access, retention, and quality.
• Be proactive in expanding your knowledge of data engineering concepts, tools, and best practices.
• Take advantage of learning opportunities, both structured and self-directed, to enhance your skills.
• Actively participate in mobbing and knowledge-sharing sessions with teammates.
• Take ownership of your day – and be prepared to diplomatically decline work that falls outside of your scope.

Your skills and experience

• Basic proficiency in Python and SQL, with a willingness to learn and improve.
• Understanding of ETL vs. ELT processes and their role in modern data workflows.
• Exposure to data transformation tools like DBT or similar, with support provided to learn DBT.
• Basic knowledge of cloud platforms (e.g., Google Cloud Platform, AWS) and cloud-based data storage like BigQuery.
• Familiarity with version control systems (e.g., Git) and CI/CD practices.
• Most importantly, you should be excited about learning new technologies and adapting to different tools as needed. A proactive approach to growing your skill set will be highly valued!

The interview process

This position has a one-stage interview process, which will be held via Zoom.

• Stage 1 – you’ll meet the Data Platform Engineering Manager and one of the Senior Data Engineers. This will be a longer interview of two parts lasting 1.5 hours.
• In the first hour we will explore some concepts and ideas with you, asking your opinion on how to go about the use cases. In the remaining half hour, you’ll have a chance to ask more about us, how we work, and anything else you would like to know.

Smell good?

Apply for the Associate Data Engineer opportunity.