hero

Job opportunities in the Octopus Ventures portfolio

Octopus Ventures
176
companies
373
Jobs

Senior Data Engineer

Vitesse PSP

Vitesse PSP

Data Science
United Kingdom
Posted on Nov 11, 2024
Join a growing Product and Technology team which has more than double in size in the last 12 month. Your role will be to help architect and build a robust, secure and scalable data architecture to support real-time observability and reporting. This will entail the design and construction of data engineering solutions on AWS, as well as the design and construction of data service API's. You will be supporting key internal and external stakeholders that require access to real-time and curated data.

In this role, you will be working closely with internal stakeholders across the organisation, rapidly becoming a subject matter expert of the data generated by Vitesse and our ELT pipelines as well as drive data architecture strategy and Terraform deployment.

The successful person will have experience building complex data frameworks in other early-stage businesses. They will have experience with cloud platforms, ideally AWS.

Applicants with the following technology experience will be preferred:

  • AWS
  • Airflow
  • Databricks
  • GitHub
  • Great Expectations
  • PyTest
  • Kafka
  • Mosaic AI
  • Terraform
  • Tableau


Your Responsibilities

  • Design, build, and maintain scalable data pipelines and architectures to handle large volumes of structured and unstructured data
  • Develop, enhance, and optimize ELT processes for ingesting, processing, and distributing data across multiple platforms in real time
  • Build and manage data warehouses (to support advanced analytics, reporting, and machine learning
  • Implement data governance, quality checks, and validation processes to ensure the accuracy, consistency, observability, and security of data
  • Optimize query performance and data storage costs through techniques like partitioning, indexing, vacuuming, and compression
  • Build monitoring and alerting systems for data pipelines to proactively detect and resolve issues before they impact business operations
  • Optimize existing data pipelines for better performance, cost-efficiency, and scalability
  • Work with data scientists, analysts, and business stakeholders to understand data needs and ensure availability of relevant data
  • Continuously research and integrate cutting-edge data technologies, tools, and practices to improve data engineering processes
  • Team up with product engineers to identify, root cause, and resolve bugs
  • Update documentation to help users navigate our data products
  • Ensure our data platform performs well and is always available for our blue-chip clients


Requirements

  • Experience with data pipeline orchestration tools such as Airflow, Luigi, or similar
  • Experience with version control systems and CI/CD best practices using GitHub Actions
  • Knowledge of data governance, privacy regulations (e.g., GDPR), and security best practices
  • Proficiency with SQL and experience with distributed data processing tools such as Apache Spark
  • Strong understanding of relational and NoSQL databases (e.g., PostgreSQL, MongoDB, Impala, Cassandra)
  • Experience with cloud infrastructure (Docker and Kubernetes, Terraform)
  • Experience in AWS platform architecture and cloud services
  • A collaborative team member with Agile experience
  • Familiarity with stream processing technologies either Kafka or Kinesis

Nice to have

  • Experience with machine learning frameworks and pipelines
  • Experience with Delta Live Tables
  • Familiarly with Great Expectations
  • Experience of search optimisers (ElasticSearch/Lucene), REST alternatives (GraphQL, AsyncAPI etc.), data science kits (Jupyter, Anaconda)


Benefits

  • 25 days Holiday per year (increasing by 1 day per years' service, up to 30 days) + Bank Holidays
  • Hybrid working arrangements - minimum 2 days in the office, Tuesday - Thursday
  • Contributory pension scheme
  • Enhanced Parental leave
  • Cycle to Work Scheme
  • Private Medical Insurance with AXA
  • Unlimited access to therapy sessions through our partner, Oliva
  • Discounted Gym membership through Gympass
  • Financial Coaching with Octopus Wealth
  • 2 days of volunteering leave per year
  • Sabbatical after 5 years' service
  • Life Assurance - MetLife (UK employees only)
  • Ongoing Learning and Development to support you reach your career goals


We are Vitesse - the payment provider of choice for the insurance and treasury industry.

Formed in 2014 by a team of proven FinTech entrepreneurs, we are an FCA regulated payments business that is driven to be the payment partner of choice for the insurance market, by providing global payment services and treasury optimisation. Operating one of the largest domestic banking and payment settlement networks in the world, we give our customers direct access to more than 170 countries and territories, covering over 110 currencies. Through a single integration, insurers can use this network to pay claims in as fast as 45 seconds, delivering a better customer experience to their claimants. Our market-leading treasury optimisation service brings complete control and transparency to insurers and allows them to have their money in the right place, at the right time, to make that all important payment - fast, and when their customers need it most.

With now over 160 employees across Europe and our London headquarters, $26m series B funding in 2022 in the bag and approaching £8bn in processed transactions, we are only just getting started.

We are collaborative, customer centric and work with integrity, whilst partnering with some of the biggest insurance leaders including Lloyd's of London and Many Pets. We take huge pride in our company culture, ensuring that everyone has a part to play, an opportunity to be heard, be involved, and the ability to make a real difference.

As we continue to scale up, we want like-minded humans to join us on this exciting journey. Are you ready?

Vitesse at our best - our values

The Vitesse values are a true reflection of what it takes to thrive in our business, so it's important to us that any employee who joins our business is aligned with these 3 attributes

Confident Humility

We don't do ego and we know that unless we all win, none of us win. We admit when we're wrong, ask for help and always think about the wider business before ourselves.

Driven to Succeed

We see the opportunity ahead of us and we won't stop until we fulfil the potential we know we have. We hold ourselves to high standards and deliver high quality outcomes for Vitesse and our customers.

Tenacious Responsibility

We take ownership for our actions and decisions, and face into the challenges that come our way. We are committed to seeing things through to completion, even in the face of adversity.

We are an Equal Opportunity Employer We are committed to creating an inclusive environment that enables everyone to perform at their best, where we recognise the rights of all individuals to mutual respect and where there is an unbiased acceptance of others. Our policies and practices aim to promote an environment that is free from all forms of Unfair discrimination and values the diversity of all people. At the heart of our policy, we seek to treat people fairly and with dignity and respect.