Data Pipelines Engineer

Development · Cambridge, Cambridgeshire
Department Development
Employment Type Full Time

Working at Ito World


We’re a mission-driven and diverse team of 80+ people from over 18 countries with a passion for technology and transportation.We’re interested in talented, curious people that share our mission and love data as much as we do.


What we do


At Ito World, we solve transportation challenges across the globe for millions of travellers every day, by delivering real-time transit data feeds to journey planners and a platform for transit authorities and operators.Our clients include Google, Apple, Microsoft and public sector organisations such as the Department of Transport and Transport for West Midlands.


The Role


We are looking for a talented Data Pipelines Engineer to join our team at Ito World. You will be developing software solutions that deliver pipelines of data from realtime tracking systems into a historical and real-time analytics console.As a key member of the team, you will be working in an environment that values your enthusiasm and ideas as well as your development skills and experience.


The role is based at our Cambridge head office, but Ito World has a flexible and remote working culture and will consider applicants that may prefer to work remotely.


What you’ll be doing


Reporting to the Full-Stack Team Lead, you will:


  • Implement data aggregation and streaming processing using Java and Apache Flink to validate, normalise and enrich transit data for downstream analytics applications.
  • Implement data flows to connect operational systems, data for analytics and business intelligence.
  • Building and maintaining ETL pipelines using Apache Airflow, Postgres, and AWS RedShift to support analytics for large-scale datasets.
  • Understand the transit model and provide solutions to effectively transform data fit for user insight and analytics.
  • Develop simulators and data-generators to aid QA team with testing data-pipelines.
  • Building and using APIs to enrich data with batch and stream processing.
  • Working closely with the product manager to realise requirements with best-practice based design solutions.
  • Working closely with the DevOps team to assist in deployment and issue tracking.


As well as these, you will be expected to demonstrate best practices for the software development process, including unit testing, code reviews and documentation.


What skills you have


We would expect you to be educated to degree level and have the necessary skills in the following areas:


  • A strong background in software engineering practices with Java, Scala and/or C++.
  • An understanding of modern data-engineering concepts and tools.
  • Knowledge and awareness of cloud-based analytical platforms, specifically AWS.
  • Experience in batch-oriented processing with Apache Airflow or similar job scheduling software.
  • Experience with stream-oriented processing Apache Flink or other data-streaming technologies such as Spark, Storm, Kinesis streams, or Kafka.
  • Experience working with big-data workloads and challenges that it brings at scale.
  • Building and using APIs to integrate external data in data-pipelines.
  • Experience with Agile/Scrum development methodologies.
  • An innovative and creative approach to software development.
  • Ability to collaborate effectively with other developers, testers and product managers.


Professional Development


Professional development is an area that is very important to us at Ito World. We understand that access to training and education in the workplace improves prospects for promotion and can help open up future career paths.


We take the time to work with each member of the team and help them to take control of their personal development. This ranges from helping them feel confident when taking on new challenges, to working with them to plan their goals for the future.


To facilitate continuous learning, the team has access to online resources as well as training courses and mentoring. They are also encouraged to share areas of interest with the wider team to help foster a culture of learning.


What we offer


  • Flexible & remote working to suit all lifestyles and life stages
  • Enhanced pension and health insurance after 2 years' service
  • Life Insurance
  • 25 days + bank holidays as standard
  • Flexible Public Holidays - option to swap up to 5 UK public holidays to celebrate the festival of your choice. Choose an alternative day that fits your personal values, beliefs or celebration calendar better
  • New parents take a day off to celebrate your child’s first birthday
  • Enhanced parental leave policy
  • Wellbeing and employee assistance programme
  • Cycle to work scheme
  • Free bike repair service for those that commute by bike
  • Free breakfast and snacks when working from the office
  • Regular team lunches and team socials

Equity, diversity and inclusion at Ito World

At Ito World we believe diverse perspectives make for a better company and better products too. We strongly encourage applications from underrepresented groups and are committed to equality and inclusivity in our hiring processes and company culture.


By submitting this application you agree to Ito World retaining your personal data on a "legitimate interest" basis. For further details see our privacy statement. 

Thank You

Your application was submitted successfully.

  • Location
    Cambridge, Cambridgeshire
  • Department
  • Employment Type
    Full Time