Data Engineer

Logo for Competition & Markets Authority

Before you apply - don't miss out!

Subscribe to our weekly job alert

By registering you agree to our terms & conditions and privacy policy.

You can unsubscribe anytime using the link in the bottom of the email.

You will receive an email asking you to confirm your subscription

Competition & Markets Authority

London, Edinburgh, Cardiff or Belfast

Application Deadline
£53,527 - £60,599

Location: London, Edinburgh, Cardiff or Belfast

Salary: £53,527 - £60,599

Hours: Full time / Part time / Flexible

Contract: Permanent

If you enjoy working with the latest developments in data engineering and want to deliver work that protects consumers and makes a real impact on society, then you will be interested in this exciting opportunity to join the expanding Data, Technology and Analytics (DaTA) unit at the Competition and Markets Authority (CMA).

The CMA is a world-leading competition authority at the forefront of tackling pressing public policy questions, including the regulation of the biggest data and technology markets.

As a Data Engineer in the DaTA unit, you will be part of a small sub-team which is critical in designing and managing our analytical infrastructure and supporting the delivery of our most technically challenging projects. You will be given time and support for study and development and will be expected to spend much of your time in hands-on technical work. However, you will also be expected to make architectural and product-level decisions in some instances and should feel comfortable engaging with internal stakeholders to make sure that we are building the right things.

You will be working across all levels of the tech stack, but with a focus on backend, infrastructure, orchestration, and data. You may be working on orchestrating a pipeline to handle and run machine learning models on millions of incoming documents or discussing with the Data Scientists how to handle model and data versioning in the same situation. You could be leading on a project and making architectural design decisions or engaging with other teams to make sure we have understood their needs correctly. You might be using Spark libraries for probabilistic data linkage across large datasets or working on containerising the Spark environment for doing that linkage as part of a regular ingestion job. All of these, and many other things, are happening in a modern tech stack, mostly in AWS, based around JupyterHub, Docker and serverless Python.

A master’s degree in a quantitative or computer science subject or equivalent experience gained working in data engineering, data science or development in the public cloud is essential. Equally important is experience of writing code, including Python, to work with large and messy datasets, ideally using cloud services such as AWS, Azure or Google Cloud. You will also need a proven interest in learning about and understanding the latest methods and technologies within data science and engineering.

This is an opportunity to join a dynamic, supportive team working across a range of interesting technologies. We are looking for potential as much as experience, so if the above sounds exciting but daunting please do still apply.

In return the CMA is a hugely rewarding, diverse and stimulating place to work – an opportunity to work for the public good and to stretch and develop yourself in doing so. All CMA staff enjoy generous benefits, including an excellent pension scheme, at least 25 days leave (increasing to 30 over five years), and generous maternity/paternity leave provision. You can also take advantage of interest-free season ticket loans, a cycle to work scheme, childcare vouchers, and favourable consideration of flexible working.

To find out more about this opportunity and about working for the CMA, please click on the APPLY button.

Closing date for applications: 11:55 pm on 20 June 2022.

The CMA are an accredited Disability Confident Employer, and we are an equal opportunities employer, welcoming suitably qualified applicants from all backgrounds.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles.


Not what you're looking for?

Use our search to find your ideal career opportunity

Search term is required
No jobs were found
Total of [[ totalJobs ]] jobs were found

[[ ]]

[[ jobs.location ]]
[[ jobs.salary_min|decimals ]] - [[ jobs.salary_max|decimals ]]
[[ jobs.posted_time_friendly ]]

Featured Jobs

Home Office

July 10, 2022

London Underground

July 01, 2022

The Virtual School in Hertfordshire

July 10, 2022

Home Office

July 10, 2022


July 09, 2022

Lewisham Borough Council

June 26, 2022


July 17, 2022

Royal Botanic Gardens, Kew

June 26, 2022

University of Leeds

July 01, 2022

Our Partners

Logo for Dstl
Logo for Prifysgol
Logo for Bank Of England
Logo for Cma
Logo for Frontier
Logo for Logo
Logo for Mit Logo

Like what you see?

Post a job