Big Data Engineer

Citibank

London EC2

Ref: 19027855

Apply

Before you apply - don't miss out!

Subscribe to our weekly job alert

By registering you agree to our terms & conditions and privacy policy.

You can unsubscribe anytime using the link in the bottom of the email.

You will receive an email asking you to confirm your subscription

We are looking for a Big Data Engineer to help us process information contained in vast streams of online and offline time-series data, enabling us to make data-driven decisions based on an enhanced understanding of our business performance in the financial markets. Your primary focus will be in building data processing pipelines across bounded and unbounded datasets, powering models integrated into our financial markets decision-making systems and processes and enabling end users to gain greater insights on their data.

Rates is one of the biggest franchise businesses within Capital Markets at Citi, consistently ranked top-tier across the street.

Rates Technology provides pricing, risk, execution and processing technology to the sales and trading functions. Each of these systems store terabytes of data in a variety of data platforms including KDB, traditional RDBMS and Hadoop infrastructure. This data is increasingly used by the in-business data science team to perform analysis which has a direct impact on the performance of the business.

Job Background/context:

We believe the future’s here. Right here with us. Home to where we define, ideate, develop and distribute production-ready financial solutions of far-reaching impact. And right now, the door’s open to direct the future of our technology for a truly global client base. This means collaborating with the keenest minds in data science, big data, software engineering, web development, UX design and more. Doers looking to bring the next bold ideas to life for a fascinating array of clients - investing, trading and transacting at the forefront of change in markets and economies the world over.

If you have this kind of vision, capable of seeing ahead, of developing a clear path forward in a quest to try the as yet untried, here is the opportunity. In a supported, resource-rich, vibrant co-working environment, part of an ecosystem of globally interconnected labs, realising a broader mission of enabling growth and economic progress on a scale you won’t find anywhere else. Welcome to our London Innovation Lab.

Key Responsibilities:

  • Define, build and scale high performance processing pipelines to deliver data for data science and downstream applications
  • Participate in cross-asset initiatives, influencing strategic technical direction and driving re-use of our data infrastructure
  • Meet the data needs of a Full Stack Data Science Engineering Team
  • Build a strong partnership with our centralized Big Data DevOps Team
  • Work closely with product owners to develop client solutions for new and existing channels
  • Grow our catalogue of common assets, such as code templates, libraries, utilities, services, etc.
  • Troubleshoot performance and scalability issues

Qualifications

Skills & Qualifications:

  • Expertise in Spark, such as RDD Operations (Transformations and Actions), DataFrame API and Shared Variables (Broadcast and Accumulators) using Python and/or Scala)
  • Expertise in the Python language and standard library
  • Knowledge of the Hadoop framework (HDFS, YARN, MapReduce, etc.) and ecosystem (Hive, Sqoop, Pig, Zookeeper, etc.) using a popular distribution (Cloudera, HortonWorks, MapR, etc.)
  • Knowledge of streaming platforms, especially Apache Kafka and Spark Streaming
  • Proficiency in using query languages, such as SQL
  • You have very high development standards, especially for code quality, code reviews, unit testing, continuous integration and deployment
  • You are proficient in git, of course
  • You have made a contribution, no matter how small, to open source software
  • You may have stood-up an app, commercial or personal, on a cloud platform, such as AWS, GCP, Azure, etc.
  • You may have containerized an app and used a container management platform, such as Kubernetes, OpenShift, Docker Swarm, etc.
  • You are very competent with your OS command line - Linux and/or Microsoft Windows
  • You apply a range of logical techniques to problem-solving, such as the use of concrete examples, case analysis, brute-force, iterative refinement and reduction
  • You are an adaptable, resourceful, well organised team player with a strong work ethic
  • You agree that verbal and written communication skills are vital
  • You are eager to grow your skills
  • You are educated to degree level or above

Apply

Before you apply - don't miss out!

Subscribe to our weekly job alert

By registering you agree to our terms & conditions and privacy policy.

You can unsubscribe anytime using the link in the bottom of the email.

You will receive an email asking you to confirm your subscription

Not what you're looking for?

Use our search to find your ideal career opportunity

Search term is required
No jobs were found
Total of [[ totalJobs ]] jobs were found

[[ jobs.name ]]

[[ jobs.location ]]
[[ jobs.salary_min|decimals ]] - [[ jobs.salary_max|decimals ]]
[[ jobs.posted_time_friendly ]]

Featured Jobs

Tui

Luton, UK

July 18, 2019

UK Debt Management Office

London EC3

July 16, 2019

NHS

Birmingham, UK

July 25, 2019

EUMETSAT

Darmstadt, Germany

July 31, 2019

RBS

Edinburgh, Scotland

July 19, 2019

International Telecommunication Union (ITU)

Geneva, Switzerland

August 25, 2019

Hanbury Strategy

London, E1

August 04, 2019

RBS

Edinburgh, Scotland

July 19, 2019

Direct Line Group

Bromley, United

July 18, 2019

British Red Cross

Belfast, Northern Ireland

July 31, 2019

Leeds Beckett University

Leeds, UK

July 21, 2019

EUMETSAT

Darmstadt, Germany

July 28, 2019

Highways England

Birmingham, UK

August 04, 2019

Greater London Authority

London, UK

August 04, 2019

University of Oxford

Oxford, UK

July 19, 2019

RBS

Edinburgh, Scotland

July 19, 2019

Our Partners

Logo for Dstl
Logo for Prifysgol
Logo for Bank Of England
Logo for Cma
Logo for Frontier
Logo for Logo
Logo for Mit Logo

Like what you see?

Post a job