For Recruiters

Lead Kafka Engineer

McCabe & Barton
London, United Kingdom
Posted 1 day ago Hybrid Contract confidential

Our client is a newly created regulatory technology start up which brings global financial institutions together to optimise standards in compliance, by providing a trusted platform to exchange and enhance information.

Are you ready to be part of the revolutionary organisation that will solve one of the most critical challenges facing the financial services industry?

The role

A new and exciting opportunity within our technology team, leading the development and delivery of the central platform’s Kafka streaming services. Reporting to the Delivery Manager.

You will define and own the technical roadmap for client’s Kafka services and ensure that capacity planning, tuning and performance planning is undertaken in line with the platform’s projected Growth. Working closely with the architecture and engineering teams, you will be subject matter expert for this technology, ensuring best practice configuration in order to meet with business and security needs.

What you’ll do

Key responsibilities in this role will include (but not be limited to):

  • Leading the detailed design, engineering and implementation of Kafka streaming services within the platform
  • Providing expert knowledge and advice to senior technical management team
  • Acting as mentor and subject matter expert to our technical engineering teams
  • Establish, communicate and advocate best practice and design patterns for Kafka consumption in our business
  • Defining and own the technical roadmap for Kafka service, ensuring the provision and operation of a performant, resilient and secure solution, aligned to growing business needs
  • Working closely with our Information security and governance teams in ensuring that compliance and internal controls requirements are met
  • Working with the the Platform teams and delivery partner teams to install, configure and operationalise Kafka deployments
  • Producing detailed designs for approval by the Design Authority
  • Owning and developing the technical relationship and ways of working with our Kafka vendors

What you’ll need

  • 6-8 years of relevant experience in an Engineering role with demonstrable experience in Apache/Confluent Kafka technologies, event driven microservices, in an highly distributed enterprise environment.
  • Strong operational knowledge and background in running Kafka clusters at scale
  • Experience working in Financial Services sector or a large complex and/or global environment
  • Expert level implementation skills with Java 11 and above using SOLID principles
  • Hands on experience in using Java Spring Boot, Spring for Apache Kafka and Spring Cloud Stream with Kafka and KStreams
  • comfortable in using Spring Reactive programming, Threads and Annotation processors
  • Experience in developing for and deploying to public cloud products especially to AWS EKS Kubernetes environment.
  • Understanding of cloud security concepts and technologies
  • Comfortable in using different Linux environments e.g. Redhat
  • Confluent Kafka admin and developer certification preferred
  • Experience of working in Agile/Scrum with virtual teams
  • Experience in DevOps, scrum/agile methodologies   and using CI/CD tools such as Github, Genkins and Terraform.

 

More Jobs From McCabe & Barton
McCabe & Barton
Project Manager with Consulting background
McCabe & Barton
London, United Kingdom
3 days ago Full time Competitive Inside IR35 rate
McCabe & Barton
Real Estate Systems Integrations Architect/Analyst - Contract - Outside IR35
McCabe & Barton
London, United Kingdom
about 1 hour ago Full time £450 - £700
McCabe & Barton
Business Analyst
McCabe & Barton
London, United Kingdom
1 day ago Full time 50k - 80k
McCabe & Barton
Data Analyst
McCabe & Barton
London, United Kingdom
1 day ago Full time £470 a day inside IR35 (Umbrella Rate)
McCabe & Barton
Infrastructure Project Manager
McCabe & Barton
London, United Kingdom
3 days ago Full time up to £85,000 + bonus + benefits package
McCabe & Barton
Production Support – Electronic Trading - Perm
McCabe & Barton
London, United Kingdom
3 days ago Full time £85k-£95k basic + package DOE
McCabe & Barton
Customer Integration Analyst
McCabe & Barton
London, United Kingdom
4 days ago Full time 550 - 650
McCabe & Barton
Infrastructure Project Manager (Windows Server EoL)
McCabe & Barton
London, United Kingdom
4 days ago Full time £700 a day umbrella rate
McCabe & Barton
Senior Business Analyst - Front Office
McCabe & Barton
London, United Kingdom
about 7 hours ago Full time £100k - £110k
McCabe & Barton
Senior Consultant
McCabe & Barton
London, United Kingdom
2 days ago Full time 90k - 110k
More Jobs Like This
NatWest Group
Lead Principal Engineer, Financial Crime Technology
NatWest Group
London, United Kingdom
NatWest Group
Data Platform Engineer
NatWest Group
London, United Kingdom
Space Executive Pte Ltd
Senior / Lead Software Engineer
Space Executive Pte Ltd
London, United Kingdom
NatWest Group
Data Engineer
NatWest Group
London, United Kingdom