Big Data Engineer ( 60 - 90k)

  • HKD40000 - HKD60000 per month + 15 ALs
  • Hong Kong
  • Temporary, Full time
  • Robert Walters Hong Kong
  • 17 May 19

A large financial institution is now hiring a data engineer to join them. Successful candidates should have extensive experience in software development, experience in engineering (commercial or open source) software platforms and large-scale data infrastructures (preferably on cloud) is a preferred.

Key responsibilities

  • Building distributed and highly parallelised Big Data ingestion and processing pipeline which is able to process massive amounts of data (both structured and unstructured data) in near real-time
  • Evaluate and deploy data quality framework to measure and improve data quality in the organisation over time
  • Engage with data stewards, producers and consumers to design appropriate data pipelines
  • Automate processes where possible and are repeatable and reliable
  • Work closely with Site Reliability Engineers and Product Managers to deliver software in a continuous delivery environment

Requirements

  • Extensive experience (5+ years) in data engineering and be a complex problem solver.
  • Experience in Apache Spark and Nifi
  • Experience in in-memory data processing
  • Knowledge in design and implementation of data infrastructure on AWS or GCP
  • Excellent communication skills and experience working in cross functional teams