Data Engineer Data Engineer …

Hays Technology
in Perth, Western Australia
Permanent, Full time
Be the first to apply
Competitive
Hays Technology
in Perth, Western Australia
Permanent, Full time
Be the first to apply
Competitive
Hays Technology
See job description for details
Tech company based in Perth are seeking a skilled Data Engineer (AWS/GCP) to join their company. Perm role.
Your new company
This company is a well-known SaaS solution, directly involved in assisting businesses to verify and validate their advertising traffic.

Your new role
In your new role you will focus on developing, constructing and maintaining data architecture on GCP - specifically building and creating a data warehouse using BigQuery.

You will be working with implementation teams by providing deep expertise to deploy large-scale data solutions in the enterprise. You will be using modern data analytics solutions on the cloud - GCP.

Duties will involve:
  • Migrating current real-time data from third-party databases to one centralised data warehouse - BigQuery
  • Integrate massive datasets from multiple data sources in order to complete data modelling procedures
  • Automate processes within the predictive pipeline to free up resource time
  • Ensure data quality in the pipeline and build process
  • Design mature software with tools including Cloud Composer, Data Build Tool, Great Expectation using DevOps principles
  • Query datasets, visualise results and create detailed reports
  • Design usable and appropriate AI which is privacy-aware, accurately detects data and selection bias using AI systems such as BigQuery ML, Google AI Pipeline and AutoML
What you'll need to succeed
The successful candidate will have proven experience working as a Data Engineer on large-scale data warehouse projects. You will bring a true passion for big data and AI to this role.

You should have the following key skills:
  • Proven experience with Cloud BigQuery
  • Experience designing and building data pipelines from ingestion of data through to consumption/visualisation within a "big data" architecture using Java, Python, Scala
  • Knowledge or previous use of the following solutions; Spark, Cloud DataProc, Cloud Dataflow, Apache Beam, BigTable, Cloud PubSub, Cloud Functions, Cloud Run, Airflow and Cloud Composer
  • Experience designing, building and deploying data solutions using Google Cloud, AWS or Azure
  • Strong understanding of data governance principles and security requirements on GCP
  • Extensive experience writing complex SQL queries and stored procedures
  • Experience using SQL & Python to build and monitor data pipelines & detect data quality issues
  • Experience using data visualisation tools such as Microsoft Power BI, Tableau, Python Data Viz or Data Studio
  • Proven experience working with semi-structured data is a must have
What you'll get in return
This role offers an excellent salary package, extremely flexible work arrangements; and a great opportunity for career growth and development.
Working for this company will also provide the successful applicant the opportunity to work with large big data companies such as Google, AWS and Imply.

What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call Hannah Becker now.
If this job isn't quite right for you but you are looking for a new position, please contact us for a confidential discussion on your career.

LHS 297508 #2576322
Company Overview

About Hays
Hays is the leading global specialist recruiting group. We are the experts at recruiting qualified, professional and skilled people worldwide, being the market leader in Asia Pacific and the UK and one of the market leaders in Continental Europe and Latin America. We operate across the private and public sectors, dealing in permanent positions, contract roles and temporary assignments.

Hays believes the right job can transform a person's life and the right person can transform a business. They are passionate about connecting candidates with the right job for them.

Hays operates in over 40 locations throughout Australia and New Zealand. They find permanent jobs for over 15,000 people a year and temporary and contract assignments for over 25,000 people a year and at any one time employ over 20,000 temporaries and contractors.

Hays Technology logo
More Jobs Like This
See more jobs
Close