Big Data Engineer
- Job Reference: 157832291-2
- Date Posted: 15 June 2020
- Employer: FIRESOFT People
- Location: Sydney
- Salary: On Application
- Sector: I.T. & Communications
- Job Type: Part-time
Big Data Engineer
Surry Hills location
6-month contract, high chance of renewal
Cutting edge technology
About the company :
One of Australia's leading retail organisations based in Surry Hills is looking for a Big Data Engineer to lay the platform for their huge BI transformation project.
About the Role:
Swift execution of Big Data Engineering, Machine Learning, and DevOps best practice on Terabytes of data from the largest Australian retail is what this role is about. Working as part of the data engineering team, hand in hand with data scientists, be prepared to build cutting edge pipelines and experiment with the best data engineering and ML tech available on the market. The team has a culture of its own, which involves an innate desire to do things differently with high quality and push tech to its limits. No matter how experienced you are, be prepared to learn a lot!
It will be your job to:
Assist the Data Scientists and lay the platform in the design, implementation, and testing of customer data products such as personalisation engine, decision engine, etc.
Ensure quality control and oversight of model outputs within the customer product
Being the single point of contact for all stakeholders to ensure outcomes are delivered and that we deliver value
What you need to succeed:
Strong software engineering background and passion for high-quality design and code
2-5 years of commercial experience with Scala, Spark, SQL and Python
Total automation mentality (CI/CD)
Very good command of Linux
Exceptional communication skills
Created production pipelines for ML algorithms
The ideal candidate will also have:
2-5 years of end to end delivery of Terabytes size Data Engineering pipelines
1-3 years of DevOps experience (GCP/AWS, Kubernetes, Terraform)
We have already launched a headhunt drive for this role - if you feel that this is the next step in your career, apply now!!