Big Data Engineer

Big Data Engineer

Job Overview

Location
Wanneroo, Western Australia
Job Type
Full Time Job
Job ID
74894
Date Posted
1 year ago
Recruiter
Michael Linda
Job Views
67

Job Description

Description

Maltem is a community of 1,200+ passionate individuals dedicated to innovation, new technologies, data and digital transformation projects.

Founded in 2001 and located in 11 different countries, our footprint covers France, Singapore, Hong Kong, Vietnam, Luxembourg, Belgium, Madagascar, Morocco, US, Canada and Australia. Our expertise consists of 18 years of market knowledge into the business organization, digital practices, agile, data management and innovation.

Our Australian operations are growing rapidly, and we are partnering with local blue-chip and multinational companies on truly transformational engagements

About the Opportunity

We are looking for an experienced Data Engineer with a focus on Spark to work on a range of projects for our clients.

You'll need to have at least five years' corporate experience in data engineering using Spark to drive commercial business outcomes. The ideal candidate's favourite words are process, data, scale, and agile. You will leverage your strong collaboration skills and the ability to streamline the components and processes in a big data environment

Responsibilities:

  • Build robust, efficient and reliable big data pipelines from different sources for machine learning applications
  • Build codes using the existing standards, lifecycle management framework and version control
  • Design and executive unit tests to ensure data compliance
  • Identify various data risks associated with the data process and draft mitigation strategies
  • Extract knowledge and insights from structured or unstructured data
  • Work closely with the business users and support them on building their Alteryx workflow to Spark
  • Development on Spark (using Java or Scala) – documenting requirements and code testing

Qualifications:

  • At least 5 years' of experience in a similar data engineering role within a corporate environment
  • Extensive hands on experience using Apache Spark
  • Strong programming skills in particular SQL, Spark SQL, R, Python, Scala and Java
  • AWS experience
  • Good business acumen to interpret complex technical data and present results to business stakeholders
  • Experience working with different technical and non-technical stakeholders
  • Strong interpersonal and communications skills with ability to interact with the business autonomously
  • Good knowledge of Hadoop ecosystem (including HDFS, Spark, Oozie, and Hive)
  • Bachelor Degree (Preferred)
  • Excellent written & verbal communication skills

*

We are looking to go beyond expectations and shape the future of work by working with passionate, skilled and energetic people both in support and delivery side.

Job ID: 74894

Similar Jobs

Cargill

Full Time Job

Big data engineer Big data engineer

A Typical Work Day May Include: • Completing preventative, predictive, ...

Full Time Job

Deloitte

Full Time Job

Big data engineer Big data engineer

Are you looking to elevate your cyber career? Your technical skills? Your opport...

Full Time Job

Cargill

Full Time Job

Big data engineer Big data engineer

Cargill Animal Nutrition is a global business that serves large-scale feed mill ...

Full Time Job

Veolia

Full Time Job

Big data engineer Big data engineer

Primary Duties / Responsibilities:● Assist in daily operational troublesho...

Full Time Job

Cookies

This website uses cookies to ensure you get the best experience on our website.

Accept