This position performs complex research and data engineering assignments within XpertHR, and provides direct input to project plans, schedules, and methodology in the development of cross-functional products. This position performs date engineering design - typically across multiple systems; mentors more junior members of the team; and talks to users/customers and translates their requests into solutions.

We are looking for a Senior Data Engineer with data transformation skills who work with the creation of the XpertHR Data Lake solution for the Reward Analytics product.

Responsibilities

Perform daily data loads ensuring recurring updates are logged and tracked.

Interface with other technical personnel or team members to document, interpret, and finalize requirements.

Produce code that is efficient, repeatable, without defects, and adherent to best practices such as naming conventions, encapsulation, etc.

Write and review portions of detailed specifications for the development of data components.

Complete complex data engineering bug fixes and issues, researching and identifying root causes as appropriate.

Identify opportunities to apply automation or other tools to improve effectiveness or efficiency.

Work closely with other development team members to understand complex product requirements and translate them into data engineering and/or data management designs.

Innovate process improvements that enable efficient delivery and maintenance.

Successfully implement development processes, coding best practices, and code reviews.

Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders.

Train entry-level and less senior data engineers as directed by department management, ensuring they are knowledgeable in critical aspects of their roles.

Requirements

Proven experience in data management area with a technical competencies required.

Have strong understanding on data architecture.

Strong proficiency with data manipulation technology Must have Apache Spark, Python, PySpark experience.

Strong hands on technical SQL experience.

Strong knowledge of multiple data storage subsystems (e.g. Data Lakes, MongoDB and SQL Server).

Good working knowledge of platforms such as Windows, Unix, Docker, Kubernetes.

Cloud experience with Azure or AWS

Advanced knowledge of software development methodologies (e.g., Agile, Scrum).

Strong understanding of normalized/dimensional data modelling principles.

Expertise in different Object Oriented development languages.

Knowledge of test-driven development (TDD)

Whats it like to work here?

Outstanding - youve probably already got a feel for what we do and the technology were involved with but whats really stands us out from the crowd is our culture. Were an agile, dynamic and forward thinking organisation who understands the importance of looking after our staff. We pride ourselves on delivering high-quality products, providing our employees with interesting challenges for their personal and career development whilst also striking the right balance between work and family life.