Senior Data Engineer

Senior Data Engineer

Job Overview

Location
Toronto, Ontario
Job Type
Full Time Job
Job ID
83964
Date Posted
1 year ago
Recruiter
Raymond Catherine
Job Views
126

Job Description

About Job

CTC Undisclosed Job Location Canada Experience 0 - 3 yrs

Description

Gapsquare and Xpert HRs vision is about creating an inclusive, people-focused environment. A culture where individuals with ambition, curiosity and ideas can make an impact. Where you can think big, aim high and explore more.

Gapsquare is growing our team to meet the accelerating demand for fairer pay and inclusive workplaces all around the world. Gapsquare is a dynamic, forward thinking and award-winning team with an incredible product and mission to achieve fair pay across the globe.

Gapsquares commitment to diversity is fundamental to our company values and mission. We are an equal opportunities employer and welcome applications regardless of gender, marital status, ethnic origin, disability, religion, sexual orientation, or age. Having diverse employees with different perspectives is key to creating innovative new products for our global customers. Our aim is for every employee to be the best version of themselves. We would actively welcome applications from candidates of diverse backgrounds and underrepresented groups.

We encourage applicants and employees to tell us about any health issues they may have to allow us to put in place reasonable adjustments that may support applicants in the application process and support employees to succeed in their role.

Job Summary

This Senior Data engineer role is in the Gapsquare Squad at XpertHR, located in London, Sutton and to be a member of the wider XpertHR development team. The person selected for this exciting new role will be responsible for performing a mixture of machine learning, statistical analysis and algorithms using python and relevant tools. Additionally, they will work directly with the rest of Squad to ensure existing, and new, products are efficiently and effectively implemented.

Requirements

Proven experience in data management area with a technical competencies required.

Have strong understanding on data architecture.

Strong proficiency with data manipulation technology Must have Apache Spark, Python, PySpark experience.

Strong hands on technical SQL experience.

Strong knowledge of multiple data storage subsystems (e.g. Data Lakes, MongoDB and SQL Server).

Good working knowledge of platforms such as Windows, Unix, Docker, Kubernetes.

Cloud experience with Azure or AWS

Advanced knowledge of software development methodologies (e.g., Agile, Scrum).

Strong understanding of normalized/dimensional data modelling principles.

Expertise in different Object Oriented development languages.

Knowledge of test-driven development (TDD)

Responsibilities

Perform daily data loads ensuring recurring updates are logged and tracked.

Interface with other technical personnel or team members to document, interpret, and finalize requirements.

Produce code that is efficient, repeatable, without defects, and adherent to best practices such as naming conventions, encapsulation, etc.

Write and review portions of detailed specifications for the development of data components.

Complete complex data engineering bug fixes and issues, researching and identifying root causes as appropriate.

Identify opportunities to apply automation or other tools to improve effectiveness or efficiency.

Work closely with other development team members to understand complex product requirements and translate them into data engineering and/or data management designs.

Innovate process improvements that enable efficient delivery and maintenance.

Successfully implement development processes, coding best practices, and code reviews.

Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders.

Train entry-level and less senior data engineers as directed by department management, ensuring they are knowledgeable in critical aspects of their roles.

Job ID: 83964

Similar Jobs

Meta

Full Time Job

Senior data engineer Senior data engineer

Meta is embarking on the most transformative change to its business and technolo...

Full Time Job

Deloitte

Full Time Job

Senior data engineer Senior data engineer

Deloitte’s Enterprise Performance professionals are leaders in optimizing...

Full Time Job

Labcorp

Full Time Job

Senior data engineer Senior data engineer

Job Duties/Responsibilities:Determine the acceptability of specimens for testing...

Full Time Job

Braintrust

Full Time Job

Senior data engineer Senior data engineer

• JOB TYPE: Direct Hire Position (no agencies/C2C - see notes below)â€Â...

Full Time Job

Cookies

This website uses cookies to ensure you get the best experience on our website.

Accept