Database Development & Administration (Information & Communication Technology)
Wellington-based only
Contract until January or February
Start date: 14th of October or 1st of November
Our client is looking for 2 x senior data engineers to work to build functionality in their new modern data platform. You will design, build, operationalise, secure and monitor data pipelines and data stores. This role involves working with the data architect and data analysts. You will also produce, test and tune code to agreed standards, meeting both functional and non-functional requirements.
Responsibilities: Designs, implements, and maintains complex data engineering solutions to acquire, prepare and present data.
Monitors application of data standards and architectures including security and compliance.
Applies data engineering standards and tools to create and maintain data pipelines and extract, transform and load data.
Plans and drives the development of data engineering solutions ensuring that solutions balance functional and non-functional requirements.
Applies knowledge of software development lifecycle and testing practices.
Carries out Unit testing.
Skills and Experience Requirements: Proficient in data modeling, ETL/ELT pipeline design, and data partitioning optimisation.
Expertise in Delta Lake, Notebooks, SQL, and pipeline orchestration (Databricks Jobs/Azure Data Factory).
Skilled in Azure Data Lake Storage, Data Factory, and DevOps practices (Git, CI/CD, Agile).
Experienced in access control (Azure RBAC), Databricks management, encryption, and compliance (GDPR, HIPAA).
Proficient in Python, PySpark, and SQL for building and optimizing data pipelines.
Skilled in orchestration (Apache Airflow/Databricks Workflows) and pipeline monitoring.
Experienced in Agile, cross-team collaboration, documentation, and optimizing Spark jobs/Databricks clusters.
Please understand that we will be able to contact only shortlisted candidates due to a high volume of applications received.
At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.
#J-18808-Ljbffr