Senior Data Engineer

Details of the offer

Database Development & Administration (Information & Communication Technology)
Full time
The FirstCape group of companies includes Jarden Wealth, JBWere, and Harbour Asset Management and is one of New Zealand's largest and best-resourced wealth advisory and asset management firms. Here at FirstCape, we believe that our people are our greatest asset. Our success is dependent on the collective talent, expertise, and dedication of each and every one of our team members. We are committed to creating an environment where everyone can thrive, grow, and contribute to their fullest potential.
About the role
The primary purpose of this role is to lead the development and management of our data, infrastructure, and systems. You will have extensive experience in building and maintaining scalable data pipelines, optimizing data processing workflows, and ensuring data integrity. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions that drive business decisions and insights.
Key responsibilities
Data Architecture: Design and implement scalable data architectures and pipelines to support analytics, reporting, and business intelligence needs.
ETL Processes: Develop and maintain ETL (Extract, Transform, Load) processes to ensure efficient data ingestion, transformation, and storage.
Data Integration: Integrate data from various sources, including databases, APIs, and third-party services, ensuring seamless data flow and consistency.
Performance Optimization: Optimize data processing and storage solutions for performance and cost efficiency, including database tuning and query optimization.
Data Quality: Implement data validation and quality checks to ensure accuracy, completeness, and reliability of data.
Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.
Documentation: Maintain comprehensive documentation for data processes, data models, and system architectures.
Security & Compliance: Ensure data security, privacy, and compliance with relevant regulations and standards.
Mentorship: Provide guidance and mentorship to junior data engineers and contribute to the development of best practices and standards within the team.
Skills you will bring to the role
Excellent team and communication skills
Extensive experience using Databricks on Microsoft Azure including Pipeline/ETL
Familiarity with Azure managed services such as ADF
Experience with PowerBI and other reporting tools
Very strong hands-on SQL and Python skills
Experience operationalizing data systems in cloud environments including alerts and monitoring
Certification of using Databricks on AWS or Azure
Experience with other ETL technologies like Airflow
Experience building data-oriented architecture (i.e. data-as-a-product)
Experience rolling out end-user governance
A degree in Computer Science or Data Engineering, or an equivalent tertiary qualification.
At least 5+ years' commercial experience as a Data Engineer
Why work at FirstCape?
We offer a competitive compensation package commensurate with experience. Additional benefits include wellbeing support, volunteer days, and a great company culture. We pride ourselves on offering our employees outstanding development and learning opportunities to support career growth, and the opportunity to work alongside the best talent in the market.
We are an inclusive employer and want our workforce to reflect a rich and diverse way of thinking and working. We know people are more than a single identity, and the qualities that make each one of us unique need to be valued and embraced. So regardless of your gender, age, background, or how you choose to identify, there's room for you to realize your potential here. And importantly, there's room to be yourself.
We're also committed to providing equal opportunities to all candidates. Let us know if you have any accessibility requirements so we can work with you to make adjustments where possible to support your application. Alternatively, if you don't meet all the requirements of the role but think you would be a great candidate, please apply explaining why you want the role, how you think your skills or background are transferable, and how you plan to upskill where needed (we will support you with this, but want to know you have thought about this too).
To be eligible to apply, you must have the right to work in New Zealand. Please note candidate screening and interviews may be conducted prior to the closing date of the job advert.

#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Allthetopbananas_Ppc

Requirements

Programme Lead

He angitutanga: The opportunity Auckland Council Libraries is the largest public library service in Australasia and the Library and Learning Services unit d...


Auckland Council - Auckland

Published 20 days ago

Technical Service Specialist

Technical Services Specialist Part Time Role – 12 – 18 hrs per week South Auckland Based Our client is seeking a Technical Service Specialist to perform on-s...


Nes Fircroft - Auckland

Published 20 days ago

Android Mobile App Developer (Contract To 22 December)

Android Mobile App Developer (contract to 22 December) Developers/Programmers (Information & Communication Technology) Contract/Temp Up to $130,000 pa, pro r...


Journey - Auckland

Published 20 days ago

Senior Information Sharing Advisor - Fixed Term / Secondment To 30 June 2025

Do you want to play an important role in the protection of New Zealand's borders? Work with a team that values collaboration and innovation. Be part of a p...


New Zealand Government - Auckland

Published 20 days ago

Built at: 2024-11-15T06:05:47.039Z