We are seeking a skilled Data Engineer to join our team and play a pivotal role in shaping our clients' data ecosystems. This role involves designing and developing data schemas, curating data, and improving workflows using cutting-edge technologies, including Snowflake and various ETL tools.
As a Data Engineer, you will actively contribute to both change initiatives and business-as-usual (BAU) activities to enhance and maintain their core data platforms. You will also support domains by demonstrating leadership in creating and maintaining critical data-related infrastructure and pipelines.
Key Responsibilities:
Database Design & Development: Create and optimise data schemas and curation processes for clients.
ETL Processes: Utilize tools like Python and Informatica to efficiently extract, transform, and load data.
Automation & Workflow Improvements: Identify and implement automation opportunities to enhance workflows.
Orchestration: Manage workflows using orchestration tools such as Airflow and Jenkins.
Incident Resolution: Diagnose, test, and resolve production incidents for assigned applications.
Platform Support: Lead efforts in supporting both legacy and future platforms, contributing to a seamless transition for clients.
About You
Essential Skills & Experience:
A strong background in modern data engineering practices.
Proficiency in developing complex SQL queries for databases like AWS Redshift, Snowflake, and Oracle.
Hands-on experience with ETL processes and tools.
Working knowledge of engineering standards and principles.
A collaborative mindset with a willingness to contribute across various team functions.
Desirable Skills:
Experience with Python, Jenkins, Airflow, and AWS (e.g., S3 buckets, data transmission).
Familiarity with Snowflake and Pyspark.
Proficiency in scripting (Unix or Python).
Knowledge of data assurance in the banking or financial services sector.
Risk management skills.
If this sounds like you - apply now!
*We can wait notice periods and there are multiple positions*
Kia ora, Comspek and our clients fully support and encourage diverse hiring and inclusive recruitment processes. Don't meet every single requirement of this job description? That's ok - You do not need to tick every box or have expertise in the full JD. Comspek is dedicated to building diverse, inclusive and authentic workplaces based on different clients' needs. So, if you're excited about this role, we encourage you to apply.
#J-18808-Ljbffr