Data Engineers are responsible for developing and maintaining ETL solutions that support the organisation’s central data warehouse and Power BI reporting environment. The role involves building and managing data interfaces between information systems, transforming diverse data sources into curated datasets, and ensuring high‑quality, reliable data flows. Working within a mature Microsoft‑based reporting ecosystem and an Agile Scrum methodology, Data Engineers play a key role in enabling analytics, reporting, and master data management across the business.
Job Responsibilities
ETL Development & Integration
- Develop and maintain ETL integrations using Azure Data Factory and related technologies.
- Connect multiple data sources to the central data warehouse and integrate them into the reporting data model.
- Build and maintain master data interfaces between systems using a range of integration methods.
- Transform data from multiple systems into curated, high‑quality datasets for reporting and master data management.
Solution Architecture & Technical Leadership
- Contribute to the development of BI solution architecture and secure datasets using the Microsoft application stack.
- Lead and support ETL solution design, ensuring scalability, robustness, and alignment with business needs.
- Assess new systems and solutions to identify integration requirements and opportunities.
- Integrate acquired (M&A) systems into the data warehouse and align them with the existing data model.
Coaching & Stakeholder Support
- Coach and mentor junior BI professionals, supporting their technical development.
- Work with clients across Oil, Gas, and Nuclear sectors to address integration and reporting challenges.
- Liaise with software vendors to deliver bi‑directional master data interfaces and extract data for reporting.
Data Quality, Governance & Documentation
- Resolve data integrity, quality, and robustness issues across legacy and system data.
- Develop and maintain process maps, ETL topology diagrams, and clear documentation for ETL configurations.
- Ensure all integration activities comply with internal standards, governance frameworks, and security requirements.
General Duties & Responsibilities
- Drive excellence through effective and efficient use of systems.
- Understand and document business requirements across short‑, medium‑, and long‑term horizons.
- Conduct lessons‑learned sessions with end users, key users, and process owners to ensure solutions evolve with business needs.
- Develop and maintain consistent solutions across the approved application suite.
- Maintain confidentiality of sensitive data and information.
- Build and maintain workflows and process automations to support digital transformation.
- Support Business Systems Analysts and project leads in delivering wider digital initiatives.
Date Posted