Summary
We have big ambitions to make better use of its data assets to create value for its end users and speed the transition to net-zero carbon emissions. This is the chance to shape the data programme managing a small team (3) of data engineers to provide high quality data through resilient data pipelines that your team will build and maintain. You will play an instrumental role in our agile data team enabling world-class data analytics and data science through a cloud-based data-lake and virtual warehouse. The platform will provide access to secure, centralised and reliable enterprise data.
We are looking for someone with experience building data pipelines to help us “do it right” and develop a world-class data platform that can be easily maintained and widely used. You will be working with a friendly team, AWS consultants and associated specialists to design, deploy and maintain a modern data environment, utilising the latest technology and innovation.
This is an exciting role for an existing data engineer looking for a step into management. We offer a flexible working environment with a strong belief in on-going development and career opportunity. We are looking for practical experience and passion, an individual who wants to keep learning and wants to be at the forefront of their profession.
We are committed to leading the transition to a new zero carbon economy, we work with customers, partners and communities and are committed to operating at the highest economic, social and environmental standards. Join us in our quest to make zero carbon happen.
Responsibilities
Develop strategy for, manage and motivate a team of 3 data engineers
Develop Python (Pandas) or Spark code to process data into different formats in an AWS data lake
You will create highly reusable well-documented data pipelines that bring data into the lake as well as designing flexible structures that the business can use to generate insights to support decision making and drive value
You will be recognised as an expert in the data held by us, understanding how data captured in processes makes its way through the data lake and into end-user reporting
You will run workshops with a wide range of business stakeholders to understand their data needs and translate these into designs that will use the core AWS toolset to deliver robust and reliable data
You will demonstrate the art-of-the-possible to a wide-range of business stakeholders – shaping and influencing their thoughts, and the future development of the platform, to best deliver business outcomes
You will ensure that all BAU data services are running to the required availability and latency metrics
You will be responsible for putting in-place the relevant IT Support models for all data-services
You will have responsibility for deploying changes to existing procedures ensuring low downtime with rapid response while complying with change management processes.
You will work with AWS consultants to continually develop and enhance the data services and your own skills.
A satisfied community of data customers
Prioritising conflicting requirements to make best use of limited team development time
Creating and maintaining automated data processes with built-in validation and control
Successfully populating the data lake with well curated and controlled data that fulfils multiple business use cases
Finding opportunities to create strategic solutions that can be applied quickly and easily to many use-cases
Building and maintaining a data lake and associated tooling to fulfil use cases and offer cost and effort transparency
Fully comply with data protection and corporate information security requirements
Key milestones met for the data programme
This role is part of an agile team, the role offers a great opportunity for the right candidate to hone their modern data management skills in a friendly and supportive environment
This role can be home or office based, we support flexible working
Able to work effectively as part of a remote team
A great opportunity for a talented data engineer seeking an opportunity to step-up and deliver through more people
Requirements
Coding experience in Apache Spark or Python (Pandas) essential
Coaching and developing technical skills in others
Direct experience with SQL, data modelling, data warehousing, metadata management or building ETL pipelines
Able to design, write and iterate code from test to production ready
Understands specific technologies that underpin the work you undertake
Able to effectively communicate to technical and non-technical stakeholders and peers
Desirable: Experience turning data requirements into data models
Desirable: Experience working with AWS data technologies (S3, Redshift, Glue, Lambda)
Experience of using AWS cloud computing services (or other cloud provider)
Degree in Mathematics, Science, Computing or similar advantageous
Experience in a data engineering role i.e., building data pipelines for either a Data Warehouse and/or a Data Lake
Experience using Python (Pandas) or Spark to deliver business value
Strong experience using SQL
Experience of any of the following AWS services will be a significant advantage: Redshift, Lambda, Glue, Athena, Step Functions, Cloud formation, DMS, EMR, S3
Any AWS qualification
About NRL
NRL connects global engineering companies with the right people to help their businesses grow and thrive, connecting organisations and candidates that share the same values and drive to succeed. As we progress your application our team of talented recruiters will be on hand to help you explore the role and answer any questions you have.
We welcome applications from every walk of life, and are committed to driving diversity and inclusion within the industries we support. That’s why our Member Committed to Diversity status with the Association of Professional Staffing Companies is so important to us.