Associate Data Engineer inSheffield inSheffield PUBLISHED MON 16 DEC 2024

A vacancy has arisen for a full time, permanent Associate Data Engineer to support the development and ongoing function of our Data Centre within the Software team at NHS South Yorkshire.

The position is to assist in the maintenance and expansion of the Integrated Care Boards database repositories. This role requires excellent SQL skills and experience of database management of a large data warehouse.

If you have used any Artificial Intelligence (AI) programmes, such as ChatGPT, to support your application, please declare this at the start of your supporting statement.

Interview date: 31/1/2025

Please note as an organisation we are unable to offer visa sponsorships.

This role will:

• Provide day-to-day maintenance of our Azure SQL and Azure SQL Managed Instance Databases
• Build, monitor and maintain Azure Data Factory (ADF) Pipelines
• Understand and utilise other Microsoft Fabric and Azure services like Storage, Events, Alerts, Power BI, and Analysis Services Understand and implement appropriate security and compliance measures based on NHS policies and industry best-practice.
• Document sources and logic used to build Data Centre structures.
• Communicate complex analytical matters to others and advise accordingly.
• Maintain and monitor the Data Centre to ensure high availability for end users and analysts and continue development.
• Working with the external organisations and key ICB contacts

The ideal candidate will:

• Have experience of NHS systems
• Have experience of working with cloud-based data platform solutions
• Have experience of working in a multi-disciplinary team

About us

The post holder supports the management of data across its full lifecycle, from data extraction, through transformation and loading into a curated asset and data products for onward use in the production of analytical insights. Working as part of multi-disciplinary teams alongside colleagues from across Data & Insights, the role holder will ensure that data are handled in an efficient and secure way in line with information governance legislation.

The role holder will apply skills across a range of data management and analysis areas including:

Supporting Requirements gathering and build of specifications across a wide array of stakeholders, both internal and external

• implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems
• document source-to-target mappings
• re-engineer manual data flows to enable scaling and repeatable use
• support the build of data streaming systems and automated reports
• write ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally
• develop business intelligence reports that can be reused and build accessible data for analysis
• Cloud and on-premise database and data pipeline management

The post holder can work under direction to identify and use the most appropriate techniques, and you have an understanding of data engineering tools. You can demonstrate numeracy. You can show an awareness of advances in digital analytics tools and data manipulation products and can keep up to date with them. You can collect, collate, cleanse, synthesise and interpret data to derive meaningful and actionable insights.

This post will comply with all regulatory requirements in such areas as data quality and data security, within an environment that is committed to the proper governance and secure use of data.