DA039 - Senior Data Engineer

JOB TYPE: CONTRACT

JOB ID: 41292

SALARY TYPE: DAILY

PER DAY PAY: From GBP £450.00 to GBP £500.00

Vacancies: 1

ADDED DATE: 06-03-2024

JOB DESCRIPTION:

SC/DV Cleared - Senior Data Engineer

 

12 months +

Hybrid-working (London / Remote)

Inside IR35

 

Our client, a central government customer, are currently looking for a Snr. Data Engineer to join an exciting programme for 12 months. Data services are very much a priority as set out in the DDaT strategy and wider government agenda as well as one of the key pillars of work in delivering the clients vision and mission in being more data driven.

 

Data Engineering and Architecture makes it easier to solve problems in executing complex datasets with reliability. Allowing the client to optimise data towards usability by transforming and modelling it to be usable in a way that can help Analysts visualise data for consumption.

 

Data can provide the client with the following:

• Help identify patterns and trends in data
• Stronger evidence base for policies and operations
• Better prediction of future trends
• Improved quality of decision making
• Faster operational response window
• Wider data availability and access
• Provide greater accountability
• Reduction in duplication and error

 

Key Skills / Experience

• MySQL as their data warehouse solution
• Data Pipelines are formed from AWS components such as S3
• Python & SQL are their most used languages

 

The Senior Data Engineer will be required to work towards the following:

• Onboard new data sources to the data platform for highest priority reporting requirements
• Maintain and test pipelines for reliability and performance
• Ensure monitoring and scanning for pipelines conforms to vulnerability management processes
• Monitor and conduct production deployments/releases
• Working collaboratively with Data Analysts to model data to deliver information requirements
• Deliver the technical roadmaps including technical and non-functional stories
• Assist with identifying and diagnosing incidents and problems
• Review large design changes to ensure correct technical direction is being taken that aligns with NCDS long term vision
• Providing technical input/pair-programming difficult problems where necessary
• Keep applications up to date in line with Infrastructure and Platform Support teams requirements, mitigating vulnerabilities and reducing risks
• Integrate an Analytic Software (eg Matomo) with NCDS applications so the business can see how users use the products, where we can get the most value and where efficiencies can be made
• Identify opportunities and make recommendations to improve functionality, applications, saving running costs, reducing tech debt etc.
• Ensure governance around data handling, ingestion, storage and retention
• Ensure best practices around data management and analysis
• Identify cost optimisation opportunities across the DO Data Analytics platform
• Support data quality standards
• Performance optimisation of data platform, its components and applications

 

Working Arrangements

 

Working at home with 1-2 days per week either working at the permanent location (2MS) or at an additional location with expensed travel.

 

Minimum Clearance: SC

 

Please apply for further information.