GEL-BRT-681-24: Data Engineering Services

Description

Summary of work The outcome of this procurement is to deliver the following projects: 1) Python and Prefect Automation. 2) Postgres SQL development and administration 3) Alteryx Flow development 4) API Layer development 5) Data migrations 6) Release Management Where the supplied staff will work London Why the work is being done For the past 18 months, the Research Data Layer (RDL) Squad has been improving current processes and pipelines, as well as ressing technical debt. The intention is to reduce the effort required to run and maintain data release processes whilst keeping up with an ever-growing demand for data and new cohorts of participants. The squad’s limited capacity prevents Genomics England Research from updating its current pipelines for ingestion into the National Genomics Research Library (NGRL), reducing the velocity of new data being available to researchers and making it difficult to make any significant improvements to our existing data offering. The business problem To improve the quality of products available in NGRL and the velocity at which we can release data. The people who will use the product or service User type: External Customers Definition: External Customers accessing the data used in the NGRL to support research and clinical activity. User type: Internal Teams Definition: Internal Teams Which phase the project is in Beta Existing team Genomics England Limited is a healthcare company owned by the UK government with a mission to enhance genomic healthcare and accelerate genomic research. We developed the National Genomic Informatics System (NGIS), which is the technology platform that underpins the NHS’s Genomic Medicine Service. We also created Research Environments which provide a secure way for genetic researchers to access anonymised genomic data in studies into the genetic determinants of disease outcomes. The squad’s limited capacity prevents Genomics England Research from updating its current pipelines for ingestion into the National Genomics Research Library (NGRL), reducing the velocity of new data being available to researchers and making it difficult to make any significant improvements to our existing data offering. The Squad consists of Product Owner, Agile Coach, Data Engineers, Data Wranglers, Data Managers, Quality Assurance and Bioinformaticians Address where the work will be done Genomics England, One Canada Square, London, E14 5AB Blended working model from GEL offices in London, Cambridge and Leeds. The majority of the team are based between home working and our London offices. Working arrangements The supplier will be expected to adopt GELs ways of working and will not be able to claim expenses the their priniciple office. Suppliers will deploy resources to work under the direction of Genomics Englands Head of Digital Communications, Product Managers, Service Delivery Managers and Genomics England designers to deliver outcomes against specific statements of work and timelines. Progress against outcomes will be managed through transparent agile processes including a regular rhythm of update meetings. The supplier may occasionally be required to attend a session in-person at the London office, for which expenses will be reimbursed in line with the Genomics England staff policy Security and vetting requirements No security clearance needed Latest start date 1 April 2024 Expected contract length Contract length: 0 years 6 months 0 days Optional extension: 0 years 3 months 0 days Budget Indicative maximum: £250000 Indicative minimum: The contract value is not specified by the buyer Further information: Anticipated spend under this contract is £250k. This is will not be committed but will be called off, as required, under SOW arrangements during the period. Contracted out service or supply of resource? Supply of resource: the off-payroll rules may apply