Westminster City Council - ITT for a Data Hub Implementation Partner

Description

This opportunity is being procured via the Crown Commercial Service Spark DPS (RM6094). Therefore to be able to submit a tender, you must be registered as a supplier on the DPS. Please note that this can take up to 15 days; * Register on the DPS by following the below link by 5pm (UK time) on Friday 11th April 2025. https://supplierregistration.cabinetoffice.gov.uk/organisation/register * Register on Westminster City Council's (WCC) eProcurement system Jaggaer https://wcc.ukp.app.jaggaer.com * Westminster City Council will pull a shortlist on Wednesday 7th May based on the Spark DPS registered suppliers. Please note that it is the Supplier's responsibility to ensure that they are registered on the DPS and showing live prior to this date. * Shortlisted suppliers will be added to the opportunity and able to view & submit a bid WCC is looking to develop its next generation, strategic data platform, to underpin its reporting, analytics, AI and personalisation goals. The platform will leverage Snowflake as its core data warehouse, likely supported by a range of other products and services. The programme of work will involve consolidation of a range of existing data platforms through migration activities, as well as identifying and processing new datasets to fuel new data products. The programme will likely involve several phases. In first instance, the contract will focus on Phase One, covering delivery items related to the Data hub and Data deliverables. Future phases, that are in scope, will be subject to variations throughout the contract term, as and when required as the programme progresses and subject to budget approval. Phase 1 The initial phase will be to design the new data warehouse environment, then migrate and refactor the existing corporate data warehouse. It will involve discovery and analysis around the data sets, privacy considerations, etc. of the data held in the existing Microsoft SQL Server environment. These datasets and their data pipelines will need to be migrated onto the Snowflake environment. Downstream dependencies such as Power BI dashboards will need to be repointed and if necessary, redesigned. Importantly, this will require extensive refactoring. For example, ingestion may move from SQL Server Integration Services (SSIS) to Azure Data Factory (ADF) and the overall architectural pattern will move from ETL to ELT. The migration is therefore not a "lift and shift" migration. However, the scope will be limited to datasets currently processed into the existing CDW. It should be noted that the advertised estimated budget of up to £3.87million represents the full potential project and is subject to further budgetary approval. The initial Phase One budget is up to £850,000.00. Further phases and additional expenditure will be confirmed as the programme progresses and are discretionary, subject to both budgetary approval and the requirements of the council, therefore not guaranteed to the supplier. Lot 1: This opportunity is being procured via the Crown Commercial Service Spark DPS (RM6094). Therefore to be able to submit a tender, you must be registered as a supplier on the DPS. Please note that this can take up to 15 days; * Please register on the DPS by following the below link by 5pm (UK time) on Friday 11th April 2025. https://supplierregistration.cabinetoffice.gov.uk/organisation/register * Register on Westminster City Council's eProcurement system Jaggaer https://wcc.ukp.app.jaggaer.com * Westminster City Council will pull a shortlist on Wednesday 7th May based on the Spark DPS registered suppliers. Please note that it is the Supplier's responsibility to ensure that they are registered on the DPS and showing live prior to this date. * All shortlisted suppliers will be added to the opportunity and able to view and submit a bid. Westminster City Council (WCC) is looking to develop its next generation, strategic data platform, to underpin its reporting, analytics, AI and personalisation goals. The platform will leverage Snowflake as its core data warehouse, likely supported by a range of other products and services. The programme of work will involve consolidation of a range of existing data platforms through migration activities, as well as identifying and processing new datasets to fuel new data products. The programme will likely involve several phases. In first instance, the contract will focus on Phase One, covering delivery items related to the Data hub and Data deliverables. Future phases, that are in scope, will be subject to variations throughout the contract term, as and when required as the programme progresses and subject to budget approval. Phase One: The initial phase will be to design the new data warehouse environment, then migrate and refactor the existing corporate data warehouse. It will involve discovery and analysis around the data sets, privacy considerations, etc. of the data held in the existing Microsoft SQL Server environment. These datasets and their data pipelines will need to be migrated onto the Snowflake environment. Downstream dependencies such as Power BI dashboards will need to be repointed and if necessary, redesigned. Importantly, this will require extensive refactoring. For example, ingestion may move from SQL Server Integration Services (SSIS) to Azure Data Factory (ADF) and the overall architectural pattern will move from ETL to ELT. The migration is therefore not a “lift and shift” migration. However, the scope will be limited to datasets currently processed into the existing CDW. It should be noted that the advertised estimated budget of up to £3.87million represents the full potential project and is subject to further budgetary approval. The initial Phase One budget is up to £850,000.00. Further phases and additional expenditure will be confirmed as the programme progresses and are discretionary, subject to both budgetary approval and the requirements of the council, therefore not guaranteed to the supplier.