Provision of a Data Integration Platform - 2024UoS-1334

Description

Summary of work This innovation programme involves the University of Southampton committing to the development of a Microsoft Azure data integration platform. This platform is intended to support the categorisation, governance, storage, transfer, presentation, and utilisation of data. The ultimate goal is to transition the University of Southampton towards a more responsive operational model that enhances data literacy and uniformity, fosters collaboration, enables self-service capabilities, and stimulates innovation. It is envisaged that the supplier partner will build the data integration environment within the University's current well architected Azure tenancy and to provide technical capacity to setup a best practice integration platform within our current Azure tenancy and hand this over to our internal teams in a supported structure ready for BAU operational tasks and augment the University's integration engineering and development resources. It is also anticipated that supplier resources will be available for call off as and when required during the contract. The supplier will provide a recommendation of expected delivery resources for each call off task. We expect the partner to mentor and guide the UoS team in the implementation of best practice. The supplier will provide time and resource estimates to deliver and supplement the platform and (for example) integration flows based on t-Shirt sizing. An example structure might take the form: Access to a data team for 350 guaranteed days per annum under a specific SLA to provide UoS available capacity in the team to deliver on a backlog of project initiatives relating to the data initiative. This might be made up of the following capabilities: Data Architect Data Engineer Data Analyst Data Scientist Data Integration Specialist The partner will be responsible for creation and implementation of an effective delivery methodology. The 350 guaranteed days per annum are a baseline and any unused days should be rolled-over into the next contract year, conversely the University should be able to purchase additional days if required based on an agreed rate card. The University is undertaking this project in order to deliver the following benefits: 1 Sustainability The cloud plays an essential role in helping organisations become more sustainable. It facilitates a business case for a sustainable approach by reducing the carbon footprint and associated costs while fostering the research and innovation required to build a viable future. By virtue of its architecture, the cloud can reduce carbon emissions and facilitate sustainable innovation and research. But moreover, the cloud is where massive data analysis supported by a web of data networks allows scientists to identify and discover new methods to bring about lasting social and economic change. The sustainability business case for the cloud is quite simple: it reduces the on-premises footprint with power/cooling, hardware, and compute power. 2 Staff experience The implementation of a centralised data platform is anticipated to significantly enhance the user experience for staff. This enhancement includes better analytics and reporting capabilities, facilitating improved decision-making processes. This initiative is a key component of the overarching digital transformation strategy, aiming to optimise operational efficiency and data-driven insights across the organisation. 3 Student experience Students are expected to benefit from an improved end-user experience, characterized by enhanced analytics and reporting through the centralized data platform. This advancement supports more informed decision-making and the ability to make real-time updates to data, thereby eliminating the current delays. The initiative underscores a commitment to providing a responsive and data-informed educational environment. 4 Data Protection Compliance The adoption of a centralised data access mechanism, alongside the use of reusable interfaces, will significantly improve data governance within the organisation. This approach not only streamlines data management but also ensures compliance with data protection regulations, safeguarding sensitive information and enhancing overall data security governance by central data access mechanism and reusable interfaces. This procurement seeks to secure a partner to design and deliver on the University’s aspirations. Where the supplied staff will work No specific location (for example they can work remotely) Why the work is being done Data is key University asset, which is crucial to the operation of the University and for enabling a more data driven organisation of the future. We need reliable data sources to be consumed in an efficient, safe, and effective way across multiple platforms such as Banner, IDM/IAM, Resource Link and Microsoft Dynamics (to name but a few) and it is critical to underpinning the capability of the University’s strategic digital ambitions. With the adoption of a new cloud based modern Data Integration platform, hosted on Microsoft Azure platform, it will empower the university with a modern tool set which is cost efficient and easy to use. It will enable out 0f the box integration with existing and future University systems. Whilst traditional systems require significant capital investment the flexible pricing models of Azure Integration Services offers consumption-based pricing models. This work is the key enabler to other aligned activity, which is focused on availability of secure, quality assured data sets. Data security is vital for the university to manage as the volume of data we collect continues to rise. Secure policies, procedures and rules will help to keep information safe and secure, both to maintain internal privacy and for the ongoing confidentiality of our users. The initial focus will be on prioritising critical areas such as student systems and then integration can be progressively augmented over a five-year period whilst retiring current technologies such as Microsoft Biztalk, which is currently used for enterprise application integration, and which is fast approaching end of life support from Microsoft. There will be a heavy reliance on testing throughout all phases of the project and will need to work with Faculty staff for Use Acceptance Testing. This project serves as a foundational core service for the University, underpinning the broader digital strategy and aligning to the Operational Excellence Strategic Plan. Without this Integration Platform the University will not be able to move towards a more responsible operational model, which enhances data literacy and uniformity, fosters collaboration, enables self service capabilities, and stimulates innovation. The ultimate goal is to transition University of Southampton towards a more secure, responsive operational model that enhances data literacy and uniformity, fosters collaboration, enables self-service capabilities, and stimulates innovation. The business problem The University operates a highly complex digital operating environment, with a wide range of systems have been deployed to support the numerous processes required of a modern higher education institution. Modelling, mapping, and transferring data between systems is an important underpinning capability, required to provide seamless service provision and support for an effective, compelling end user experience. A recent Data Strategy report from within the University identified several critical issues which negatively impact the experience of students and staff, the quality of executive-level reporting, research functions, and collaborations within the University’s partner network. Furthermore, the impending end-of-support status of key systems such as Microsoft Biztalk, currently used for enterprise application integration, underscores the urgent need for deployment of a contemporary data integration platform. The last version of Biztalk is Microsoft last planned release before they move to Cloud only alternatives. Therefore, there is a critical timeline to move from the current version to facilitate a move to the Cloud version as soon as possible, due to the size and complexity of the intended migration this will be a multiyear undertaking. These challenges and pain points underscore the implications of inaction and their current detrimental effect on University of Southampton as an institution. The issues can be broadly categorised into areas that presently serve as barriers to the organisational business performance. The people who will use the product or service User type: Data analysis and data engineering roles Definition: define data structures, models, interfaces and integrations User type: Report analysts Definition: consume and present data via BI reporting tools User type: Application developers Definition: consume data via well defined APIs Work done so far The University has an agreed business case (with funding) to deliver an Azure Cloud based integration platform. A proposed High Level Design has been completed - it is expected that the design be validated by the supplier and then implemented. Which phase the project is in Not applicable Existing team The planned project team consists of Team Manager, 6 Senior Data Engineers, Senior Reporting Engineer, Cloud Infrastructure Engineer and Senior Meta Data Engineer. Project Managers, business continuity manager, senior business analyst. Further work with the wider in-house applications teams is expected Address where the work will be done The supplier will be required to work primarily remote with occasional physical presence in our Southampton City Centre office to attend planning and design workshops. Expenses for on site workshops will be capped at £500 / day for the duration of the contract, and all travel and subsistence will require prior approval. Working arrangements The supplier will be required to work primarily remote with occasional physical presence in our Southampton City Centre office to attend planning and design workshops. Expenses for on site workshops will be capped at £500 / day for the duration of the contract, and all travel and subsistence will require prior approval. Security and vetting requirements Baseline Personnel Security Standard (BPSS) Latest start date 30 October 2024 Expected contract length Contract length: 2 years 0 months 0 days Optional extension: 1 years 0 months 0 days Special terms and conditions special term or condition: The Insurance levels required for this tender have been amended to include the requirement for bidders to hold £5,000,000 Cyber Liability Insurance. Please see the Annex to (File 5) Call Off Conditions of Contract – Joint Schedule 3 for full insurance requirement details. Budget Indicative maximum: £1740000 Indicative minimum: The contract value is not specified by the buyer Further information: The estimated Contract value is £1,740,000 GBP (excluding VAT). This figure is based on a project budget of £690,000 for delivery of the specified requirements (including 350 days guaranteed resource to augment the UoS team) for the full term of the Contract, with the option to purchase additional resource days throughout the term of the Contract, as required and up to a total overall spend of £1,740,000. The University reminds tenderers that commercial responses must be submitted in accordance with the Framework pricing agreed as part of the original tender process. Therefore, commercial proposals must not exceed the published framework rates. Tenderers may consider reducing their rates in order to submit a more competitive response at Further Competition Stage. Details of current expenditure or potential future uptake are given as a guide based on past purchasing and current planning to assist you in the preparation of your response. They should not be interpreted as an undertaking to purchase any goods or services to any particular value and do not form part of the Contract. Contracted out service or supply of resource? Contracted out service: the off-payroll rules do not apply