GSCIP Data analysis and visualisation tools

Description

This PIN is for Market Engagement purposes only. DIT leads a cross-government pilot to test the feasibility and value of combining government and private sector data sets to build global supply chain understanding. The heart of this pilot is a graph database which is enhanced by adding other data sets which we provide or procure, to probabilistically infer relationships between products, entities, and geolocations for global supply chain mapping. This PIN is to engage with data analysis and visualisation software providers who can supply data analysis and visualisation tools that can be used to analyse and display our knowledge graph data and relationships to improve our supply chain mapping capabilities. Lot 1: The Global Supply Chains Intelligence Pilot (GSCIP) is a pilot project led by DIT and supported by five other departments which has combined government and private sector data to build detailed global supply chain maps using a knowledge graph (currently provided by Altana), and graph data analysis and visualisation tools. We are engaging with the market to find potential partners for a further two years of development and testing of this concept (April 2023-March 2025.) We currently have around 25 analysts testing specific use cases across the six departments, but we expect the number of departments and analysts may increase during the next two years and some operational use cases will arise in response to global events. The current prototype infrastructure comprises a secure digital environment for storing, linking, and analysing HMG, commercial and open-source data. The environment features graph database capabilities, specialist data visualisation software, and analysis tools, such as Spark SQL, Python and R, for supply chain mapping. The prototype resides within the core DIT infrastructure. We would like to hear from companies that already have graph database analysis and visualisation software which can be deployed to our infrastructure and be used to interrogate our knowledge graph by analysts without coding skills. The visualisation part of the software needs to be able to visualize 2M+ edges without disabling features, and must be able to do interactive real-time analytics on 100M+ edges. We would like it to have connectors for various graph databases, non-graph databases, and tabular+graph files, be compatible with modern data format support (Apache Arrow etc.), and work with dominant tools such as Jupyter notebooks and StreamLit/Dash/Databricks dashboards. Due to the sensitivity of the data, the knowledge graph and data sets will need to be assured by government data assurance processes including ISO27001 or equivalent, an ability to show evidence of a strong security posture, penetration testing by a CHECK service provider and Government Information Risk and Cyber Security assurance processes. The software should be SOC2 Type 2 + ISO27001 compliant, with continuous evidence available. In addition, any supplier staff having access to our copy of the knowledge graph will need to have SC security clearance. We expect to have a decision on funding for the continuation of the GSCIP in December 2022 and will have limited time to procure the required analytical tools before the current agreements end in March 2023. For this reason, we are only engaging with suppliers that already have the tools that we require so that they can be procured in March 2023 and available for use in April 2023. The estimated value for analysis and visualisation tools for the two-year pilot continuation above is only our best current estimate of what our budget will allow. We may be funded at a higher or lower level. Additional information: For these procurements we are likely to use CCS framework agreements such as G-Cloud 13, Spark DPS or AI DPS. The latter two can be joined at any time: https://www.crowncommercial.gov.uk/agreements/RM6094 https://www.crowncommercial.gov.uk/agreements/RM6200