FTS - Westminster City Council - P390 Contract for a Data Hub Implementation Partner

WCC is looking to develop its next generation, strategic data platform, to underpin its reporting, analytics, AI and personalisation goals. The platform will leverage Snowflake as its core data warehouse, likely supported by a range of other products and services.

The programme of work will involve consolidation of a range of existing data platforms through migration activities, as well as identifying and processing new datasets to fuel new data products. The programme will likely involve several phases.

In first instance, the contract will focus on Phase One, covering delivery items related to the Data hub and Data deliverables. Future phases, that are in scope, will be subject to variations throughout the contract term, as and when required as the programme progresses and subject to budget approval.

It should be noted that the advertised estimated budget of up to £3.87million represents the full potential project and is subject to further budgetary approval. The initial Phase One spend is up to £799,273.00.

Further phases and additional expenditure will be confirmed as the programme progresses and are discretionary, subject to both budgetary approval and the requirements of the council, therefore not guaranteed to the supplier. WCC is looking to develop its next generation, strategic data platform, to underpin its reporting, analytics, AI and personalisation goals.

The platform will leverage Snowflake as its core data warehouse, likely supported by a range of other products and services. The programme of work will involve consolidation of a range of existing data platforms through migration activities, as well as identifying and processing new datasets to fuel new data products.

The programme will likely involve several phases. In first instance, the contract will focus on Phase One, covering delivery items related to the Data hub and Data deliverables.

Future phases, that are in scope, will be subject to variations throughout the contract term, as and when required as the programme progresses and subject to budget approval. Phase 1 The initial phase will be to design the new data warehouse environment, then migrate and refactor the existing corporate data warehouse.

It will involve discovery and analysis around the data sets, privacy considerations, etc. of the data held in the existing Microsoft SQL Server environment. These datasets and their data pipelines will need to be migrated onto the Snowflake environment.

Downstream dependencies such as Power BI dashboards will need to be repointed and if necessary, redesigned. Importantly, this will require extensive refactoring.

For example, ingestion may move from SQL Server Integration Services (SSIS) to Azure Data Factory (ADF) and the overall architectural pattern will move from ETL to ELT. The migration is therefore not a "lift and shift" migration. However, the scope will be limited to datasets currently processed into the existing CDW.