CircularPSP AI-training Evaluation is Complete

TAGES successfully conducted three-way analysis and evaluation during the prototype testing phase.

-          Evaluation and assessment of the Circular Economy Taxonomy provided by CircularPSP Buyers Group;

-          Evaluation and assessment of the Circular Economy trained AI of suppliers;

-          Benchmarking of enhanced training with Circular Economy-specific taxonomy with the regular trained commercial-AI’s

TAGES evaluation team consisted of Eda Telli Yamamoto, who currently working on a similar topic on her PhD-thesis, and Erdem Gülgener, with his 40 years of experience in Computer Science. Istanbul Metropolitan Municipality (IMM) also collaborated to assess the results in terms of circularity-level.

A set of comprehensive use cases and supplementary questionnaire were developed for conducting the tests. Then use-cases and questionnaire were fed to each AI, which took part in the benchmarking, its results were recorded, standardised and exported to benchmarking tables, where similarities, expertise levels, strengths and weaknesses are thoroughly assessed.

The results are surprisingly satisfactory; The-AI’s which received enhanced training with the provided taxonomy performed way better with the responses with the main-stream commercial-AI’s. The successful results indicate that both taxonomy and the AI-training teams of CircularPSP suppliers are adequate.

Improvement areas of the existing taxonomy and each supplier’s AI are identified and reported to the related teams and parties for next prototype testing. We are eager to analyse next version.

CircularPSP (Public Service Platforms for Circular, Innovative and Resilient Municipalities through PCP Project) brings together 8 cities from 8 countries, representing 45 million citizens, to invest €5.64 million in R&D to tackle common challenges following a pre-commercial procurement (PCP) approach. Pre-Commercial Procurement challenges industry from the demand side to develop innovative solutions for public sector needs and it provides a first customer reference that enables companies to create competitive advantage on the market. Project started in January 2023 and will run until April 2026.

A tender for this challenge was created and published in between January 2023 and April 2024. 15 applications were assessed and 5 supplier consortiums were selected for Phase I - Solution Design (June 2024 - October 2024). From those suppliers 3 were selected to go through Phase II – Prototype Testing, started in November 2024. The first prototype was developed by our Suppliers, CircularAI, VCG.AI and CIRRUS, and the testing has now been completed. In May 2025, the second prototype will be showcased and tested.

Want to Get Involved?

If you're a business, city, or public buyer interested in the CircularPSP initiative, we invite you to become a follower and stay updated on project developments.

👉 Visit www.circularpsp.eu to learn more.