DOI: 10.12688/openreseurope.22944.1 ISSN: 2732-5121

Monitoring effectiveness in sustainability demonstrations: a reproducible framework integrating stakeholder engagement and continuous feedback

Ilias Karachalios, Nikolaos Tantaroudas, Christos Makropoulos
Show PDF Cite
Background Real-world sustainability demonstrations usually need to balance two competing requirements: local adaptation to specific contexts and comparability across pilots, countries, and stakeholder groups. Methods This Method Article presents the monitoring framework developed in the CHOICE project to address that challenge across five heterogeneous pilot demonstrations in Austria, Spain, Greece, Colombia, and South Africa. The article documents the overall monitoring architecture, the operational definition of effectiveness, and the logic used to compare diverse interventions without requiring identical indicators in all settings. The framework combines five evaluation dimensions - reliability, user acceptance, user-friendliness, transferability, and behavioural conversion - with a mixed-methods evidence pipeline integrating digital analytics, stakeholder questionnaires, qualitative inquiry, Participatory Labs, and structured internal reporting. A conversion-types pathway is used to trace progression from awareness and interest to engagement, action, and continuation. Stakeholder engagement and feedback are treated as methodological inputs that support iterative adaptation during implementation rather than as separate project activities. The framework also incorporates risk management, privacy safeguards, and the use of A/B testing where feasible. Results This article does not report pilot outcomes. Conclusions The article provides a reproducible methodological blueprint to guide data collection, interpretation, iterative refinement, and future cross-pilot analysis in complex sustainability demonstrations.

More from our Archive