Please use this identifier to cite or link to this item:
Fulltext available Open Access
Publisher DOI: 10.24405/14522
Title: Idea evaluation by citizens : the Hamburg Fab City Maker Challenge case
Language: English
Authors: Pacuku, David 
Schnier, Johanna 
Redlich, Tobias 
Moritz, Manuel 
Klein, Marvin 
Raasch, Christina 
Lüthje, Christian 
Issue Date: Dec-2022
Publisher: Helmut-Schmidt-Universität, Bibliothek
Source:äge der Helmut-Schmidt-Universität. - (1) 91-95 (12-2022)
Abstract (english): 
Experts play an important role in the evaluation of ideas. Owing to their experience and knowledge, they are believed to be best suited to objectively evaluate ideas. At the same time, expert evaluations sometimes fail to accurately reflect stakeholder preferences. For this reason, more and more organizations have begun to solicit ‘non-expert’ evaluations from the ‘crowd’ (e.g., via community voting). We illustrate how organizations can involve stakeholders in idea evaluation in the context of the Fab City project. Integrating citizens into the innovation process is particularly interesting in a Fab City–a city that produces many of the products it needs locally–since it enables one to develop regional preferences into tailored solutions. Here, citizens evaluate a solution, implement it as a local product, and ultimately share the design (mostly open-source) within the community. In the course of a Fab City initiative in Hamburg–the Maker Challenge–citizens were invited to evaluate almost 100 innovative ideas in pairwise comparisons. We draw on over 20,000 votes from around 400 citizen judges to assess the crowd opinion formation process. Unlike in other studies, our data allow us to measure the time every citizen judge needed to make their decision. Thus, we can conclude how diligent citizen judges are and, conversely, how much attention an idea can attract. Looking at the citizen judges’ evaluation times, it appears that, in most cases, the opinion-formation process is spontaneous. In a few cases, however, a substantial amount of time is spent. All the evaluation times followed a Poisson distribution. Further, we compare expert evaluations with crowd evaluations and relate the results to the literature. We conclude that the crowd evaluation process resembles the expert evaluation process. Also, we show that citizens optimize their cognitive effort over time. For real-world cases, such as the Fab City project, this implies that not only the ideation process and the implementation process can be carried out by local citizens, but also that the evaluation can be done within a community without significant loss of quality, but with much lower effort on the part of organizers.
DOI: 10.15480/882.4972
ISBN: 978-3-86818-315-3
Institute: Innovationsmarketing W-3 
Document Type: Chapter (Book)
Funded by: Digitalization and Technology Research Center of the Bundeswehr (
License: In Copyright In Copyright
Is Part of: 10.24405/14522
Identical to: 10.24405/14535
Appears in Collections:Publications with fulltext

Files in This Item:
File Description SizeFormat
openHSU_14535-2.pdf1,02 MBAdobe PDFView/Open
Show full item record

Google ScholarTM


Note about this record

Cite this record


Items in TORE are protected by copyright, with all rights reserved, unless otherwise indicated.