Evaluation framework

» Posted by on Dec 27, 2011 in All entries, Practice, Publications, Resources | 0 comments

Evaluation framework

As communities and networks go more mainstream there is an increasing demand from organizations to have ways of monitoring their value. How can we make the connection between the activities of a community or network and the improved performance of an organization, institution or even a country?

In our value assessment framework, published by the Open University of the Netherlands, we identify five levels of value creation of a community or network:

  • Cycle 1. Immediate value: the activities and interactions between members have value in and of themselves
  • Cycle 2. Potential value: the activities and interactions of cycle 1 may not be realized immediately, but rather be saved up as knowledge capital whose value is in its potential to be realized later.
  • Cycle 3. Applied value: knowledge capital may or may not be put into use. Leveraging capital requires adapting and applying it to a specific situation.
  • Cycle 4. Realized value: even applied new practices or tools are not enough. A change in practice does not necessarily lead to improved performance, so it is important to find out what effects the application of knowledge capital is having on the achievement of what matters to stakeholders …
  • Cycle 5. Reframing value: this happens when learning causes a reconsideration of how success is defined. It includes reframing strategies, goals and values…

 

For a reliable picture of how the community is creating value we would have to follow the value creation across these different cycles. To do this we collect “value creation stories”. Value creation stories and indicators (qualitative or quantitative) at each cycle are complementary. The idea is to generate a value-creation matrix that combines qualitative and quantitative data into a rich picture of the value created by learning in these social contexts.

Sponsors, evaluators and leaders of communities and networks should be able to use the framework and accompanying toolkit.

Contents

  • clarifications about the distinct learning value of communities and networks respectively
  • a conceptual framework to understand the value from such learning in terms of five cycles of value creation
  • examples of indicators for each cycles
  • a template for telling stories that account for value creation
  • a toolkit for collecting data

 

Download

You can download the full text in PDF format here:


Download the evaluation framework 

Citation

Wenger, E., Trayner, B., and de Laat, M. (2011) Promoting and assessing value creation in communities and networks: a conceptual framework. Rapport 18, Ruud de Moor Centrum, Open University of the Netherlands.

 

See also

There are some resources on evaluating communities of practice and networks on the CPSquare wiki and on the KM4dev wiki. Nancy White looks at three different perspectives on evaluating communities on a video on her blog.

The first four cycles in this framework are an adaptation of the four-level model of Donald Kirkpatrick (1976, 1994), which has become a standard in the training and program evaluation literature (the fifth cycle is an addition we have made specifically for the work of communities). An early version of this adaptation appeared in chapter 8 of the book Cultivating communities of practice.

0 Comments

Trackbacks/Pingbacks

  1. Communities versus networks? | Wenger-Trayner - [...] more details on this contrast, see ourevaluation framework for communities and networks. [...]
  2. | Wenger-Trayner - [...] Community Directors were very appreciative of our Assessment Framework. They were particularly taken by the value-creation matrix (Figure 7.1, ...
  3. Planning and Evaluating Your CoP (amplifying and other good stuff) | Full Circle Associates - [...] Promoting and Assessing Value Creation in Communities and Networks: a Conceptual Framework: http://wenger-trayner.com/resources/publications/evaluation-framework/ [...]
  4. Social learning at Deutsche Bank | Wenger-Trayner - [...] started using the value-creation framework early in the project and are publishing the results in a newsletter/report format. The ...
  5. Beneath the surface | Open Learning House - [...] the real risk? The threat lies in the lack of Value adaptation, creation and culture [...]
  6. Working Smarter in Online Communities – Etienne Wenger at Tulser « Technology, Innovation, Education - [...] thing to follow up is to look at the Value-creation assessment framework. Rate this: Share this:EmailPrintTwitterMoreDiggStumbleUponRedditLinkedInLike this:LikeBe the ...
  7. Virtual Canuck » Blog Archive » Comments on Promoting and assessing value communities and networks - [...] 56 page report Promoting and assessing value creation in communities and networks: a conceptual framework was co-authored by Etienne ...
  8. Assessing value creation? | Wenger-Trayner - [...] for such conversations, they tend to become counterproductive. For more on this topic, see our evaluation framework ...
  9. A Practitioner’s Dilemma: How can I calculate the value of communities of practice? « « DediCommDediComm - [...] value of the CoP to the organization. The framework can be downloaded at Etienne and Bev’s website, which is ...
  10. Meten = Weten: Hoe kun je online leren evalueren? | En Nu Online - [...] Value creation model (Wenger, Trayner, de Laat) doorloopt 5 fases, waarin de opbrengst van online leren wordt gevolgd. Van ...
  11. #betreat12 Communities of practice and learning « Jenny Connected - [...] requires work. (There is a good section on the difference between CoPs and networks in the Value Creation Framework ...
  12. How does a MOOC demonstrate it’s value? « Jenny Connected - [...] Whilst the discussion has been centred around Etienne’s 1988 book and their more recent value creation framework (written with ...
  13. MOOC and its value | Learner Weblog - [...] however likely be perceived by the instructors and participants through different lenses.  The value model as presented by Wenger ...
  14. Value Creation in Communities of Practice – further insights « Jenny Connected - [...] first wrote about the Value Creation Framework when I attended last year’s BEtreat in Grass Valley, California (2011) – ...
  15. Digital Storytelling in the US Army « Jenny Connected - [...] E., Trayner, B., and de Laat, M. (2011) Promoting and assessing value creation in communities and networks: a conceptual ...

Submit a Comment

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>