KM WEBSITE ANALYSIS PROJECT

This project investigates Knowledge Mobilization (KM) practices employed by organizations on their websites. To date, we have examined over 150 websites belonging to a wide-range of organizations in Canada and internationally, including: universities, government departments, school districts, as well as ‘third party’ organizations such as think tanks, research centres and NGOs. Although our focus is mainly on organizations working within the education sector, we have also analyzed the websites of healthcare organizations when they employ alternative KM website strategies that may be useful within education.

PROJECT OVERVIEW

KM research suggests that knowledge mobilization is a process involving three general practices: the creation of products, the hosting of events, and the creation of networks. For this reason, when investigating the KM strategies employed by each organization on their website, we ask:

What kinds of products does this organization make available on its website (e.g. reports, audio/video, syntheses, newsletters, etc.)?

What kinds of events does this organization promote on its website (e.g. conferences, workshops, etc.)?

What kinds of networks does this organization promote on its website (e.g. online networks, face-to-face networks, networks comprised of individuals and/or groups, networks that are local, national, or international, etc.)?

PRELIMINARY FINDINGS

Our analysis of over 150 websites appears to have uncovered the following trends among websites:

University websites seem more difficult to navigate than other organizations with an explicit focus on mobilizing knowledge.
The strategy of disseminating products over a website, rather than promoting events or developing networks, seems to be a preferred practice among organizations. However, it remains unclear how often visitors actually access and use products available on these websites.
Organizations seem to use a wide-range of specific strategies within the three general categories of KM practices - disseminating products, hosting events, and developing networks. Understanding the range of potential strategies within each general KM category is an area for future analysis.
As evidenced from their websites, few organizations appear to have a strong commitment to Knowledge Mobilization efforts; although, it should be noted that these organizations may be engaged in activities that are not evident from their websites.
Knowledge Mobilization strategies of these organizations seem to rely on passive dissemination - relying on potential users to search and find information, rather than actively identifying and sharing information with potential users.

METRIC TO EVALUATE KM STRATEGIES AND INDICATORS ON WEBSITES

For the purpose of analyzing the KM website practices employed by various organizations, we developed a metric (based on a point system) that assesses websites based on the types of general KM Strategies they employ (products, events, and/or networks) and the nature of each strategy (the specific strategies used within each general category, their accessibility, ease of use, appropriateness for their audience, etc.). We refer to these as KM Indicators. As evidenced from their website, we asked:

What kinds of products is this organization producing?

What kinds of events is this organization planning?

What kinds of networks is this organization developing?

Part of this analysis has included creating new sub-categories within each general KM strategy category. For example:

Products - subcategories may include databases, webpages, ebulletins, etc.

Events - subcategories may include conferences, workshops, training days, etc.

Networks - subcategories may include those involved and their location. For example, networks may connect individuals, groups/organization, or both, and networks may connect individuals at the local, national, or international level.

Strategies

Indicators

Products

Events

Networks

Overall features

Total

Different types

1 point (1-2 types )

2 points (3-4 types)

3 points (5-6 types)

2 point (1-2 types)

4points (3-4 types)

6 points (5-6 types)

2 point (1 type )

4points (2 types)

6points (3 types)

1 point ( 1 strategy)

2 points (2 strategies)

3 points (2 strategies with a good balance )

4 points (three strategies)

5 points (three strategies with a good balance)

/20

Ease of use

1 point (means provided to make comment on the main page)

2 points (means provided to make comments on specific products)

2 point (occasional follow-ups)

4 points ( regular follow-ups)

2 point (events archived)

2points (archived network communication )

1 point (1 searching tool)

2 points ( 2 searching tools)

3 points ( 3 searching tools)

4 points (4 searching tools)

/14

Accessibility

1 point (small portion )

2 points (large portion )

3 points ( all )

2 point ( conditions attached)

4points ( part of events with conditions attached)

6 points ( no conditions attached)

2point (once every three month or less)

4 points (more frequently)

1 point ( low readability)

2 points (average readability)

3points (high readability)

/16

Focus of audience

1 point ( part of products)

2 points (part of products with clear application information)

3 points (all products)

4 points ( all products with clear application information)

2 points ( brief introduction)

2 points ( general introduction about who is involved in the network)

4 points ( clear introduction about who is involved and the responsibilities and contributions and the purpose of the network)

/10

Extra indicators

Collaborative nature of the network

2points (some indication)

4 points (strong indication)

Explicit KM statement on the site

2 points ( general statement )

4 points ( clear statement without overall plan)

6 points ( strong statement loosely connected to org overall plan)

8 points (strong statement directly connected to org overall plan)

/12

Total points

/ 12

/20

/72 /72

INITIAL ANALYSIS: ANALYISING 100 WEBSITES USING OUR POINT SYSTEM

Please view our preliminary summary

Please view our preliminary data analysis

100 websites belonging to organizations in the education and healthcare sector include: faculties of education, governmental organizations (school districts and provincial ministries), and "third party" organizations grouped into five categories (those within Australia, Canada, the United Kingdom, the United States, and international organizations involving members from multiple countries).
We are currently looking at other potential websites to increase our sample size
We are also conducting additional data analysis, disaggregating data by country, sector and type of organization.

For further information on this project, contact Jie Qi jqi@oise.utoronto.ca