Benton Foundation
 
Strategic Communications...
...in the digital age  


ARCHIVAL MATERIAL

Think it Through

Planning
Audience
Message Shaping
Media Choices
Funding
Evaluation

Put it to Work

What to Watch

Peer2Peer Learning

Funders' Corner


BENTON FOUNDATION

www.benton.org

© Benton Foundation 2001

Evaluation
Evaluate the effectiveness of your communications effort

Evaluation is often that last little paragraph of a grant proposal that we throw in because we know we're supposed to. However, a good communications strategy recognizes that evaluation is what it takes in order to know if all your hard work is achieving the results you seek! Keep evaluation in mind as you create your communications plan and when you apply for a grant to support your communications efforts.

Conducting a thorough evaluation of your communications effort includes gathering quantitative data as well as qualitative information.

  • How many people did we reach with our email newsletter? (quantitative)
  • Did our message have the effect we hoped it would on those people? (qualitative)

Technology has made quantitative data less expensive and easier to collect. Web hosting services can record the number of visits to your Web site and other data about how your site is used. You can easily count how many email addresses you collected in a month or how many newsletters you sent out. More complex information like, what action did our members take after reading our newsletter? can help you determine if your communications strategy is supporting your mission. This kind of information is not only harder to come by, but can be significantly more expensive.

A complete evaluation of your communications efforts will incorporate evaluating your outreach materials, including your Web site. To be effective, your Web site has to be easy to read and navigate. Visit the resources below for tips on how to evaluate the usability of your Web site and to learn more about evaluation procedures in general.


Tools & Resources:
Use these how-to articles and tip sheets to evaluate your communications effort.

Outcome Measurement In Nonprofit Organizations: Current Practices and Recommendations
With nonprofits feeling the pressure to measure and report the success of projects to funders, the Independent Sector report, Outcome Measurement In Nonprofit Organizations: Current Practices and Recommendations, offers key findings on the current state of nonprofit outcome measurement. The executive summary of the report outlines a series of recommendation on how to collect and analyze outcomes.

Evaluating Your Outreach Efforts
This excerpt from a Benton Foundation publication titled, "Making Television Matter," outlines why you should evaluate a media project and lists several guidelines for evaluation, including how to hire an outside evaluator and how to conduct one in-house.

InnoNet's Workstation for Innovative Nonprofits
This free, online tool helps you build program and evaluation plans as well as fundraising proposals and budgets.

Usability Matters
A good Web site follows a logical structure and is easy to use. Evaluating the usability of your site will help you figure out if it meets the needs of your visitors.

Why You Only Need to Test With 5 Users
From Jakob Neilson's Alertbox, explains how effective small-scale Web usability testing can be. See also his Voodoo Usability.


Profiles:
For inspiration, read these stories and lessons learned by other nonprofits that have done evaluation.

But How Did Outreach Affect Life In The Real World?
Although evaluation of a communications effort can be difficult and expensive, this story, originally published in 1992, outlines the lessons learned through evaluating one public television program and its outreach efforts.


What to Watch:
These resources track the latest trends in evaluation efforts.

Grantmakers Evaluation Network
An affinity group of foundations that focus on evaluation. Copies of their newsletters are available online in PDF.

The Evaluation Exchange
Each issue of this newsletter from the Harvard Family Research Project focuses on a particular topic related to evaluation. The Winter 2001 issue focuses on strategic communications.

Stanford/Poynter Eyetracking Study
Everyone knows that images and graphics are the first thing to catch a reader's eye, right? Well, maybe not. According to an eyetracking study conducted by Stanford University and the Poynter Institute, the way people read news online is very different from the way they read in print.

Usability Articles and Other Resources
Several informative, though somewhat advanced, articles on usability and user testing can be found in this resource from User Interface Engineering.


 

Last updated: 18 September 2001 jss