We’ve all had the experience of sitting in a dark theater and being moved by a compelling documentary story. And as documentary mediamakers, many of us have felt that power materialize during animated discussions that occur with and among audience members when the lights come up for the Q&A.
But how do we really know if our films are having an impact beyond the walls of the theater, and how do we know that our film is causing something besides “clicks” and “likes” online?
At Bay Area Video Coalition, we’ve come a long way in our understanding of impact evaluation and its purpose. It used to be that evaluation was another box to check off in order to satisfy the requirements of our funders. We collected surveys at the end of each training or program, and when funding allowed, we began to track our program participants and projects over a longer period of time.
Our thinking about the purpose of evaluation began to shift, however, when we received a multi-year grant from the National Science Foundation that included a funded, dedicated evaluator to help us design and implement an evaluation not just for reporting purposes, but to create feedback loops that would shape future programming throughout the program’s lifecycle.
Participating in the design of this evaluation freed us to shift our focus from one of conducting surveys and basic reporting (for others, usually as an afterthought) to one of viewing evaluation as an opportunity to better understand the real and long-term impact of our work—for ourselves, so we could become more effective. Read the rest of this entry »