(Click on any screen to see a larger version. Note that the
large pictures may take time to load without a high speed connection.)

The following screen gives access to the main parts of the program:

Lessons:
All lesson pages are very similar, providing a video window and a coding sheet with appropriate controls to enter data for that activity. In all lessons, the learner can choose to just watch the video, watch the video and code it, or watch the video while our fictional expert, Dr. Wellington, codes it.

The lesson on reliability takes the data from the coding screen...

...and steps the student through the process of using that data in the calculations for percent agreement and Cohen's Kappa.
   

Case Study:
The case study starts by introducing the student to the scenario and characters. Clicking on a picture with a sound icon will allow the student to hear that character speak.

The student is guided through the process of deciding what to observe, determining the best coding and sampling strategies to use, and then coding the video. Thus it requires the student to apply what he/she has learned in the lesson. In so doing, the student is often prompted with questions such as the matching exercise depicted below.

As the student answers questions, the coding sheet is built as shown below. The student then prints the coding sheet and, with a partner, codes the video.
   

This then leads the students into doing inter-rater reliability calculations with the data collected. The students can ask for help if they are stuck, and will also be given feedback on the answers they enter.

Students are then led into calculating Cohen’s Kappa. If they are able to calculate this value correctly, they continue on to assessing the reliability and validity of their data...

...but if they are unable to calculate this value correctly, they will be given step-by-step help in determining the value before going on to assess the reliability and validity of their data.

This page is maintained by Dawn Blasko.
Last updated November 8, 2003.
Copyright 2003 by The Pennsylvania State University.