Preparing additional questions for the Student Review of Teaching questionnaire
Departments and student committees may each prepare one supplementary question for the Student Review of Teaching questionnaire, in order to gather information about distinctive elements of the faculty member’s teaching responsibilities or practices. Below are suggestions for preparing effective questions and examples of questions that have been used in previous reviews.
Guidelines for developing effective questions in Student Reviews of Teaching
- Ask about things students can reasonably be expected to remember, describe, and/or evaluate. Some aspects of faculty performance are outside the range of students' direct experience or knowledge. For example, students are rarely able to evaluate an instructor's disciplinary or subject-matter expertise. They can provide information on how effectively the faculty member promotes student understanding of, or interest in, that area. In addition, some students will be completing a Student Review questionnaire two or three years after their work with the faculty member, so it is best to avoid questions that require detailed recollection.
- Focus each question on a single topic or issue. Folding two or more questions into one will compromise the accuracy of the responses. Asking "Was the faculty member's feedback on student work timely and helpful?" will pose problems if the students felt the feedback was timely but not particularly helpful, or helpful but not sufficiently timely. If a student writes "no," the reviewers won't know if the problem was lack of timeliness, lack of helpfulness, or both.
- Keep questions simple and direct. Long questions, or questions that include negatives, are more subject to misinterpretation by the respondents.
- Avoid questions that are likely to evoke simple "yes" or "no" answers. Instead of asking "Did the faculty member encourage the expression of different points of view?" phrase the question to elicit more judgment and/or description: "To what extent did the faculty member encourage..." or "How effectively did the faculty member encourage..." Adding "Please elaborate" or "In what ways?" at the end of the question is another way to elicit more information.
- Avoid leading questions. For example, asking "In what ways does the faculty member promote active learning?" appears to presume that the faculty member does promote active learning. Rewording the question more neutrally will elicit more valid responses: "To what extent does the faculty member promote active learning? Please elaborate."
- Avoid words or phrases that might mean different things to different respondents. For example, asking "To what extent did the faculty member evaluate student work fairly?" is problematic because students might assign different meanings to "fairly." Some may interpret the question to mean, "Did the faculty member spell out the criteria for evaluation in advance and adhere to them in assigning grades?" Others may interpret the question to mean, "Did the faculty member show favoritism in assigning grades?" (Notice that this latter interpretation also falls prey to the problem described in #2 above. Students can only evaluate favoritism if they know what grades other students received and why.)
- Keep question phrasing consistent throughout the questionnaire. If you are preparing questions to supplement a standard form (such as the common form for tenure and promotion reviews), phrase the supplementary questions so the wording is consistent with the wording of the standard questions. For example, use "the faculty member" instead of "the instructor" or "Professor Jones."
- Avoid replicating previous questions.This is particularly important in preparing questions to be added to a standard form. The purpose of the supplementary questions is to elicit information that probably would not be elicited by the questions that precede them. Redundancy is confusing to respondents (“I thought I already answered that!”) and can also lower response rates by making questionnaires unnecessarily long.