Information on study participants (i.e., the people who filled out a survey, were interviewed or whose learning outcomes were measured) is usually included in the methodology section of a report. It is important that you look for information specific to a study\u2019s participants. When this information is missing, you may not be able to understand where the results come from or to whom the results apply. In addition, without this information, it is difficult to evaluate whether a study\u2019s results are relevant to other populations. For example, studies with too few participants, participants who are homogeneous or participants recruited through convenience rather than appropriateness cannot be as broadly applicable as studies with high numbers of diverse participants who more closely resemble the general population. The following are important things to look for when you are reading about a study\u2019s participants:<\/p>
As a report reader, you should be able to easily see who the participants were or where the data for the study originated. It should be clear who was asked to participate, how many chose to participate and the overall demographics of those participants (such as gender, race, etc.) who participated. In the case of existing data, it should be clear how the data were collected and when. Having this information allows you to determine how generalizable the study results may be to larger populations than the smaller sample included in the study results.
In order to assess whether or not the study participants were individuals who were appropriate for the particular study, it is important to know how the participants were recruited or selected. You will want to look in the report to see what specific procedures were used for recruitment (e.g., email, word of mouth, etc.). It is also important to know whether participants received any form of incentive or compensation.
Take note of whether the participant sample resembles the population that is being studied. The population<\/span><\/span> includes everyone that the study is supposed to apply to (i.e., a study about college student learning is supposed to apply to all college students). For example, if you are studying the habits of college students, does the participant sample include an appropriate number of students at all class levels? In order for you to evaluate the study and generalize<\/span><\/span> the findings, you need to understand if the participant sample adequately represents the population under study. In other words, would the results likely hold if all people in the population had been included in the study? If the report includes subgroups (e.g., participants organized by gender, race, age, institution type or other variables), they are clearly labeled in all places where data regarding the subgroups is presented. This includes the use of any graphs, charts or tables to describe subgroup results. When subgroups are included in results reported, the size of the group(s) should always be included for you to reference in relation to the larger study participant sample. <\/p>\nExamples<\/h2>\n
a. The study participants and\/or data source (e.g., existing data from IPEDS) are described in detail, including how many are engaged in the study.<\/h3>\n
\n
\n
b. It is clear how the participants were recruited for the study.<\/h3>\n
\n
c. The participant sample represents an appropriate level of diversity for the study aims.<\/h3>\n
\n
\n
d. If subgroups are included in analyses, they are appropriately defined and labeled.<\/h3>\n
\n
\n