{"id":1448,"date":"2018-11-28T16:39:08","date_gmt":"2018-11-29T00:39:08","guid":{"rendered":"http:\/\/ecampus.oregonstate.edu\/research\/?page_id=1448"},"modified":"2021-01-07T13:48:13","modified_gmt":"2021-01-07T21:48:13","slug":"transparency","status":"publish","type":"page","link":"https:\/\/ecampus.oregonstate.edu\/research\/projects\/report-reader\/checklist\/transparency\/","title":{"rendered":"Report Reader Checklist: Transparency"},"content":{"rendered":" <p class=\"intro\">It is important for research reports to be as transparent as possible, not only so you understand the study, but also so you can adequately evaluate the quality of a research study. Further, it is an ethical research practice to provide as much detail about a study so that others could easily replicate the study or perform their own data analysis and\/or coding of the data. Reports that are fully transparent include data tables and research instruments (surveys, interview protocols, where possible). If these elements are missing, your ability to fully verify results and evaluate the study is diminished.<\/p><div style=\"clear:both;\">&nbsp;<\/div>\n<p>If any of the following are missing, you will not be able to evaluate the authors\u2019 results and recommendations.<\/p>\n<div class=\"segment\"  id=\"raw-data-included\">a. Raw quantitative data (i.e., tables of frequency counts) for the entire study are included somewhere in the report, or in an appendix, for you to reference.<\/p>\n<p>If a report includes quantitative analysis, it is a best practice to include the frequency tables for you to reference. This allows you to verify the study findings or to refer to the original data if they have questions about how a particular result was calculated. Providing the data tables also allows other researchers to build off of the original dataset. If data tables are not provided, they should provide an explanation as to why they are not included.<div class=\"examples-link\">[<a href=\"#examples-raw-data-included\">see examples<\/a>]<\/div><\/div>\n<div class=\"segment\"  id=\"instrument-provided\">b. The instrument and\/or study protocol are provided in the report or as an appendix.<\/p>\n<p>In order to fully understand the scope of a research design, it can be helpful to view any instruments, such as surveys, interview protocols or focus group questions. By providing the instrument and\/or study protocols, the report authors allow you to see the full picture of what was asked of research participants, as well as how the questions were worded and in what order they were asked. This level of transparency also allows you to see if any data gathered for particular questions are not being reported on in the study findings (if this happens, the rationale should be explained by the report authors).<div class=\"examples-link\">[<a href=\"#examples-instrument-provided\">see examples<\/a>]<\/div><\/div>\n<div class=\"segment\"  id=\"conflicts-or-motivations\">c. The authors are clear about any conflicts of interest or other motivations for their role in the study.<\/p>\n<p>Sometimes studies are conducted in whole, or in part, by vendors or companies, or as part of market research campaigns. When this is the case, and the vendor or company may be perceived as having a  <span title=\"click to see a definition of this term\"><span class=\"define fancyframe\" tabindex=\"0\" data-fancybox-type=\"inline\" data-fancybox-width=\"200\" data-fancybox-href=\"#define-conflictofinterest\">conflict of interest<\/span><\/span> regarding the study results, it should be made clear in the study report what role the vendor and\/or company played in funding the study, the study design, implementation, data analysis, report writing and dissemination.<div class=\"examples-link\">[<a href=\"#examples-conflicts-or-motivations\">see examples<\/a>]<\/div><\/div>\n<div class=\"segment\"  id=\"commentary-rooted-results\">d. Any commentary or discussion is rooted in data results or study findings shared within the report.<\/p>\n<p>In the discussion of the findings, authors should not make claims that are beyond the scope of the data presented in the report. For example, the authors should not make inferences from the data that are not supported by the study results.<div class=\"examples-link\">[<a href=\"#examples-commentary-rooted-results\">see examples<\/a>]<\/div><\/div>\n<p><!-- EXAMPLES --><\/p>\n<h2 class=\"examples\">Examples<\/h2>\n<div class=\"example-group\"><h3 id=\"examples-raw-data-included\">a. Raw quantitative data (i.e., tables of frequency counts) for the entire study are included somewhere in the report, or in an appendix, for you to reference.<\/h3>\n<div class=\"example-text\">\nLinder, K. (2016). <em>Student uses and perceptions of closed captions and transcripts: Results from a national study<\/em>. Oregon State University Ecampus Research Unit. [<a href=\"https:\/\/www.3playmedia.com\/resources\/industry-studies\/student-uses-of-closed-captions-and-transcripts\/\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a>]\n<ul>\n<li>See pages 42-50 for tables of frequency counts for the entire study.<\/li>\n<\/ul>\n<\/div>\n<div class=\"return-link\">[<a href=\"#raw-data-included\">return to section<\/a>]<\/div><\/div>\n<div class=\"example-group\"><h3 id=\"examples-instrument-provided\">b. The instrument and\/or study protocol are provided in the report or as an appendix.<\/h3>\n<div class=\"example-text\">\nBetts, K., Miller, M., Tokuhama-Espinosa, T., Shewokis, P., Anderson, A., Borja, C., &#8230; Dekker, S. (2019). <em>International report:<\/em> <em>Neuromyths and evidence-based practices in higher education.<\/em> Online Learning Consortium. [<a href=\"https:\/\/onlinelearningconsortium.org\/read\/international-report-neuromyths-and-evidence-based-practices-in-higher-education\/\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a>]\n<ul>\n<li>See Appendix A on pages 94-104 for the study instrument.<\/li>\n<\/ul>\n<\/div>\n<div class=\"return-link\">[<a href=\"#instrument-provided\">return to section<\/a>]<\/div><\/div>\n<div class=\"example-group\"><h3 id=\"examples-conflicts-or-motivations\">c. The authors are clear about any conflicts of interest or other motivations for their role in the study.<\/h3>\n<div class=\"example-text\">\nDabbagh, N., Bass, R., Bishop, M., Costelloe, S., Cummings, K., Freeman, B., &#8230; Wilson, S. J. (2019). <em>Using technology to support postsecondary student learning: A practice guide for college and university administrators, advisors, and faculty.<\/em> Institute of Education Sciences, What Works Clearinghouse.\u00a0 [<a href=\"https:\/\/ies.ed.gov\/ncee\/wwc\/\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a>]\n<ul>\n<li>See page 93 for a disclosure of potential conflicts of interest.<\/li>\n<\/ul>\n<\/div>\n<div class=\"return-link\">[<a href=\"#conflicts-or-motivations\">return to section<\/a>]<\/div><\/div>\n<div class=\"example-group\"><h3 id=\"examples-commentary-rooted-results\">d. Any commentary or discussion is rooted in data results or study findings shared within the report.<\/h3>\n<div class=\"example-text\">\nJaschik, S. &amp; Lederman, D. (2018). <em>2018 Survey of faculty attitudes on technology<\/em>. Inside Higher Ed. [<a href=\"https:\/\/www.insidehighered.com\/booklet\/2018-survey-faculty-attitudes-technology\" target=\"_blank\" rel=\"noopener noreferrer\">link<\/a>]\n<ul>\n<li>This report does a good job of limiting discussion to each finding presented in results section.<\/li>\n<\/ul>\n<\/div>\n<div class=\"return-link\">[<a href=\"#commentary-rooted-results\">return to section<\/a>]<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>If any of the following are missing, you will not be able to evaluate the authors\u2019 results and recommendations. Examples<\/p>\n","protected":false},"author":2,"featured_media":1655,"parent":1439,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-scorecard-area.php","meta":{"jetpack_post_was_ever_published":false,"footnotes":""},"class_list":["post-1448","page","type-page","status-publish","has-post-thumbnail","hentry"],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/P7BNXQ-nm","_links":{"self":[{"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/pages\/1448","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/comments?post=1448"}],"version-history":[{"count":0,"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/pages\/1448\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/pages\/1439"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/media\/1655"}],"wp:attachment":[{"href":"https:\/\/ecampus.oregonstate.edu\/research\/wp-json\/wp\/v2\/media?parent=1448"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}