Searching for Significance in the Scholarship of Teaching and Learning and Finding None: Understanding Non-Significant Results

April McGrath

Abstract


Quantitative results from empirical studies are common in the field of Scholarship of Teaching and Learning (SoTL), but it is important to remain aware of what the results from our studies can, and cannot, tell us. Oftentimes studies conducted to examine teaching and learning are constrained by class size. Small sample sizes negatively influence statistical power and make non-significant results a more likely occurrence. When one finds non-significant results it is important to consider what conclusions can be drawn from the study. This article provides information on null hypothesis significance testing that is relevant to our understanding of non-significant results, and it highlights the importance of recognizing underpowered studies in the teaching and learning literature. Factors that can contribute to non-significant findings in a study are also highlighted. Being aware of these factors, statistical power, and the logic of significance testing will put scholars in a better position to evaluate non-significant results from their own research and that of others.

Keywords


Null Hypothesis Significance Testing; Statistical Power; Non-significant Effect

Full Text:

PDF


DOI: http://dx.doi.org/10.20343/teachlearninqu.4.2.12

PID: http://hdl.handle.net/10515/sy54j0bf2

Comments on this article

View all comments




Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.


CURRENTPREVIOUSSUBMISSIONSALERTSLOGINABOUT

Teaching & Learning Inquiry is the official journal of the
International Society for the Scholarship of Teaching and Learning (ISSOTL)