Usability Testing for an Open Educational Resource to Teach Language and Culture
DOI:
https://doi.org/10.19173/irrodl.v27i1.8870Keywords:
usability testing, language and culture, EAP, OER, open educational resource, English for academic purposesAbstract
This study focused on procedures for creating, testing, and developing a set of reusable online resources for use in English for academic purposes programmes. The aim of the materials was to help migrants and refugees develop the linguistic and cultural skills, knowledge, and understanding they would need to engage, interact, and collaborate effectively in a multicultural context. Development of the materials involved an iterative process using a three-stage approach:
- Expert review: Experts in relevant fields worked through the first version of the materials and provided critical feedback, which guided initial revisions.
- Usability testing groups: Small groups of target users (students and teachers) used the revised materials in workshop settings, and data were gathered from observations, interviews, and written comments.
- Wider evaluation: Larger-scale use and evaluation of the materials (which is ongoing, beyond the scope of this paper).
This article reports on the second stage.
References
Barnum, C. M. (2020). Usability testing essentials: Ready, set ... test! (2nd ed.). Morgan Kaufmann.
Borthwick, K., & Gallagher-Brett, A. (2014). “Inspiration, ideas, encouragement”: Teacher development and improved use of technology in language teaching through open educational practice. Computer Assisted Language Learning, 27(2), 163–183. https://doi.org/10.1080/09588221.2013.818560
Brook, J. (2011). The affordances of YouTube for language learning and teaching. Hawaii Pacific University TESOL Working Paper Series, 9(1, 2), 37–56. https://hpu.edu/research-publications/tesol-working-papers/2011/9_1-2_Brook.pdf
Burrows, K. M., Staley, K., & Burrows, M. (2022). The potential of open educational resources for English language teaching and learning: From selection to adaptation. English Teaching Forum, 60(2), 2–9. https://americanenglish.state.gov/files/ae/60_2_pg02-09_cx2_corrected.pdf
Chang, H., Windeatt, S., & Stockwell, E. (2025). Communication across cultures. University of Southern Queensland. https://usq.pressbooks.pub/interculturalcommunication/
Doubleday, E. G., O’Loughlin, V. D., & Doubleday, A. F. (2011). The virtual anatomy laboratory: Usability testing to improve an online learning resource for anatomy education. Anatomical Sciences Education, 4(6), 318–326. https://doi.org/10.1002/ase.252
Dumas, J. S., & Redish, G. (1999). A practical guide to usability testing (rev. ed.). Intellect Books.
Getenet, S., Cantle, R., Redmond, P., & Albion, P. (2024) Students’ digital technology attitude, literacy and self-efficacy and their effect on online learning engagement. International Journal of Educational Technology in Higher Education, 21, Article 3. https://doi.org/10.1186/s41239-023-00437-y
Kessler, G., & Plakans, L. (2001). Incorporating ESOL learners’ feedback and usability testing in instructor-developed CALL materials. TESOL Journal, 10(1), 15–20. https://doi.org/10.1002/j.1949-3533.2001.tb00012.x
Laurillard, D. (2012). Teaching as a design science: Building pedagogical patterns for learning and technology. Routledge.
Liddicoat, A. J., & Scarino, A. (2013). Intercultural language teaching and learning (2nd ed.). Wiley-Blackwell. https://doi.org/10.1002/9781118482070
Mueller, P. A., & Oppenheimer, D. M. (2014). The pen is mightier than the keyboard: Advantages of longhand over laptop note taking. Psychological Science, 25(6), 1159–1168. https://doi.org/10.1177/0956797614524581
Nielsen, J., & Landauer, T.K. (1993). A mathematical model of the finding of usability problems. Proceedings of the INTERCH93: Conference on Human Factors in Computing Systems, The Netherlands, 206-213. https://doi.org/10.1145/169059.16916
Olivier, J. (2019) Towards a multiliteracies framework in support of self- directed learning through open educational resources. In E. Mentz, J. de Beer, & R. Bailey (Eds.), Self-directed learning for the 21st century: Implications for higher education (pp. 167–201). AOSIS Scholarly Books. https://doi.org/10.4102/aosis.2019.BK134.06
Rubin. J., & Chisnell., D. (2008). Handbook of usability testing: How to plan, design, and conduct effective tests (2nd ed.). Wiley. https://content.e-bookshelf.de/media/reading/L-571931-cbc66f3178.pdf
Sanders, J., & Lafferty, N. (2010). Twelve tips on usability testing to develop effective e-learning in medical education. Medical Teacher, 32(12), 956–960. https://doi.org/10.3109/0142159X.2010.507709
Sugar, W. (1999). Novice designers’ myths about usability sessions: Guidelines to implementing user-centered design principles. Education Technology, 36(6), 40–44. https://www.jstor.org/stable/44428569
Tomlinson, B. (2012). Materials development for language learning and teaching. Language Teaching, 45(2), 143–179. https://doi.org/10.1017/S0261444811000528
UNESCO. (2019, November 25). Recommendation on open educational resources (OER). UNESCO. https://www.unesco.org/en/legal-affairs/recommendation-open-educational-resources-oer
Weller, M. (2010). Big and little OER. In Open Ed 2010 Proceedings. Universitat Oberta de Catalunya, Open Universiteit Nederland, & Brigham Young University. https://hdl.handle.net/10609/4851
Wiley, D., & Hilton, J. L., III. (2018). Defining OER-enabled pedagogy. The International Review of Research in Open and Distributed Learning, 19(4). https://doi.org/10.19173/irrodl.v19i4.3601
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons Attribution 4.0 International License. The copyright for all content published in IRRODL remains with the authors.
This copyright agreement and usage license ensure that the article is distributed as widely as possible and can be included in any scientific or scholarly archive.
You are free to
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms below:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
