Teachers’ Use of Education Dashboards and Professional Growth

  • Shiran Michaeli Tel Aviv University
  • Dror Kroparo Tel Aviv University
  • Arnon Hershkovitz Tel Aviv University
Keywords: teachers, education dashboard, professional development, data-driven decision-making, elementary school

Abstract

Education dashboards are a means to present various stakeholders with information about learners, most commonly regarding the learners’ activity in online learning environments. Typically, an education dashboard for teachers will include some type of visual aids that encourage teachers to reflect upon learner behavior patterns and to act in accordance to it. In practice, this tool can assist teachers to make data-driven decisions, thus supporting their professional growth, however, so far, the use of education dashboards by teachers has been greatly understudied. In this research we report on two studies related to the associations between the use of education dashboards by elementary school teachers and the teachers’ professional growth. We used the framework defined by the International Society for Technology in Education’s (ISTE) Standards for Educators. In the first study, we took a quantitative approach (N=52 teachers), using an online self-report questionnaire, and found that the use of dashboards is positively associated with professional growth in the dimensions of facilitator, analyst, designer, and citizen. In the second study, we took a qualitative approach (N=9 teachers), using semi-structured interviews, to shed light on the mechanisms through which teachers benefit from the use of education dashboards.

Author Biographies

Shiran Michaeli, Tel Aviv University

Shiran Michaeli holds an M.A. in Science Teaching (Tel Aviv University, Israel), and a B.Ed. (Kibbutzim College, Israel). She works as an instructional developer of learning materials for elementary school students, and had been a science teacher for four years. Her Masters' thesis was focused on teachers' use of education dashboards.

Dror Kroparo, Tel Aviv University

Dror Kroparo holds an M.A. in Science Teaching (Tel Aviv University, Israel), and an LL.B. (Sapir College, Israel). He works as a globa learning expert in the business sector. His Masters' thesis was focused on teachers' professional growth.

Arnon Hershkovitz, Tel Aviv University

Arnon Hershkovitz, Ph.D., is a Senior Lecturer in the Department of Mathematics, Science, and Technology Education. He holds a B.A. in Mathematics and Computer Science, and an M.A. in Applied Mathematics. His research is mostly focused on the skills required for learning and instructing in the cyberlearning ecosystem.

References

Allen, I. E., & Seaman, J. (2017). Digital learning compass: Distance education enrollment report 2017. Babson Survey Research Group. https://doi.org/10.1108/IJEM-02-2014-0018

Annerstedt, C., & Larsson, S. (2010). ‘I have my own picture of what the demands are ... ’: Grading in Swedish PEH — problems of validity, comparability and fairness. European Physical Education Review, 16(2), 97–115. https://doi.org/10.1177/1356336X10381299

Avidov-Ungar, O. (2016). A model of professional development: teachers’ perceptions of their professional development. Teachers and Teaching, 22(6), 653–669. https://doi.org/10.1080/13540602.2016.1158955

Charleer, S., Klerkx, J., Duval, E., De Laet, T., & Verbert, K. (2016). Creating effective learning analytics dashboards: Lessons learnt (pp. 42–56). In K. Verbert M. Sharples & T. Klobučar (Eds.) Adaptive and adaptable learning, Springer, Cham. https://doi.org/10.1007/978-3-319-45153-4_4

Collinson, V., Kozina, E., Kate Lin, Y. H., Ling, L., Matheson, I., Newcombe, L., & Zogla, I. (2009). Professional development for teachers: A world of change. European Journal of Teacher Education, 32(1), 3–19. https://doi.org/10.1080/02619760802553022

Danielson, C. (2011). Enhancing Professional Practice (2nd ed.). Association for Supervision and Curriculum Development. Received from http://www.ascd.org/Publications/Books/Overview/Enhancing-Professional-Practice-A-Framework-for-Teaching-2nd-Edition.aspx

Darling-Hammond, L., & McLaughlin, M. W. (1995). Policies that support professional development in an era of reform. Phi Delta Kappan, 92(6), 81–92. https://doi.org/10.1177/003172171109200622

Demmans Epp, C., Phirangee, K., & Hewitt, J. (2019). User-centered dashboard design: Iterative design to support teacher informational needs in online learning contexts. American Educational Research Association Annual Meeting. Toronto: Canada. Received from https://www.researchgate.net/publication/332380972

Ez-zaouia, M., Tabard, A., & Lavoué, E. (2020). EMODASH: A dashboard supporting retrospective awareness of emotions in online learning. International Journal of Human Computer Studies, 139, 102411. https://doi.org/10.1016/j.ijhcs.2020.102411

Faria, A.-M., Greenberg, A., Meakin, J., Bichay, K., & Heppen, J. (2014). Replicating the relationship between teachers’ data use and student achievement: The urban data study and the data dashboard usage study. Society for Research on Educational Effectiveness, 1–8. Retrieved from https://files.eric.ed.gov/fulltext/ED562866.pdf

Ferreira, J., Ryan, L., & Tilbury, D. (2007). Mainstreaming education for sustainable development in initial teacher education in Australia: a review of existing professional development models. Journal of Education for Teaching, 33(2), 225–239. https://doi.org/10.1080/02607470701259515

Gillet, D., Holzer, A., Schwendimann, B. A., Boroujeni, M. S., Vozniuk, A., Prieto, L. P., & Rodríguez Triana, M. J. (2017). Monitoring, awareness and reflection in blended technology enhanced learning: A systematic review. International Journal of Technology Enhanced Learning, 9(2/3), 126. https://doi.org/10.1504/ijtel.2017.10005147

Grossi, M. G. R., Oliveira, E. S., Barbosa, A. C., & Oliveira, P. H. de. (2016). People with disabilities and the formation of the basic education teacher: A study of Brazilian reality. Journal of Education and Human Development, 5(4), 2334–2978. https://doi.org/10.15640/jehd.v5n4a14

Lang, C., Siemens, G., Wise, A., & Gašević, D. (Eds.) (2017), Handbook of learning analytics. Society for Learning Analytics Research (SoLAR). https://doi.org/10.18608/hla17

Hargreaves, A. (2005). Educational change takes ages: Life, career and generational factors in teachers’ emotional responses to educational change. Teaching and Teacher Education, 21(8), 967–983. https://doi.org/10.1016/j.tate.2005.06.007

Hay, P. J., & Macdonald, D. (2008). (Mis)appropriations of criteria and standards‐referenced assessment in a performance‐based subject. Assessment in Education: Principles, Policy & Practice, 15(2), 153–168. https://doi.org/10.1080/09695940802164184

Hershkovitz, A. & Karni, O. (2018). Borders of change: A holistic exploration of teaching in one-to-one computing programs. Computers & Education, 125, 429-443.

Hershkovitz, A., Merceron, A., & Shamaly, A. (2019). The role of pedagogy in one-to-one computing lessons: a quantitative observational study of teacher-student interactions. Revista Española de Pedagogía, 77(274), 487-515.

Holstein, K., McLaren, B. M., & Aleven, V. (2017). Intelligent tutors as teachers’ aides. Proceedings of the Seventh International Learning Analytics & Knowledge Conference on - LAK ’17, 257–266. https://doi.org/10.1145/3027385.3027451

Hsieh, H.-F. & Shannon, S.E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288.

Hung, M.-L. (2016). Teacher readiness for online learning: Scale development and teacher perceptions. Computers & Education, 94, 120–133. https://doi.org/10.1016/J.COMPEDU.2015.11.012

Khan, M., & Khan, S. (2011). Data and information visualization methods, and interactive mechanisms: A survey. International Journal of Computer Applications, 34(1), 1–14. https://doi.org/10.5120/4061-5722

Light, D., Wexler, D. H., & Heinze, J. (2005). Keeping teachers in the center: A framework for data-driven decision-making. Proceedings of Society for Information Technology & Teacher Education International Conference 2005, Secada 2001, 128–133. Retrieved from https://www.learntechlib.org/primary/p/18964/

Mandinach, E. B. (2012). A perfect time for data use: using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71–85. https://doi.org/10.1080/00461520.2012.667064

Mandinach, E. B., & Gummer, E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30–37. https://doi.org/10.3102/0013189X12459803

Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics, 18(1), 50–60. https://doi.org/10.1214/aoms/1177730491

Tissenbaum, Matuk, C., M., Berland, M., Lyons, L., Cocco, F., Linn, M., … & Dillenbourg, P. (2016). Real-time visualization of student activities to support classroom orchestration (symposium). In C.-K. Looi, J. Polman, U. Cress, & P. Reimann (eds.), Transformin learning, empowering learners: The international conferences of the learning sciences: Volume 2 (pp. 1120-1127). Singapore: International Society of the Learning Sciences. https://www.isls.org/icls/2016/docs/ICLS2016_Volume_2.pdf

Molenaar, I., & Knoop-van Campen, C. (2018). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies, 12(3), 347–355. https://doi.org/10.1109/TLT.2018.2851585

Nabhani, M., & Bahous, R. (2010). Lebanese teachers’ views on “continuing professional development.” Teacher Development, 14(2), 207–224. https://doi.org/10.1080/13664530.2010.494502

Reeves, T. D., & Honig, S. L. (2015). A classroom data literacy intervention for pre-service teachers. Teaching and Teacher Education, 50, 90–101. https://doi.org/10.1016/J.TATE.2015.05.007

Richardson, J. W., McLeod, S., Flora, K., Sauers, N. J., Kannan, S., & Sincar, M. (2013). Large-scale 1:1 computing initiatives: An open access database. International Journal of Education and Development Using Information and Communication Technology, 9(1), 4–18. https://doi.org/http://ijedict.dec.uwi.edu/

Rienties, B., Herodotou, C., Olney, T., Schencks, M., & Boroowa, A. (2018). Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. International Review of Research in Open and Distance Learning, 19(5), 187–202. https://doi.org/10.19173/irrodl.v19i5.3493

Schifter, C. et al. (2014). Data-driven decision making: Facilitating teacher use of student data to inform classroom instruction. Contemporary Issues in Technology and Teacher Education, 14(4), 419–432. Retrieved from https://www.learntechlib.org/p/148436/

Schwendimann, B. A., Rodríguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Shirvani Boroujeni, M., Holzer, A., … & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30-41. https://doi.org/10.1109/TLT.2016.2599522

Tissenbaum, M., & Slotta, J. (2019). Supporting classroom orchestration with real-time feedback: A role for teacher dashboards and real-time agents. International Journal of Computer-Supported Collaborative Learning, 14(3), 325–351. https://doi.org/10.1007/s11412-019-09306-1

Trust, T. (2018). 2017 ISTE Standards for educators: From teaching with technology to using technology to empower learners. Journal of Digital Learning in Teacher Education, 34(1), 1–3. https://doi.org/10.1080/21532974.2017.1398980

Vanlommel, K., Van Gasse, R., Vanhoof, J., & Van Petegem, P. (2017). Teachers’ decision-making: Data based or intuition driven? International Journal of Educational Research, 83, 75–83. https://doi.org/10.1016/J.IJER.2017.02.013

Wishart, J. (2017). Mobile learning in schools. In J. Wishart (Ed.) Mobile learning in schools. London, Routledge. https://doi.org/10.4324/9781315536774

Xhakaj, F., Aleven, V., & McLaren, B. M. (2016). How teachers use data to help students learn: Contextual inquiry for the design of a dashboard. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9891 LNCS, 340–354. https://doi.org/10.1007/978-3-319-45153-4_26

Xhakaj, F., Aleven, V., & McLaren, B. M. (2017). Effects of a teacher dashboard for an intelligent tutoring system on teacher knowledge, lesson planning, lessons and student learning. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 10474 LNCS, 315–329. https://doi.org/10.1007/978-3-319-66610-5_23

Yoo, Y., Lee, H., Jo, I. H., & Park, Y. (2015). Educational dashboards for smart learning: Review of case studies. In G. Chen, V. K. Kinshuk, R. Huang, & S. C. Kong (Eds.), Lecture Notes in Educational Technology (Issue 9783662441879, pp. 145–155). Springer-Verlag. https://doi.org/10.1007/978-3-662-44188-6_21

Yurtseven Avci, Z., & O’Dwyer, L. (2016). Effective technology professional development: A systematic review. Society for Information Technology & Teacher Education International Conference, 2016(1), 2455–2460. Retrieved from https://www.learntechlib.org/p/172038/

Published
2020-07-23
How to Cite
Michaeli, S., Kroparo, D., & Hershkovitz, A. (2020). Teachers’ Use of Education Dashboards and Professional Growth. The International Review of Research in Open and Distributed Learning, 21(4), 61-78. https://doi.org/10.19173/irrodl.v21i4.4663
Section
Research Articles