Students' Insights from Interactive Visualizations Arranged Multimodally in Knowledge Visualizations
DOI:
https://doi.org/10.24834/educare.2022.1.3Keywords:
design-based research, knowledge visualisations, multimodal arrangement, social science classrooms, visual analyticsAbstract
In this study, a visual analytics application is put into practice in Swedish secondary school social science classrooms. The application offers support to analyse vast amounts of data through interactive data visualizations. Previous studies have demonstrated that the visual interactive interface challenges the traditional practice in school, where students usually demonstrate their knowledge by means of written texts. Thus, this study examines what happens if students work with more malleable, adaptable, or fluid modes when attempting to express their conclusions from work with interactive data visualizations. It aims to detect patterns in how knowledge visualizations are produced and arranged multimodally. Inspired by design-based research, the study conducted two classroom interventions followed by video captures. It employed a socio-material semiotic approach, which enables the study of interactions between both social and material actors. Three patterns emerged when students’ insights were translated into knowledge visualizations – exploring, gathering, and inserting. It became obvious how different actors taking part of such a digital multimodal writing activity affect and change every actor/everyone/everything, which in turn transfers, relocalizes, reformulates, and re-presents the communicated message. Knowing how knowledge visualizations are produced might strengthen students’ visual abilities when transforming insights multimodally.
References
Aagaard, T., & Silseth, K. (2017). Teachers’ assessment of digital stories: Challenges and dilemmas. Nordic Studies in Education, 37(03–04), 231–242. DOI: https:// doi.org/10.18261/issn.1891-5949-2017-03-04-08
Anderson, T., & Shattuck, J. (2012). Design-based research: A decade of progress in education research? Educational Researcher, 41(1), 16–25.
Andrienko, G., Andrienko, N., Keim, D., MacEachren, A. M., & Wrobel, S. (2011). Challenging problems of geospatial visual analytics. Journal of Visual Languages & Computing, 22(4), 251–256.
Baldwin, K. (2015). Assessing the new media rhetoric: Crossing disciplinary boundaries. In A. T. Demo (ed.) Rhetoric across Borders (pp. 245–253). Anderson, SC: Parlor Press.
Baldwin, K. M. (2016). Multimodal Assessment in Action: What We Really Value in New Media Texts. Amherst: University of Massachusetts.
Bearne, E. (2009). Multimodality, literacy and texts: Developing a discourse. Journal of Early Childhood Literacy, 9(2), 156–187.
Bertschi, S., Breschiani, S., Crawford, T., Goebel, R., Keinreich, W., Lindner, M., Sabol, V., & Vane Moere, A. (2011). What is Knowledge Visualisation? Perspectives on an Emerging Discipline. 15th International Conference on Information Visualisation, IEEE. DOI:10.1109/IV.2011.58
Bresciani, S., & Eppler, M. J. (2015). The Pitfalls of Visual Representations: A Review and Classification of Common Errors Made While Designing and Interpreting Visualizations. SAGE Open. https://doi.org/10.1177/2158244015611451
Bezemer, J., & Kress, G. (2016). Multimodality, Learning and Communication: A Social Semiotic Frame. London: Routledge. DOI: https://doi.org/10.4324/9781315687537
Bodén, U., & Stenliden, L. (2019). Emerging Visual Literacy through Enactments by Visual Analytics and Students. Designs for Learning, 11(1), 40–51. DOI: http://doi.org/10.16993/dfl.108
Brownell, C. J. (2020). Disentangling the possibilities, practicalities, and progressions of writing in the contemporary (digital) era. Theory into Practice, 60(2), 160–171. DOI: 10.1080/00405841.2020.1857140
Burkhard R. A. (2005). Towards a framework and a model for Knowledge Visualization: Synergies between information and Knowledge Visualization. In: S. O. Tergan & T. Keller (Eds.), Knowledge and Information Visualization: Lecture Notes in Computer Science, vol 3426. Springer, Berlin, Heidelberg. DOI: 10.1007/11510154_13
Callon, M. (1986). Some elements of a sociology of translation: Domestication of the scallops and the fishermen of St Brieuc Bay. In J. Law (Ed.), Power, Action, and Belief: A New Sociology of Knowledge (pp. 196–233). London: Routledge & Kegan Paul.
Callon, M., Law, J., & Rip, A. (Eds.) (1986). Mapping the Dynamics of Science and Technology: Sociology of Science in the Real World. London: MacMillan.
Cederlund, C., & Sofkova Hashemi, S. (2018). Multimodala bedömningspraktiker och lärares lärande [Multimodal assessment practices and teachers’ learning]. EduCare, 1, 43–68. DOI: https://doi. org/10.24834/educare.2018.1.3
Comber, B. (2016). The relevance of composing: Children’s spaces for social agency. In A. Haas Dyson (Ed.), Child Cultures, Schooling, and Literacy: Global Perspectives on Composing Unique Lives (pp. 119–132). New York, NY: Routledge.
Cope, B., & Kalantzis, M. (2000). Multiliteracies: The beginning of an idea. In B. Cope & M. Kalantzis (Eds.), Multiliteracies: Literacy Learning and the Design of Social Futures (pp. 3–8). London: Routledge.
Cope, B., & Kalantzis, M. (2010). New media, new learning. In D. R. Cole & D. L. Pullen (Eds.), Multiliteracies in Motion (pp. 87–104). Abingdon & New York: Routledge.
Crawford, T. (2012). What is knowledge visualization? Eight reflections on an evolving discipline. In F. T. Marchese, & E. Banissi (Eds.), Knowledge Visualization Currents: From Text to Art to Culture (pp. 13–34). London: Springer Science & Business Media.
Easterday, M. W., Rees Lewis, D. G., & Gerber, E. M. (2017). The logic of design research. Learning: Research and Practice. DOI:10.1080/23735082.2017.1286367
Elf, N., Gilje, Ø., Olin-Scheller, C., & Slotte, A. (2018). Nordisk status og forskningsperspektiver: Multimodalitet i styredokumenter og klasserumsrumspraksis [Nordic research perspectives: Multimodality in curricula and classroom practices]. In M. Rogne & L. Rune Waage (Eds.), Multimodalitet i skole- og fritidstekstar. Ein vitskapleg antologi (pp. 71−104). Oslo: Fagbokforlaget.
Elkins, J. (2008). Introduction: The concept of visual literacy and its limitations. In Elkins, J. (Ed.), Visual Literacy, (pp. 1–9). New York: Routledge.
Eppler M. (2013). What is an effective Knowledge Visualization? Insights from a review of seminal concepts. In: Marchese F., & Banissi E. (Eds.), Knowledge Visualization Currents (pp. 3–12). London: Springer.
Eppler, M. J., & Burkhard, R. A. (2007). Visual representations in knowledge management: Framework and cases. Journal of Knowledge Management, 4(11), 112–122.
Felten, P. (2008). Visual literacy: Change. The Magazine of Higher Learning, 40(6), 60–64. DOI:10.3200/CHNG.40.6.60-64
Fenwick, T., & Edwards, R. (2010). Actor-Network Theory in Education. London: Routledge.
Godhe, A.-L. (2014). Creating and assessing multimodal texts: Negotiations at the boundary. Diss. Göteborg: Göteborgs universitet.
Hashemi Sofkova, S. (2019). Young students’ reading paths of media: Semiotic focus as a strategy to guide educational practice. AMIM 2019, Reading beyond Words: Approaches to Multimodality in the Media, 12 April 2019, ArtsOne, Queen Mary University of London, London, UK. Book of abstracts, p. 10. 2019-01-01.
Heath, C., Hindmarsh, J., & Luff, P. (2010). Video in Qualitative Research: Analysing Social Interaction in Everyday Life. Los Angeles, CA: Sage.
Iedema, R. (2003). Multimodality, resemiotization: Extending the analysis of discourse as multi-semiotic practice. Visual Communication, 2(1), 29–57. https://doi.org/10.1177/1470357203002001751
Jewitt, C. (2014a). An introduction to multimodality. In C. Jewitt (Ed.), The Routledge Handbook of Multimodal Analysis (2nd edn.) (pp. 15–30). London: Routledge.
Jewitt, C. (2014b). Different approaches to multimodality. In C. Jewitt (Ed.), The Routledge Handbook of Multimodal Analysis (2nd edn.) (pp. 31–43). London: Routledge.
Kress, G. R. (2003). Literacy in the New Media Age. New York, NY: Routledge.
Kress, G. R. (2010). Multimodality: A Social Semiotic Approach To Contemporary Communication. London and New York: Routledge.
Kress, G., & van Leeuwen, T. (2001). Multimodal Discourse, the Modes and Media of Contemporary Communication. London: Arnold.
Kress, G.R., & Van Leeuwen, T. (2006). Reading Images, the Grammar of Visual Design. (2nd ed.) London: Routledge.
Latour, B. (1987). Science in action: How to follow scientists and engineers through society/Bruno Latour. Cambridge, Mass.: Harvard Univ. Press, 1987
Latour, B. (1990). Visualisation and cognition: Drawing things together. In: M. Lynch, and S. Wolgar (eds.) Representation in Scientific Activity (pp.19-68). Cambridge, MA: MIT Press.
Latour, B. (1993). We Have Never Been Modern. Cambridge, MA: Harvard University Press.
Latour, B. (2005). Reassembling the Social: An Introduction to Actor-Network-Theory. Oxford: Oxford University Press.
Law, J. (1987). Technology and heterogeneous engineering: The case of Portuguese expansion. In W. E. Bijker, T. P. Hughes & T. J. Pinch (Eds.), The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology (pp. 111-134). Cambridge, MA: MIT Press.Law, J. (2004). After method: mess in social science research. (1. ed.) London: Routledge.
Law, J. (2004). After method: mess in social science research. London: Routledge.
Law, J. (2007). Actor Network Theory and Material Semiotics, version of April 25, 2007, available at: http://www.heterogeneities.net/publications/Law2007ANTandMaterialSemiotics.pdf, (downloaded on May 18, 2007).
Law, J., & Hassard, J. (1999). Actor Network Theory and After. Oxford: Blackwell.
Lundblad, P. (2013). Applied Geovisual Analytics and Storytelling. [Electronic resource]. Norrköping: Department of Science and Technology, Linköping University.
Magnusson, P., & Godhe, A.-L. (2019). Multimodality in language education: Implications for teaching. Designs for Learning, 11(1), 127–137. DOI: https://doi.org/10.16993/dfl.127
Massumi, B. (2002). Parables for the Virtual: Movement, Affect, Sensation. Durham, NC: Duke University Press.
Meyer, R. (2009). Knowledge Visualization. Research paper for the Media Informatics Advanced Seminar on Information Visualization, 2008/2009.
Molin, L. (2020). Kritiskt digitalt textarbete i klassrummet. Diss. Nr 81, Institutionen för tillämpad informationsteknologi, Göteborgs universitet.
Nissen, J. & Stenliden, L. (2020). Visualized Statistics and Students’ Reasoning Processes in A Post Truth Era. Journal of Interactive Learning Research, 31(1), 49-76.
Pennycook, A. (2017). Translanguaging and semiotic assemblages. International Journal of Multilingualism, 14(3), 269–282, DOI: 10.1080/14790718.2017.1315810
Purchase, H. C. (2014). Twelve years of diagrams research. Journal of Visual Languages & Computing, 25(2), 57-75. doi:https://doi.org/10.1016/j. jvlc.2013.11.004
Purdy, J.P. (2014). What can design thinking offer writing studies? College Composition and Communication, 65(4), 612–641.
Roll, I., & Wylie, R. (2016). Evolution and revolution in artificial intelligence in education. International Journal of Artificial Intelligence in Education, 26(2), 582–599.
Ryan, L. (2016). The Visual Imperative: Creating a Visual Culture of Data Discovery. Cambridge, MA: Morgan Kaufmann.
Sabol, V., Kow, W. O., Rauch, M., Ulbrich E., Seifert C., Granitzer, M. Lukose, D. (2012). Visual ontology alignment system: An evaluation. In Proceedings of SIGRAD 2012, Interactive Visual Analysis of Data (pp. 9–18). Vaxjö, Sweden.
Sefton-Green, J. (2021). Is the re-contextualization of digital writing inevitable, escapable or desirable? Theory into Practice, 60(2), 116–125. DOI:
Segel, E., & Heer, J. (2010). Narrative visualization: Telling stories with data. IEEE Transactions on Visualization and Computer Graphics 16(6), 1139–1148.
Seifert, C., Sabol, V., Kienreich, W., Lex, E., & Granitzer, M. (2014). Visual analysis and knowledge discovery for text. In A. Gkoulalas-Divanis & A. Labbi (Eds.), Large-Scale Data Analytics, (IBM Research) (pp. 189-218) New York: Springer.
Shipka, J. (2011). Toward a Composition Made Whole. Pittsburgh, PA: University of Pittsburgh. DOI: https://doi.org/10.2307/j.ctt5hjqkk
Stenliden, L. (2014). Visual Storytelling interacting in School. Learning Conditions in the Social Science Classroom. Linköpings universitet
Stenliden, L. (2015). Visual Analytics and K 12 Students - Emerging Dimensions of Complexity. International Journal of Social, Behavioral, Educational, Economic, Business and Industrial Engineering, 9(2), 663-671.
Stenliden, L. (2018). Geovisual Analytics in School: Challenges for the Didactic Design of the Classroom. International Journal of Information and Education Technology (3), 178-185.
Suthers, D.D. (2001). Towards a systematic study of representational guidance for collaborative learning discourse. Journal of Universal Computer Science, 7(3), 254–277.
Säljö, R. (2010). Digital tools & challenges to institutional traditions of learning, technologies, social memory and the performative nature of learning. Journal of Computer Assisted Learning, 26, 53–64.
TechSmith, C. (2010). Camtasia Studio. In (Vol. 7.1). Okemos, Michigan.
Tergan, S.-O., Keller, T., & Burkhard, R. A. (2006). Integrating Knowledge and Information: Digital Concept Maps as a Bridging Technology. Information Visualization, 5(3), 167–174. https://doi.org/10.1057/palgrave.ivs.9500132
Thomas, J., & Cook, K. (2005). Illuminating the path: A research and development agenda for visual analytics. In: Visual Representations and Interactions Technologies (pp. 69–104). IEEE Press.
Tomaszewski, B., & MacEachren, A. M. (2012). Geovisual analytics to support crisis management: Information foraging for geo-historical context. Information Visualization, 11(4), 339–359.
Treagust, D. F., Duit, R., & Fischer, H. E. (2017). Multiple Representations in Physics Education [Elektronisk resurs]. Cham: Springer.
Tufte, E. R. (1997). Visual Explanations. Cheshire, CT: Graphics Press.
Tversky, B., & Suwa, M. (2009). Thinking with sketches: Tools for innovation. In A. B. Markman & K. L. Wood (Eds.), The Science behind the Practical Methods that Drive Innovation (pp. 75–85). Oxford: Oxford University Press.
United Nations, General Assembly (UN) (2014) RES/68/261, Fundamental Principles of Official Statistics. Retrivied from https://unstats.un.org/unsd/dnss/gp/FP-Rev2013-E.pdf
Wei, L. (2011). Moment analysis and translanguaging space: Discursive construction of identities by multilingual Chinese youth in Britain. Journal of Pragmatics, 43(5), 1222–1235. DOI: doi.org/10.1016/j.pragma.2010.07.035
Kimber, K., & Wyatt-Smith, C. (2010). Secondary students’ online use and creation of knowledge: Refocusing priorities for quality assessment and learning. Australasian Journal of Educational Technology, 26(5).
Åkerfeldt, A. (2014a). Re-shaping of writing in the digital age-a study of pupils’ writing with different resources. Nordic Journal of Digital Literacy, 9(3), 172-193.
Åkerfeldt, A. (2014b). Didaktisk design med digitala resurser: en studie av kunskapsrepresentationer i en digitaliserad skola. English title: Didactic design with digital resources: A study of representations of knowledge in a digitalised school Stockholm: Institutionen för pedagogik och didaktik, Stockholms universitet.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Ulrika Christina Bodén, Linnea Stenliden, Jörgen Nissen
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
