Materializing data
Notes on collaboration and tangible interfaces with excerpts and additions
DOI:
https://doi.org/10.29147/2526-1789.DAT.2016v1i2p2-14Keywords:
Visualization, Data, Cognition, Citizen Engagement, Embodied Interaction, HCI, Tangible Interface, Data Sculpture, LearningAbstract
The visualization of data elucidates trends and patterns in the phenomena that the data represents, and opens accessibility to understanding complicated human and natural processes represented by data sets. Research indicates that interacting with a visualization amplfies cognition and analysis. A single visualization may show only one facet of the data. To examine the data from multiple perspectives, engaged citizens need to be able to construct their own visualizations from a data set. Many tools for data visualization have responded to this need, allowing non-data experts to manipulate and gain insights into their data, but most of these tools are restricted to the computer screen, keyboard, and mouse. Cognition and analysis may be strengthened even more through embodied interaction with data, whether through data sculpture or haptic and tangible interfaces. We present here the rationale for the design of a tool that allows users to probe a data set, through interactions with graspable (tangible) three-dimensional objects, rather than through a keyboard and mouse interaction. We argue that the use of tangibles facilitates understanding abstract concepts, and facilitates many concrete learning scenarios. Another advantage of using tangibles over screen-based tools is that they foster collaboration, which can promote a productive working and learning environment.
Downloads
References
Antle, A.N. and Wise, A.F. Getting Down to Details: Using Theories of Cognition and Learning to Inform Tangible User Interface Design. Interacting with Computers 25, 1 (2013), 1–20.
Bohman, S. (2015). Data Visualization: An Untapped Potential for Political Participation and Civic Engagement. In Kő, A., & Francesconi, E. (Eds.), Electronic Government and the Information Systems Perspective (pp. 302-15). Lecture Notes in Computer Science 9265. Springer International Publish- ing. http://link.springer.com/chapter/10.1007/978-3-319-22389-6_22.
Bongshin, L., Isenberg, P., Riche, N. H. & Carpendale, S. (2012). Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Transactions on Visualization and Computer Graphics, 18(12), 2689-98. doi: http://dx.doi.org/10.1109/TVCG.2012.204
Bouabid, A., Lepreux, S., Kolski, C, & Havrez, C. (2014). Context-Sensitive and Collaborative Application for Distributed User Interfaces on Tabletops. In Proceedings of the 2014 Workshop on Distributed User Interfaces and Multi- modal Interaction, 23-26. DUI ’14. New York, NY, USA: ACM. doi: http:// dx.doi.org/10.1145/2677356.2677661
Camarata, K., Yi-Luen Do, E., Johnson, Brian R., & D. Gross, M. (2002). Naviga- tional Blocks: Navigating Information Space with Tangible Media. In Proceedings of the 7th International Conference on Intelligent User Interfaces (pp. 31-38). IUI ’02. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/502716.502725
Chapman, M. (1988). Constructive Evolution: Origins and Development of Piaget’s Thought. Cambridge University Press. https://books.google.ca/books?hl=e- n&lr=&id=7WgCnXmdX1MC&oi=fnd&pg=PR7&dq=Origins+and+Development+of+Piaget%27s+thoughts&ots=j-JrALSuHbr&sig=0dftyPoKgBB RjQB50p12dnVt_UM
Chevalier, F., Vuillemot, R., & Gali, G. (2013). Using Concrete Scales: A Practical Framework for Effective Visual Depiction of Complex Measures. IEEE Transactions on Visualization and Computer Graphics, 19(12), 2426-35. doi: http://dx.doi.org/10.1109/TVCG.2013.210
Cohen, N., Confessore, S., & Yourish, K. (2015). The Families Funding the 2016 Presidential Election. The New York Times, October 10. http://www.nytimes. com/interactive/2015/10/11/us/politics/2016-presidential-election-super- pac-donors.html
Crowe, P. et al (2015) Time Tremors https://play.google.com/storeapps/details?id=ca.xenophile.timetremors.agoandroid&hl=en
Data Sculpture | List of Physical Visualizations. (2015). Accessed December 6. http://dataphys.org/list/tag/data-sculpture/
Dewey, J. (1997). Democracy and Education. Simon & Schuster.
Diamond, S. et al. (2005) CodeZebraInc. www.codezebra.net and http://www.codezebraosphd.com/
Do-Lenh, S., Jermann, P., Cuendet, S., Zufferey, G., & Dillenbourg. P. (2010). Task Performance vs. Learning Outcomes: A Study of a Tangible User Interface in the Classroom. In Martin Wolpers, P., Kirschner, A., Scheffel, M., Lindstaedt, S., & Dimitrova, V. (Eds.), Sustaining TEL: From Innovation to Learning and Practice (pp. 78-92). Lecture Notes in Computer Science 6383. Springer Berlin Heidel- berg. http://link.springer.com/chapter/10.1007/978-3-642-16020-2_6
Espinosa, R., Garriga, L., Zubcoff, J.J., & Mazon, J.-N. (2014). Linked Open Data Mining for Democratization of Big Data. In 2014 IEEE International Conference on Big Data (Big Data) (pp. 17-19). doi: http://dx.doi. org/10.1109/BigData.2014.7004479
Fischer, Andrew Nicholas (2014) http://anf.nu/
Follmer, S., Leithinger, D., Olwal, A., Hogge, A., & Ishii, H. (2013). inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (pp. 417-26). UIST ’13. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/2501988.2502032
Fundament – Financial Data Sculpture / Andreas Nicolas Fischer. (2015). Accessed December 6. http://anf.nu/fundament/
Gonzalez-Franco, M., Hall, M., Hansen, D., Jones, K., Hannah, P., & Bermell- Garcia, P. (2015). Framework for Remote Collaborative Interaction in Virtual Environments Based on Proximity. In 2015 IEEE Symposium on 3D User Interfaces (3DUI), 153–54. doi: http://dx.doi.org/10.1109/3DUI.2015.7131746
Gwilt, I., Yoxall, A., and Sano, K. Enhancing the Understanding of Statistical Data Through the Creation of Physical Objects. DS 73-1 Proceedings of the 2nd International Conference on Design Creativity Volume 1, (2012).
Haller, M., Leitner, J., Seifried, T., Wallace, J. R., Scott, S. D., Richter, C., Brandl, P., Gokcezade, A., & Hunter, S. (2010). The NiCE Discussion Room: Integrating Paper and Digital Media to Support Co-Located Group Meetings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 609-18). CHI ’10. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/1753326.1753418
Hans, Rosling. (2010). Global Population Growth, Box by Box. TEDtalk presented at the TED, Cannes, June. http://www.ted.com/talks/hans_rosling_on_global_population_growth?language=en
Hornecker, E., & Buur, J. (2006). Getting a Grip onTangible Interaction: AFramework on Physical Space and Social Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 437-46). CHI ’06. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/1124772.1124838
How Much Does the Tax Code Reduce Inequality? (2015). The Brookings Institution. Accessed December 2. http://www.brookings.edu/blogs/up- front/posts/2015/04/09-how-does-tax-code-reduce-inequality-wessel
Huron, S., Carpendale, S., Thudt, A., Tang, A., & Mauerer, M. (2014). Constructive Visualization. In Proceedings of the 2014 Conference on Designing Interactive Systems (pp. 433-42). DIS ’14. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/2598510.2598566
Hurst, Rachel (2016) http://hur.space/
Ishii, H.(2008). Tangible Bits: Beyond Pixels. In Proceedings of the 2Nd International Conference on Tangible and Embedded Interaction, xv – xxv. TEI ’08. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/1347390.1347392
Ishii, H., & Ullmer, B. (1997). Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 234-41). CHI ’97. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/258549.258715
Jacob, Robert J. K., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Treacy Solovey, E., & Zigelbaum, J. (2008). Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 201-10). CHI ’08. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/1357054.1357089
Jansen, Y., Dragicevic, P., & Fekete. J.-D. (2013). Evaluating the Efficiency of Physical Visualizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2593-2602). CHI ’13. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/2470654.2481359
Jofre, A., Szigeti, S., Keller, S., Tiefenbach, Filho, Frederico Tome, Dong, Lan- Xi, & Diamond, S. (2015). A Tangible User Interface for Interactive Data Analysis. In Proceedings of CASCON 2015. November 2-4, 2015. Toronto, Canada.
Jofre, A., Szigeti, S., & Diamond, A. (2016). Citizen Engagement through Tangible Data Representation. Foro de Educación, 14(20), 305-325. doi: http://dx.doi.org/10.14516/
Kaltenbrunner, M., & Bencina, R. (2007). reacTIVision: A Computer- Vision Framework for Table-Based Tangible Interaction. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (pp. 69-74). TEI ’07. New York, NY, USA: ACM. doi: http://dx.doi. org/10.1145/1226969.1226983
Keller, K. H. (2012). Gapminder: An AP Human Geography Lab Assignment. The Geography Teacher, 9(2), 60-63. doi: http://dx.doi.org/10.1080/19338341.2012.679893
Kim, Mi Jeong, & Lou Maher, M. 2008. The Impact of Tangible User Interfaces on Spatial Cognition during Collaborative Design. Design Studies, 29(3), pp. 222-53. doi: http://dx.doi.org/10.1016/j.destud.2007.12.006
Klum, S., Isenberg, P., Langner, R., Fekete, J.-D., & Dachselt, R. (2012). Stackables: Combining Tangibles for Faceted Browsing. In Proceedings of the International Working Conference on Advanced Visual Interfaces (pp. 241-48). AVI ’12. New York, NY, USA: ACM. doi: http://dx.doi. org/10.1145/2254556.2254600
Koh, Germaine (2015) http://www.museumofvancouver.ca/exhibitions/exhibit/lively-objects
Langner, R., Augsburg, A., & Dachselt, R. (2014). CubeQuery: Tangible Interface for Creating and Manipulating Database Queries. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (pp. 423-26). ITS ’14. New York, NY, USA: ACM. doi: http://dx.doi. org/10.1145/2669485.266952
Le, Dai-Trang. (2013). Bringing Data to Life into an Introductory Statistics Course with Gapminder. Teaching Statistics, 35(3), 114-22. doi: http:// dx.doi.org/10.1111/test.1201=
Leithinger, D., Follmer, S., Olwal, A., & Ishii, H. (2014). Physical Telepresence: Shape Capture and Display for Embodied, Computer-Mediated Remote Collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (pp. 461-70). UIST ’14. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/2642918.2647377
Loren Madsen. (1995). CPI. http://www.newloren.com/data_art.html#0. Moere, A. V., & Hill, D. (2012). Designing for the Situated and Public Visualization of Urban Data. Journal of Urban Technology, 19(2), 25-46. doi: http://dx.doi.org/10.1080/10630732.2012.698065
Nasrine Olson, J. M. N., & Nelhans, G. (2015). Semantic Web, Ubiquitous Computing, or Internet of Things? A Macro-Analysis of Scholarly Publications. Journal of Documentation, 71(5), 884–916. doi: http://dx.doi. org/10.1108/JD-03-2013-0033
Neill, Emily (2016) http://www.emily-neill.com/
Norooz, L., Mauriello, M. L., Jorgensen, A., McNally, B., & Froehlich, J, E. (2015). BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp.1025-34). ACM. http://www. cs.umd.edu/~jonf/publications/Norooz_BodyVis-ANewApproachToBodyLearningThroughWearableSensingAndVisualization_CHI2015.pdf. Posted by Eye Candy on May 12, 2015 at 10:30am, and View Blog. (2015).
FEATURE: #ManifestJustice Art Exhibit in Los Angeles. Accessed December
Pousman, Z., & Stasko, J. (2006). A Taxonomy of Ambient Information Systems: Four Patterns of Design. In Proceedings of the Working Conference on Advanced Visual Interfaces (pp. 67-74). AVI ’06. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/1133265.1133277
Rodgers, J., & Bartram, L. (2011). Exploring Ambient and Artistic Visualization for Residential Energy Use Feedback. IEEE Transactions on Visualization and Computer Graphics, 17(12), 2489-97. doi: http://dx.doi.org/10.1109/ TVCG.2011.196.
Rosling, H. (2008). Gapminder: World. URL Http://www. Gapminder. Org/ world.
Rosling, H., & Zhang, Z. (2011). Health Advocacy with Gapminder Animated Statistics. Journal of Epidemiology and Global Health, 1(1), 11-14.
Schmandt-Besserat, D. (1999). Tokens: The Cognitive Significance. Documenta Praehistorica, 26.
Schneider, B., Bumbacher, E., & Blikstein, P. (2015). Discovery versus Direct Instruction: Learning Outcomes of Two Pedagogical Models Using Tangible Interfaces. In Exploring the Material Conditions of Learning: Opportunities and Challenges for CSCL, the Proceedings of the Computer Supported Collaborative Learning (CSCL) Conference (pp. 1364-71). http://www.isls.org/cscl2015/ papers/MC-0335-FullPaper-Schneider.pdf
Schneider, B., Sharma, K., Cuendet, S., Zufferey, G., Dillenbourg, P., & Pea, A. D. (2015). 3D Tangibles Facilitate Joint Visual Attention in Dyads. In International Conference on Computer Supported Collaborative Learning (CSCL) (pp. 158-65). http://blog.bertrandschneider.com/wp-content/ uploads/2012/01/9.MC-0182-paper-edit1-LD.pdf
Schneider, B., Jermann, P., Zufferey, G., & Dillenbourg, P. (2011). Benefits of a Tangible Interface for Collaborative Learning and Interaction. IEEE Transactions on Learning Technologies, 4(3), 222–32. doi: http://dx.doi. org/10.1109/TLT.2010.36
Shaer, O., & Hornecker, E. (2010). Tangible User Interfaces: Past, Present, and Future Directions. Found. Trends Hum.-Comput. Interact, 3(1-2), 1-137. doi: http://dx.doi.org/10.1561/1100000026
Shaer, O., Leland, N., Calvillo-Gamez, E. H., & Jacob, R. J. K. (2004). The TAC Paradigm: Specifying Tangible User Interfaces. Personal Ubiquitous Comput, 8(5), 359-69. doi: http://dx.doi.org/10.1007/s00779-004-0298-3
Sharlin, E., Watson, B., Kitamura, Y., Kishino, F., & Itoh, Y. 2004. On Tangible User Interfaces, Humans and Spatiality. Personal Ubiquitous Comput, 8(5), 338-46. doi: http://dx.doi.org/10.1007/s00779-004-0296-5
Spitx, A. (2013) http://www.andrew-spitz.com/
Stan’s Cafe. 2013. Of All the People in the World. http://www.stanscafe.co.uk/ project-of--all-the-people.html
Steward, R. Justin (2011) https://thesocietypages.org/graphicsociology/2011/03/07/infographics-inspire-art-r-justin-stewart/
Stusak, S., Tabard, A., Sauka, F., Khot, R. A., & Butz, A. (2014). Activity Sculptures: Exploring the Impact of Physical Visualizations on Running Activity. IEEE Transactions on Visualization and Computer Graphics, 20(12), 2201-10. doi: http://dx.doi.org/10.1109/TVCG.2014.2352953
Szigeti, S.J., Stevens, A., Tu, R., et al. Output to Input: Concepts for Physical Data Representations and Tactile User Interfaces. CHI ’14 Extended Abstracts on Human Factors in Computing Systems, ACM (2014), 1813–1818.
Szigeti, S. J., Stevens, A., Tu, R., Jofre, A., Gebhardt, A., Chevalier, F., Lee, J., & Diamond, S. (2014). Output to Input: Concepts for Physical Data Representations and Tactile User Interfaces. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (pp. 1813-18). CHI EA ’14. New York, NY, USA: ACM. doi: http://dx.doi.org/10.1145/2559206.2581333
Szigeti, S., & Davila, P. (2013). Conversations with Buildings: Ambient Visualization of Energy Use Data. In Proceedings of Urban Ecologies 2013, June 20-21, 2013. Toronto, Ont., Canada.
Ullmer, B., Ishii, H., & Jacob, R. J. K. (2005). Token+Constraint Systems for Tangible Interaction with Digital Information. ACM Trans. Comput.-Hum. Interact, 12(1), 81-118. doi: http://dx.doi.org/10.1145/1057237.1057242
Valkanova, N., Jorda, S., & Vande Moere, A. (2015). Public Visualization Displays of Citizen Data: Design, Impact and Implications. International Journal of Human-Computer Studies, Transdisciplinary Approaches to Urban Computing, 81(September), 4-16. doi: http://dx.doi.org/10.1016/j. ijhcs.2015.02.005
Vande Moere, A. (2008). Beyond the Tyranny of the Pixel: Exploring the Physicality of Information Visualization. In Information Visualisation, 2008. IV ’08. 12th International Conference (pp. 469-74). doi: http://dx.doi. org/10.1109/IV.2008.84
Xie, L., Antle, A.N., and Motamedi, N. Are Tangibles More Fun? Proceedings of the 2Nd International Conference on Tangible and Embedded Interaction, ACM (2008), 191–198.
Ware, C. (2012). Information Visualization: Perception for Design. Elsevier.
Weiyuan, L. (2010). Natural User Interface- next Mainstream Product User Interface. In IEEE (pp. 203-5). doi: http://dx.doi.org/10.1109/ CAIDCD.2010.5681374
Wigdor, Daniel, and Dennis Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier.
