The purpose of this workshop, held in cooperation with the ICA Commission on Use, Users and Usability and the ISPRS Working Group IV/9 - Geovisualization, Augmented and Virtual Reality, was to discuss whether reproducibility efforts recently or currently underway in the biological and social sciences might be beneficial to advancing the science of cartography.
The ideas shaping this workshop were informed in part by the thinking that went into two research agenda papers, published in The International Journal of Cartography in 2017, one on user studies in cartography, the other on designing across map use context.
Assuming that there was agreement among workshop participants that this is important (this was not a foregone conclusion!), then key questions related to how to undertake such a project. Thus this event was based around a series of semi-structured conversations in order to determine whether this would be a worthwhile investment of effort.
A summary of the discussions can be found here. We encourage you to have a read of the summary and contribute your thoughts to the community to help shape the development of our follow-up events on this theme.
Programme
Friday 27 April, 2018
9:00 - 9:30 Reproducibility in Cartography
Amy Griffin, Arzu Çöltekin, Sidonie Christophe
9:30-10:15
Discussion: Should we investigate this in cartography? How could one reproduce prior studies? How do we judge reproducibility? How do we select studies to attempt to reproduce them?
10:15-10:45 Coffee break
10:45-11:30 Presentation on Cartographic User Studies Database
Travis White
11:15-12:00
Discussion: How can we use this database to help support the reproducibility of cartographic user studies? How do we judge reproducibility? How do we select studies to attempt to reproduce them? What overlap/synergy is there with the UUU Commmission's database efforts?
12:00-13:00 Lunch
13:00-14:00
Practical Matters Discussion: What studies might we try to replicate? How might we coordinate those activities? How will we judge whether the replication was successful?
14:00-15:00
Discussion: Another angle on reproducibility and context: multi-site studies. What are they? Which kinds of studies might benefit from this approach? (terrain reversal effect, colour perception?) What aspects of context should be controlled? What kinds of factors do we think are most likely to be context sensitive?
15:00-15:30
Summary / wrap-up / next steps?
15:30-16:00 Coffee Break
