class:title-slide-custom <style> /* colors: #EEB422, #8B0000, #191970, #00a8cc */ /* define the new color palette here! */ a, a > code { color: #8B0000; text-decoration: none; } .title-slide h2::after, .mline h1::after { content: ''; display: block; border: none; background-color: #8B0000; color: #8B0000; height: 2px; } .remark-slide-content { background-color: #FFFFFF; border-top: 80px solid #8B0000; font-size: 20px; font-weight: 300; line-height: 1.5; <!-- padding: 1em 2em 1em 2em --> background-image: url(css/UNL.svg); background-position: 2% 98%; background-size: 10%; border-bottom: 0; } .inverse { background-color: #8B0000; <!-- border-top: 20px solid #696969; --> <!-- background-image: none; --> <!-- background-position: 50% 75%; --> <!-- background-size: 150px; --> } .remark-slide-content > h1 { font-family: 'Roboto'; font-weight: 300; font-size: 45px; margin-top: -95px; margin-left: -00px; color: #FFFFFF; } .title-slide { background-color: #FFFFFF; <!-- border-left: 80px solid #8B0000; --> background-image: url(css/UNL.svg); background-position: 98% 98%; <!-- background-attachment: fixed, fixed; --> background-size: 20%; border-bottom: 0; border: 10px solid #8B0000; <!-- background: transparent; --> } .title-slide > h1 { color: #111111; font-size: 32px; text-shadow: none; font-weight: 500; text-align: left; margin-left: 15px; padding-top: 80px; } .title-slide > h2 { margin-top: -25px; padding-bottom: -20px; color: #111111; text-shadow: none; font-weight: 100; font-size: 28px; text-align: left; margin-left: 15px; } .title-slide > h3 { color: #111111; text-shadow: none; font-weight: 100; font-size: 28px; text-align: left; margin-left: 15px; margin-bottom: -20px; } body { font-family: 'Roboto'; font-weight: 300; } .remark-slide-number { font-size: 13pt; font-family: 'Roboto'; color: #272822; opacity: 1; } .inverse .remark-slide-number { font-size: 13pt; font-family: 'Roboto'; color: #FAFAFA; opacity: 1; } .title-slide-custom .remark-slide-number { display: none; } .title-slide-custom h3::after, .mline h1::after { content: ''; display: block; border: none; background-color: #8B0000; color: #8B0000; height: 2px; } .title-slide-custom { background-color: #FFFFFF; <!-- border-left: 80px solid #8B0000; --> background-image: url(css/UNL.svg); background-position: 98% 98%; <!-- background-attachment: fixed, fixed; --> background-size: 20%; border-bottom: 0; border: 10px solid #8B0000; <!-- background: transparent; --> } .title-slide-custom > h1 { color: #111111; font-size: 40px; text-shadow: none; font-weight: 500; text-align: left; margin-left: 15px; padding-top: 80px; padding-bottom: 10px; } .title-slide-custom > h2 { margin-top: -25px; padding-bottom: 30px; color: #111111; text-shadow: none; font-weight: 100; font-size: 32px; text-align: left; margin-left: 15px; } .title-slide-custom > h3 { margin-top: -25px; padding-bottom: -25px; color: #111111; text-shadow: none; font-weight: 100; font-size: 32px; text-align: left; margin-left: 15px; } .title-slide-custom > h4 { color: #111111; text-shadow: none; font-weight: 100; font-size: 28px; text-align: left; margin-left: 15px; margin-bottom: -30px; padding-bottom: -25px; } .title-slide-custom > h5 { color: #111111; text-shadow: none; font-weight: 100; font-size: 24px; text-align: left; margin-left: 15px; margin-bottom: -40px; } <!-- img { --> <!-- max-width: 50%; --> <!-- } --> <!--------------FOOTER--------- --> <!-- Divider line above footer --> .footer hr{ width: 100%; } .footer { font-size: 14px; color: #808080; text-align: center; width: 90%; margin: 3rem auto; font-weight: 300; } .footer.logo { width: 25px; margin: 0px !important; } .rstudio4edu-footer { font-size: 12px; text-transform: uppercase; } .tocify-extend-page { height: 0px !important; } </style> <br><br> # Exploring Rural Shrink Smart Through Guided Discovery Dashboards ## SDSS 2022 ### June 8, 2022 #### Denise Bradford #### Department of Statistics, University of Nebraska - Lincoln #####
[denise.bradford@huskers.unl.edu](denise.bradford@huskers.unl.edu) <!-- #####
[www.deniserbradford.com](https://www.deniserbradford.com/) --> #####
[drbradford12](https://github.com/drbradford12) ??? Thank you for inviting me for a visit today and for attending my talk. --- class:primary # Outline <br> .large.emph[ + Introduction to Rural Shrink Smart Project with Iowa State University and Open-Source Data Challenges + Motivation - Why Use Dashboards? + Guiding Design Principles & Dashboard Design Workflow + Dashboard Philosophy - PCPs and the Novice User + Using Guided Discovery Learning (GDL) + Dashboard Design Workflow + Feedback Loop (Active and Passive Data Collections) + Future Work ] ??? In this talk today, I will provide a background of the Rural Shrink Smart Project. I will then provide a framework to way using a dashboard can be helpful to these population discovery of gaining insights from other towns. I will continue to discuss the usefulness of parallel coordinate plots on the naive user. I will conclude with future work. --- class:inverse <br> <br> <br> <br> <br> <br> .center[ # Project Introduction and Open-source Data Description ] --- # Rural Shrink Smart Project .center[ <img src="images/Shrink_Smart_Logo.png" width="35%"/> ] + <span style="color:darkred"> Project Question:</span> How do some cities manage to maintain quality of life for residents amid shrinking populations? + Can this be taught? .medium.emph[ This material is based upon work supported by the National Science Foundation under Grant No. 1952007. We would also like to thank our collaborators at Iowa State, the Iowa League of Cities, and the various Iowa government organizations which publish their data at (https://data.iowa.gov). ] --- # Basic Idea + Assemble publicly available data sets + Available over lots of different geographic measurements Lat/Long, Zip code (5 or 9 digit, changes over time), Address, City, Census units, School District, County + May not be complete for small towns (ACS estimates aren't useful in these areas - not enough people surveyed) + Assess usability, interpretability and adaptability to new statistical methodology. + .emph.cerulean[The Rural Shrink Smart EDA dashboard incorporates two major components]: + Data Visualization Interface component with Guided Discovery Learning (GDL) principles + Exploratory Data Analysis component utilizing statistical graphical elements, such as maps and Parallel Coordinate Plots (PCPs) --- # Challenges + Quality of Life is a subjective assessment + Iowa Small Town poll has measured subjective QOL by decade for one small town in each of the 99 counties in Iowa (same town each year) + Survey response rates keep decreasing over time + There are objective measures of things that contribute to QOL available in public datasets + School ratings + Town budgets for services + Access to medical care, shopping, etc. + Transportation trends + Demographic shifts + City level cooperative agreements with other government entities and NGOs --- # Challenges + Quality of Life is a subjective assessment + Iowa Small Town poll has measured subjective QOL by decade for one small town in each of the 99 counties in Iowa (same town each year) + Survey response rates keep decreasing over time + There are objective measures of things that contribute to QOL available in public datasets + <span style="color:darkred">Project Question:</span> How do we leverage <span style="color:blue">data science</span> and <span style="color:blue">exploratory data methods</span> to inform town leaders to reduce the shrinkage and maintain reliability? + How does an interactive dashboard of open-source data integrate into overall decision-making? + Can we focus on estimating only things that objective measurements don't capture? --- class:inverse <br> <br> <br> <br> <br> <br> .center[ # Motivation - Why Use Dashboards? ] --- # Identifying Key Metrics <b><u>Audience</u></b> .medium.emph[ + As small rural towns, traditionally, do not have access: + Data scientists + Ability to easily leverage data collected locally to support decisions Our research team will provide communities with data about services in small town Iowa in order to assist with developing strategies to improve quality of life for their residents amid shrinking populations ] -- <b><u>Visualization Goals</u></b> .medium.emph[ + Create a central place for the excess of data to be conveyed in a single comprehensive visual. + We will utilize Parallel Coordinate Plot (PCPs) + Create a map feature that will allow for town leaders to understand the distance of essential QoL components (e.g. Fire Dept, Schools, etc.) + Add an overview of town general basics related to the seven QoL factors. ] -- <b><u>Engage People</u></b> .medium.emph[ + We will assess our visualizations to determine which strategies for user interface and interactive graphics design are most useful to empower town leaders to make discoveries in publicly available data assembled with a focus on items that impact rural quality of life. ] --- # Visualization + Create a town-focused dashboard that lets leaders see how their town compares to other similar towns (geographically and as measured by the unsupervised statistical analysis) + Goal is to help towns see what strategies for maintaining QOL work and don't + Emphasis on things towns are empowered to change + Can't focus on e.g. agricultural policy + City budgets, partnerships with outside entities, services that matter and don't -- + How do we best design charts/graphs/UI to make people feel empowered and help them explore the data with an open mind? + How do we incorporate statistical analyses into this? Much of the data will provide qualitative differences but not statistically significant differences. --- class:inverse <br> <br> <br> <br> <br> <br> .center[ # Guiding Design Principles and Dashboard Design Workflow ] --- # Guiding Design Principles Our initial set of dashboard design principles are: + The town leaders are the focus audience (central focus of the app) + Local Map (Local Essential Services) + Vital Statistics + Facilitate comparisons with other towns in order to allow the user to explore other potential solutions + Present the user with peer comparisons in order to widen the scope of exploration beyond the initial set of obvious peers in the local region. + PCP to compare the towns with varying similar features (e.g. economy, population, rurality or user input) + Allow for more detailed data and feature requests to improve the dashboard design over time. --- # Dashboard Design Workflow + Compile a single data set + rows: Each town + columns: Each variable with appropriate spatial aggregation e.g. distance to service instead of lat/long + Unsupervised Analysis + Which towns are most similar based only on the public data? + Dashboard Layout + Which layout will allow the user to engage the most without overwhelming their curiosity? + Dashboard Feedback + What elements on the dashboard are useful, confusing, misleading or incorrect from town leaders? --- # Dashboard Design Workflow ## Unsupervised Analysis <br> - Unsupervised clustering methods were used to determine data quality -- <br> - During the process, we found that schools, fire departments, post offices and hospitals were missing from our open-source data -- <br> - Resulted in finding other open-source data that were used for sanity checks along with adding information of missing data ??? We found that in towns that the project leaders understood were off. For example, we found that many of the schools that were known to be in the towns were not in the dataset that we were using. Along with the fact that we have the leaflet feature, we could see that schools were in particular parts of towns that we did not see. --- # Dashboard Design Workflow (Layout) ## Dashboard Layout Iterations .large.emph[ + Version 1: An idea without limitations of the actual implementation pieces. ] .center[ <img src="images/Version1.png" width="80%"/> ] --- # Dashboard Design Workflow (Layout) ## Dashboard Layout Iterations .large.emph[ + Version 2: After implementation has been completed and the team notes limitations, we change the interface. ] .center[ <img src="images/Version2.png" width="52%"/> ] --- # Dashboard Design Workflow (Layout) ## Dashboard Layout Iterations .large.emph[ + Version 3: Now incorporate more literature on dashboard design and user experience, which removes some of the "cool" implementations ] .center[ <img src="images/Version3.png" width="60%"/> ] --- # Dashboard Design Workflow (Layout) ## Dashboard Layout Iterations .large.emph[ + Version 4: Finally incorporate a collective feedback from team-leaders that suggests lack of understanding of information ] .center[ <img src="images/Version4.png" width="75%"/> ] --- # Dashboard Design Workflow (Layout) ## Dashboard Components - Map (Town's closest services) .center[ <img src="images/map.png" width="60%"/> ] --- # Dashboard Design Workflow (Layout) ## Dashboard Components - Vital Statistics (Town-centric and county level) .center[ .column[ <img src="images/vital1.png" width="45%"/> <img src="images/vital2.png" width="45%"/> ] ] --- # Dashboard Design Workflow (Layout) ## Dashboard Components - Parallel Coordinate Plot with objective measures related to the QoL Survey .center[ <img src="images/pcp.png" width="75%"/> ] [Smart Connected Communities Dashboard](https://shiny.srvanderplas.com/Smart-Connected-Communities/) --- class:inverse <br> <br> <br> <br> <br> <br> .center[ # Dashboard Philosophy - PCPs and the Novice User ] --- exclude: true # Dashboard Philosophy ## Reasoning behind using PCP <br> .large.emph[ + We provide users with a town-centric approach: their town is at the center of our application, and comparisons to other, similar towns are secondary. ] -- exclude: true <br> .large.emph[ + We allow users to modify a set of suggested comparison towns to indicate other towns of interest. ] --- class:primary # Dashboard Philosophy ## PCPs Effectiveness & Novice Users **Who?** Sukwon Lee, et al. wrote "How do People Make Sense of Unfamiliar Visualizations?: A Grounded Model of Novice’s Information Visualization Sensemaking" **What?** Propose a grounded model of `NO`vice’s information `VI`sualization `S`ensemaking (`NOVIS` model) + Framework for assessing a person's ability to interpret a new graphical map + Two Basic Components: + Visual Object (textual objects and non-textual objects) + Frame (frame of content and frame of visual encoding) **Why?** Advantages of using NOVIS model includes a reproducible framework of understanding graphics. **Findings** The PCP in this study were found to be promising for novice users, when comparing to the Treemap and Chord Diagram. <br><br> [Reference Journal](https://ieeexplore.ieee.org/document/7192668) ??? NOVIS Model has been used to compare other graphs such as PCP, Tree Maps and Chord diagrams, which helps with the understanding of why we could use the PCPs. We will use this model to ask questions of our town leaders to gain feedback on what they understand. --- # Dashboard Philosophy ## PCP in Dashboard Develop Reasoning <br> + The large set of publicly available data we have assembled is useful, but we must be careful with how we present this data because it would be easy to overwhelm the user with small details that mask the bigger picture. + A small subset of variables of interest to start with, and then + Allow the user to increase the complexity of the display in accordance with their interest + This avoids some of the pitfalls of dashboard design that can easily lead to user overload [Few](https://www.stephen-few.com/) --- class:primary # Dashboard Philosophy ## Background of Guided Discovery Learning **Who?** [Michael A. DeDonno](https://doi.org/10.1016/j.lindif.2016.05.023) wrote "The Influence of IQ on pure discovery and guided discovery learning of a complex real-world task." **What?** To investigate the predictive ability of IQ on pure discovery and guided discovery learning of a complex real-world task. **How is this useful?** As mentioned previously, we not only want to present a complex graphic for novice users, we also want to empower the town-leader users to explore the dashboard, comprehensively. We would like to use the general principles by making sure that the users understands what is being presented to them. **Experimentation** We will collect how the users are clicking on the app. This will help us understand if the users are getting better understanding of the app over time. ??? --- # Dashboard Philosophy ## Guided Discovery Learning with Dashboard Design <br> We leverage the framework of Guided Discovery Learning (GDL) to guide the town leaders to make discoveries using our interactive visualization. By leveraging: + hints + feedback + other helpful information to guide users in interactive exploration e.g. user ignoring the radio buttons to compare similar cities, etc. --- class:inverse <br> <br> <br> <br> <br> <br> .center[ # Dashboard Design Workflow - Feedback Loop (Actively & Passively) ] --- # Dashboard Design WorkFlow (Feedback) ## Background of User Feedback Questionnaire **Who?** [Young & Kitchin](https://doi.org/10.1016/j.ijhcs.2020.102429) wrote "Creating design guidelines for building city dashboards from a user's perspectives" **What?** To help summarize a users concerns,Young & Kitchin utilize six main critiques, which are framed into questions. **How is this useful?** We will adapt these questions to better help the town leaders communicate clear feedback for our team to use. **Experimentation** We will collect how the users are experiencing the app with these set questions: + Is the information the dashboard presents clear? <i>(Scope)</i> + Is the dashboard easy to navigate? <i>(Usability)</i> + Is the dashboard used in a socially responsible manner? <i>(Ethics)</i> + Do you believe that you can trust the Rural Shrink Smart dashboard? <i>(Validity)</i> + Do you find value in the Rural Shrink Smart dashboard? <i>(Utility)</i> ??? --- # Dashboard Design WorkFlow (Feedback) ## User Testing in Beta + Groups of Users: + Graphics Group Members (Users know Statistical Graphics) + Rural Shrink Smart Project Members (Users know the project with little background in Statistical Graphics) + Others (Member of doctoral community that has background in educational adaptivity) --- # Dashboard Design WorkFlow (Feedback) ## Dashboard Feedback + Our feedback from users has two components: + User prompted (using a survey and screenshots) + User behaviors being record in the background: + This will help validate issues that are being mentioned in the survey. + e.g. "I'm having a hard time understanding the PCP information", we will see that users are not spending any time on the PCP. .center[ <img src="images/feedback_question.png" width="55%"/> ] --- class:primary # Future Work + Comparatively look at the cities town leaders used to compare to other towns to the USDA rurality index classifications. [Rural-Urban Continuum Codes](https://www.ers.usda.gov/topics/rural-economy-population/rural-classifications/) + If results are correlated, making an argument for a proxy + Continue to incorporate feedback from town leaders. <br> .center[ <img src="images/feedback_loop.png" width="50%"/> ] ??? With six rural town leaders, we will have enough information needed to understand the usefulness of the dashboard from town leaders that are working with us directly. The Rural-Urban Continuum Codes are released every 10 years. The most recent release was in 2013, the next release will be in 2023. --- class:inverse <br> <br> <br> .center[ # Thank you! ### Acknowledgments: Dr. Susan VanderPlas & the ISU - Rural Shrink Smart Project Team <br> <br>
**denise.bradford@huskers.unl.edu** <!-- #####
[www.deniserbradford.com](https://www.deniserbradford.com/) -->
**@drbradford12** ] <br> .medium.emph[ Special Thank You to Emily A. Robinson for creating our UNL theme, find her work at
**@earobinson95** ] ??? Thank you for the support of my adviser Dr. Susan VanderPlas and the ISU Rural Shrink Smart Project Team for the hard work that they have done for not only me but also the rural town leaders.