Creating a Data-Informed Culture to Drive Innovation

Using evaluation findings and insights gained from more than a decade of evaluating the Extreme Science and Engineered Discovery Environment (XSEDE), NSF's innovative national research cyber-infrastructure program, we will present strategies for creating and maintaining a robust and organic data-informed culture that promotes communication, evidence-based decision-making, continuous improvement, and accountability across all levels of a large, distributed virtual organization. Using multimedia (video testimonials, graphics, narration, and audience participation), we will explore topics such as positioning evaluation within the organization, establishing key performance indicators (KPIs) and metrics, measuring progress over time, conducting efficient data collection, balancing formative and summative needs, selecting collaboration tools to promote data use, ensuring ethical use, protecting privacy, developing data literacy, and selecting an evaluator. Examples of evaluation plans, KPIs and metrics, data collection tools, strategies for stakeholder involvement, and ways of assessing culture and climate will be presented. Timeline, budget, administrative needs, and other practical considerations will be discussed. The goal of this session is to spark interest in creating comprehensive innovation evaluation approaches that reflect the complexity of the institutions in which we work and provide sufficient, relevant data to truly guide and assess long- and short-term actions.