Mikaela Hoffman-Stapleton

This white paper presents a generalized evaluation framework that can be used for assessing project impacts within the context of transportation-related city projects. In support of this framework, we discuss a selection of metrics and data sources that are needed to evaluate the performance of smart city innovations. We first present a collection of projects and applications from near-term smart city concepts or actual pilot projects underway (i.e., Smart City Challenge, Federal Transit Administration (FTA) Mobility on Demand (MOD) Sandbox, and other pilot projects operating in the regions of Los Angeles, Portland, and San Francisco). These projects are identified and explained in Section 2 of this report. Using these projects as the basis for hypothetical case studies, we present selected metrics that would be necessary to evaluate and monitor the performance of such innovations over time. We then identify the data needs to compute those metrics and further highlight the gaps in known data resources that should be covered to enable their computation. The objective of this effort is to help guide future city planners, policy makers, and practitioners in understanding the design of key metrics 3 and data needs at the outset of a project to better facilitate the establishment of rigorous and thoughtful data collection requirements.