Measuring performance: Moving NASA Earth science products into the mainstream user community

Demonstrating performance of the applications of Earth observation satellite-based science data products and services is increasingly a requirement of government research agencies. We present efforts from the NASA-funded Earth Observing System Data and Information System's Synergy Project to measure performance in the development of applications from NASA research and development projects. We summarize challenges in monitoring performance and share our experience in evolving metrics over a 5-year project life. We demonstrate how to adapt project management processes and metrics from the information technology (IT) industry to Earth observation applications research and development. A roadmap for adapting IT processes and developing metrics and examples of quantitative and qualitative metrics are provided. Our findings suggest that designing and implementing these IT metrics will enhance project success, as defined by the degree of penetration of NASA products into the user community and level of non-NASA funding secured.