Science and Technology for America’s Reinvestment Measuring the Effects of Research on Innovation, Competitiveness, and Science (STAR METRICS)
George Chacko, Director of the Office of Planning, Analysis, and Evaluation, Center for Scientific Review
STAR METRICS is a consortium of federal agencies in collaboration with research institutions led by the National Institutes of Health (NIH), the National Science Foundation (NSF), and the White House Office of Science and Technology Policy (OSTP). The goal of this program is to provide a better empirical basis for science policy through the development of an enabling data infrastructure, which can be used by federal agencies, research institutions, and researchers to document and analyze federal investments in science. STAR METRICS is organized around two related efforts: Level I- which is focused on collecting data to describe the national scientific workforce supported by federal funds and Level II- which will focus on collecting data to document the output from science investments.
Background: The STAR METRICS program was created in direct response to the reporting requirements associated with the 2009 American Recovery and Reinvestment Act (ARRA), which required recipients of Federal funding to document the initial jobs resulting from Federal expenditures. STAR METRICS Level I was designed to facilitate this reporting. STAR METRICS is also responsive to Open Government memoranda requiring agencies to publish their information online in an open format that can be retrieved, downloaded, and searched and to use modern technology to disseminate useful information1. In addition, the White House Office of Management and Budget (OMB) and OSTP have requested that federal agencies should support the development and use of "science of science policy" tools that can improve management of their R&D portfolios and enable better assessment of the impact of their science, technology and innovation investments2.
The STAR METRICS project was officially approved in October 2010 and now comprises six federal agencies and 86 research institutions. These 86 institutions represent a significant fraction of research expenditure. For example, research institutions participating in STAR METRICS represent 33% of NIH’s grants budget. The six federal participants are the NIH, NSF, OSTP, the Environmental Protection Agency (EPA), the United States Department of Agriculture (USDA), and the Department of Energy (DOE).
In early 2012, NIH was designated as the host institution and a new governance system was put in place to help guide STAR METRICS as it transitions from a pilot to an operational phase. A Lead Entity Executive in consultation with a senior Executive Council and an Interagency Working Group directs the program. Dr. Sally Rockey, Deputy Director for Extramural Research at NIH serves as the Lead Entity Executive and chairs the Executive Council along with Dr. Carl Wieman from OSTP. The NIH and NSF representatives on the Interagency Working Group serve as Program Managers for STAR METRICS.
Immediate plans for Level I are to:
FUTURE PLANS FOR STAR METRICS: