Topic analysis and forecasting for science, technology and innovation: Methodology with a case study focusing on big data research

• Data-driven clustering approach to group topics with high accuracy
• Similarity measure approach to trace the interaction between topics in time series
• Analyzing changes of TFIDF values of related topics to predict future trends
• Technology Roadmapping to blend historical analysis and expert-based forecasting

The number and extent of current Science, Technology & Innovation topics are changing all the time, and their induced accumulative innovation, or even disruptive revolution, will heavily influence the whole of society in the near future. By addressing and predicting these changes, this paper proposes an analytic method to (1) cluster associated terms and phrases to constitute meaningful technological topics and their interactions, and (2) identify changing topical emphases. Our results are carried forward to present mechanisms that forecast prospective developments using Technology Roadmapping, combining qualitative and quantitative methodologies. An empirical case study of Awards data from the United States National Science Foundation, Division of Computer and Communication Foundation, is performed to demonstrate the proposed method. The resulting knowledge may hold interest for R&D management and science policy in practice.