Reconceptualizing measuring, benchmarking for improving interoperability in smart ecosystems: The effect of ubiquitous data and crowdsourcing

•There is a fundamental shift in measuring and benchmarking practices.•Interoperability measurement is reconceptualized in the light of smart ecosystems.•Technical and organizational Interoperability are identified.•Interoperability is measured by a combination of constructs organizational aspects.•Interpretation of measuring results is difficult.

There is a fundamental shift in measuring and benchmarking due to the ability to use a large variety of data sources and virtually anybody can be involved. Interoperability is the ability of entities to work together covering aspects ranging from the technical to the organizational level. In smarter government, interoperability becomes increasingly important as relationships are subject to continuous changes and organizations operate within organizational ecosystems. In this paper interoperability measurement, benchmarking and improvement are reconceptualized in the light of the effects of big and open data and crowdsourcing in smarter government. Organizational and technical interoperability is decomposed into measurement constructs. A case study is presented showing the applicability and usefulness of the model. Using data sources inside and outside the organization the level of interoperability was measured and suggestions for improvements were identified by making use of experts and the crowd.