A framework for user driven data management

• We show a data storage model which can be used for recording a wide variety of data and metadata.
• The model allows sharing of files of any size.
• We show the model's use with examples from materials engineering.
• We demonstrate some tools built to show the flexibility of the model.
• We review some alternative approaches used for storage of data.

Scientists within the materials engineering community produce a wide variety of data, with datasets differing in size and complexity. Examples include large 3D volume densitometry files (voxel) generated by microfocus computer tomography (μCT) and simple text files containing results from a tensile test. Increasingly, there is a need to share this data as part of international collaborations. The design of a suitable database schema and the architecture of a system that can cope with the varying information is a continuing problem in the management of heterogeneous data. We present a model flexible enough to meet users’ diverse requirements. Metadata is held using a database and its design allows users to control their own data structures. Data is held in a file store which, in combination with the metadata, gives huge flexibility. Using examples from materials engineering we illustrate how the model can be applied.