On the impact of trace-based feature location in the performance of software maintainers

Software maintainers frequently strive to locate source code related to specific software features. This situation is mostly observable when features are scattered in the code. Considering this problem, several approaches for feature location using execution traces have been developed. Nonetheless, the practice of post-mortem analysis based on execution traces is not fully incorporated in the daily practice of software maintainers. Empirical studies that reveal strengths and weaknesses on the use of execution traces in maintenance activities could better explain the role of execution traces in software maintenance. This study reports on a controlled experiment conducted with maintainers performing actual maintenance activities on systems of different sizes unknown to them. There are benefits from systematic use of execution traces: the reduction of the maintenance activity time and greater accuracy of the activity outcome. Other qualitative observations were the lower level of activity difficulty perceived by the participants that used execution trace information and that this kind of information seems to be less useful in maintenance activities where the problem of feature scattering does not occur clearly.

► We provide an empirical assessment on the use of execution traces in software maintenance tasks.
► The use of execution traces information, in general, reduces the execution time of maintenance tasks.
► The use of execution traces information, in general, enhances the correction of maintenance tasks outcomes.
► The use of execution traces information hinders the maintainer activity when the information necessary to the maintenance task is easily accessible.