Evaluating the Quality of Process Models: Empirical Analysis of a Quality Framework

This paper conducts an empirical analysis of the quality framework proposed by Lindland et al (1994) for evaluating the quality of conceptual models. 194 participants were trained in the concepts of the quality framework, and then used it to evaluate models in an extended ER language. A randomised, double-blind design was used, and the results evaluated by a combina-tion of quantitative and qualitative analysis. Finally, an analysis was conducted of the frame-work’s perceived ease of use, usefulness and likelihood of adoption in practice. The study pro-vides strong support for the validity of the framework and suggests that it is likely to be adopted in practice, but raises questions about its reliability. The research findings provide cleardirection for further refinements of the framework to improve its reliability.