Metadata-driven Delphi rating on the Internet

Metadata-driven Delphi rating on the Internet

Deshpande AM; Shiffman RN; Nadkarni PM

Computer Methods And Programs In Biomedicine

2005

Delphi Technique; Internet; P.H.S.; Research Support; U.S. Gov't; Guidelines; Software

Paper-based data collection and analysis for consensus development is inefficient and error-prone. Computerized techniques that could improve efficiency, however, have been criticized as costly, inconvenient and difficult to use. We designed and implemented a metadata-driven Web-based Delphi rating and analysis tool, employing the flexible entity-attribute-value schema to create generic, reusable software. The software can be applied to various domains by altering the metadata; the programming code remains intact. This approach greatly reduces the marginal cost of re-using the software. We implemented our software to prepare for the Conference on Guidelines Standardization. Twenty-three invited experts completed the first round of the Delphi rating on the Web. For each participant, the software generated individualized reports that described the median rating and the disagreement index (calculated from the Interpercentile Range Adjusted for Symmetry) as defined by the RAND/UCLA Appropriateness Method. We evaluated the software with a satisfaction survey using a five-level Likert scale. The panelists felt that Web data entry was convenient (median 4, interquartile range [IQR] 4.0-5.0), acceptable (median 4.5, IQR 4.0-5.0) and easily accessible (median 5, IQR 4.0-5.0). We conclude that Web-based Delphi rating for consensus development is a convenient and acceptable alternative to the traditional paper-based method.

2005

Article information provided for research and reference use only. PedPalASCNET does not hold any rights over the resource listed here. All rights are retained by the journal listed under publisher and/or the creator(s).

Journal Article

Backlog