Arch Fam Med
Institution: STANFORD Univ Med Center  | My Account | E-mail Alerts | Access Rights | Sign In
  Vol. 5 No. 5, May 1996 TABLE OF CONTENTS
  •  Online Features
 This Article
 •Full text PDF
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Contact me when this article is cited
 Related Content
 •Similar articles in this journal

The Clinical Value of Computerized Information Services

A Review of 98 Randomized Clinical Trials

E. Andrew Balas, MD, PhD; Suzanne M. Austin, MHA; Joyce A. Mitchell, PhD; Bernard G. Ewigman, MD, MSPH; Kenneth D. Bopp, PhD; Gordon D. Brown, PhD

Arch Fam Med. 1996;5(5):271-278.

Article references have been provided for searching and linking. Additional reference information may be available in the article PDF.

1. Gorry GA. Computer-assisted clinical decision making. Methods Inf Med. 1973;12:45-51. PUBMED
2. de Dombal FT, Leaper DJ, Staniland JR, McCann AP, Horrocks JC. Computer-aided diagnosis of acute abdominal pain. BMJ. 1972;2:9-13. FREE FULL TEXT
3. Mc Adam WA, Brock BM, Armitage T, Davenport P, Chan M, de Dombal FT. Twelve years' experience of computer-aided diagnosis in a district general hospital. Ann R Coll Surg Engl. 1990;72:140-146. PUBMED
4. Sutton GC. Computers in medicine: how accurate is computer-aided diagnosis? Lancet. 1989;2:905-908. PUBMED
5. Paterson-Brown S, Vipond MN, Simms K, Gatzen C, Thompson JN, Dudley HA. Clinical decision making and laparoscopy versus computer prediction in the management of the acute abdomen. Br J Surg. 1989;76:1011-103 PUBMED
6. Piantadosi S, Byar DP. A proposal for registering clinical trials. Control Clin Trials. 1988;9:82-84. PUBMED
7. Byar DP. Why data bases should not replace randomized clinical trials. Biometrics. 1980;36:337-342. PUBMED
8. Ewigman BG, Crane JP, Frigoletto FD, et al. Effect of prenatal ultrasound screening on perinatal outcome. N Engl J Med. 1993;329:821-827. FREE FULL TEXT
9. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA. 1992;267:374-378. FREE FULL TEXT
10. Balas EA, Mitchell JA, Bopp KD, Brown GD, Ewigman BG. The Columbia Registry of Controlled Clinical Computer Trials. Proc Annu Symp Comput Appl Med Care. 1993;16:220-224.
11. Balas EA, Austin SM, Ewigman BG, Brown GD, Mitchell JA. Methods of randomized controlled clinical trials in health services research. Med Care. 1995;33:687-699. PUBMED
12. Armitage P, Blendis LM, Smyllie HC. The measurement of observer disagreement in the recording of signs. J R Stat Soc. 1966;A129:98-.
13. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-174. PUBMED
14. Light RJ, Smith PV. Accumulating evidence: procedures for resolving contradictions among studies. Harvard Educ Rev. 1971;41:429-471.
15. Bushman BJ. Vote counting procedures in meta-analysis. In: Cooper H, Hedges L, eds. The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation; 1994:193-213.
16. Conover WJ. Practical Nonparametric Statistics. 2nd ed. New York, NY: John Wiley & Sons Inc; 1980.
17. Rosenthal R. The 'file drawer problem' and tolerance for null results. Psychol Bull. 1979;86:638-641.
18. Morgan M, Studney DR, Barnett GO, Winickoff RN. Computerized concurrent review of prenatal care. ORB Qual Rev Bull. September 1978;4:33-36.
19. Banks NJ, Palmer RH, Kane NM, Braun P, Feldstein ML, Harrington AM. Implementation and evaluation of a computerized reminder system in ambulatory care. Proc Annu Symp Comput Appl Med Care. 1988;12:753-757.
20. Barnett GO, Winickoff RN, Morgan MM, Zielstorff RD. A computer-based monitoring system for follow-up of elevated blood pressure. Med Care. 1983;21:400-409. PUBMED
21. Begg EJ, Atkinson HC, Jeffery GM, Taylor NW. Individualized aminoglycoside dosage based on pharmacokinetic analysis is superior to dosage based on physician intuition at achieving target plasma drug concentrations. Br J Clin Pharmacol. 1989;28:137-141. PUBMED
22. Bird JA, McPhee SJ, Jenkins C, Fordham D. Three strategies to promote cancer screening: how feasible is wide-scale implementation? Med Care. 1990;28;1005-1012. PUBMED
23. Boswik JM, Lee KL, Aronson LG, et al. Use of computerized statistical models to educate medical housestaff in estimating clinical outcomes. Proc Annu Symp Comput Appl Med Care. 1987;11:162-165.
24. Brimberry R. Vaccination of high-risk patients for influenza: a comparison of telephone and mail reminder methods. J Fam Pract. 1988;26:397-400. PUBMED
25. Bulpitt CJ, Beilin LJ, Coles EC, et al. Randomized controlled trial of computer-held medical records in hypertensive patients. BMJ. 1976;273:677-679.
26. Burling TA, Marotta J, Gonzalez R, et al. Computerized smoking cessation program for the worksite: treatment outcome and feasibility. J Consult Clin Psychol. 1989;57:619-622. PUBMED
27. Campbell DS, Neill J, Dudley P. Computer-aided self-instruction training with hearing-impaired impulsive students. Am Ann Deaf. 1989;134:227-231. PUBMED
28. Carel RS. Utilization of an AMHTS for pre-hospitalization examinations. In: Lindberg DAB, Collen MF, Van Brunt EE, eds. Proceedings of American Medical Informatics Association Congress 82. New York, NY: Masson Publishing USA Inc; 1982:352-356.
29. Chambers CV, Balaban DJ, Carlson BL, Grasberger DM. The effect of microcomputer-generated reminders on influenza vaccination rates in a university-based family practice center. J Am Board Fam Pract. 1991;4:19-26. PUBMED
30. Chambers CV, Balaban DJ, Carlson BL, Ungemack JA, Grasberger DM. Microcomputer-generated reminders: improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract. 1989;3:273-280.
31. Chan CW, Witherspoon JM. Health risk appraisal modifies cigarette smoking behavior among college students. J Gen Intern Med. 1988;3:555-559. PUBMED
32. Chase CR, Vacek PM, Shinozaki T, Giard AM, Ashigaka T. Medical information management: improving the transfer of research results to presurgical evaluation. Med Care. 1983;21:410-424. PUBMED
33. Chiarelli F, Tumini S, Morgese G, Albisser AM. Controlled study in diabetic children comparing insulin-dosage adjustment by manual and computer algorithms. Diabetes Care. 1990;13:1080-1084. ABSTRACT
34. Coe FL, Norton E, Oparil S, Tatar A, Pullman TN. A prospective controlled study of hypertension treatment by computer and physician. In: McCormick BH, ed. Proceedings of Third Illinois Conference on Medical Information Systems. Dept of Information Engineering, University of Illinois at Chicago; 1976; 206-217.
35. Darnell JC, Hiner SL, Neill PJ, Mamlin JJ, McDonald CJ, Hui SL, Tierney WM. After-hours access to physicians with access to computerized medical records: experience in an inner-city general medicine clinic. Med Care. 1985;23:20-26. PUBMED
36. Rogers JL, Haring OM, Watson RA. Automating the medical record: emerging issues. Proc Annu Symp Comput Appl Med Care. 1979;3:255-263.
37. Dickinson JC, Warhasw GA, Gehlbach SH, Bobula JA, Muhlbaier LH, Parkerson GR. Improving hypertension control: impact of computer feedback and physician education. Med Care. 1981;19:843-854. PUBMED
38. Peck CC, Sheiner LB, Martin MM, Combs DT, Melmon KL. Computer-assisted digoxin therapy. N Engl J Med. 1973;289:441-446. PUBMED
39. Baird TK, Broekemeier RL, Anderson MW. Effectiveness of a computer-supported refill reminder system. Am J Hosp Pharm. 1984;41:2395-2397. PUBMED
40. Fordham D, McPhee SJ, Bird JA, Rodnick JE, Detmer WM. The cancer prevention reminder system. MD Comput. 1990;7:289-295. PUBMED
41. Gehlbach SH, Wilkinson WE, Hammond WE, et al. Improving drug prescribing in a primary care practice. Med Care. 1984;22:193-201. PUBMED
42. Ghosh A, Marks IM, Carr AC. Controlled study of self-exposure treatment for phobics: preliminary communication. J R Soc Med. 1984;77:483-487. ABSTRACT
43. Ghosh A, Marks IM, Carr AC. Therapist contact and outcome of self-exposure treatment for phobias. Br J Psychiatry. 1988;152:234-238. FREE FULL TEXT
44. Rubin DH, Leventhal JM, Sadock RT, et al. Educational intervention by computer in childhood asthma: a randomized clinical trial testing the use of a new teaching intervention in childhood asthma. Pediatrics. 1986;77:1-10. FREE FULL TEXT
45. Hershey CO, Porter DK, Breslau D, Cohen DI. Influence of simple computerized feedback on prescription charges in an ambulatory clinic. Med Care. 1986;24:472-481. PUBMED
46. Hershey CO, Goldberg HI, Cohen DI. The effect of computerized feedback coupled with a newsletter upon outpatient prescribing charges. Med Care. 1988;26:88-93. PUBMED
47. Hickling K, Begg E, Moore ML. A prospective randomized trial comparing individualized pharmacokinetic dosage prediction for aminoglycosides with prediction based on estimated creatinine clearance in critically ill patients. Intensive Care Med. 1989;15:233-237. PUBMED
48. Hofmeyr GJ, Pattinson R, Buckley D, Jennings J, Redman CW. Umbilical artery resistance index as a screening test for fetal well-being: randomized feasibility study. Obstet Gynecol. 1991;78:359-362. PUBMED
49. Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. JAMA. 1986;255:1450-1454. FREE FULL TEXT
50. Lin DTC, Wilson SE, Reidy JJ, et al. An adjustable single running suture technique to reduce postkeratoplasty astigmatism. Ophthalmology. 1990;97:934-938. PUBMED
51. Lorentz A, Gasteiger P, Osswald PM. Calculation of the allowable pretransfusion blood loss with a programmable pocket computer [in German]. Anaesthetist 1987;36:306-312. PUBMED
52. McAlister NH, Covvey HD, Tong C, Lee A, Wigle ED. Randomized controlled trial of computer-assisted management of hypertension in primary care. BMJ. 1986;293:670-674. FREE FULL TEXT
53. Mamon J, Barrett P, Fahey M, Steinwachs DM. Impact of receipt of patient bills in an inpatient setting on physician ordering practices. Proc Annu Symp Comput Appl Med Care. 1980;4:1673-1679.
54. Margolis CZ, Warshawsky S, Goldman L, Dagan O, Wirtschafter D. Effect of a computerized clinical algorithm system on patient care. In: Barber B, Cao D, Qin D, Wagner G, eds. Proceedings of the Sixth World Congress on Medical Informatics: MEDINFO 89. Amsterdam, the Netherlands: North-Holland Publishing Co; 1989:161-164.
55. McDonald CJ. Use of computer to detect and respond to clinical events: its effect on clinician behavior. Ann Intern Med. 1976;84:162-167. FREE FULL TEXT
56. McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectibility of man. N Engl J Med. 1976;295:1351-1355. ABSTRACT
57. McDonald CJ, Hui SL, Smith DM, et al. Reminders to physicians from an introspective computer medical record: a 2-year randomized trial. Ann Intern Med. 1984;100:130-138. FREE FULL TEXT
58. McDonald CJ, Wilson GA, McCabe GP. Physician response to computer reminders. JAMA. 1980;244:1579-1581. FREE FULL TEXT
59. McDowell I, Newell C, Rosser W. Comparison of three methods of recalling patients for influenza vaccination. Can Med Assoc J. 1986;135:991-997. ABSTRACT
60. McDowell I, Newell C, Rosser W. A randomized trial of computerized reminders for blood pressure screening in primary care. Med Care. 1989;27:297-305. PUBMED
61. McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract. 1989;28:420-424. PUBMED
62. McDowell I, Newell C, Rosser W. A follow-up study of patients advised to obtain influenza immunizations. Fam Med. 1990;22:303-306. PUBMED
63. McKibbon KA, Walker CJ, Ryan NC, Fitzgerald D, Haynes B. A study of MEDLINE in clinical settings: design and preliminary results. Proc Annu Symp Comput Appl Med Care. 1988;12:526-529.
64. McPhee SJ, Bird JA, Jenkins C, Fordham D. Promoting cancer screening: a randomized controlled trial of three interventions. Arch Intern Med. 1989;149:1866-1872. FREE FULL TEXT
65. Millstein SG, Irwin CE. Acceptability of computer-acquired sexual histories in adolescent girls. J Pediatr. 1983;103:815-819. PUBMED
66. Ornstein SM, Garr DR, Jenkins RG, Rust PF, Arnon A. Computer-generated physician and patient reminders: tools to improve population adherence to selected preventive services. J Fam Pract. 1991:32:82-90. PUBMED
67. Peterson CM, Jovanovic L, Chanoch LH. Randomized trial of computer-assisted insulin delivery in patients with type I diabetes beginning pump therapy. Am J Med. 1986;81:69-72. PUBMED
68. Porter D. Patient responses to computer counseling. Proc Annu Symp Comput Appl Med Care. 1978;2:233-237.
69. Privitera MD, Homan RW, Ludden TM, Peck CC, Vasko MR. Clinical utility of a Bayesian dosing program for phenytoin. Ther Drug Monit. 1989;11:285-294. PUBMED
70. Reid JA, Kenny GNC. Evaluation of closed-loop control of arterial pressure after cardiopulmonary bypass. Br J Anaesth. 1987;59:247-255. FREE FULL TEXT
71. Reid RA, Hodges AG, Drucker RP. Utilization of computerized medical data system to assess and improve patient appointment keeping. Proc Annu Symp Comput Appl Med Care. 1977;1:194-198.
72. Robertson IH, Gray JM, Pentland B, Waite LJ. Microcomputer-based rehabilitation for unilateral left visual neglect: a randomized controlled trial. Arch Phys Med Rehabil. 1990;71:663-668. PUBMED
73. Robinson TN. Community health behavior change through computer network health promotion: preliminary findings from Stanford Health-Net. Comput Methods Programs Biomed. 1989;30:137-144. PUBMED
74. Robson J, Boomla K, Fitzpatrick S, et al. Using nurses for preventive activities with computer assisted follow up: a randomized controlled trial. BMJ. 1989;298:433-436. FREE FULL TEXT
75. Rodman JH, Jelliffe RW, Kolb E, et al. Clinical studies with computer-assisted initial lidocaine therapy. Arch Intern Med. 1984;144:703-709. FREE FULL TEXT
76. Rogers JL, Haring OM. Assessing computerized medical records on outcome of care. Presented at the Eighth Annual Conference of the Society for Computer Medicine; October 12-14, 1978; Minneapolis, Minn.
77. Rogers JL, Haring OM. Effect of a computerized medical record summary system on patient hospitalization. In: McCormick BH, ed. Proceedings of Third Illinois Conference on Medical Information Systems. Dept of Information Engineering, University of Illinois at Chicago; 1976;3:382-385.
78. Rogers JL, Haring OM. The impact of a computerized medical record summary system on incidence and length of hospitalization. Med Care. 1979;17:618-630. PUBMED
79. Rogers JL, Haring OM, Goetz JP. Changes in patient attitudes following the implementation of a medical information system. QRB Qual Rev Bull. March 1984;10:65-74. PUBMED
80. Rogers JL, Haring OM, Wortman PM, Watson RA, Goetz JP. Medical information systems: assessing impact in the areas of hypertension, obesity and renal disease. Med Care. 1982;20:63-74. PUBMED
81. Schrezenmeir J, Achterberg H, Bergeler J, et al. Controlled study on the use of hand-held insulin dosage computers enabling conversion to and optimizing of meal-related insulin therapy regimens. Life Support Syst. 1985;3(suppl):561-567. PUBMED
82. Selmi PM, Klein MH, Greist JH, Sorell PS, Erdman HP. Computer-administered cognitive-behavioral therapy for depression. Am J Psychiatry. 1990;147:51-56. FREE FULL TEXT
83. Simkins CV, Wenzloff NJ. Evaluation of a computerized reminder system in the enhancement of patient medication refill compliance. Drug Intell Clin Pharm. 1986;20:799-802. ABSTRACT
84. Smith DM, Weinberger M, Katz BP. A controlled trial to increase office visits and reduce hospitalizations of diabetic patients. J Gen Intern Med. 1987;2:231-237.
85. Smith DM, Weinberger M, Katz BP, Moore PS. Postdischarge care and readmissions. Med Care. 1988;26:699-708. PUBMED
86. Soljak MA, Handford S. Early results from the Northland Immunization Register. N Z Med J. 1987;100:244-246. PUBMED
87. Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for reducing outpatient prescribing costs. Drug Intell Clin Pharm. 1989;23:497-500. ABSTRACT
88. Strack T, Bergeler J, Beyer J, Hutten H. Computer assisted conventional insulin therapy. Life Support Syst. 1985;3:568-572. PUBMED
89. Tape TG, Givner N, Wigton RS, Seelig CB, Patil K, Cambell R. Process in ambulatory care: a controlled trial of computerized records. Proc Annu Symp Comput Appl Med Care. 1988;12:749-752.
90. Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Med Care. 1986;24:659-666. PUBMED
91. Tierney WM, McDonald CJ, Hul SL, Martin DK. Computer predictions of abnormal test results: effects on outpatient testing. JAMA. 1988:259:1194-1198. FREE FULL TEXT
92. Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990;322:1499-1504. ABSTRACT
93. Turner BJ, Day SC, Borenstein B. A controlled trial to Improve delivery of preventive care: physician or patient reminders? J Gen Intern Med. 1989;4:403-409. PUBMED
94. Weinberger M, Smith DM, Katz BP, Moore PS. The cost-effectiveness of intensive postdischarge care: a randomized trial. Med Care. 1988:26:10921102.
95. Weingarten MA, Bazel D, Shannon HS. Computerized protocol for preventive medicine: a controlled self-audit in family practice. Fam Pract. 1989;6:120-124. FREE FULL TEXT
96. Wetstone SL, Sheehan TJ, Votaw RG, Peterson MG, Rothfield N. Evaluation of a computer based education lesson for patients with rheumatoid arthritis. J Rheumatol. 1985;12:907-912. PUBMED
97. Wheeler LA, Wheeler ML, Ours P, Swider C. Use of CAI/video in diabetes patient nutritional education. Proc Annu Symp Comput Appl Med Care. 1983;7:961-964.
98. White KS, Lindsay A, Pryor TA, Brown WF, Walsh K. Application of a computerized medical decision-making process to the problem of digoxin intoxication. J Am Coll Cardiol. 1984;4:571-576. ABSTRACT
99. Whiting-O'Keefe QE, Simborg DW, Epstein WV, Warger A. A computerized summary medical record system can provide more information than the standard medical record. JAMA. 1985;254:1185-1192. FREE FULL TEXT
100. Wilkinson WE, Gehlbach SH, Hammond WE, Clapp NE. Using computergenerated feedback to improve physician prescribing. Proc Annu Symp Comput Appl Med Care. 1982;6:76-78.
101. Wilson GA, McDonald CJ, McCabe GP. The effect of immediate access to a computerized medical record on physician test ordering: a controlled clinical trial in the emergency room. Am J Public Health. 1982;72:698-702. FREE FULL TEXT
102. Wolffing BK. Computerized literature searching in the ambulatory setting using PaperChase. Henry Ford Hosp Med J. 1990;38:57-61. PUBMED
103. Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care. 1987;25:78-82. PUBMED
104. Wyatt J. Lessons learnt from the field trial of ACORN, an expert system to advise on chest pain. In: Barber B, Cao D, Qin D, Wagner G, eds. Proceedings of the Sixth World Congress on Medical Informatics: MEDINFO 89. Amsterdam, the Netherlands: North-Holland Publishing Co; 1989:111-115.
105. Ziegler DK, Hurwitz A, Hassanein RS, Kodanaz HA, Preskorn SH, Mason J. Migraine prophylaxis: a comparison of propranolol and amitriptyline. Arch Neurol. 1987;44:486-489. FREE FULL TEXT
106. Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Med Care. 1984;22:527-534. PUBMED
107. Larson EB, Bergman J, Heidrich F, Alvin BL, Schneeweiss R. Do postcard reminders improve influenza vaccination compliance? Med Care. 1982;20:639-648. PUBMED
108. Peters A, Rubsamen M, Jacob U, Look D, Scriba PC. Clinical evaluation of decision support system for insulin-dose adjustment in IDDM. Diabetes Care. 1991;14:875-880. ABSTRACT
109. Lucas RW, Mullin PJ, Luna CBX, Mclnroy DC. Psychiatrists and a computer as interrogators of patients with alcohol-related illness: a comparison. Br J Psychiatry. 1977;131:160-167. FREE FULL TEXT
110. Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB. A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. N Engl J Med. 1984;310:1273-1278. ABSTRACT
111. Fisher LA, Johnson TS, Porter D, Bleich HL, Slack WV. Collection of clean voided urine specimen: a comparison among spoken, written, and computerbased instructions. Am J Public Health. 1977;67:640-644. FREE FULL TEXT
112. Sheiner LB, Halkin H, Peck C, Rosenberg B, Melmon KL. Improved computerassisted digoxin therapy: a method using feedback of measured serum digoxin concentrations. Ann Intern Med. 1975;82:619-627. FREE FULL TEXT
113. Reid RA, Lantz KH. Physician profiles in training the graduate internist. J Med Educ. 1977;52:301-307. PUBMED
114. Coe FL, Norton E, Oparil S, Tatar A, Pullman TN. Treatment of hypertension by computer and physician: a prospective controlled study. J Chronic Dis. 1977;30:81-92. PUBMED
115. Pozen MW, D'Agostino RB, Mitchell JB, et al. The usefulness of a predictive instrument to reduce innappropriate admissions to the coronary care unit. Ann Intern Med. 1980;92:238-242. PUBMED
116. Shortliffe EH, Perreault LE, eds; Fagan LM, Wiederhold G, assoc eds. Medical Informatics: Computer Applications in Health Care. Reading, Mass: Addison-Wesley Publishing Co; 1990.
117. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts: treatments for myocardial infarction. JAMA. 1992;268:240-248. FREE FULL TEXT
118. Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Metaanalyses of randomized controlled trials. N Engl J Med. 1987;316:450-455. ABSTRACT
119. Light RJ, Smith PV. Accumulating evidence: procedures for resolving contradictions among different research studies. Harvard Educ Rev. 1971;41:429-471.