JAMA & ARCHIVES
Arch Fam Med
SEARCH
GO TO ADVANCED SEARCH
HOME  PAST ISSUES  TOPIC COLLECTIONS  CME  PHYSICIAN JOBS  CONTACT US  HELP
Institution: CLOCKSS  | My Account | E-mail Alerts | Access Rights | Sign In
  Vol. 8 No. 1, January 1999 TABLE OF CONTENTS
  Archives
  •  Online Features
  Editorial
 This Article
 •PDF
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Contact me when this article is cited
 Related Content
 •Similar articles in this journal
 Topic Collections
 •Oncology
 •Cervical Cancer
 •Alert me on articles by topic

Reducing Mortality Due to Cervical Cancer

PAPNET Fails the Test

Arch Fam Med. 1999;8:56-57.

SINCE ITS INTRODUCTION into clinical practice in the 1940s, the Papanicolaou smear has become one of the most notable success stories in preventive screening. The overall impact of regular screening in an organized program is a reduction of the number of women in whom invasive cervical cancer develops of up to 90%.1

Despite this success, concerns remain about the weaknesses inherent in Papanicolaou smear testing. The weakness of greatest concern to clinicians and women is the potential for a false-negative result. Sources of a false-negative result include failure of the clinician to obtain an adequate sample, failure of the cytopathology laboratory to read the slide accurately, and chance errors in sampling, which will continue to occur even with the most carefully applied sampling techniques. There have been efforts to increase the ability of the clinician to obtain an adequate sample (by use of tools such as the Cytobrush [Med Scand, Malmö, Sweden] and Ayre spatula or Cervex brush [Med Scand, Hollywood, Fla]),2-3 and to improve the reliability of cytopathology laboratories through quality assurance regulations and standardized terms for describing findings.4-5

Given these efforts, there remains a divergence of opinion as to the sensitivity of Papanicolaou testing and the risk for a false-negative test result. The reported range has varied from 5% to 25%. False-negative rates are likely to be at the lower end of the range when appropriate measures are used to obtain and to read a sample.6 False-negative rates are further reduced in organized screening programs with repeated screening. The long-term course of cervical squamous cell abnormalities preceding invasive cervical cancer provides the opportunity for detection of abnormalities missed on results of an initial smear in the second or third round of screening. With repeated screening, the performance of cervical cytologic screening is best, and false-negative rates may be reduced by 80% after 3 consecutive smears with negative findings.1 Nevertheless, there remains a climate of fear of clinical and legal consequences should any abnormality on results of cervical cytologic screening be overlooked.

The past 20 years have brought the introduction of many technologies that have attempted to improve the diagnosis of cervical cancer and its precursors. These have included colposcopy, cervicography, speculoscopy, new cytologic sampling instruments (Cytobrush, Cervex Brush), new methods for processing the cytologic sample (Thinprep; Cytec, Boxborough, Mass), and methods for review of cytologic interpretation (PAPNET [Neuromedical Systems, Incorporated, Suffern, NY], Neopath [Redmond, Wash]). Many of these tests, including PAPNET, have been designed specifically to reduce the rate of false-negative results. PAPNET, based on computerized imaging and neural network artificial intelligence, has been approved by the US Food and Drug Administration for rescreening of Papanicolaou smears with findings interpreted as negative by cytotechnologists. Would the widespread use of PAPNET result in tangible benefits to our patients? What are the drawbacks? What are the costs?

Brotzman et al7 sought to answer some of these questions in this issue of the ARCHIVES. They conducted a prospective evaluation of PAPNET rescreening of 1200 Papanicolaou smears with initial negative findings in a community hospital setting. The most important findings of this study are as follows:

  1. Of 1200 smears with findings initially interpreted as negative by cytotechnologists, PAPNET identified 37 as requiring additional review. Subsequent review of these by a pathologist identified 8 cases of atypical squamous cells of undetermined significance (ASCUS). No cases of squamous intraepithelial lesions (SIL) or cervical cancer were identified.
  2. In 13 months of follow-up, of the 8 patients with ASCUS, 6 underwent follow-up studies. Results of 3 were negative; 1 repeated smear showed low-grade SIL; and 2 repeated smears showed ASCUS.
  3. The estimated marginal cost of PAPNET review in this laboratory, compared with 100% manual rescreening by a cytotechnologist of all smears with negative findings, ranged from $7832 to $35,379 per case of ASCUS detected.

O'Leary et al8 from the Armed Forces Institute of Pathology corroborated these findings in another setting. A total of 5478 Papanicolaou smears randomly selected for manual rescreening and with findings interpreted as negative or showing benign cellular changes underwent rescreening with PAPNET. PAPNET required additional review of 29% of the slides. Eleven of these were referred to a consensus panel of 3 pathologists and 3 cytotechnologists for review. Ultimately, 5 cases of ASCUS and 1 case of atypical glandular cells of undetermined significance were identified. Low-grade SIL ultimately developed in 1 of these patients, as seen on results of a follow-up Papanicolaou smear. Estimated costs per additional case of ASCUS or atypical glandular cells of undetermined significance detected were $5825 to $33,781, compared with 100% manual rescreening.

In summary, findings from both studies indicate that the addition of PAPNET to routine cervical cytologic screening is unlikely to detect significant lesions with any frequency, and that at current costs, manual rescreening is substantially less expensive. Despite these consistent findings from large, well-designed studies, the pressure on clinicians and on cytopathology laboratories to avoid false-negative results at all costs looms large. This pressure recently has included direct consumer advertising from Neuromedical Systems, Incorporated.

The history of technology in medical practice is replete with methods disseminated widely into practice based on initially promising results that were withdrawn when rigorous evaluation showed no significant benefit.9-10 Present evidence indicates that automated rescreening in general will add little to the effectiveness of a good community laboratory. If the costs become less than those of manual rescreening, automated rescreening may become a useful part of cytology laboratory quality control.

Presently in the United States, 25% of women have not had a Papanicolaou smear in the past 3 years.11 Percentages are higher among low-income and uninsured women.12 Lack of follow-up after an abnormal result may be as high as 40% to 50%.13 Programs to reach women who have not undergone screening and to improve follow-up after abnormal results will reduce mortality and morbidity from cervical cancer more effectively than will costly efforts to apply technology to eliminate false-negative results.

Joy Melnikow, MD, MPH; James Nuovo, MD
Department of Family and Community Medicine
University of California, Davis
4860 Y St, Suite 2300
Sacramento, CA 95817
(e-mail: jamelnikow{at}ucdavis.edu)


REFERENCES

1. International Agency for Research on Cancer Working Group on Evaluation of Cervical Cancer Screening Programmes. Screening for squamous cervical cancer: duration of low risk after negative results of cervical cytology and its implication for screening policies. BMJ. 1986;293:659-664.
2. Buntinx F, Essed GGM, Knottnerus JA, Crebolder HFJM. The effect of different sampling devices on the presence of endocervical cells in cervical smears: a meta-analysis. Eur J Cancer Prev. 1994;3:23-30. PUBMED
3. Buntinx F, Brouwers M. Relation between sampling device and detection of abnormality in cervical smears: a meta-analysis of randomised and quasi-randomised studies. BMJ. 1996;313:1285-1290. FREE FULL TEXT
4. Helfand M, O'Connor GT, Zimmer-Gembeck M, Beck JR. Effect of the Clinical Laboratory Improvement Amendments of 1988 (CLIA '88) on the incidence of invasive cervical cancer. Med Care. 1992;30:1067-1082. PUBMED
5. National Cancer Institute Workshop. The 1988 Bethesda system for reporting cervical/vaginal cytological diagnoses. JAMA. 1989;262:931-934. FREE FULL TEXT
6. Council on Scientific Affairs, American Medical Association. Quality assurance in cervical cytology: the Papanicolaou smear. JAMA. 1989;262:1672-1679. FREE FULL TEXT
7. Brotzman GL, Kretzchmar S, Ferguson D, Gottlieb M, Stowe C. Costs and outcomes of PAPNET secondary screening technology for cervical cytologic evaluation: a community hospital's experience. Arch Fam Med. 1999;8:52-55. FREE FULL TEXT
8. O'Leary TJ, Tellado M, Buckner SB, Ali IS, Stevens A, Ollayos CW. PAPNET-assisted rescreening of cervical smears: cost and accuracy compared with a 100% manual rescreening strategy. JAMA. 1998;279:235-237. FREE FULL TEXT
9. Sackett DL, Haynes RB, Guyatt GH, Tugwell P. Clinical Epidemiology. 2nd ed. Boston, Mass: Little Brown & Co; 1991:190-198.
10. The EC/IC Bypass Study Group. Failure of extracranial-intracranial bypass to reduce the risk of ischemic stroke: results of an international randomized trial. N Engl J Med. 1985;313:1191-1200. ABSTRACT
11. McGinnis JM, Lee PR. Healthy People 2000 at mid decade. JAMA. 1995;273:1123-1129. FREE FULL TEXT
12. Calle EE, Flanders D, Thun M, Martin LM. Demographic predictors of mammography and Pap smear screening in US women. Am J Public Health. 1993;83:53-60. FREE FULL TEXT
13. McKee D. Improving the follow-up of patients with abnormal Papanicolaou smear results. Arch Fam Med. 1997;6:574-577. FREE FULL TEXT





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | CME | PHYSICIAN JOBS | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 1999 American Medical Association. All Rights Reserved.