Quality Measures - Obstetric Resources

OBJECTIVES: To use PERISTAT data on indicators of maternal mortality and morbidity to explore maternal health outcomes in Europe, and to discuss the implications of variations in the data sources for these indicators.
STUDY DESIGN: The PERISTAT feasibility study provides the source for this descriptive study, covering 15 European countries. Maternal mortality ratios are calculated, and data to describe maternal mortality by age, cause of death and mode of delivery are pooled for the countries that provided data.
RESULTS: Data presented show an increased risk of maternal death among older mothers and for caesarean sections compared with other modes of delivery, and the three most prevalent causes of maternal deaths reported were embolism, hypertensive diseases of pregnancy, and haemorrhage.
CONCLUSIONS: Variations in maternal mortality ratios reflect different data sources with varying levels of ascertainment in addition to differences in the number of maternal deaths. Further development is needed to construct comparable indicators of maternal morbidity.

Obstetric admissions are the leading cause of hospitalization for women in the United States, accounting for over 4 million hospital discharges each year. Measuring the quality of inpatient obstetrical care provided to these women is becoming increasingly important to patients, providers, and insurers. While numerous quality measures have been proposed, there is no agreement as to which measures should be used. An ideal quality measure for inpatient obstetrics would encompass 5 major characteristics: 1) association with meaningful maternal and neonatal outcomes, 2) relation to outcomes that are influenced by physician/health system behaviors, 3) affordability for application on a large scale basis, 4) acceptability to practicing obstetricians as a meaningful marker of quality, and 5) reliability/reproducibility. Traditional quality measurement tools such as maternal mortality, neonatal mortality and cesarean delivery rate are flawed measures. New measurements such as risk-adjusted primary cesarean rates, the nulliparous term singleton vertex cesarean birth (NTSV) rate, and the Adverse Outcomes Index (AOI) are currently being studied but these measures require further validation before widespread adoption.
TARGET AUDIENCE: Obstetricians & Gynecologists, Family Physicians
LEARNING OBJECTIVES: After completion of this article, the reader should be able to summarize that quality measures of inpatient obstetrical care are numerous, explain that no one agrees on which measures should be used, and state that newer measures, once validated, should be considered.

OBJECTIVE: To report the distribution and availability of the indicators describing the population of childbearing women in Europe and to assess the impact of the difference in the distribution of two of these indicators (age and multiple births) on some outcome indicators.
METHODS: The six PERISTAT indicators of population characteristics were computed using data from a survey of data providers in Europe. For maternal age and multiple births, the impact on health outcome was simulated for the extremes of the distribution using indirect standardised rates.
RESULTS: Data availability is good for basic demographic indicators (age, parity, multiple births), but less complete for indicators of social characteristics (education, smoking, country of birth). Further, common definitions are not used for the latter. Simulations of the impact of maternal age on health outcome found that variation in the maternal age distribution may cause trisomy 21 rates to differ by nearly 20% and maternal mortality ratios by nearly 50%.
CONCLUSION: Indicators of basic population characteristics are not collected routinely in every country. The crude distribution of these indicators is essential for international comparisons. Interpretation of comparative data would be improved by collection of health outcomes and service use by maternal characteristics.

OBJECTIVE: To assess the ability of the member states of the European Union to produce the indicators recommended by the PERISTAT project on perinatal health indicators and to provide an overview of fetal and infant health outcomes for these countries according to the information now available.
METHODS: We used data from the PERISTAT survey of data providers to compute PERISTAT indicators of fetal and infant health.
RESULTS: National data on fetal mortality are available for all countries, but vary in their definitions. To adjust for these differences in definition, PERISTAT recommends presenting rates by gestational age and birth weight. Not all countries can provide neonatal mortality data by gestational age, birth weight or plurality, as recommended by PERISTAT. Few countries in Europe can report infant mortality rates by birth weight and gestational age. The other recommended indicators are available to varying degrees.
CONCLUSIONS: This overview, which shows that Europe can produce a variety of indicators for monitoring the health of its new-borns, indicates that some key dimensions of perinatal health cannot now be measured with routine health statistics and reveals important disparities in health outcomes throughout Europe. For most indicators, the highest values are between 50 and 100% higher than the lowest values. The reasons for these variations and their importance for the surveillance of perinatal health are discussed.

OBJECTIVES: This study was undertaken to examine the national and regional rates of operative delivery among almost one quarter million births in a single year in the nation’s largest healthcare delivery system, using variation as an arbiter of the quality of decision making. STUDY DESIGN: We compared the variation in rates of primary cesarean and operative vaginal delivery in facilities of the Hospital Corporation of America during the year 2004. RESULTS: In 124 facilities representing almost 220,000 births during a 1-year period, the primary cesarean and operative vaginal delivery rates were 19%
5% (range 9-37) and 7%
4% (range 1-23). Within individual geographic regions, we consistently found variations of 200-300% in rates of primary cesarean delivery and variations approximating an order of magnitude for operative vaginal delivery. CONCLUSION: Within broad upper and lower limits, rates of operative delivery in the United States are highly variable and suggest a pattern of almost random decision making. This reflects a lack of sufficient reliable, outcomes-based data to guide clinical decision making. Key words: cesarean delivery, operative vaginal delivery, quality of care

Oxytocin is the drug most commonly associated with preventable adverse perinatal outcomes and was recently added by the institute for Safe Medication Practices to a small list of medications "bearing a heightened risk of harm," which may "require special safeguards to reduce the risk of error." Current recommendations for the administration of this drug are vague with respect to indications, timing, dosage, and monitoring of maternal and fetal effects. A review of available clinical and pharmacologic data suggests that specific, evidence-based guidelines for the intrapartum administration of oxytocin may be derived from available data. If implemented, such practices may reduce the likelihood of patient harm. These suggested guidelines focus on limited elective administration of oxytocin, consideration of strategies that have been shown to decrease the need for indicated oxytocin use, reliance on low-dose oxytocin regimens, adherence to specific semiquantitative definitions of adequate and inadequate labor, and an acceptance that once adequate uterine activity has been achieved, more time rather than more oxytocin is generally preferable. The use of conservative, specific protocols for monitoring th effects of oxytocin on mother and fetus is likely not only to improve outcomes but also reduce conflict between members of the obstetric team. Implementation of these guidelines would seem appropriate in a culture increasingly focused on patient safety.

INTRODUCTION: The 2000-2002 triennial UK Report on Confidential Enquiries into Maternal Deaths concluded that over 50% of maternal deaths involved substandard care and that many could have been prevented. Catastrophic events leading to cardio-respiratory arrest may necessitate the resuscitation of pregnant women in various hospital locations. This study was designed to evaluate knowledge about resuscitation of parturients among anesthesiologists, obstetricians and emergency physicians.
METHODS: A 12-question survey was distributed anonymously to residents and faculty in the anesthesia (ANES), obstetrics (OB), and emergency medicine (EM) departments at Stanford University Medical Center/Lucile Packard Children's Hospital, Stanford, California. Questions were designed to elicit knowledge deficiencies in four critical areas: need for left uterine displacement (LUD), advanced cardiac life support algorithms (ACLS), physiologic changes of pregnancy (PHYS), and the recommendation to perform cesarean delivery in parturients (>20 weeks gestation) after 4-5 min of unsuccessful resuscitation for cardiac arrest (5CD).
RESULTS: In total, 74/75 physicians (43% ANES, 37% OB, and 20% EM) completed the test. ANES scored highest in overall test scores, and in knowledge of PHYS (P<0.05). Scores for LUD and 5CD were similar among groups, but 25-40% of these questions were answered incorrectly. In the ACLS category, the EM group scored highest (93%).
CONCLUSION: We conclude that knowledge of important basic concepts, including the need for LUD and the potential benefit of early cesarean delivery during cardiac arrest, is inadequate among all three specialties. All three departments should provide ACLS physician training with emphasis on the special considerations for parturients.

A great essay on the history of the APGAR score and how obstetrics has changed with its focus on baby outcomes over the last generation. Atul Gawande's writing style works well for both lay and professional audiences.

The need to monitor progress in reducing maternal mortality has a long history, which can be traced back to the 1700s in some parts of the Western world. Today, however, this need is felt most acutely in developing countries, where the priority is to stimulate, evaluate and sustain action to prevent these essentially avoidable deaths. Over the last two decades, considerable efforts have been made to understand and overcome the measurement challenges of maternal mortality in the context of weak information systems, and new and enhanced methods and tools have emerged.

BACKGROUND: In collaboration with the California Department of Health Maternal and Child Health Branch, the authors formed a Working Group to identify potential clinical indicators that could be used to inform decision making regarding maternal health care quality.
OBJECTIVE: To develop potential indicators for the assessment of maternal health care quality.
MATERIALS AND METHODS: A Working Group was convened to review information from the published literature and expert opinion. Selection of potential indicators was guided by the following goals: 1) To identify key areas for routine aggregate monitoring; 2) To include perspectives of relevant stakeholders in maternal health care services; 3) To include measures that are comprehensive and reflect a balance between maternal and fetal interests; and 4) To develop measures that would be valid, generalizable, mutable, and feasible.
RESULTS: Ninety potential indicators were identified. Each underwent a thorough review based on: its definition, objective, and validity; its contribution to innovation; the cost and timeliness of implementation; its feasibility, acceptability, and potential effectiveness; and its compatibility with ethics, values, and social policy. This process yielded 24 final indicators from the following categories: Health Status and Access (e.g., availability of 24 h inpatient anesthesia); Preconception and Interconception Care (e.g., Pap smear use); Antenatal Care (e.g., hospitalization for uncontrolled diabetes or pyelonephritis); Labor and Delivery Care (e.g., chorioamnionitis or obstetrical hemorrhage), and Postpartum Care (e.g., rate of postpartum visits).
CONCLUSIONS: These potential indicators, representative of the women's health continuum, can serve as a foundation to structure the development of consensus and methods for maternal health care quality assessment.

The main purpose of this article is to point out common pitfalls that can confuse comparative analyses of indicators of perinatal health and to discuss ways to overcome or minimize these difficulties. The challenge is to distinguish 'real' variations in the value of an indicator from variations due to differences in registration practices and definitions and from random variation. The first section presents the major properties that are desirable in indicators of perinatal health status and perinatal health care in Europe to be used for comparative purposes. The second section provides specific examples of the types of methodological difficulties encountered in European cross-country comparisons due to variations in the definition, measurement and construction of indicators. The conclusion discusses the PERISTAT project's responses to these difficulties and how these methodological constraints impact on the selection of an appropriate indicator set for Europe today.

With obstetrical delivery being the most frequent cause for hospital admissions, it is important to determine health- and patient-related characteristics affecting maternity length of stay (LOS). Although the average inpatient LOS has decreased steadily over the years, the issue of the appropriate LOS after delivery is complex and hotly debated, especially since the introduction of the mandatory minimum-stay legislation in the USA. The purpose of this paper is to identity factors associated with maternity LOS and to model variations in LOS. A Gamma mixture risk-adjusted model is proposed in order to analyze heterogeneity of maternity LOS within obstetrical Diagnosis Related Groups (DRGs). The determination of pertinent factors would benefit hospital administrators and clinicians to manage LOS and expenditures efficiently.

This paper uses the results of the PERISTAT feasibility study to assess the extent to which the participating countries of Europe were able to provide data to construct the core and recommended indicators of perinatal health defined in the project. After describing the approaches used for data collection in participating countries, this paper describes the extent to which they were able to provide the data requested to construct the indicators. It documents data sources within each country and their characteristics. The paper then discusses influences on the agenda, particularly the extent to which data collection occurs as a by-product of other processes such as civil registration and the administration of health care and how these processes can both enable and impede data collection. It closes by suggesting how data collection in Europe can be improved in order to widen the scope of the agenda for compiling perinatal indicators.

BACKGROUND: No nationally accepted set of quality indicators exists in obstetrics. A set of 10 outcome measures and three quality improvement tools was developed as part of a study evaluating the effects of teamwork on obstetric care in 15 institutions and > 28,000 patients. Each outcome was assigned a severity weighting score.
MEASURES: Three new obstetrical quality improvement outcome tools were developed. The Adverse Outcome Index (AOI) is the percent of deliveries with one or more adverse events. The average AOI during the pre-implementation data collection period of the teamwork study was 9.2% (range, 5.9%-16.6%). The Weighted Adverse Outcome Score (WAOS) describes the adverse event score per delivery. It is the sum of the points assigned to cases with adverse outcomes divided by the number of deliveries. The average WAOS for the preimplementation period was 3 points (range, 1.0-6.0). The Severity Index (SI) describes the severity of the outcomes. It is the sum of the adverse outcome scores divided by the number of deliveries with an identified adverse outcome. The average SI for the pre-implementation period was 31 points (range, 16-49).
DISCUSSION: The outcome measures and the AOI, WAOS, and SI can be used to benchmark ongoing care within and among organizations. These tools may be useful nationally for determining quality obstetric care.

PURPOSE: To describe the application of the Quality of Health Outcomes Model, introduced by the American Academy of Nursing Expert Panel on Quality of Health Care, to obstetrical care, particularly second-stage labor.
ORGANIZING FRAMEWORK: The model is different from the more linear structure-process-outcome frameworks used in the past to a dynamic conceptualization of reciprocal relationships among the system, intervention, client, and outcome components. Analysis of these components can provide a comprehensive picture of the complexity of patient care decision making in hospital labor and delivery units.
CONCLUSIONS: Research findings indicate that interventions such as cesarean delivery and epidural analgesia may result in several significant quality of health outcomes for women that should receive increased attention. Uses of this model for shaping best practices among physicians and nurses and for setting directions for priorities in future interdisciplinary research and health policy are discussed.

The effect of medical errors and unsafe systems of care has had a profound effect on the practice of obstetrics and gynecology. From 1975 to 2000, medical malpractice costs for obstetrician– gynecologists have risen nearly four-fold higher than that of other medical costs. In addition, it has been estimated that defensive medicine may cost society $80 billion per year. Most importantly, many obstetrician– gynecologists are frustrated and seem to be abandoning the parts of their practice they perceive to put them at higher liability risk. This article discusses other medical specialty society efforts that have been successful in addressing the area of patient safety. Efforts to better track quality outcomes has been initiated by the American College of Surgeons through the National Surgical Quality Improvement Project, and the American Society of Anesthesiologists has demonstrated both dramatically improved outcomes and reduced liability costs through a concerted patient safety effort. The author proposes changes in four areas to specifically address patient safety in obstetrics and gynecology, including: the development of reliable and reproducible quality control measures (and a system to track them); national closed claim reviews to better understand and address the most important safety and liability areas for obstetrician– gynecologists; work prospectively with pharmaceutical and surgical device manufacturers to develop innovative new products that would increase the likelihood of safe outcomes; and create a culture of safety in obstetrics and gynecology by incorporating safety education into all levels of training. (Obstet Gynecol 2006;108:1266–71)

OBJECTIVE: To assess the validity of obstetric complications, including the Joint Commission on Accreditation of Healthcare Organizations (JCAHO) Core Measure on perineal lacerations, in the California Patient Discharge Data Set.
METHODS: We randomly sampled 1,611 deliveries from 52 of the 267 hospitals that performed more than 678 eligible deliveries in California in 1992-1993. We compared hospital-reported complications against our recoding of the same records.
RESULTS: Third- and fourth-degree perineal lacerations were reported accurately, with estimated sensitivities exceeding 90% and positive predictive values exceeding 65% (weighted to account for the stratified sampling design) or 85% (unweighted). Based on in-depth review of discrepant cases, we estimate the actual positive predictive value at over 90%. Most coding discrepancies were between no injury and first degree, or between first and second degree. Most postpartum complications, including urinary tract and wound infections, endometritis, anesthesia complications, and postpartum hemorrhage were reported with less than 70% sensitivity, but at least 80% positive predictive value. Composite measures from HealthGrades and Solucient, which include these complication codes, also suffer from high false-negative rates.
CONCLUSION: Third- and fourth-degree perineal lacerations are accurately reported on hospital discharge abstracts, confirming the validity of related quality indicators sponsored by the Agency for Healthcare Research and Quality and JCAHO. Administrative data seem less useful for monitoring other in-hospital postpartum complications.

OBJECTIVES: To review the standard of care in cases of maternal mortality due to hypertensive diseases in pregnancy and to make recommendations for its improvement.
DESIGN: Care given to women with hypertensive disease in pregnancy was audited and substandard care factors identified.
SETTING: Confidential enquiry by the Dutch Maternal Mortality Committee (MMC) from the Netherlands Society of Obstetrics and Gynaecology.
POPULATION: All maternal deaths reported to the MMC due to hypertensive disease in pregnancy in the Netherlands during the years 2000-04.
METHODS: Assessment for substandard care factors using a checklist based on the Dutch guideline of 'Hypertensive Disorders in Pregnancy'.
MAIN OUTCOME MEASURES: Substandard care in cases of maternal mortality due to hypertensive diseases in pregnancy.
RESULTS: A total of 27 cases of maternal death due to hypertensive disease in pregnancy were reported to the committee in the study period. In 26 cases (96%), substandard care factors were present, of which in 17 cases (63%), these were for more than five different items. In community midwifery care, the most frequent substandard care factor was no testing for proteinuria when clearly indicated (41%). In hospital care, the most frequent substandard care was related to insufficient diagnostic testing when indicated (41%), insufficient management of hypertension by obstetricians (85%), no use or inadequate use of magnesium sulphate (67%), inadequate stabilisation before transport to tertiary care centres and/or delivery (52%) and failure to consider timely delivery (44%).
CONCLUSIONS: Education of pregnant women concerning danger signs of hypertensive disease should be improved. Training of midwives and obstetricians should be improved in the following areas: performing basic diagnostic tests, adequate management of hypertension and eclampsia, with more attention to treatment of systolic blood pressure. This training should be guided by clear local protocols. Delivery should not be delayed in serious cases of hypertensive disease in pregnancy, not only after 32-34 weeks but also in early-onset pre-eclampsia as maternal risks often outweigh possible fetal benefits of temporising management.

Failure to rescue is an indicator that has been used to measure quality of care for surgical patients by evaluating the number of patients who die after developing postoperative complications. There are 2 key components of failure to rescue: (a) careful surveillance and timely identification of complications and (b) taking action by quickly initiating appropriate interventions and activating a team response. This concept has not been explored as a potential method to evaluate quality of intrapartum care. In obstetrics, complications leading to death are relatively rare because mothers and infants are generally healthy. Thus, there are not large numbers of maternal or infant deaths in individual hospitals or healthcare systems that allow the types of statistical analyses that have been previously used to measure failure to rescue rates. With modifications in the measurement process for failure to rescue in this population, there are direct implications for perinatal patient safety and lessons to be learned. A new use of the failure to rescue concept in a population not previously considered is proposed.

Methods to measure patient safety include structure, process and outcome measures, safety attitude and climate surveys, focus groups, storytelling, executive walk rounds, and external review. Ideally, measures of patient safety should be meaningful, science based, psychometrically sound, feasible, and actionable. Accurate and timely data feedback to caregivers is critical to effect required changes. A balanced set of patient safety measures provides valuable data to guide efforts to improve perinatal patient safety.

OBJECTIVES: To describe variation across Europe in PERISTAT indicators of health care in the perinatal period, and to assess the comparability of these indicators.
STUDY DESIGN: The PERISTAT feasibility study provides the source for this descriptive study, covering 15 European countries. Comparative analysis includes descriptions of births following management of sub-fertility, timing of first antenatal visit, onset of labour, mode of delivery, place of birth, preterm births in units without NICU, and breast-feeding uptake.
RESULTS: There is broad variation in the availability to provide data on perinatal indicators, and in perinatal health care across the European Union.
CONCLUSIONS: This paper describes the challenge of identifying indicators that are meaningful and robust for the full distribution of health care systems represented in the European Union. Further work is needed to ensure that the implementation of each indicator is comparable across member states.

OBJECTIVE: The objective of the study was to estimate the validity of obstetric procedures and diagnoses in California patient discharge data.
STUDY DESIGN: We randomly sampled 1611 deliveries from 52 of 267 California hospitals that performed more than 678 eligible deliveries in 1992 to 1993. We compared hospital-reported procedures and diagnoses against our recoding of the same records.
RESULTS: Cesarean, forceps, and vacuum delivery were accurately reported, with sensitivities and positive predictive values exceeding 90%. Episiotomy was underreported (70% sensitivity). Cesarean indications were reported with at least 60% sensitivity, except uterine inertia, herpes, and long labor. Among comorbidities, sensitivity exceeded 60% for chorioamnionitis, diabetes, premature labor, preeclampsia, and intrauterine death. Sensitivity was poor (less than 60%) for anemia, asthma, thyroid disorders, mental disorders, drug abuse, genitourinary infections, obesity, fibroids, excessive fetal growth, hypertension, premature rupture, polyhydramnios, and postdates.
CONCLUSION: The validity of hospital-reported obstetric procedures and diagnoses varies, with moderate to high accuracy for some codes but poor accuracy for others.

The PERISTAT project was charged with developing an indicator set for monitoring and describing perinatal health in Europe as part of the European Commission's Health Monitoring Programme, run by the Directorate General for Health and Consumer Protection (DG-SANCO), which is working towards the establishment of a comprehensive health monitoring system at the community level. To develop its recommendations, the PERISTAT project carried out an extensive review of existing perinatal health indicators and then implemented a DELPHI consensus process with its scientific advisory committee, a panel composed of clinicians, epidemiologists and statisticians, as well as with a panel of midwives. Consensus was achieved on 10 core and 23 recommended indicators using methods that drew on and consolidated previous work in this field. Twelve of these indicators were targeted for further development and the other 21 for immediate implementation. A feasibility study, reported in the rest of this issue, was put into place to assess these recommendations.

BACKGROUND: The PERISTAT project aimed to develop an indicator set for monitoring and describing perinatal health in Europe. The challenge was to define indicators that cover common concerns and have the same meaning within the different European health care systems.
METHODS: PERISTAT included i) a review of existing recommendations on perinatal health indicators, ii) a DELPHI consensus process with a scientific advisory committee composed of a clinician and an epidemiologist or statistician from each European member state as well as with a panel of midwives, and iii) a study of the availability of national statistics to construct recommended indicators. This article describes the first two components.
RESULTS: The review identified 10 international and 13 national recommended indicator sets. It also included indicators routinely compiled by WHO, EUROSTAT and OECD. Because of the methodological limits to using existing indicators for European comparisons, a high priority was placed on improving indicators already collected. Using the DELPHI method based on the results of the review, the scientific committee achieved a consensus on ten core and 23 recommended indicators, including 12 requiring further development.
CONCLUSIONS: The PERISTAT project was successful in identifying a set of indicators, which drew on and consolidated previous work. Consensus was not achieved on precise indicators in areas where uncertainty about appropriate indicators was high, although areas were targeted for future development. Finally, the feasibility study, which is in progress, is an essential part of the project, since it will enable member states to evaluate their capacity to produce these indicators.