If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
The clinical utility of antimicrobial susceptibility testing (AST) in CF respiratory disease management is unclear.
•
This study found that AST increased the odds of antimicrobial switching.
•
The use of AST was not associated with a longer time to next pulmonary exacerbation.
•
Additional studies evaluating the use of AST in CF are essential.
Abstract
Background
Although antimicrobial susceptibility testing (AST) frequently guides cystic fibrosis (CF) pulmonary exacerbation (PEx) management, its clinical utility is unclear. This study examined associations between AST and antimicrobial switching during PEx treatment and time and occurrence of next PEx as treatment outcomes.
Methods
This retrospective cohort study utilized Pediatric Health Information System data. Children and adolescents aged 1–18 years admitted for a PEx from 2011 to 2016 were studied. Antimicrobial switching was defined as any intra-admission change in intravenous (IV), oral, and/or inhaled antimicrobials. Time to next PEx was defined as the time between index PEx hospital discharge and subsequent hospital admission requiring IV antimicrobials. Odds of antimicrobial switching ≥5 days after treatment initiation were determined by generalized linear mixed models, and associations between AST and time to next PEx were studied using Kaplan-Meier curves and Cox proportional hazards regression.
Results
AST occurred in 2518 (39%) of 6451 PEx at 36 hospitals and was associated with increased odds of antimicrobial switching (OR 1.33, 95% CI 1.16–1.52; p = 0.001) and increased hazard of future PEx (HR 1.32, 95% CI 1.16–1.50; p < 0.001). However, antimicrobial switching was not associated with a longer time to next PEx.
Conclusions
AST was associated with both increased probability of antimicrobial regimen change and increased PEx hazard. There was no evidence that antimicrobial regimen change was associated with clinical benefit as assessed by time to next PEx. However, these results indicate residual indication bias remained after adjustment for available disease covariates. Additional studies of the clinical value of AST are warranted.
]. Common PEx treatment strategies include increasing airway clearance and oral, inhaled and/or intravenous (IV) antimicrobial treatments. Traditionally, PEx antimicrobial selection is guided by surveillance respiratory culture results and antimicrobial susceptibility testing (AST)—such as Kirby-Bauer disk diffusion testing—to identify pathogen-specific antimicrobial susceptibility patterns and to aid clinicians in choosing appropriate antimicrobial therapy. Although an evidence-based AST performance guideline exists [
], the clinical utility of AST in the management of CF-related infections, including PEx management, is unclear.
Data from single center retrospective analyses have failed to illustrate benefits of AST for several CF-related clinical outcomes, including lung function, body-mass index (BMI), and time to next PEx [
Susceptibility testing of pseudomonas aeruginosa isolates and clinical response to parenteral antibiotic B administration: lack of association in cystic fibrosis.
]. A randomized trial comparing CF patients treated with IV antimicrobials chosen either from conventional sputum bacterial isolate susceptibility testing or multiple combination bactericidal testing found no difference in clinical outcomes between the two groups [
Combination antibiotic susceptibility testing to treat exacerbations of cystic fibrosis associated with multiresistant bacteria: a randomized, double-blind, controlled clinical trial.
]. In addition, a quality improvement project implemented to reduce AST did not worsen several measured clinical parameters, including change in lung function, weight, and IV antimicrobial therapy duration [
]. These aforementioned studies, however, were limited by concerns related to sample size and generalizability.
We sought to evaluate the use of AST in a pediatric CF cohort using a large national administrative dataset. The study aims were 1) to describe the frequency of AST conducted during admission for pediatric CF-related PEx, 2) to determine if AST conducted during admission for PEx treatment is associated with an increased probability of changes in antimicrobial treatment regimen (i.e., switching) beyond 5 days of treatment, and 3) to determine if AST conducted during admission is associated with better clinical outcomes demonstrated by an increased time to next PEx requiring IV antimicrobials. We hypothesized that antimicrobial switching would occur in a greater proportion of PEx with AST compared to PEx without AST, and that AST would be associated with a longer time to next PEx requiring IV antimicrobials. Our goal from this study is to aid CF clinicians and microbiology laboratory personnel in the appropriate use of AST in clinical practice and to inform future AST guidelines.
2. Methods
This retrospective cohort study utilized data from the Pediatric Health Information System (PHIS; Children's Hospital Association [CHA], Lenexa, KS), an administrative database that includes inpatient, ambulatory surgery, emergency department and observation unit clinical and resource utilization data from 49 U.S. children's hospitals [
]. PHIS data have been used extensively for studies related to resource utilization variation, cost estimation/analysis, and clinical effectiveness and includes International Classification of Diseases (ICD) and Clinical Transaction Classification (CTC) diagnostic codes to indicate individual diseases, medications, and procedures. PHIS data can thus be used to determine if AST was performed during a PEx; however, neither AST results (i.e. specific resistance patterns) nor related culture results are available for review within the PHIS database.
Children and adolescents aged 1–18 years at time of discharge were included if they fit 1 of 2 possible CF PEx definitions. The first definition comprised an ICD-9 code for CF with pulmonary manifestations and IV antimicrobial use within the first 24 h of admission. The second definition included any other CF-related ICD-9 code (CF with gastrointestinal manifestations, CF without mention of meconium ileus, or CF with other manifestations) with one of several respiratory disease-specific ICD-9 codes (acute upper respiratory tract infections of multiple or unspecific sites, acute bronchitis or bronchiolitis, pneumonia and influenza, bronchitis and chronic bronchitis, or bronchiectasis) and IV antimicrobials within the first 24 h of admission. These two definitions were chosen to be consistent with a previous analysis of PHIS data that characterized the management of inpatient pediatric CF-related PEx [
Any PEx that occurred from January 1st, 2011 through December 31st, 2016 and had documented antimicrobial use each hospital day (with the exception of discharge date) qualified for analysis. To determine if AST occurred during a PEx, we used the PHIS CTC code 361500, “Sensitivity/Susceptibility Testing” (which includes disk diffusion and Kirby-Bauer testing). A PEx in which AST occurred at any point from admission to discharge was included in the AST PEx group. We performed a single-center chart review to determine the sensitivity and specificity of the CTC code “Sensitivity/Susceptibility Testing” within the PHIS database.
Length of stay was limited to 7–21 days to account for the fact that antimicrobial susceptibilities typically take at least 5–6 days after specimen collection to become available (L. Hoffman and X. Qin, personal communication, October 26th, 2017), and to exclude hospitalizations not thought to be representative of the majority of inpatient pediatric PEx. People with CF were excluded if they had a history of malignancy or organ transplant. PEx were excluded if an intensive care unit stay occurred or if one of the following ICD-9 diagnostic codes were utilized: complications of transplant or other postoperative complication, acute pancreatitis, or mechanical complication of gastrostomy, colostomy, enterostomy tube, insulin pump, or vascular device. In addition, hospitals were excluded if they provided incomplete oral medication information or systematic coding discrepancies making data unreliable, or if they were not CF Foundation-accredited at time of PEx (CF Foundation-accredited centers are more likely aware of existing CF Foundation AST and PEx guidelines).
An antimicrobial switch was defined as any change in IV, oral, and/or inhaled antimicrobials after hospitalization day 5 up to the day prior to discharge. Hospitalization day 5 was chosen to both avoid tolerability-based early regimen changes (i.e., allergic reactions) and to define baseline antimicrobial therapy before AST results were likely to be known. The day prior to hospital discharge (rather than the discharge day itself) was chosen because parenteral antimicrobials might be switched to oral to facilitate outpatient therapy. At Seattle Children's Hospital, the following sequence of events occurs following the collection of a respiratory culture: Day 1-respiratory sample arrives, is processed, cultures set up and incubated; Day 3-CF isolates sub-cultured; Day 4-species are identified and AST performed; Day 5/6—antimicrobial susceptibilities are available for faster (day 5) or slower (day 6) growers (L. Hoffman and Xuan Qin, personal communication, October 26th, 2017).
Time to next PEx requiring IV antimicrobials was defined as the time between the index PEx hospital discharge and a subsequent hospital admission requiring IV antimicrobials. The index PEx was defined as the first PEx that met inclusion and exclusion criteria recorded during the study period. We included only one PEx per patient to ensure that patients with multiple PEx would not contribute more PEx episodes and bias the results towards a shorter time to next PEx requiring IV antimicrobials. Patients for whom a subsequent PEx was not observed prior to December 31, 2016 were censored on December 31, 2016.
Characteristics of the study cohorts were summarized using descriptive statistics. Continuous variables were compared using a two-sample t-test or Wilcoxon rank sum test, whereas categorical variables were compared by Pearson's χ2 tests.
To test the hypothesis that AST was associated with increased antibiotic switching, AST was entered as a predictor into a generalized linear mixed model predicting antibiotic switching with a nested random effect of participant within hospital. A compound symmetry covariance structure was used to model structural clustering and the associated expected correlation. Covariates included sociodemographic measures (age group, gender, race/ethnicity, and insurance). We chose to include additional clinical variables felt to be related to disease severity; these included number of PEx recorded in the prior 12 months, administration of any IV aminoglycoside antimicrobial (amikacin, gentamicin, kanamycin, or tobramycin) during a PEx (as a surrogate for presence of Pseudomonas aeruginosa (Pa)), and administration of pancreatic enzymes, insulin, and ursodiol as markers of pancreatic insufficiency, CF-related diabetes, and CF-related liver disease, respectively. PEx year was also included as a categorical covariate in the model to adjust for temporal patterns.
The primary analysis included PEx from all hospitals meeting inclusion and exclusion criteria. To distinguish between hospitals that use AST routinely versus hospitals that more frequently order AST by indication only, we conducted a sensitivity analysis that stratified results into three AST tertiles (lowest, middle, and highest AST use). These tertiles were also included as covariates in the generalized linear mixed model. Hospitals with an antimicrobial switch rate of <10% were excluded to address concerns that antimicrobial recording at these hospitals might be incomplete.
Time from index to subsequent PEx requiring IV antimicrobials was visualized by Kaplan-Meier curves, stratified by (1) AST and (2) antibiotic switching. AST and antibiotic switching were entered into a Cox proportional hazards regression model predicting next PEx, adjusted for the aforementioned covariates as well as hospital length of stay as a surrogate for index PEx severity. Hospital and year of index PEx discharge were also included as fixed effects to adjust for variation across hospitals and over time, respectively. Analyses were conducted at the = 0.05 level of significance using SAS (version 9.4, SAS Institute, Cary, NC). This study was approved by the Seattle Children's Hospital Institutional Review Board (STUDY00000759).
3. Results
From January 1st, 2011 through December 31st, 2016, AST was associated with 2518 (39%) of 6451 included PEx at 36 PHIS hospitals. The mean AST frequency among all hospitals was 35% of PEx (Fig. 1). Three hospitals performed AST in <10% of PEx, while AST occurred in >50% of PEx at 10 PHIS hospitals (28%). A single-center chart review performed at Seattle Children's Hospital found the sensitivity and specificity of the AST CTC code 361500 (“Sensitivity/Susceptibility Testing”) to be 94.7% and 100%, respectively.
Fig. 1Histogram illustrating frequency of AST and number of PEx with AST among PHIS hospitals.
Characteristics of the study cohorts are described in Table 1. Children and adolescents with CF who had AST associated with admission for PEx treatment were older (66% ≥12 years vs 50% ≥12 years for those without AST associated with their treatment), more likely female (57% vs 52%), and more likely to have public insurance (56% vs 49%). In addition, children and adolescents with CF who had AST were more likely to use insulin (21% vs 15%) and ursodiol (21% vs 16%) (markers of CF-related diabetes and CF-related liver disease, respectively), and were more likely to have had at least 2 PEx requiring IV antimicrobials in the prior 12 months (36% vs 25%). Antimicrobial switching after 5 days occurred in 58% of PEx with AST compared to 51% of PEx without AST.
Fig. 3a) Kaplan-Meier curve illustrating the time to next PEx requiring IV antimicrobials with respect to antibiotic switching. b) Kaplan-Meier curve illustrating the time to next PEx requiring IV antimicrobials with respect to AST.
AST during PEx treatment was associated with increased odds of antimicrobial switching (odds ratio (OR) 1.33 95% confidence interval (CI)1.16–1.52, p < 0.001; Fig. 2). Other variables associated with antimicrobial switching included insulin use (OR 1.19, 95% CI 1.01–1.41, p = 0.04), IV aminoglycoside use (OR 2.30, 95% CI 2.04–2.60, p < 0.0001), and number of oral, inhaled and/or IV antimicrobials administered on hospitalization day 5 (3 vs <3) (OR 1.95, 95% CI 1.75–2.18, p < 0.0001). Among AST tertiles, AST during PEx treatment remained associated with increased odds of antimicrobial switching in the lowest and highest tertiles (OR 1.58, 95% CI 1.17–2.13, p = 0.003 and OR 1.20, 95% CI 1.02–1.42, p = 0.03, respectively), but not the middle tertile (OR 1.16, 95% CI 0.93–1.44, p = 0.2; Supplementary Figs. S1 and S2).
4. Discussion
Using the PHIS database to evaluate CF-related PEx, we found that AST use during inpatient pediatric PEx was associated with higher odds of antimicrobial switching compared to PEx in which AST was not ordered. In addition, contrary to our hypothesis, AST use was not associated with better outcomes (longer time to next PEx requiring IV antimicrobials). Our single center validation of the AST code found high sensitivity and specificity (94.7% and 100%, respectively), indicating that this PHIS code could reliably identify AST use during PEx treatment. Further, the strong association observed between AST and antimicrobial switching in our primary and sensitivity analyses in the lowest and highest AST tertiles suggests that the CTC code for AST is likely to be accurate in our analyses.
AST use was associated with a 33% higher odds of antimicrobial switching during PEx treatment, suggesting that AST results influenced clinician antimicrobial prescribing patterns. Potential reasons for antimicrobial switching during PEx treatment include sensitivity/intolerance to prescribed antimicrobials, development of unwanted antimicrobial side effects (e.g., acute kidney injury, liver toxicity), lack of expected improvement in symptoms, lung function, or weight gain, and discordance of antimicrobial regimens with AST results. We purposely analyzed antimicrobial switching occurring after 5 days to decrease contribution from patient intolerance of antimicrobials and to allow sufficient time for AST results to become available to treating clinicians. Interestingly, antimicrobial switching was also high among PEx without AST, particularly among hospitals in the lowest and middle AST tertiles (probability of switching 53% (95% CI 46–61%) and 55% (95% CI 45–65%), respectively); it is likely that an element of antimicrobial switching across the population irrespective of AST was related to lack of expected improvement from original antimicrobial treatments after 5 days, and it may even be that lack of response was greater in those in which AST was ordered, as they tended to have more advanced disease as indicated by IV aminoglycoside and insulin use (Fig. 2). However, antimicrobial switching was not associated with a treatment benefit as measured by time to next PEx requiring IV antimicrobials.
Our results indicate that AST in the primary analysis and in the highest AST tertile was associated with a shorter rather than longer time to next PEx requiring IV antimicrobials (probably due to confounding where individuals with more advanced disease were more likely to have AST performed) and that AST was not associated with improved clinical outcomes. As noted, sicker patients admitted for PEx treatment are more likely to have AST performed. However, even after adjustment for disease severity using medication data as surrogates for pancreatic status, Pa colonization, CF-related diabetes, and CF-related liver disease, as well as number of PEx in the prior 12 months (a known risk factor that predicts future PEx [
]), AST was still not associated with improved outcomes with respect to time to next PEx, raising questions about the utility of this test. It is important to note that AST is generally performed only on specific bacterial species considered to be “standard CF pathogens”, and the absence of AST in this study may indicate an absence of these organisms, another potential source of confounding. This highlights an important limitation of using PHIS data in this manner, as it lacks airway microbiology and other markers of disease stage and severity such as lung function and BMI.
A recent collaborative effort by the Antimicrobial Resistance in Cystic Fibrosis International Working group, using the PICO (patient, intervention, comparator, outcome) format, undertook a systematic review that evaluated the relationships between AST results and clinical response [
]. Similar to our results, these investigators found that among twenty separate studies (13 of which were related to PEx) included in their analysis, little evidence existed that AST predicted clinical outcomes of CF antimicrobial treatment. Our analysis takes this line of investigation a step further by studying possible effects on treatment of ordering AST at the time of the PEx.
Although AST is recommended in CF PEx treatment guidelines, it can be burdensome, resource- and time-intensive, and may not be uniformly available. An adult CF clinic in Leeds, England found that reducing the number of antimicrobial susceptibility tests by 56% resulted in saving an estimated 170 h of laboratory staff time per year [
]. Interestingly, our data suggest a modest trend towards increasing use of AST among the institutions studied over this time period (Fig. 2). At Seattle Children's Hospital, depending on the organisms isolated and the location where the respiratory culture is collected (outpatient vs inpatient), the cost of AST ranges from $78–$370/test. Over a 12-month period (November 1st, 2017 through October 31st, 2018) at Seattle Children's Hospital, 1455 susceptibility tests were performed on isolates from 733 CF respiratory cultures at a total cost of >$580,000 (J. Stapp, personal communication, November 1st, 2018). Future cost-effectiveness analyses utilizing multicenter AST cost data can additionally evaluate the potential financial impact of the use of AST in clinical practice.
Strengths of this study include the large number of PEx available for analysis and the inclusion of large pediatric hospitals from across the country to increase its generalizability. This study does have several important limitations. Since PHIS is an administrative dataset, the reason for admission (planned ‘tune-up’ or acute illness), motivation for performing AST and reasons for antimicrobial switching remain unknown. We were unable to validate the AST code at other institutions, and thus it is plausible that some PEx with AST were missed, which would bias the results evaluating the relationship between AST and antimicrobial switching towards the null. Within PHIS, there is no way to associate AST with a specific culture (respiratory, urine, blood, etc.), and thus it is possible that, for a few PEx, AST was performed on non-respiratory cultures. Since PHIS only captures in-hospital data, we were unable to determine whether patients had AST performed on respiratory cultures collected just prior to admission that might impact whether AST was performed during a PEx. The CF AST literature has a heavy emphasis on Pa treatment, but in our analysis, it was not clear which organisms were of greatest concern for a given PEx. Lastly, as mentioned previously, PHIS does not capture lung function, airway microbiology, CFTR genotype, or data on growth parameters—important markers of disease stage and severity. However, in collaboration with Children's Hospital Association and the CF Foundation Patient Registry (CFFPR) team, we recently successfully linked the CFFPR with the PHIS database [
]. This newly-created CFFPR-PHIS linked dataset will allow for further analyses evaluating AST and additional relevant clinical outcomes, including change in lung function pre- to post-PEx and return to lung function baseline.
In conclusion, this study provides further evidence that AST (and in particular AST ordered during hospital admission) might not be helpful in PEx antimicrobial treatment. We found that PEx in which AST was ordered had significantly higher odds of antimicrobial switching after 5 days of treatment, but antimicrobial switching was not associated with improved outcomes as assessed by time to next PEx requiring IV antimicrobials. AST is resource-intensive and may lead to unnecessary antimicrobial use; additional studies evaluating its clinical impact in CF are warranted, particularly in the current era of worsening global antimicrobial resistance.
Author contributions
Dr. Cogen conceptualized and designed the study, interpreted the study results, drafted the initial manuscript, and reviewed, revised, and approved the final manuscript as submitted.
Ms. Whitlock carried out the analyses, and reviewed, revised, and approved the final manuscript as submitted.
Drs. Gibson, Hoffman, and VanDevanter conceptualized and designed the study, interpreted the study results, and reviewed, revised, and approved the final manuscript as submitted.
Data presented at North American Cystic Fibrosis Conference, October 18th–20th, 2018 Denver CO.
Funding
None.
Conflicts of interest statement
Drs. Cogen, Gibson and Ms. Whitlock have no conflicts of interest to disclose.
Dr. Hoffman consults on behalf of the CF Foundation regarding incorporating AST into research studies; he does not receive personal fees.
Dr. VanDevanter reports personal fees from AbbVie, Albumedix, AN2, Aradigm, Calithera, Cystic Fibrosis Foundation, Chiesi USA, Concert, CURx, Eloxx, Enbiotix, Genentech, Horizon, IBF, ICON Clinical Sciences, Ionis, Kala, Life Science Strategies, OrbiMed, Protalix, PTC, Pulmocide, Raptor, Recida, Respirion, Savara, VAST, and Vertex, outside the submitted work.
Acknowledgements
We would like to thank Jenny Stapp and Xuan Qin from the Seattle Children's Microbiology Laboratory for input related to the logistics and cost of antimicrobial susceptibility testing.
Kaplan-Meier curves illustrating the time to next PEx requiring IV antimicrobials with respect to antibiotic switching stratified by AST tertile group.
Susceptibility testing of pseudomonas aeruginosa isolates and clinical response to parenteral antibiotic B administration: lack of association in cystic fibrosis.
Combination antibiotic susceptibility testing to treat exacerbations of cystic fibrosis associated with multiresistant bacteria: a randomized, double-blind, controlled clinical trial.
30764-7&id=gr1.jpg){kind=link}
30764-7&id=gr2.jpg){kind=link}
30764-7&id=gr3.jpg){kind=link}
30764-7&id=gr4.jpg){kind=link}