Skip to main content

Ultrasound guidance reduces pneumothorax rate and improves safety of thoracentesis in malignant pleural effusion: report on 445 consecutive patients with advanced cancer

Abstract

Background

Malignant pleural effusion (MPE) is an extremely common problem affecting cancer patients, and thoracentesis is an essential procedure in an attempt to delineate the etiology of the fluid collections and to relieve symptoms in affected patients. One of the most common complications of thoracentesis is pneumothorax, which has been reported to occur in 20% to 39% of thoracenteses, with 15% to 50% of patients with pneumothorax requiring tube thoracostomy.

The present study was carried out to assess whether thoracenteses in cancer patients performed with ultrasound (US) guidance are associated with a lower rates of pneumothorax and tube thoracostomy than those performed without US guidance.

Methods

A total of 445 patients were recruited in this retrospective study. The medical records of 445 consecutive patients with cancer and MPE evaluable for this study, undergoing thoracentesis at the Oncology-Hematology and Internal Medicine Departments, Piacenza Hospital (Italy) were reviewed.

Results

From January 2005 to December 2011, in 310 patients (69.66%) thoracentesis was performed with US guidance and in 135 (30.34%) without it. On post-thoracentesis imaging performed in all these cases, 15 pneumothoraces (3.37%) were found; three of them (20%) required tube thoracostomy. Pneumothorax occurred in three out of 310 procedures (0.97%) performed with US guidance and in 12 of 135 procedures (8.89%) performed without it (P <0.0001). It must be emphasized that in all three patients with pneumothorax requiring tube thoracostomy, thoracentesis was performed without US guidance.

Conclusions

The routine use of US guidance during thoracentesis drastically reduces the rate of pneumothorax and tube thoracostomy in oncological patients, thus improving safety as demonstrated in this study.

Background

Malignant pleural effusions (MPE) are an extremely common problem affecting cancer patients both at the onset or during the course of the disease, and thoracentesis is a commonly performed procedure whereby pleural fluid is aspirated percutaneously through the chest wall for diagnostic or therapeutic purpose.

Potential complications of thoracentesis are pain (5%), cough (24%), shortness of breath (15%), vasovagal reaction (3%), and pneumothorax (20% to 39%) [1].

Less common complications of thoracentesis include inadvertent liver or splenic puncture, bleeding, subcutaneous emphysema, re-expansion pulmonary edema, and infection [1]. Iatrogenic pneumothorax resulting from thoracentesis increases morbility, mortality, and length of hospitalization. In addition, chest tube insertion may be required in up to 50% of cases, with a mean duration of placement of approximately 4 days [2, 3]. Approximately 1.5 million people are found to have pleural effusion each year in the United States [4], and although thoracentesis is typically considered by physicians a relatively safe procedure with few complications [4], the incidence of pneumothorax has been reported to be as high as 20% to 39% [5].

Factors that have been shown to reduce the rate of pneumothorax include the performance by experienced personnel [6], as well as the use of US guidance [5, 7–9]. While the usefulness of US guidance in reducing the incidence of pneumothorax from thoracentesis has been reported in several studies [5, 7–9] and in a recent meta analysis [10], to our knowledge the incidence of pneumothorax from US-guided or unguided bedside thoracentesis in cancer patients is less well documented.

The purpose of this study was to assess the rate of pneumothorax associated with US-guided or unguided thoracentesis in clinical practice in cancer patients attending the oncological-hematological and internal medicine departments of a North Italian general hospital, the Piacenza Hospital.

Methods

After approval by the institutional review board (Ethic Committee Azienda Sanitaria di Piacenza (Italy)), a search was conducted in the medical records of cancer patients to identify those patients with pleural effusion who underwent thoracentesis.

A total of 462 consecutive patients with cancer who underwent thoracentesis at the oncology-hematology and internal medicine departments over a 6-year period (2 January 2005 to 31 December 2011) were identified.

The medical records of six of these patients were incomplete and they were excluded from the study.

The following clinical data were abstracted from the medical records: clinical setting (inpatient and outpatient); age; diagnosis; sex; indications as to thoracenthesis (diagnostic or therapeutic, diagnostic, and therapeutic); chest radiography findings pre-and post- thoracentesis; pneumothorax; and tube thoracostomy rate.

Eleven patients in whom no prior chest X-ray or following thoracentesis were available or with pre-existing hydropneumothorax at admission to our departments were excluded from the study.

The final group of cases which was the object of this study consisted of 445 evaluable patients.

The patients were divided into two groups: group A, conventional thoracentesis traditional land mark method); and group B, US-guided thoracentesis.

US-guided or conventional thoracentesis was performed by one of five experienced physicians of the departments (LC, PM, RB, MAP, GC) both for groups A and B.

The decision to perform US-guided or conventional thoracentesis was made by the availability or otherwise of US machines at bedside at the moment of thoracentesis. The two groups were not homogeneous since in our departments thoracentesis is performed preferably with US guidance; diagnostic thoracenteses were 5.19% in group A and 11.29% in group B.

All the patients in this study had a pre- and post-thoracentesis chest X-ray.

Once the location of the pleural fluid was identified by physical examination or by US (Esaote, Genoa, Sonosite, Milan, Italy equipped with two transducers between 3.5 to 7.5 MHZ), the area was cleaned with povidone-iodine and local anesthesia and (1% lidocaine without epinephrine) was injected intradermally subcutaneously using a 22-gauge needle into the parietal pleura with or without US guidance. A 14-gauge cannula catheter needle system (ABBOCATH.T, HOSPIRA Inc., Philippines) was used to enter the pleural space at the same point as the local anesthesia, with or without US guidance.

Once the pleural space was entered, the needle was withdrawn and fluid was removed through the catheter. All patients included in the study signed informed consent before undergoing the procedure. This study was approved by the local ethical committee.

Statistical analysis

Categorical variables were summarized as counts and percentages, continuous variables using median and range.

Comparisons of group A versus group B, pneumothorax versus no pneumothorax, outpatients versus inpatient for various variables were performed using Yates corrected chi square test. In all cases, two-tailed P values of 0.05 or less were considered statistically significant. All data were analyzed with OPENEPI statistical computer software. When at least one expected value (row total * column total/grand total) was <5, Fisher’s exact test was used. Student’s t-test to calculate the difference between the two groups and the standard deviation was used.

Results

Clinical characteristics of the 445 patients who underwent US-guided or unguided thoracentesis are reported in Table 1.

Table 1 Clinical characteristics of 445 cancer patients with malignant pleural effusion undergoing US-guided (group B) and conventional thoracentesis (group A)

All 445 cases had malignant pleural effusion.

There were 252 male (56.63%) and 193 female (43.37%) patients. The mean age of the group was 70.96 (±9.215) years (range, 18-88 years), 156 (35.06%) were inpatients: 72 in group A and 84 in group B, and 289 (64.94%) outpatients, 63 in group A and 226 in group B.

A total of 195 patients had lung cancer (43.82%), 175 breast cancer (39.33%), 35 gastrointestinal cancer (7.86%), 40 (8.99%) other cancers (mesotelioma, lymphoma, gynaecological cancer, and so on). US was used to guide thoracentesis in 310 of 445 cases (69.66%), including 37 out of 42 (88.1%) diagnostic located thoracentesis, while in 135 (30.34%) cases thoracentesis was performed without US guidance.

The volume of fluid removed was higher for thoracentesis performed with US guidance compared with the procedures done without US guidance: median; 1,100 mL (range, 70-2,300 mL) versus 750 mL (range, 40-1,700 mL) (Table 1). There were no significant correlations between the drainage amount and pneumothorax (P value = 0.447).

Fifteen of 445 patients (3.37%) who underwent thoracentesis had pneumothorax; among them, three patients (20%) required insertion of a chest tube for a symptomatic or enlarging pneumothorax (Table 2).

Table 2 Number of pneumothorax and chest tube insertion following conventional thoracentesis and US-guided thoracentesis

In group A (conventional thoracentesis) 12 pneumothoraces occurred (8.89%), while in group B (thoracentesis performed with US guidance) only three (0.97%) pneumothoraces occurred (P <0.0001) (Table 2).

All three chest tubes were inserted in patients with pneumothorax secondary to thoracentesis performed without US guidance. No significant correlations were found between the occurrence of pneumothorax after thoracentesis and type of cancer.

Discussion

Thoracentesis is a diagnostic and therapeutic procedure that is routinely performed for evaluation of pleural effusion and to relieve symptoms.

The most common reported thoracentesis complication is the puncture of the visceral pleura, which can cause a pneumothorax [10].

US guidance allows the physician to determine a more accurate needle insertion depth into the intercostal space and thus reduces the incidence of pneumothorax [2, 3, 5].

It must be emphasized that most studies of US-guided thoracentesis do not use real-time guidance for needle insertion, but insert the needle immediately after identification, with US, of the appropriate site [4].

In our study, the needle was inserted under US real-time guidance, allowing a procedure which was safer and gave less discomfort to the patient. In fact, US guidance also allows for dynamic needle visualization, enabling precise needle placement.

Thoracentesis is typically thought to be a relatively safe procedure with few complications; the incidence of pneumothorax, however, has been reported to be as high as 20% to 39% [5].

The National Confidential Enquiry into perioperative deaths has reported one death resulting from a procedural-induced pneumothorax [11].

It must be emphasized that less serious discomfort (though unpleasant for the patient), clinicians’ time, hospital stay, and economic costs are variables rates from iatrogenic pnemothorax [12].

Several studies have demonstrated that US guidance can reduce the rate of pnemothorax [5, 7–9]. Grogan et al. [5] found a significant reduction of the pneumothorax rate when US was utilized for identification of needle placement (0% versus approximately 29%).

Similar reductions in the rate of pneumothorax were reported by other authors [7–9].

In addition the occurrence of pneumothorax requiring tube thoracostomy is also significantly reduced with US guidance as reported in the present study, and this is considered even more clinically relevant [8, 9].

Another very important benefit of US guidance is the increased success in thoracentesis also after a clinically failed directed thoracentesis: it has been demonstrated that fluid can be successfully obtained in up to 88% of patients after an unsuccessful by clinically guided thoracentesis [9, 13–16] and even more importantly in 58% of clinically attempted ‘dry taps’ the needle insertion site was found to be below the diaphragm [15].

US guidance increased the rate of accurate site selection by 26% and decreased the number of mean misses, the number of potentially dangerous needle insertion sites by 10% when compared to fluid localization by physical examination and chest radiography [16].

In our study, we found a statistical significant reduction in the pneumothorax rate after thoracentesis when US guidance was utilized: three (0.97%) versus 12 (8.89%) without US guidance (P <0.0001), and also a reduction in tube thoracostomy: 0 (0%) versus three (100%).

It must be emphasized that our data concern cancer patients. To our knowledge, this is the first report of this setting of patients.

In view of the above, the advantages of US-guided thoracentesis are demonstrated also in cancer patients; and we recommend that the use of US for thoracentesis be considered for all patients with cancer and pleural effusion. Should patients undergoing thoracentesis be referred to interventional radiologists for US-guided procedure, or should it be a clinician (oncologist, hematologist, internist, or a physician from another medical specialty) that performs the US-guided procedure? Thoracentesis by interventional radiologists under US guidance include the necessity of moving the patient to the radiology suite with the additional cost of the procedure in the US suite [1]. Although interventional US guidance is well-established in such specialties as radiology, cardiology, and obstetrics and gynecology, it is becoming more common across a range of specialties and procedures [17].

In addition, it must be emphasized that the use of US is not limited to radiologists [4]; the American Medical Association policy favors US imaging technique diffusion in medical practice [18]; the American College of Emergency Physicians and the American College of Surgeons support the use of US by members of their societies and address ways to obtain and maintain competence as well as ensuring quality control [19, 20]. We agree with previous report [4] that US is an excellent teaching tool, and in our departments we use it routinely to reinforce the physical examination of residents and medical students.

In our departments oncologists, hematologists, and internists have performed US imaging procedures as well as interventional US in clinical practice for the management of patients (diagnosis, staging, restaging follow-up) for almost 25 years [12, 21–26]. So this procedure was early applied to guide thoracentesis, performed by physicians at the bedside without moving the patients to the radiology suite.

David Kopman Feller 2007 [27] stated that US is an easily learned technique that not only enhances the physical examination but has also the distinct advantage of being a portable tool that can provide real-time guidance for thoracentesis and other interventional procedures such as biopsy, abscess drainage, paracentesis, and central venous catheter insertion. In addition, this procedure can be performed easily at the bedside as reported in our study.

Gordon et al. [10] in their systematic review and meta-analysis showed that the most important strategy to reduce pneumothorax rates following thoracentesis, was the use of US guidance, and they encourage institutions to consider a policy of uniform use of US guidance for thoracentesis, and more recently Patel et al. [17] showed that US-guided thoracentesis is associated with lower total hospital stay, lower costs, and lower incidence of pneumothorax and hemorrhage. In addition, the Patient Protection and Affordable Care Act of 2010 and the Centers for Medicare and Medicaid Services Reporting Hospital Quality Data for Annual Payment Update Program Quality Measures FY 2012–2014 identify as major goals for better healthcare delivery, safer medical care, and avoidance of preventable complications, including iatrogenic pneumothorax [28–30].

More recent literature highlights the safety and efficacy of US-guided thoracentesis. These data indicate that US guidance is associated with decreased risk of pneumothorax. This complication results in a measurable increase in hospitalization costs and length of stay [31, 32].

Conclusions

The results of the present study, show that US-guided thoracentesis in cancer patients is a safe, cheap, and effective technique in reducing both pneumothotax rate and tube thoracostomy rate.

Based on these findings, on previous reports [1–10, 17, 31] and on the availability of portable US machines, we believe that the time has come to perform all thoracenteses in cancer patients under US guidance, thus improving safety and avoiding complications and patient discomfort.

References

  1. Ducan DR, Morgenthaler TI, Ryu JH, Daniels CE: Reducing iatrogenic risk in thoracentesis: establishing best practice via experiential training in a zero-risk environment. Chest. 2009, 135 (5): 1315-1320. 10.1378/chest.08-1227.

    Article  Google Scholar 

  2. Despars JA, Sassoon CS, Light RW: Significance of iatrogenic pneumothoraces. Chest. 1994, 105: 1147-1150. 10.1378/chest.105.4.1147.

    Article  CAS  PubMed  Google Scholar 

  3. Sassoon CS, Light RW, O’Hara VS, Moritz TE: Iatrogenic pneumothorax: etiology and morbidity: results of a Department of Veterans Affairs Cooperative Study. Respiration. 1992, 59: 215-220. 10.1159/000196061.

    Article  CAS  PubMed  Google Scholar 

  4. Feller-Kopman D: Ultrasound-guided thoracentesis. Chest. 2006, 129: 1709-1714. 10.1378/chest.129.6.1709.

    Article  PubMed  Google Scholar 

  5. Grogan DR, Irwin RS, Channick R, Raptopoulos V, Curley FJ, Bartter T, Corwin RW: Complications associated with thoracenteses: a prospective, randomized study comparing three different methods. Arch Intern Med. 1990, 150: 873-877. 10.1001/archinte.1990.00390160119023.

    Article  CAS  PubMed  Google Scholar 

  6. Bartter T, Mayo PD, Pratter MR, Santarelli RJ, Leeds WM, Akers SM: Lower risk and higher yield for thoracenteses when performed by experienced operators. Chest. 1993, 103: 1873-1876. 10.1378/chest.103.6.1873.

    Article  CAS  PubMed  Google Scholar 

  7. Jones PW, Moyers JP, Rogers JT, Rodriguez RM, Lee YC, Light RW: Ultrasound-guided thoracenteses: is it a safer method?. Chest. 2003, 123: 418-423. 10.1378/chest.123.2.418.

    Article  PubMed  Google Scholar 

  8. Raptopoulos V, Davis LM, Lee G, Umali C, Lew R, Irwin RS: Factors affecting the development of pneumothorax associated with thoracenteses. AJR Am J Roentgenol. 1991, 156: 917-920. 10.2214/ajr.156.5.2017951.

    Article  CAS  PubMed  Google Scholar 

  9. Barnes TW, Morgenthaler TI, Olson EJ, Hesley GK, Decker PA, Ryu JH: Sonographically guided thoracenteses and rate of pneumothorax. J Clin Ultrasound. 2005, 33: 442-446. 10.1002/jcu.20163.

    Article  PubMed  Google Scholar 

  10. Gordon CE, Feller Kopman D, Balk EM, Smetana GW: Pneumothorax following thoracenteses. Arch Intern Med. 2010, 4: 332-339.

    Article  Google Scholar 

  11. Callum KG, Whimster F: International vascular radiology and neurovascular radiology: a report of the National Confidential Enquiry into Perioperative Deaths. Data collection period 1 April 1998 to 31 Mar 1999. 2000, London: NCEPOD

    Google Scholar 

  12. Cavanna L, Civardi G, Vallisa D, Di Nunzio C, Cappucciati L, Bertè R, Cordani MR, Lazzaro A, Cremona G, Biasini C, Muroni M, Mordenti P, Gorgni S, Zaffignani E, Ambroggi M, Bidin L, Palladino MA, Rodinò C, Tibaldi L: Ultrasound-guided central venous catheterization in cancer patients improves the success rate of cannulation and reduces mechanical complications. a prospective observational study of 1978 consecutive catheterisations. World J Surg Oncol. 2010, 8: 91-97. 10.1186/1477-7819-8-91.

    Article  PubMed Central  PubMed  Google Scholar 

  13. Hirsch JH, Rogers JV, Mack LA: Real-time sonography of pleural opacities. AJR Am J Roentgenol. 1981, 136: 297-301. 10.2214/ajr.136.2.297.

    Article  CAS  PubMed  Google Scholar 

  14. Kohan JM, Poe RH, Israel R, Kennedy JD, Benazzi RB, Kallay MC, Greenblatt DW: Value of chest ultrasonography versus decubitus roentgenography for thoracenteses. Am Rev Respir Dis. 1986, 133: 1124-1126.

    CAS  PubMed  Google Scholar 

  15. Weingardt JP, Guico RR, Nemcek AA, Li YP, Chiu ST: Ultrasound findings following failed clinically directed thoracenteses. J Clin Ultrasound. 1994, 22: 419-426. 10.1002/jcu.1870220702.

    Article  CAS  PubMed  Google Scholar 

  16. Diacon AH, Brutsche MH, Soler M: Accuracy of pleural punctures sites: a prospective comparison of clinical examination with ultrasound. Chest. 2003, 123: 436-441. 10.1378/chest.123.2.436.

    Article  PubMed  Google Scholar 

  17. Patel PA, Ernest FR, Gunnarsson CL: Ultrasonography guidance reduces complications and costs associated with thoracentesis procedures. J Clin Ultrasound. 2012, 40: 135-141. 10.1002/jcu.20884.

    Article  PubMed  Google Scholar 

  18. American Medical Association: Res. 802, I-99 and Reaffirmed: Sub. Res. 108, A-00; privileging for ultrasound imaging. 2005,http://www.acep.org/WorkArea/DownloadAsset.aspx?id=44304,

    Google Scholar 

  19. American College of Emergency Physicians: AECP policy statement: emergency ultrasound guidelines. 2001,http://www.acep.org/NR/rdonlyres/802407–28E8–4875-93E66867EA705A2A/0/ultrasound_guidelines.pdf,

    Google Scholar 

  20. American College of Surgeons: Ultrasound examinations by surgeons. 1998,http://www.facs.org/fellows_info/statements/st-31.html,

    Google Scholar 

  21. Cavanna L, Di Stasi M, Fornari F, Civardi G, Sbolli G, Buscarini E, Buscarini L: Ultrasound and ultrasonically guided biopsy in hepatic lymphoma. Eur J Cancer. 1987, 23: 323-326. 10.1016/0277-5379(87)90076-9.

    Article  CAS  Google Scholar 

  22. Fornari F, Civardi G, Cavanna L, Di Stasi M, Rossi S, Sbolli G, Buscarini L: Complications of ultrasonically guided fine-needle abdominal biopsy. Results of a multicenter Italian study and review of the literature. The Cooperative Italian Study Group. Scand J Gastroenterol. 1989, 24: 949-955. 10.3109/00365528909089239.

    Article  CAS  PubMed  Google Scholar 

  23. Sbolli G, Fornari F, Civardi G, Di Stasi M, Cavanna L, Buscarini E, Buscarini L: Role of ultrasound guided fine needle aspiration biopsy in the diagnosis of hepatocellular carcinoma. Gut. 1990, 31: 1303-1305. 10.1136/gut.31.11.1303.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  24. Cavanna L, Civardi G, Fornari F, Di Stasi M, Sbolli G, Buscarini E, Vallisa D, Rossi S, Tannini P, Buscarini L: Ultrasonically guided percutaneous splenic tissue core biopsy in patients with malignant lymphomas. Cancer. 1992, 69: 2932-2936. 10.1002/1097-0142(19920615)69:12<2932::AID-CNCR2820691211>3.0.CO;2-7.

    Article  CAS  PubMed  Google Scholar 

  25. Civardi G, Vallisa D, Bertè R, Giorgio A, Felice C, Caremani M, Caturelli E, Pompili M, De Sio I, Buscarini E, Cavanna L: Ultrasound-guided fine needle biopsy of the spleen; high clinical efficacy and low risk in a multicenter Italian study. Am J Hematol. 2001, 67: 93-99. 10.1002/ajh.1085.

    Article  CAS  PubMed  Google Scholar 

  26. Civardi G, Vallisa D, Berte’ R, Lazzaro A, Moroni CF, Cavanna L: Focal liver lesions in non-Hodgkin’s lymphoma: investigation of their prevalence, clinical significance and the role of Hepatitis C virus infection. Eur J Cancer. 2002, 38: 2382-2387. 10.1016/S0959-8049(02)00481-1.

    Article  CAS  PubMed  Google Scholar 

  27. Kopman-Feller D: Ultrasound-guided internal jugular access: a proposed standardized approach and implications for training and practice. Chest. 2007, 132: 302-309. 10.1378/chest.06-2711.

    Article  Google Scholar 

  28. Department of Health and Human Services: Hospital inpatient prospective payment systems for acute care hospital and long–term care hospital prospective payment system and FY 2012 rates; Hospital’s FTE resident caps for graduate medical education payment. US Government Printing Office website. 2012, http://www.gpo.gov/fdsys/pkg/FR-2011-08-18/pdf/2011-19719 (accessed 30 January 2012)

    Google Scholar 

  29. Shojania KG, Duncan BW, McDonald KM, Wachter RM, Markowitz AJ: Making health care safer: a critical analysis of patient safety practices. Evid Rep Technol Assess (Summ). 2001, 43: 1-668.

    Google Scholar 

  30. Patient Protection and Affordable Care Act. 2012, US Government Printing Office website: http://www.gpo.gov/fdsys/pkg/PLAW-111publ148/html/PLAW-111publ148.htm (accessed 20 January 2012] US Government Printing Office website: (accessed 20 January 2012]

  31. Mercaldi CJ, Lanes S: Ultrasound guidance decreases complications and improves the cost of care among patients undergoing thoracentesis and paracentesis. Chest. 2013, 143: 532-538. 10.1378/chest.12-0447.

    Article  PubMed  Google Scholar 

  32. Soldati G, Smargiassi A, Inchingolo R, Sher S, Valente S, Corbo GM: Ultrasound–guided pleural puncture in supine or recumbent lateral position-study. Multidiscip Respir Med. 2013, 8: 18-10.1186/2049-6958-8-18.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luigi Cavanna.

Additional information

Competing interests

The authors have no conflicts of interest or financial support to declare.

Authors’ contributions

LC and PM designed the research, LC, PM, RB, MAP, CB, EA, PS, SV, GC and CDN contributed to acquisition of data, LC, PS, SV and CDN analyzed and interpreted data. All authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cavanna, L., Mordenti, P., Bertè, R. et al. Ultrasound guidance reduces pneumothorax rate and improves safety of thoracentesis in malignant pleural effusion: report on 445 consecutive patients with advanced cancer. World J Surg Onc 12, 139 (2014). https://doi.org/10.1186/1477-7819-12-139

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1477-7819-12-139

Keywords