Cited 0 times in Scipus Cited Count

Feasibility and evaluation of a large-scale external validation approach for patient-level prediction in an international data network: validation of models predicting stroke in female patients newly diagnosed with atrial fibrillation

DC Field Value Language
dc.contributor.authorReps, JM-
dc.contributor.authorWilliams, RD-
dc.contributor.authorYou, SC-
dc.contributor.authorFalconer, T-
dc.contributor.authorMinty, E-
dc.contributor.authorCallahan, A-
dc.contributor.authorRyan, PB-
dc.contributor.authorPark, RW-
dc.contributor.authorLim, HS-
dc.contributor.authorRijnbeek, P-
dc.date.accessioned2022-11-29T01:43:22Z-
dc.date.available2022-11-29T01:43:22Z-
dc.date.issued2020-
dc.identifier.urihttp://repository.ajou.ac.kr/handle/201003/22972-
dc.description.abstractBACKGROUND: To demonstrate how the Observational Healthcare Data Science and Informatics (OHDSI) collaborative network and standardization can be utilized to scale-up external validation of patient-level prediction models by enabling validation across a large number of heterogeneous observational healthcare datasets.

METHODS: Five previously published prognostic models (ATRIA, CHADS2, CHADS2VASC, Q-Stroke and Framingham) that predict future risk of stroke in patients with atrial fibrillation were replicated using the OHDSI frameworks. A network study was run that enabled the five models to be externally validated across nine observational healthcare datasets spanning three countries and five independent sites.

RESULTS: The five existing models were able to be integrated into the OHDSI framework for patient-level prediction and they obtained mean c-statistics ranging between 0.57-0.63 across the 6 databases with sufficient data to predict stroke within 1 year of initial atrial fibrillation diagnosis for females with atrial fibrillation. This was comparable with existing validation studies. The validation network study was run across nine datasets within 60 days once the models were replicated. An R package for the study was published at https://github.com/OHDSI/StudyProtocolSandbox/tree/master/ExistingStrokeRiskExter nalValidation.

CONCLUSION: This study demonstrates the ability to scale up external validation of patient-level prediction models using a collaboration of researchers and a data standardization that enable models to be readily shared across data sites. External validation is necessary to understand the transportability or reproducibility of a prediction model, but without collaborative approaches it can take three or more years for a model to be validated by one independent researcher. In this paper we show it is possible to both scale-up and speed-up external validation by showing how validation can be done across multiple databases in less than 2 months. We recommend that researchers developing new prediction models use the OHDSI network to externally validate their models.
-
dc.language.isoen-
dc.subject.MESHAtrial Fibrillation-
dc.subject.MESHFeasibility Studies-
dc.subject.MESHFemale-
dc.subject.MESHHumans-
dc.subject.MESHPrognosis-
dc.subject.MESHReproducibility of Results-
dc.subject.MESHStroke-
dc.titleFeasibility and evaluation of a large-scale external validation approach for patient-level prediction in an international data network: validation of models predicting stroke in female patients newly diagnosed with atrial fibrillation-
dc.typeArticle-
dc.identifier.pmid32375693-
dc.identifier.urlhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC7201646-
dc.subject.keywordPatient-level prediction-
dc.subject.keywordPrognostic model-
dc.subject.keywordExternal validation-
dc.subject.keywordTransportability-
dc.subject.keywordCollaborative network-
dc.contributor.affiliatedAuthorPark, RW-
dc.contributor.affiliatedAuthorLim, HS-
dc.type.localJournal Papers-
dc.identifier.doi10.1186/s12874-020-00991-3-
dc.citation.titleBMC medical research methodology-
dc.citation.volume20-
dc.citation.number1-
dc.citation.date2020-
dc.citation.startPage102-
dc.citation.endPage102-
dc.identifier.bibliographicCitationBMC medical research methodology, 20(1). : 102-102, 2020-
dc.identifier.eissn1471-2288-
dc.relation.journalidJ014712288-
Appears in Collections:
Journal Papers > School of Medicine / Graduate School of Medicine > Biomedical Informatics
Journal Papers > School of Medicine / Graduate School of Medicine > Cardiology
Files in This Item:
32375693.pdfDownload

qrcode

해당 아이템을 이메일로 공유하기 원하시면 인증을 거치시기 바랍니다.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse