Article Open Access November 16, 2024

Digital Therapeutics: A New Dimension to Diabetes Mellitus Management

1
Tata Institute of Social Sciences, Mumbai, India
2
ICARE Institute of Medical Science and Research, India
3
Rajiv Gandhi University of Health Sciences, Karnataka, India
Page(s): 74-81
Received
August 15, 2024
Revised
September 29, 2024
Accepted
November 14, 2024
Published
November 16, 2024
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright: Copyright © The Author(s), 2024. Published by Scientific Publications

Abstract

Digital therapeutics (DTx) play a transformative role in diabetes management by leveraging technology to provide personalized, data-driven medical interventions. These tools enhance self-management by offering continuous monitoring and real-time feedback on glucose levels, diet, and physical activity. This personalized approach helps patients adhere to treatment plans and make informed lifestyle changes, leading to improved clinical outcomes such as reduced HbA1c levels and better overall diabetes control. The importance of DTx lies in their ability to make diabetes care more accessible and convenient. Mobile apps and telemedicine platforms enable patients to receive support and guidance from anywhere, reducing the need for frequent in-person visits. Additionally, DTx often include behavioral support features like reminders, educational content, and motivational tools, which are crucial for maintaining healthy habits and managing stress. Currently, the dynamics of DTx in diabetes are rapidly evolving, with increasing integration of artificial intelligence and machine learning to further personalize and optimize care. As the adoption of these technologies grows, they hold the potential to significantly improve patient outcomes and revolutionize diabetes management on a global scale. This article will focus on the benefits of novel digital therapeutics for prevention and management of type II diabetes that are currently available in the market.

1. Introduction

The landscape of healthcare is becoming increasingly digital, with concepts such as personalised and precision medicine taking the lead. The integration of health and digital technology has resulted in the development of Digital Health, a broad category of digital health technologies aimed at improving human health and well-being, enhancing the quality and safety of care, expanding access to treatment, improving the efficiency of health services, and lowering overall health-care costs.

Digital therapeutics (DTx) defined by the Digital Therapeutics Alliance as “evidence-based therapeutic interventions driven by high-quality software programs to prevent, manage, or treat a medical disorder or disease” [1] have emerged as a new therapeutic modality for the prevention, management, or treatment of chronic, behaviour-modifiable disease. To prevent, manage, and/or treat a medical problem, these software-driven medical interventions combine pharmacologic and non-pharmacologic techniques with/without expert supervision. However, many companies follow four primary methods for validation. These include FDA (Food and Drug Administration) approval or clearance for use, registered clinical trials, observational studies or clinical trials, and retrospective studies.

The benefits of digital medicines align with market demand, therefore the market for digital therapeutics is growing worldwide, with an emphasis on advanced medical markets [2]. It is a relatively new discipline that uses digital implements like mobile devices, apps, sensors, the Internet of Things, and others to spur behavioural changes in patients. Mostly, DTx systems draw upon the evidence-based principles of behavioral or psychological intervention protocols known as “cognitive behavioral therapy” (CBT) [2]. It uses evidence-based techniques to change problematic behaviors and unhelpful cognitive distortions, and to improve emotional regulation and coping skills to solve the current problems [3]. Patients, physicians, and payers benefit from digital therapeutics because they provide sophisticated and accessible tools for addressing a wide range of diseases with high-quality, safe, and effective data-driven interventions.

According to the latest data from the International Diabetes Federation (IDF), the global prevalence of diabetes has reached 10.5% of the adult population (ages 20-79), which translates to approximately 537 million adults living with diabetes. Alarmingly, nearly half of these individuals are unaware that they have the condition. Projections indicate that by 2045, the number of adults with diabetes will rise to 783 million, or about 1 in 8 adults [4]. By leveraging technology, DTx provide scalable and effective solutions to manage diabetes, ultimately improving patient outcomes and quality of life.

This article will focus on the benefits of novel digital therapeutics for prevention and management of type II diabetes that are currently available in the market.

2. Materials and Methods

Comprehensive, structured literature searches were conducted in PubMed, Google Scholar and print media using key words digital therapeutics, digital health, Software as a Medical Device (SaMD), healthcare digitization and technology in healthcare.

Subsequently, the relevant papers and data published from 2010 to 2024 were fully reviewed, and their findings were noted.

2.1. Digital therapeutics market size & growth opportunities

The 2024’s breakout funding in digital therapeutics is evidence of an unprecedented mandate for change, across all aspects of healthcare. Investments in digital therapeutics companies in the United States have grown as digital health funding continues to break records during 2024’s blockbuster year, with the three highest-funded quarters ever [5]. Due to the increasing prevalence of diabetes, the diabetes application segment dominated the market in 2024.

The global digital therapeutics market size is estimated to grow from USD 2.83 billion in 2024 to USD 19.76 billion by 2035, representing a CAGR of 19.32% during the forecast period 2024-2035 [6] (See figure 1).

Furthermore, the market is expected to increase due to the cost-effectiveness of digital health technology for providers and patients, as well as rising demand for integrated healthcare systems and patient-centric care.

2.2. Potential benefits of Digital therapeutics in Diabetes

Digital therapeutics in diabetes offer a range of benefits aimed at improving disease management and patient outcomes. Here are some key aspects:

  1. Personalized Treatment: Digital therapeutics provide tailored interventions based on individual patient data, which can include glucose levels, diet, physical activity, and medication adherence [7].
  2. Enhanced Self-Management: These tools empower patients to take control of their diabetes management through continuous monitoring and feedback. This can lead to better adherence to treatment plans and lifestyle changes [8].
  3. Improved Clinical Outcomes: Studies have shown that digital therapeutics can help reduce HbA1c levels, improve physical activity, and enhance overall diabetes knowledge [9].
  4. Accessibility and Convenience: Digital platforms, including mobile apps and telemedicine, make it easier for patients to access care and support from anywhere, reducing the need for frequent in-person visits [10].
  5. Behavioral Support: Many digital therapeutics include features like reminders, educational content, and motivational support to help patients maintain healthy behaviors and manage stress [7].

Overall, digital therapeutics offer a promising adjunct to traditional diabetes care, providing scalable and effective solutions to improve patient outcomes and quality of life (8). Table 1 summarizes the DTx currently available in market.

3. Discussion

DTxs have shown to enhance clinical outcomes in T2DM patients in cohort studies. Over the course of a 3-month research [11], a mobile medical app named FareWell (now changed to Better Therapeutics) that gave intense behavioural treatment together with assistance from a remote multidisciplinary care team showed mean HbA1c reduction of 0.8%. Greater glycemic control was observed with increasing app engagement.

Digital therapeutic applications (DTx) like Blue Star, Diabeo System, Livongo Diabetes Program, and Tidepool, use web-based applications/cloud platforms to provide evidence based, personalized, rapid point of care management of chronic, behavior-modifiable conditions like diabetes mellitus (DM). It has significantly improved patient compliance, therapeutic success and economic outcomes in DM management by enabling active patient engagement, lifestyle change, comprehensive medical care, and periodic monitoring of glycemic status [12].

Regulated digital therapeutics are those that have been approved by the FDA and follow a prescription model similar to medical technology and pharmaceuticals. Software algorithms that administer insulin are one example in diabetes. Some examples of insulin dosage algorithms have been [13] certified by the FDA and are commercially accessible - Tandem, Voluntis, Hygieia, and Welldoc. Livongo's effort to combine remote monitoring and coaching with blood glucose monitoring is an excellent example of digital therapeutics that complement devices and pharmaceuticals. Onduo and Welldoc's work are two further examples which are working globally to reduce the disease burden. While in the Indian market, Mumbai based Fitterfly is a leading digital therapeutics company that provides a 360-degree holistic care and support to patients to help manage their diabetes.

In a recent study of 109 participants in the Fitterfly Diabetes CGM program, there was significant reduction in the mean HbA1c levels, weight, and BMI of the participants, emphasizing a high level of engagement with the program [14].

Another tool named MayaMD.AI [15] has features of recording vitals and care program through which remote patient monitoring is possible. This application consists of a customized and evidence-based medicine curated ‘Care Program’ (See figure 2) for wide range of lifestyle diseases like Hypertension, Diabetes, CKD and CHF etc. The symptom checker is intended to assist patients in deciphering their medical symptoms and provide them with reliable information to help them maintain their health. For instance, to have a look at the blood glucose levels in case of diabetes along with timely vital check, right diet consumption and exercises in order to maintain healthy lifestyle. The Connect with Care team feature consists of a team of expert professional doctors further aiding in pharmaceutical intervention along with lifestyle intervention.

It has a dedicated medical records section designed to help patients to store and access their health information making them track their own progress or health journey. It also increases portability of clinical information including the better interaction between patient and health service provide. Patients can even take their medical records to a new provider for second opinions. One can very easily use the application for doing daily wellness check in order to track progress and motivate themselves. The medication and refilling section provide system generated alerts in order to remind the user in case of medicine stock refilling ahead in time to keep patient constantly motivated towards the healthy goals.

The MayaMD.AI app presently allows customers to make simple digital payments and view their health insurance coverage information, ensuring that the buyer-seller service is transparent about treatment costs. It not only provides therapy but educates the patient about diabetes making patient self-aware, conscious controller of their own health. Medication increases control attributions while decreasing behavior management stability. As a result, medication and behavior therapy combined with a focus on overall comprehensive disease management are recommended to promote compliance.

3.1. Benefits and barriers of digital therapeutics

Digital therapeutics in diabetes prevention and management can have profound benefits in the overall health of the patient. It can help improve medication and dietary adherence, thereby helping in weight loss, better glycemic control and lower medication requirement. Increased app usage has been linked to better diabetes management, including increased diabetes awareness and diabetes self-management behaviors like blood glucose monitoring and insulin administration [16, 17].

Despite the benefits, there is still scope of work pertaining to the quality of clinical data and real-world evidence, as well as adapting digital therapeutics’ business model to meet the demands of payers, providers, and health systems. The benefits and limits [18] of digital therapeutics is well summarized in Figure 3.

There are several benefits that have a significant influence on all stakeholders (patients, physicians, caregivers, nurses, healthcare system, pharmaceutical firm), with limitations linked to technological problems, regulatory restraints, prices, and practice adjustments [19]. Although many medications and medical devices have undergone several validation and stability testing throughout time, the hurdles to approval for DTx are thought to be very low when compared to traditional drugs and medical devices [20]. Moreover, as technology gathers additional data, the proof will need to be updated on a frequent basis.

4. Conclusion

In a short span of time, digital therapeutics has become an integral part of healthcare systems. With chronic lifestyle diseases like diabetes on the rise, technology support would be required in effective management especially in monitoring. This technology would partly empower the patient to take charge of their health. While DTx cannot take the place of healthcare providers (HCPs), it will support the HCPs in decision making and treatment planning, thereby making their work easier and organized. Considering some aspects of healthcare may never be completely replaced by technology, it is probable that DTx will be used in conjunction with other treatments to enhance patient results.

References

  1. Digital Therapeutics Alliance. Retrieved from https://dtxalliance.org (2020).
  2. Patel, N. A., & Butte, A. J. (2020). Characteristics and challenges of the clinical pipeline of digital therapeutics. NPJ digital medicine, 3(1), 1-5.[CrossRef] [PubMed]
  3. Murphy, R., Straebler, S., Cooper, Z., & Fairburn, C. G. (2010). Cognitive behavioral therapy for eating disorders. Psychiatric Clinics, 33(3), 611-627.[CrossRef] [PubMed]
  4. IDF Diabetes Atlas 2021 – 10th edition www.diabetesatlas.org
  5. Capobianco, E. (2015). On digital therapeutics. Frontiers in Digital Humanities, 2, 6.[CrossRef]
  6. Digital Therapeutics Market (3rd Edition): Industry Trends and Global Forecasts, till 2035. Retrieved from https://www.rootsanalysis.com/reports/digital-therapeutics- market/208.html
  7. Neal Kaufman; Digital Therapeutics: Leading the Way to Improved Outcomes for People With Diabetes. Diabetes Spectr 1 November 2019; 32 (4): 301–303. https://doi.org/10.2337/ds19-0012[CrossRef] [PubMed]
  8. G. Alexander Fleming, John R. Petrie, Richard M. Bergenstal, Reinhard W. Holl, Anne L. Peters, Lutz Heinemann; Diabetes Digital App Technology: Benefits, Challenges, and Recommendations. A Consensus Report by the European Association for the Study of Diabetes (EASD) and the American Diabetes Association (ADA) Diabetes Technology Working Group. Diabetes Care 1 January 2020; 43 (1): 250–260. https://doi.org/10.2337/dci19-0062[CrossRef] [PubMed]
  9. https://www.pharmacytimes.com/view/digital-therapeutics-in-diabetes-show-potential-for-improved-disease-management Accessed in October 2024.
  10. https://www.cognitiveclouds.com/insights/digital-therapeutics-for-diabetes-how-prescription-digital-therapeutics-solve-a-growing-global-health-problem Accessed in October 2024.
  11. Berman, M. A., Guthrie, N. L., Edwards, K. L., Appelbaum, K. J., Njike, V. Y., Eisenberg, D. M., & Katz, D. L. (2018). Change in glycemic control with use of a digital therapeutic in adults with type 2 diabetes: cohort study. JMIR diabetes, 3(1), e9591.[CrossRef] [PubMed]
  12. Ramakrishnan, P., Yan, K., Balijepalli, C., & Druyts, E. (2021). Changing face of healthcare: digital therapeutics in the management of diabetes. Current Medical Research and Opinion, 37(12), 2089-2091.[CrossRef] [PubMed]
  13. Harrison S, Stadler M, Ismail K, et al.: Are patients with diabetes mellitus satisfied with technologies used to assist with diabetes management and coping?: a structured review. Diabetes Technol Ther 2014;16:771–783.[CrossRef] [PubMed]
  14. Joshi S, Verma R, Lathia T, Selvan C, Tanna S, Saraf A, Tiwaskar M, Modi A, Kalra S, K V, Chitale M, Malde F, Abdul Khader M, Singal A. Fitterfly Diabetes CGM Digital Therapeutics Program for Glycemic Control and Weight Management in People With Type 2 Diabetes Mellitus: Real-world Effectiveness Evaluation. JMIR Diabetes 2023;8:e43292. URL: https://diabetes.jmir.org/2023/1/e43292. DOI: 10.2196/43292[CrossRef] [PubMed]
  15. https://www.mayamd.ai/ Accessed in October 2024.
  16. Offringa R, Sheng T, Parks L, et al.: Digital diabetes management application improves glycemic outcomes in people with type 1 and type 2 diabetes. J Diabetes Sci Technol 2018;12:701–708.[CrossRef] [PubMed]
  17. Northeast Business Group on Health. (n.d.). Retrieved from https://nebgh.org/wp- content/uploads/2018/02/Diabetes_Digital_Fin_spreads_26NOV2018.pdf
  18. Aapro, M., Bossi, P., Dasari, A., Fallowfield, L., Gascón, P., Geller, M., ... & Porzig, S. (2020). Digital health for optimal supportive care in oncology: benefits, limits, and future perspectives. Supportive Care in Cancer, 28(10), 4589-4612.[CrossRef] [PubMed]
  19. Park, S. H., & Han, K. (2018). Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology, 286(3), 800-809.[CrossRef] [PubMed]
  20. Kim, H. S. (2020). Decision-making in artificial intelligence: is it always correct? Journal of Korean Medical Science, 35(1).[CrossRef] [PubMed]
Article metrics
Views
369
Downloads
90

Cite This Article

APA Style
Rhee, R. , Jaiswal, R. K. , & Lath, G. (2024). Digital Therapeutics: A New Dimension to Diabetes Mellitus Management. Journal of Artificial Intelligence and Big Data, 4(2), 74-81. https://doi.org/10.31586/jaibd.2024.1090
ACS Style
Rhee, R. ; Jaiswal, R. K. ; Lath, G. Digital Therapeutics: A New Dimension to Diabetes Mellitus Management. Journal of Artificial Intelligence and Big Data 2024 4(2), 74-81. https://doi.org/10.31586/jaibd.2024.1090
Chicago/Turabian Style
Rhee, Raju, Rahul K Jaiswal, and Gunjan Lath. 2024. "Digital Therapeutics: A New Dimension to Diabetes Mellitus Management". Journal of Artificial Intelligence and Big Data 4, no. 2: 74-81. https://doi.org/10.31586/jaibd.2024.1090
AMA Style
Rhee R, Jaiswal RK, Lath G. Digital Therapeutics: A New Dimension to Diabetes Mellitus Management. Journal of Artificial Intelligence and Big Data. 2024; 4(2):74-81. https://doi.org/10.31586/jaibd.2024.1090
@Article{jaibd1090,
AUTHOR = {Rhee, Raju and Jaiswal, Rahul K and Lath, Gunjan},
TITLE = {Digital Therapeutics: A New Dimension to Diabetes Mellitus Management},
JOURNAL = {Journal of Artificial Intelligence and Big Data},
VOLUME = {4},
YEAR = {2024},
NUMBER = {2},
PAGES = {74-81},
URL = {https://www.scipublications.com/journal/index.php/JAIBD/article/view/1090},
ISSN = {2771-2389},
DOI = {10.31586/jaibd.2024.1090},
ABSTRACT = {Digital therapeutics (DTx) play a transformative role in diabetes management by leveraging technology to provide personalized, data-driven medical interventions. These tools enhance self-management by offering continuous monitoring and real-time feedback on glucose levels, diet, and physical activity. This personalized approach helps patients adhere to treatment plans and make informed lifestyle changes, leading to improved clinical outcomes such as reduced HbA1c levels and better overall diabetes control. The importance of DTx lies in their ability to make diabetes care more accessible and convenient. Mobile apps and telemedicine platforms enable patients to receive support and guidance from anywhere, reducing the need for frequent in-person visits. Additionally, DTx often include behavioral support features like reminders, educational content, and motivational tools, which are crucial for maintaining healthy habits and managing stress. Currently, the dynamics of DTx in diabetes are rapidly evolving, with increasing integration of artificial intelligence and machine learning to further personalize and optimize care. As the adoption of these technologies grows, they hold the potential to significantly improve patient outcomes and revolutionize diabetes management on a global scale. This article will focus on the benefits of novel digital therapeutics for prevention and management of type II diabetes that are currently available in the market.},
}
%0 Journal Article
%A Rhee, Raju
%A Jaiswal, Rahul K
%A Lath, Gunjan
%D 2024
%J Journal of Artificial Intelligence and Big Data

%@ 2771-2389
%V 4
%N 2
%P 74-81

%T Digital Therapeutics: A New Dimension to Diabetes Mellitus Management
%M doi:10.31586/jaibd.2024.1090
%U https://www.scipublications.com/journal/index.php/JAIBD/article/view/1090
TY  - JOUR
AU  - Rhee, Raju
AU  - Jaiswal, Rahul K
AU  - Lath, Gunjan
TI  - Digital Therapeutics: A New Dimension to Diabetes Mellitus Management
T2  - Journal of Artificial Intelligence and Big Data
PY  - 2024
VL  - 4
IS  - 2
SN  - 2771-2389
SP  - 74
EP  - 81
UR  - https://www.scipublications.com/journal/index.php/JAIBD/article/view/1090
AB  - Digital therapeutics (DTx) play a transformative role in diabetes management by leveraging technology to provide personalized, data-driven medical interventions. These tools enhance self-management by offering continuous monitoring and real-time feedback on glucose levels, diet, and physical activity. This personalized approach helps patients adhere to treatment plans and make informed lifestyle changes, leading to improved clinical outcomes such as reduced HbA1c levels and better overall diabetes control. The importance of DTx lies in their ability to make diabetes care more accessible and convenient. Mobile apps and telemedicine platforms enable patients to receive support and guidance from anywhere, reducing the need for frequent in-person visits. Additionally, DTx often include behavioral support features like reminders, educational content, and motivational tools, which are crucial for maintaining healthy habits and managing stress. Currently, the dynamics of DTx in diabetes are rapidly evolving, with increasing integration of artificial intelligence and machine learning to further personalize and optimize care. As the adoption of these technologies grows, they hold the potential to significantly improve patient outcomes and revolutionize diabetes management on a global scale. This article will focus on the benefits of novel digital therapeutics for prevention and management of type II diabetes that are currently available in the market.
DO  - Digital Therapeutics: A New Dimension to Diabetes Mellitus Management
TI  - 10.31586/jaibd.2024.1090
ER  - 
  1. Digital Therapeutics Alliance. Retrieved from https://dtxalliance.org (2020).
  2. Patel, N. A., & Butte, A. J. (2020). Characteristics and challenges of the clinical pipeline of digital therapeutics. NPJ digital medicine, 3(1), 1-5.[CrossRef] [PubMed]
  3. Murphy, R., Straebler, S., Cooper, Z., & Fairburn, C. G. (2010). Cognitive behavioral therapy for eating disorders. Psychiatric Clinics, 33(3), 611-627.[CrossRef] [PubMed]
  4. IDF Diabetes Atlas 2021 – 10th edition www.diabetesatlas.org
  5. Capobianco, E. (2015). On digital therapeutics. Frontiers in Digital Humanities, 2, 6.[CrossRef]
  6. Digital Therapeutics Market (3rd Edition): Industry Trends and Global Forecasts, till 2035. Retrieved from https://www.rootsanalysis.com/reports/digital-therapeutics- market/208.html
  7. Neal Kaufman; Digital Therapeutics: Leading the Way to Improved Outcomes for People With Diabetes. Diabetes Spectr 1 November 2019; 32 (4): 301–303. https://doi.org/10.2337/ds19-0012[CrossRef] [PubMed]
  8. G. Alexander Fleming, John R. Petrie, Richard M. Bergenstal, Reinhard W. Holl, Anne L. Peters, Lutz Heinemann; Diabetes Digital App Technology: Benefits, Challenges, and Recommendations. A Consensus Report by the European Association for the Study of Diabetes (EASD) and the American Diabetes Association (ADA) Diabetes Technology Working Group. Diabetes Care 1 January 2020; 43 (1): 250–260. https://doi.org/10.2337/dci19-0062[CrossRef] [PubMed]
  9. https://www.pharmacytimes.com/view/digital-therapeutics-in-diabetes-show-potential-for-improved-disease-management Accessed in October 2024.
  10. https://www.cognitiveclouds.com/insights/digital-therapeutics-for-diabetes-how-prescription-digital-therapeutics-solve-a-growing-global-health-problem Accessed in October 2024.
  11. Berman, M. A., Guthrie, N. L., Edwards, K. L., Appelbaum, K. J., Njike, V. Y., Eisenberg, D. M., & Katz, D. L. (2018). Change in glycemic control with use of a digital therapeutic in adults with type 2 diabetes: cohort study. JMIR diabetes, 3(1), e9591.[CrossRef] [PubMed]
  12. Ramakrishnan, P., Yan, K., Balijepalli, C., & Druyts, E. (2021). Changing face of healthcare: digital therapeutics in the management of diabetes. Current Medical Research and Opinion, 37(12), 2089-2091.[CrossRef] [PubMed]
  13. Harrison S, Stadler M, Ismail K, et al.: Are patients with diabetes mellitus satisfied with technologies used to assist with diabetes management and coping?: a structured review. Diabetes Technol Ther 2014;16:771–783.[CrossRef] [PubMed]
  14. Joshi S, Verma R, Lathia T, Selvan C, Tanna S, Saraf A, Tiwaskar M, Modi A, Kalra S, K V, Chitale M, Malde F, Abdul Khader M, Singal A. Fitterfly Diabetes CGM Digital Therapeutics Program for Glycemic Control and Weight Management in People With Type 2 Diabetes Mellitus: Real-world Effectiveness Evaluation. JMIR Diabetes 2023;8:e43292. URL: https://diabetes.jmir.org/2023/1/e43292. DOI: 10.2196/43292[CrossRef] [PubMed]
  15. https://www.mayamd.ai/ Accessed in October 2024.
  16. Offringa R, Sheng T, Parks L, et al.: Digital diabetes management application improves glycemic outcomes in people with type 1 and type 2 diabetes. J Diabetes Sci Technol 2018;12:701–708.[CrossRef] [PubMed]
  17. Northeast Business Group on Health. (n.d.). Retrieved from https://nebgh.org/wp- content/uploads/2018/02/Diabetes_Digital_Fin_spreads_26NOV2018.pdf
  18. Aapro, M., Bossi, P., Dasari, A., Fallowfield, L., Gascón, P., Geller, M., ... & Porzig, S. (2020). Digital health for optimal supportive care in oncology: benefits, limits, and future perspectives. Supportive Care in Cancer, 28(10), 4589-4612.[CrossRef] [PubMed]
  19. Park, S. H., & Han, K. (2018). Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology, 286(3), 800-809.[CrossRef] [PubMed]
  20. Kim, H. S. (2020). Decision-making in artificial intelligence: is it always correct? Journal of Korean Medical Science, 35(1).[CrossRef] [PubMed]