ISLE: An Intelligent Streaming Framework for High-Throughput AI Inference in Medical Imaging
Abstract: As the adoption of AI systems within the clinical environment grows, limitations in bandwidth and compute can create communication bottlenecks when streaming imaging data, leading to delays in patient care and increased cost. As such, healthcare providers and AI vendors will require greater computational infrastructure, therefore dramatically increasing costs. To that end, we developed ISLE, an intelligent streaming framework for high-throughput, compute- and bandwidth- optimized, and cost effective AI inference for clinical decision making at scale. In our experiments, ISLE on average reduced data transmission by 98.02% and decoding time by 98.09%, while increasing throughput by 2,730%. We show that ISLE results in faster turnaround times, and reduced overall cost of data, transmission, and compute, without negatively impacting clinical decision making using AI systems.
- “Jpeg 2000 compression of medical imagery,” in Medical Imaging 2000: PACS Design and Evaluation: Engineering and Clinical Issues. SPIE, 2000, vol. 3980, pp. 85–96.
- “HTJ2K transfer syntax support,” https://www.dicomstandard.org/docs/librariesprovider2/default-document-library/htj2k-transfer-syntax-support.docx, 2022.
- Working Group 4 DICOM Standards Committee, “HTJ2K transfer syntax,” https://dicom.nema.org/medical/dicom/Final/sup235_ft_HTJ2K.pdf, 2023.
- “Amazon Healthlake,” https://aws.amazon.com/healthlake/, Accessed: 2023-02-27.
- “High throughput JPEG 2000 (HTJ2K): Algorithm, performance and potential,” International Telecommunications Union (ITU), pp. 15444–15, 2019.
- Pranav Kulkarni, “openjphpy,” https://github.com/UM2ii/openjphpy.
- Aous Naman, “Openjph: Open source implementation of high-throughput jpeg2000 (htj2k),” https://github.com/aous72/OpenJPH.
- “Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 2097–2106.
- “Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison,” in Proceedings of the AAAI conference on artificial intelligence, 2019, vol. 33, pp. 590–597.
- “Physiobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals,” circulation, vol. 101, no. 23, pp. e215–e220, 2000.
- “Mimic-cxr-jpg, a large publicly available database of labeled chest radiographs,” arXiv preprint arXiv:1901.07042, 2019.
- “Mimic-cxr, a de-identified publicly available database of chest radiographs with free-text reports,” Scientific data, vol. 6, no. 1, pp. 317, 2019.
- “Exposing some important barriers to health care access in the rural usa,” Public health, vol. 129, no. 6, pp. 611–620, 2015.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.