User Tools

Site Tools


10a.015.SBU - Data Collection on Remote Telehealth

Project - Summary

This project is a multi-year and multi-task project concerned with developing a framework for collecting a large number of dynamic scenes in remote telehealth systems using multiple cameras and multiple microphones. The input data are coming from multiple sources, including a variety of cameras, providing both images and videos, a variety of microphones, and the like. Images coming from cameras identified as humans versus background will be separated and masked by classification and segmentation machine learning algorithms, and sounds coming from microphones identified as speech will be separated and masked by NLP algorithms. The current year, year 10, was focused mostly on finishing the data collection and completing the initial algorithm design. However, due to the COVID pandemic data collection was reduce, but there was progress in the algorithm design and some testing.

This is a multi-year project started in Year 9.

Project - Team

Team Member Role Email Phone Number Academic Site/IAB
Arie Kaufman PI (631) 632-8441 Stony Brook University
Dimitris Samaras Co-PI (631) 632-8464 Stony Brook University
Minh Hoai Nguyen Co-PI (631) 632-8460 Stony Brook University
N. Balasubramanian Co-PI (631) 632-2457 Stony Brook University
Shawn Mathew Student (516) 306-1876 Stony Brook University
Parmida Ghahremani Student N/A Stony Brook University
Viresh Ranjan Student N/A Stony Brook University
Heeyoung Kwon Student (631) 260-3441 Stony Brook University
Vinh Quang Tran Student N/A N/A Stony Brook University
Yicheng Lin Student N/A N/A Stony Brook University
Shahrukh Athar Student N/A N/A Stony Brook University
Lou Lavino Project Mentor (631) 291-1233 Medpod
Funded by: Medpod

Project - Deliverables

1 Working framework for data collection from multiple videos
2 Working framework for data collection from multiple microphones
3 Tested algorithms differentiating humans from background in imaging
4 Tested algorithms differentiating speech from background

Project - Novelty of Approach

Telemedicine devices are a few and data collection of images, video and sound streams are uncommon and unavailable. These devices have the potential to break the boundaries of traditional care. This project will provide such a collection with differentiating foreground from background image, video and sound.

Project - Benefits to IAB

Remote telehealth is critical for remote and isolated areas as well as in contaminated regions, as evidenced from COVID-19 situations. It also be used for extending practice reach, health professional shortage areas (HPSAs), hub and spoke operations, healthcare microsite, resource load balancing, improving workflow, expanding on-site point-of-care options, managing work/life balance, home hospitalization, etc. The telemedicine devices come fully equipped to deliver primary care functions and can be typically outfitted to manage advanced specialty care as well. Therefore, development of telemedicine technologies are paramount.

Project - Documents

projects/year10/10a.015.sbu.txt · Last modified: 2022/10/03 15:35 by sally.johnson