User Tools

Site Tools


8a.023.SBU - Image-based Dynamic Scene Analysis

Project - Summary

This project is a multi-year and multi-task project concerned with developing a framework for collecting a large number of dynamic scenes in remote telehealth systems using multiple cameras and multiple microphones. The input data are coming from multiple sources, including a variety of cameras, providing both images and videos, a variety of microphones, and the like. Images coming from cameras identified as humans versus background will be separated and masked by classification and segmentation machine learning algorithms, and sounds coming from microphones identified as speech will be separated and masked by NLP algorithms. The current year, year 8, was focused mostly on data collection and initial algorithm design.

Project - Team

Team Member Role Email Phone Number Academic Site/IAB
Arie Kaufman PI (631) 632-8441 Stony Brook University
Dimitris Samaras Co-PI (631) 632-8464 Stony Brook University
Minh Hoai Nguyen Co-PI (631) 632-8460 Stony Brook University
Niranjan Balasubramanian Co-PI (631) 632-2457 Stony Brook University
Eugenia Soroka Student Not available Not available Stony Brook University
Heeyoung Kwon Student (631) 260-3441 Stony Brook University
Shawn Mathew Student (516) 306-1876 Stony Brook University
Yicheng Lin Student Not available Not available Stony Brook University
Viresh Ranjan Student Not available Stony Brook University
Vinh Quang Tran Student Not available Not available Stony Brook University
ShahRukh Athar Student (631) 398-2919 Stony Brook University
Parmida Ghahremani Student Not available Stony Brook University
Lou Lavino Project Mentor (631) 291-1233 Medpod
Lisa Groom Project Mentor Not available Not available Medpod
Funded by: Medpod

Project - Novelty of Approach

Focus on images of dynamic scene

Project - Deliverables

1 Application segmenting images
2 Application analyzing images
3 ML algorithm for detection dynamics

Project - Benefits to IAB

Remote telehealth is critical for remote and isolated areas as well as in contaminated regions, as evidenced from COVID-19 situations. It also be used for extending practice reach, health professional shortage areas (HPSAs), hub and spoke operations, healthcare microsite, resource load balancing, improving workflow, expanding on-site point-of-care options, managing work/life balance, home hospitalization, etc. The telemedicine devices come fully equipped to deliver primary care functions and can be typically outfitted to manage advanced specialty care as well. Therefore, development of telemedicine technologies are paramount.

Project - Documents

FilenameFilesizeLast modified
8a.023.sbu_final_report.pdf849.3 KiB2020/09/08 14:13
8a.023.sbu_year_8_project_proposal_arie_kaufman.pdf597.4 KiB2019/09/18 17:26

Life Form Feedback

Year 8 Project Poster Session Feedback (Fall 2019)
Real name Great Progress On Course Needs Change Off Course Abstain
Kimmo Valtonen (kimmo.valtonen)     
Sumit Shah (sumit.shah)     
projects/year8/8a.023.sbu.txt · Last modified: 2021/06/02 17:03 by sally.johnson