User Tools

Site Tools


projects:year7:7b.043.sbu

7b.043.SBU - Dynamic Scene Analysis

Project - Summary

In this project, we will develop a framework for analyzing dynamic scenes using machine learning and natural language processing algorithms. The input data are coming for multiple sources, including a variety of cameras, variety of microphones, and the like. Sounds coming from microphones identified as speech will be processed by a natural language processing algorithms, while other sounds and images will be processed with deep learning algorithms. Medpod will provide the necessary data.

Project - Team

Team Member Role Email Phone Number Academic Site/IAB
Arie E. Kaufman PI ari@cs.stonybrook.edu (631) 632-8428 Stony Brook University
Dimitris Samaras Co-PI samaras@cs.stonybrook.edu (631) 632-8464 Stony Brook University
Minh Hoai Nguyen Co-PI minhhoai@cs.stonybrook.edu (631) 632-8460 Stony Brook University
Niranjan Balasubramanian Investigator niranjan@cs.stonybrook.edu (631) 632-2457 Stony Brook University
Eugenia Soroka Student Not Available Not Available Stony Brook University
Shawn Mathew Student shawmathew@cs.stonybrook.edu (516) 306-1876 Stony Brook University
Yicheng Lin Student Not Available Not Available Stony Brook University
Viresh Ranjan Student vranjan@cs.stonybrook.edu Not Available Stony Brook University
Vinh Quang Tran Student Not Available Not Available Stony Brook University
Shahrukh Athar Student sathar@cs.stonybrook.edu (631) 398-2919 Stony Brook University
Heeyoung Kwon Student heekwon@cs.stonybrook.edu (631) 260-3441 Stony Brook University
Lou Lavino Project Mentor llavino@medpodinc.com (631) 291-1233 Medpod, Inc.
Funded by: Medpod

Project - Deliverables

Deliverables
1 An application that can differentiate speech from other sounds
2 A natural language processing algorithm to analyze the speech
3 A machine learning algorithm for analyzing other sounds and imagery
4 A framework for analyzing dynamic scenes

Project - Documents

FilenameFilesizeLast modified
7b.043.sbu_mid-year_report.docx237.1 KiB2019/08/13 15:09
7b.043.sbu_2018_fall_meeting_poster.pptx81.7 KiB2019/08/13 15:09
projects/year7/7b.043.sbu.txt · Last modified: 2021/06/02 17:28 by sally.johnson