User Tools

Site Tools


6a.008.TUT - Co-botics: Intelligent Cooperating Robots & Humans

Project - Summary

Computational models designed to automate and monitor interactions between humans and robotics that provide humans and robots with an appropriate mental model of how the others (humans and robots) will react to various behaviors, data quality, instructions and environmental changes are of extreme importance for collaborative robotics, referred here as “co-botics”. The planned research will focus on the application of advanced machine learning and pattern recognition methodologies for facilitating shared intelligent cooperation between robotic units and humans. Advanced multi-modal data analysis aiming at describing cues from the real world (including humans) from multiple information sources will be developed and applied to this end. Based on that technology, online visual information analysis will be combined with sensor data analysis for decision making that will be interpreted in the entire system as suggestion-based cooperation through shared intelligent interactions. The project will investigate efficient scheduling approaches that involve robots and humans. An example of such scenarios is the efficient loading and unloading of e.g. autonomous shipping applications. We will work on providing accurate descriptions of the objects appearing within the working envelope of each robot, leading to safe and efficient working environment. We believe that by exploiting information of the package and combining all available sensor cues instead of using only information related to destination, can lead to intelligent planning. To make the intelligent cooperation among humans and robots more accurate, the efficient scheduling will be investigated over the provided labelled data, if provided by the sponsoring industry, for specific tasks.

Project - Team

Team Member Role Email Phone Number Academic Site/IAB
Moncef Gabbouj PI +358 (400) 736613 Tampere University
Jenni Raitoharju Co-PI 358 50 447 8418 Tampere University
Alexandros Iosifidis Co-PI +4593508875 Tampere University
Fahad Sohrab Researcher 46 962 9962 Tampere University
Matti Vakkuri Project Mentor 358 40 512 6894 Tieto
Peter Matthews Project Mentor Not available Not available CA Technologies
Steven Greenspan Project Mentor Not available Not available CA Technologies

Project - Deliverables

1 Multi-modal datasets
2 Trained models of multi-modal data embedding
3 Data analysis and decision making in the latent space
4 Efficient implementation

Project - Documents

FilenameFilesizeLast modified
6a.008.tut_final_report.docx867.1 KiB2019/08/14 15:31
6a.008.tut_confluence_project_page.pdf152.9 KiB2019/08/14 15:30
6a.008.tut_cvdi_mid-year-report.pdf275.5 KiB2019/08/14 15:30
6a.008.tut_executives_summary.pdf84.0 KiB2019/08/14 15:30
6a.008.tut_poster_pdf.pdf325.9 KiB2019/08/14 15:30
6a.008.tut_quad_chart.pptx58.0 KiB2019/08/14 15:30
6a.008.tut_poster_ppt.pptx59.9 KiB2019/08/14 15:30
6a.008.tut_ppt_presentation.pptx68.2 KiB2019/08/14 15:30
projects/year6/6a.008.tut.txt · Last modified: 2021/06/02 14:50 by sally.johnson