VOICE Workshop at the University of Notre Dame, 24-25 October, 2024

Thursday, 24 October 2024

8:30AM     Welcome Remarks, Jarek Nabrzyski, Ed Fennell, Jeannette Antalek [video]

9:00AM   Keynote Talk: 

• Teruyuki Tanaka, Department of Pediatrics at Tokyo Children's Rehabilitation Hospital,  Toward Understanding   the Cognitive, Emotional and Internal States of People with Profound Intellectual   and Multiple Disabilities [slides][video]

10:00AM    Invited Talk: 

• [INSENSION Project Video]
• Michał Kosiedowski, Poznań Supercomputing and Networking Center,   The INSENSION Project - An   ICT System for Supporting Interaction of People with Profound Intellectual and Multiple Disabilities   With Their Surroundings [slides][video]

10:45AM    Coffee Break

11:00AM Lightning Talks: 

• Caitlyn Clements, Assistant Professor of Psychology, Notre Dame [slides][video]
• Kristin Wier, Chief Program Officer- Therapy Services LOGAN Community Resources, Inc. [slides][video]
• Allison Slabaugh, Senior Director of Strategic Initiatives, College of Science, Notre Dame [slides][video]
• Joshua Diehl, Teaching Professor, Department of Psychology, University of Notre Dame [video]
• Michela Fagiolini, Harvard Medical School, Boston Children’s Hospital, Director of Institute of Neuroscience of the National Research Council in Italy: “Developing New Biomarkers for Neurodevelopmental Disorders” (on ZOOM) [video]

11:40AM Invited Talk: 

• Tim Benke,   Pedriatrics-Neurology, University of Colorado Anschutz Medical Campus,  “Communication challenges in   neurodevelopmental disorders: Rett, CDKL5 and FOXG1 syndromes” (via ZOOM) [slides][video]

  12:00PM Lunch Break

1:00PM      Session:   Artificial Intelligence Tools Supprting Commuincation for PIMD

• Kristina   Johnson, Northeastern   University, Vocalizations From Non- and Minimally-Speaking Individuals   with Complex NDDs/PIMD [slides][video]
• Waldemar   Jęśko,   Poznan Supercomputing and Networking Center, Vocalization Recognition of People with Profound   Intellectual and Multiple Disabilities Using Machine Learning Algorithms [slides][video]
• Gašper   Slapničar,   Jožef Stefan Institute, Monitoring of Psychophysiological States and   Behavioral Patterns to Model Inner States and Interaction [slides][video]
• Jeremy   Hill, National Center for   Adaptive Neurotechnologies, Low-Bandwidth Communication:  Extracting 'Cognitive Signals'   from EEG and using Language Models to Harness Them [video]

2:30PM       Coffee Break

2:45PM      Session:   Communication with PIMD Individuals

• Maryam   Mahmoudi,   University of Minnesota, Functional Topography   Differences In Autistic And Typical Children: A Focus on Language and Speech   Networks [slides][video]
• Vikram   Jaswal, University   of Virginia, Cognitive and Social Processes Underlying Communication in Nonspeaking Autistics [slides][video]
• Ben   Simmons, Bath   Spa University, Communicating with children with ‘PMLD’ and their support   networks: lessons learned from the field [slides][video]

3:45PM Coffee   Break

4:00PM Panel:   “Moral Imperative”. Panelists: Jeremy Hill, Ben Simmons,  Sarah Chan Yun Yu,  Vikram Jaswal [video]

Moderator   - Ed Fennell

5:00PM        End of Day 1 (Please note that participation in Day 2 sessions is by invitation only)

6:30PM    Dinner,   Cascade Prime Steak and Seafood, Downtown South Bend

All meetings will take place in room E378 at Corbett Family Hall on the University of Notre Dame campus.

Participation is free. Registration is required. Attendance is limited to 50 participants. Please register here. 

· Notre Dame Research

· Boler-Parseghian Center for Rare Diseases

· Notre Dame Patient Advocacy Education and Outreach 

· Center for Research Computing at the University of Notre Dame

The VOICE4PIMD Initiative is currently in the planning phase. It seeks to develop an advanced AI-based communication system designed to bridge the communication gap for individuals with Profound Intellectual and Multiple Disabilities (PIMD). 

By interpreting non-verbal cues such as facial expressions, body movements, vocalizations, and physiological neurological signals, the AI system aims to enable PIMD-affected individuals to convey their thoughts, needs, and emotions effectively to caregivers and the world around them.

While the VOICE4PIMD Initiative is still seeking funding, this workshop aims to bring together stakeholders to discuss the challenges, opportunities, and potential solutions in this domain. We welcome submissions related to the following topics:

• Non-verbal Communication and Language Development
  • Theoretical Frameworks and Empirical Research on non-verbal Communication
  • Role of non-verbal cues in language acquisition and development
  • Cross-cultural perspectives on non-verbal communication
• Communication Challenges in PIMD Individuals
  • Case studies and practical resaachforfor working with rational
  • models for understanding attention, intention, and cognition
  • Multimodal approaches to analyzing non-verbal communication signals
• Biomarkers for Cognitive Abilities in PIMD
  • Development and validation of biomarkers for cognitive abilities
  • Neuroimaging and neurophysiological techniques for biomarker identification
  • Application of biomarkers in measuring therapeutic interventions
• Data Management and Privacy Considerations
  • Secure storage and management of collected data
  • Data use policies and adherence to privacy laws and ethical standards
  • Patient confidentiality and consent protocols
• Commercialization and Scalability
  • Strategies for commercializing AI-based communication systems
  • Compatibility with existing healthcare systems and regulatory requirements
  • Partnerships and collaborations for market entry and global deployment
• Community Engagement and Caregiver Training
  • Strategies for engaging with the caregiver community
  • Development and implementation of training programs for caregivers
  • Personalization of AI models to meet individual PIMD needs
• Technological Innovation and Practical Applications
  • Latest advancements in AI and sensor technology for non-verbal communication
  • Practical applications of these technologies in real-world settings
  • Home-based and cloud-based systems for continuous monitoring
• Ethical and Regulatory Considerations
  • Ethical implications of using AI in healthcare for PIMD individuals
  • Regulatory challenges and solutions for AI-based healthcare systems
  • Ensuring equitable access to advanced communication technologies
• Funding and Project Planning
  • Strategies for securing funding for innovative healthcare projects
  • Planning and managing large-scale research and development projects
  • Building partnerships with academic, commercial, and healthcare institutions

• Abstracts should be no more than 2 pages long, using 11pt Times New Roman font.
• Submissions should include theoretical frameworks, empirical research, case studies, practical applications, or technological innovations related to the above topics or other relevant areas within the scope of the VOICE4PIMD Initiative.
• Abstracts should be submitted by 30 September, 2024 via email below.
• Accepted submissions will have the opportunity to present their work and engage in discussions with leading experts in the field. Travel support (up to $1,000) will be provided for accepted abstracts. 
• For abstract submissions or to obtain more information about the VOICE project and the workshop, please contact Jarek Nabrzyski at:

Jarek Nabrzyski

Director, Center for Research Computing

naber@nd.edu