Multimodal Technologies for Skills Development (mute4skid)

JTELSS logo large
Multimodal Technologies for Skills Development (mute4skid) Monday 13/05 10:30-12:00h (Part 1) Monday 13/05 14:00-15:30h (Part 2) Workshop Space B Needs Analysis Multimodal and immersive systems, such as virtual and augmented reality, powered by AI and sensors, are changing how we interact and learn with technology. This has implications for human-computer

Speakers

Daniele Di Mitri
DIPF, Germany
Jan Schneider
DIPF, Germany
Bibeg Limbu
Leiden Delft Erasmus Center for education and learning
Khaleel Asyraaf Mat Sanusi
Khaleel Asyraaf Mat Sanusi
Cologne Game Lab, TH Köln, Germany
Roland Klemke
Open University of The Netherlands, The Netherlands / TH Köln, Germany

Start

13/05/2024 - 10:30

End

13/05/2024 - 15:30

Multimodal Technologies for Skills Development (mute4skid)

Monday 13/05 10:30-12:00h (Part 1)
Monday 13/05 14:00-15:30h (Part 2)
Workshop Space B
Needs Analysis

Multimodal and immersive systems, such as virtual and augmented reality, powered by AI and sensors, are changing how we interact and learn with technology. This has implications for human-computer interaction and technology-enhanced learning, enabling personalised, contextual and deliberate practice of skills in real settings. This can foster holistic learning that integrates cognitive, affective and psychomotor domains. Sensor data and computational approaches can reveal complex learning phenomena and enable seamless learning interventions in authentic settings. Multimodal and immersive systems can support embodied learning, considering context, psychomotor, affective and physiological aspects. However, multimodality still faces some challenges.

 

Learning Objectives

We propose this to be a workshop of 90 minutes where we will discuss our research on multimodal technologies for skill development.

  1. the first part is a lecture-style presentation introducing the rationale of AI in Education for skills development while presenting some concrete examples from research.
  2. the second part is a brainstorming/group-work phase in which groups of participants work on aspects to push forward skills development using multimodal technologies.

Participants will learn about various aspects of AI in Education: the main concepts, historical and future development of AI in education, the new opportunities introduced by multimodal interfaces, sensors, and advanced machine-learning environments

 

Pre-activities

There are no pre-requisites for participants to attend this workshop

 

Session Description

Lecture style presentation about multimodal technologies 4 Skills development (25’)
MLX
The notion of “Intelligent Tutoring System”
Modelling the learner’s
Knowledge representation and tracing
Task modelling
Instructional modelling (taxonomy and frameworks for skill development)
Existing and most popular AI systems in Education
Prototype demonstrations (20’)
Projects
Lessons learned
Open discussion in groups on how to push the use of Multimodal technologies for skill development forward. (45’)
-What will the future look like?
-What considerations do we need to take?