Emotion and Touch in Virtual Reality

Emotion and Touch in Virtual Reality

IEEE Virtual Reality Conference via YouTube Direct link

Facial expression recognition (eye-tracking) Body gestures (cameras) Skin temperature - Pupil dilation Speech recognition

15 of 19

15 of 19

Facial expression recognition (eye-tracking) Body gestures (cameras) Skin temperature - Pupil dilation Speech recognition

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Emotion and Touch in Virtual Reality

Automatically move to the next video in the Classroom when playback concludes

  1. 1 Intro
  2. 2 College campus visits Read bedtime story Virtual showrooms
  3. 3 Problem No technical language to define touch Important for immersive VR experience Bring body back into equation
  4. 4 Importance of emotions in VR Sense of connection Sense of presence -Enhanced experience
  5. 5 Current Offerings in VR - Vibration (forced feedback) Haptic Gloves - Fingertip devices Partial body coverage Full body coverage
  6. 6 The Big Idea - Aggregating emotions data Simulate tactile sensations Smart garments -Better immersion
  7. 7 Things to think about Type of touch and emotion
  8. 8 Virtual Environment Restaurant Two parties sitting at a table Ocean or forest sounds
  9. 9 Classical Touch Initiated Awareness before touch Receive response Will awareness match response
  10. 10 Physical Touch Bumping into world or avatar Awareness of action Feeling object Feeling avatar Will awareness match feeling
  11. 11 Background Emotions Sounds Visual effects Indicator of next action Will awareness match feeling
  12. 12 Steps Deep research of emotions Creation of databases Implementation of Agent
  13. 13 Datasets Creation of databases - facial expression and speech recognition - Collecting data Processing data Aggregate data
  14. 14 Current Setup Oculus Rift (2) Muse 2
  15. 15 Facial expression recognition (eye-tracking) Body gestures (cameras) Skin temperature - Pupil dilation Speech recognition
  16. 16 Related: Museums VR Touch Museum Mixture of real-life & visual props Potential increase in sense of presence and learning Results: better sense of presence
  17. 17 Related: Retail Consumer able to touch products Work best for buying tools vs Clothing Convince self touching tool but not the feel of fabric - Need for touch
  18. 18 Reason before pandemic Reason during pandemic Reason post pandemic Persons dealing with loss of a sense
  19. 19 Future work Wearable devices Object recognition via touch - Touch between avatars Smart textiles Cost-effective and accessible solution

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.