ISO/IEC DIS 23005-3

Description / Abstract: This Part of ISO/IEC 23005 specifies syntax and semantics of description schemes and descriptors that represent sensory information. This international standard is applicable to enhance the experience of users while consuming media resources by stimulating human multi-sensor such as tactile, orfactory, light sense, temperature sense, etc.

NOTE 1 The actual RàV/VàR Adaptation is deliberately informative and left open for industry competition.

NOTE 2 Additional informative information can be found in Annex A.

MPEG-V Part 3 Sensory information specifies the Sensory Effect Description Language (SEDL) as an XML Schema-based language which enables one to describe so-called sensorial effects such as light, wind, fog, vibration, etc. that trigger human senses. The actual sensorial effects are not part of SEDL but defined within the Sensory Effect Vocabulary (SEV) for extensibility and flexibility allowing each application domain to define its own sensorial effects. A description conforming to SEDL is referred to as Sensory Effect Metadata (SEM) and may be associated to any kind of multimedia content (e.g., movies, music, Web sites, games). The SEM is used to steer actuators like fans, vibration chairs, lamps, etc. via an appropriate mediation device in order to increase the immersive experience of the user. That is, in addition to the audio-visual content of, e.g., a movie, the user will also perceive other effects such as the ones described above, giving her/him the sensation of being part of the particular media which shall result in a worthwhile, informative user experience. The concept of receiving sensorial effects in addition to audio/visual content is depicted in Figure 2.

The media and the corresponding SEM may be obtained from a Digital Versatile Disc (DVD), Blu-ray Disc (BD), or any kind of online service (i.e., download/play or streaming). The media processing engine – also referred to as the adaptation engine – acts as the mediation device and is responsible for playing the actual media resource and accompanied sensorial effects in a synchronized way based on the user’s setup in terms of both media and sensorial effect rendering. Therefore, the media processing engine may adapt both the media resource and the SEM according to the capabilities of the various rendering devices.

The usage scenarios are described in detail in MPEG-V Architecture (ISO/IEC 23005-1).