Dissertation Defense: Raphael Silva de Abreu
Student: Raphael Silva de Abreu
Title: Authorship of documents Multimedia Interactive based on Synchronization of sensory effects in Relationship To Content Audiovisual
Advisors: Joel A. F. Dos Santos, Eduardo Bezerra da Silva (co-advisor)
Jury: Joel A. F. Dos Santos (CEFET/RJ) (President), Eduardo Bezerra da Silva (CEFET/RJ), Gustavo Paiva Guedes e Silva (Cefet/RJ), Glauco Fiorott Amorim (Cefet/RJ), Débora Christina Muchaluat Broadcast (UFF)
Day/Time: July 20/10h
Room: Auditorium V
Summary:
Advances Of Computing Ubiquitous Have Shown to be important to increase the Levels Of Immersion Of Users In virtual environments. Such Advances Several types of research aimed at increasing the Immersion Of User In Applications Multimedia. One of them is the Addition of sensory effects, enabling the Applications The Mulsemedia. Such Applications interface with other human senses Besides Of Vision And Hearing. However, the development of these Applications needs an effort of authorship to synchronize sensory effects with Content Audiovisual. Besides That Applications Interactive, lack of Abstractions To facilitate the authorship of sensory effects. Therefore, this paper presents an approach to facilitate the authorship of Applications Interactive Mulsemedia. To resolve these issues, this work focused on Three Fronts. The first is the concept of Anchors Abstract, which performs the Synchronization of sensory effects with an object of Media In a Semiautomatic. In this context, a processor is presented for the NCL language that uses neural networks to identify when Content Are Presented to carry out the Synchronization. The second front is a bimodal neural network architecture, aiming to improve the Identification Of Content Present in the audiovisual object by taking into Consideration The modalities of Audio And Video. The third front is to allow the Definition of sensory effects in languages Multimedia Declaratives, making Possible The authorship of Applications Interactive with sensory effects according to the Default MPEG-V. This work also presents an Extension Of the MPEG-V positioning system, allowing the use of coordinated Spherical. Finally, a 3d simulator of an interactive Mulsemedia environment is presented. As a result, this work facilitates authorship in the following ways. First to abstract the Synchronization of sensory effects. Then, by enhancing the Method Of Identification Of Content of an audiovisual object. Finally, allowing a Definition But Generic of sensory effects along with its positioning in Applications Multimedia Through the 3d simulator, to support the author to visualize the Run of these effects.
