My research activities lies at the confluence of multimedia and Internet of Things. My main focus in on application modeling, authoring, validation and execution. The ideia is to permeate all the multimedia application pipeline working on exciting new approaches for providing high quality interactivity and quality of experience.
See below a video explaining my research interests (in Portuguese).
I’m part of the Multimedia Research Group in CEFET/RJ. You can contact us at: multimedia at eic dot cefet-rj dot br
I’m proud to work and collaborate with a team of researchers from both CEFET/RJ and external institutions. Past and present collaborations include:
- the MidiaCom lab team at UFF (Universidade Federal Fluminense)
- the TeleMídia team at PUC-Rio.
- the Tyrex team at Inria Grenoble-Alpes.
Main interests
- Multimedia authoring languages and models
This includes exploring new ways to provide media synchronization at scene level, thinking at multimedia authoring language abstractions and multimedia model entities to represent synchronization or authoring tools to facilitate the creation of multimedia documents.
My background in this topic includes (but is not limited to) the development of the XTemplate language and the aNa API collaborating in the development of JNS (JSON NCL Script), NCL4Web, NEXT (NCL Editor Using XTemplate) and STEVE (Spatial-Temporal View Editor for Authoring Hypermedia Documents).
- Multi-sensory (mulsemedia) authoring and modeling
Multi-sensory (mulsemedia) applications provide sensory effect synchronization with audiovisual content. The authoring of such kind of application is author-dependent as no model for representing such kind of application is available yet. I’m currently working on such topic using my background in multimedia to provide a model for mulsemedia applications.
- Multimodal interactive environments
A constraint to multimedia applications has always been user interaction. IoT brings the possibility of integrating sensors in multimedia (or mulsemedia) application enabling users to interact via gestures, speech, etc. Different from the mulsemedia modeling point of view, the idea here is to provide tools for multimodal interaction. I have a few students exploring this interesting field right now.
- Multimedia document validation
This includes exploring how to model facilities provided by declarative multimedia authoring languages for providing document validation. Formal approaches are of interest while modeling multimedia languages. Interesting research topics I’m currently working on are (i) providing a formal definition of multimedia documents and a classification of multimedia languages; (ii) providing game-narrative validation.
My background in this topic includes (but is not limited to) the development of the SHM (Simple Hypermedia Model). SHM is a formal representation for the generic behavior of multimedia documents. Using SHM I am able to provide validation in two different ways: (i) modeling document behavior as a rewriting theory and using a model-checker and (ii) modeling document behavior using constraints and using a SMT (SAT Modulo Theories) solver.
- Internet of Things
Once we start to work at mulsemedia, sensors and actuators integration plays an important role. Here is where my research combines with IoT.