Researchplan

Frank Nack

Period: 02.2000 to 02.2002

Over the last three years I have been working on the representation of audiovisual media (MPEG-7)and, resulting from that, a framework for distributed digital media production (A4SM). A4SM is based on a digital library of consistent data structures, around which associated tools are grouped to support the creation, manipulation, and archiving/retrieval for the different syntactic, semantic, and semiotic levels of media material in the distinct phases of the media production process. A4SM is intended for use by all types of experts involved in producing audio-visual media.

The main research areas I would like to investigate over the next two years are :

1. which conceptual models of annotations of audio-visual media are required to improve the semi-automated generation of hypermedia presentations
2. what is required for run time delivery of audio-visual annotations
3. what representational models are required to support multimodal presentations, and how might different representational models (eg. XML, SMIL, MPEG 7, MPEG 4) be combined and/or interrelated
4. how to model hypermedia composition rules, eg. for design (e.g. fonts, emphasis, etc.), for conceptual dependencies (rhetorics, narrative structure, summarization,), etc.

The above questions shall be undertaken in the Dynamo project and applied to the Eistenstein project.