date: feb 10, 2005 author Joost additions Lynda This bluebook note intends to become a survey of multimedia ontologies/thesauri including Mime, Premo and Modality Theory. The ultimate goal is to create a unifying ontology. lynda: (And include "modality transformations, for example, dynamic -> static can be done by, for example, interaction stools (video/audio can be played/paused etc.); voice transformed to subtitle; video transformed to thumbnail image. ) Workshop is “Multimedia and the Semantic Web” http://www.acemedia.org/ESWC2005_MSW http://www.eswc2005.org/ 11 March 2005: Paper submission 7 April 2005: Notification of acceptance 30 April 2005: Camera-ready paper submission 29 May 29 2005: Workshop date Resources --------- Using a theoretical multimedia taxonomy framework http://portal.acm.org/citation.cfm?id=376701&coll=portal&dl=ACM&CFID=38419155&CFTOKEN=66605959 http://csdl.computer.org/comp/proceedings/icmcs/1999/0253/02/02530661abs.htm jacco swoogle:semantic http://derpi.tuwien.ac.at/~andrei/cerif/multimedia.rdf http://www.mindswap.org/~glapizco/SemanticMedia/ont.daml daml ontology contains MPEG-7 multimedia classes - subclasses of Manifestation ABC ontology http://www.cs.umd.edu/users/alejandr/cmsc828y/ABC.xml the aggregate ontology generated by extending ABC with MPEG-7 and MPEG-21/indecs Modality Theory --------------- Bernsen PREMO ----- Premo: an emerging standard for multimedia presentation. I. Overview and framework Herman, I. Reynolds, G.J. van Loo, J. Multimedia, IEEE Publication Date: Summer 1996 On page(s): 83-89 Volume: 3, Issue: 2 http://ieeexplore.ieee.org/xpl/abs_free.jsp?arNumber=502299 Also in bridge: D.A. Duce, D.J. Duke, F.Faconti, I. Herman, and M. Massink Talks about two types of media ontologies/taxonomy: 1) human centered, such as the one described by Bernsen. 2) System centered which is used to identify implications for the system. An automatic multimedia presentation engine needs both. Relating the primitive hierachy of the PREMO standard to the SRM-IMMPS. This article appeared in the special issue with SRM-IMMPS. In the SRM the presentation specific issues (presentation layer) are not discussed in detail. Instead, they refer to PREMO as a possible way to instantiate this. This article attempts to answer the question wheter PREMO is suited for this purpose. The short answer is: partly. PREMO just as the SRM is meant as a reference model and not as an implementation model. So, they deliberately made as few commitments as possible in order to describe a large class of systems by using PREMO terminology. From an SRM perspective the primitives defined by PREMO are important because the knowledge acquired in the above layers needs to be expressed in terms of PREMO. It turns out, what they call "design knowledge" is hard to express. (eg. "spatial information is best presented graphically") because PREMO doesn't make statements about rules and processes. Classification of media on the other hand can be handled reasonably well, although the categories are still quite generic. They do have some interesting observation on the requirements of a classification hierachy: - object vs attributes and methods It is not always clear in a model what should become an object and an attribute. It depends on the context and the system perspective how a domain is modeled. They use an OO example of graphical objects which needs to be rendered. One apprach is to include the render function in the object. Alternatively you can have a renderer which gets graphical objects as data input. "With regard to the issue of conceptualization, one may conclude that any classification of media types must leave sufficient freedom to allow designers the freedom of their design philosophy" note: I think we need to find a better example. A media object has a property painting or a media object is a painting. "A good classification should be organised in a way that reflects the relevant differences between the essential properties of the classified items, and at the same time, removes redundancies. Choosing the optimal set of primitives for media objects, however, remains a difficult endeavour as long as new multimedia input and output devices are appearing from one day to the next. That is, the development of a classification that is complete in any useful sense is highly problematic. Therefore, a useful media classification must also allow the systematic integration of new media, preferably without resort to the most naive approach to classification, which is simply an open-ended flat list of media types." PREMO was designed from a systems perspective and therfore expressing design knowledge is not really possible. Mime ---- mime http://www.mhonarc.org/~ehood/MIME/ MAVIS ----- mavis http://www.ecs.soton.ac.uk/research/projects/MAVIS2 http://www.mmrg.ecs.soton.ac.uk/publications/archive/lewis1996a/html/index.html They use multimedia thesaurus as a wordnet like thesaurus except that it can contain multimedia data in adition to textual data. MPEG7 ----- Utz XML schema's WAI --- CC/PP ----- What do you want from a multimedia ontology? -------------------------------------------- Find media specific properties such as length width duration etc. - does the media comply with device constraints Understand whether media can be used on a device - whether media is suited for a device (no large images on a PDA) Understand what types of media can be combined without overloading the user. - Users typically can not watch too video's simultanously Understand what type of media is best suited to convey certain types of information - Spatial information is best presented using spatial media Express design knowledge - Paintings have captions Domain knowledge / content description - dublin core Instance/Class descriptive/generative Property -> Class mapping -------------------------- The modalities of Bernsen are described using properties which have fixed values (yes/no, graphical/haptic/acoustic etc). The hierarchy he defines is somewhat arbitrarily organized (I think). He uses super level (linguistic, analogue,arbitrary,explicit) and generic (static,dynamic,graphical/acoustic/haptic) but you can use other properties which you keep constant through the sub-levels in the hierarchy. Point is that the information is in the properties. The accumulation of properties in classes is needed to make a mapping to system specific information which is encoded in an ontology. (e.g width height as property of class Image (and all its subclasses) List of properties of a multimedia ontology ------------------------------------------ System oriented - User oriented Complete - Incomplete Only primitive object - Composite objects Processing/transformation included - only static media Scenario's ---------- Digital Library Archivist The maintainer of an cultural heritage audiovisual library wants to make the content of the library digitally available. The original artefact's are digitized and now she is concerned with creating their metadata. Part of the metadata is available in analogue format, such as descriptions and comments on the content. She wants to add specific information such as digital rights, the encoding format, and specific properties of the medium. For example a short documentary film about the early 1950's art movement called "the beat generation". The film shows different works of different artists. Part of the documentary are original black-white footage and there is recorded material of a poetry reading held in 1954 in the "citylight bookstore" in San Fransico. (robert frank) Digital Library Visitor A visitor of the above described dl is doing researching for a project on the beat generation writer Jack Kerouac. She is interested in his work and personal life of Jack when the beat generation was started, she is searching for material covering this period. Multimedia Author As a tribute to the beat generation about 50 years ago a multimedia artist gets the assignment to create a multimedia presentation about the beat generation. She is using original material for her presentation, such as film, pictures and audio as well as work of contemporary artist influenced by the movement. The style of the presentation is historic black-white as well as typical controversial of the beat generation it self. Software engineer A programmer working for a small software company specializing in art related web sites is building a website for the beat generation art movement, as part of its 50th anniversary. He has 2 months to complete this and he is a bit bored because he doesn't really like the beat generation. Furthermore this is the 3rd art related website he has to do this year, he knows that the next 2 assignment he gets will be a website about clair-obscure paintings and medieval Spanish fresco's.