7th K-Space General Meeting

11-12 June 2007, Prague (CZ)

Author: Raphael, Zeljko
CWI participants: Raphael, Zeljko
# participants: around 35

Table of Contents

• 1. WP1 - Administration, Management
• 2. WP2 - Integration Activities
• 3. WP3 - Content-based multimedia analysis
• 4. WP4 - Knowledge extraction
• 5. WP5 - Semantic Multimedia
• 6. WP6 - Framework for the integration of software tools
• 7. WP7 - Activities to Spread Excellence

Summary of Action Points

1. Raphael to distribute the updated TOC of D5.9, by 13/06/2007
2. CWI to send the chapter 3 of D5.9, by 18/06/2007
3. Raphael to make the interview with Thierry about the W3C XG for the 3rd Newsletter, by 18/06/2007
4. Raphael to complete some parts of D4.6 (COMM), by 25/06/2007
5. ALL to send their chapter contributions for D5.9, by 25/06/2007
6. Raphael to do a quick check of the deliverable D3.4, by 25/06/2007
7. CWI to make a proof reading version of D5.9, by 30/06/2007
8. CWI to provide access to the Semantic Media Wiki for all partners, by 30/06/2007
9. Raphael and Simon to re-distribute a better TOC of *our* K-Space book, by 30/06/2007
10. CWI to review the Deliverable D7.5, by 15/07/2007
11. ALL to fill the Semantic Media Wiki, by 25/09/2007

1. WP1 - Administration, Management (QMUL)

2. WP2 - Integration Activities (GU)

• 10 PhD students, 8 Researchers exchange and 14 visiting scientists
• 3 industrial placements (need 3 for the next year)
• 22 online teaching resources (needs 28 at M12 and 28 more at M30!)
• Submission of an Erasmus Mondus Proposal

Ask for clarification about what is a researcher exchange and what is a visiting scientist. The criteria is still obscure. GU has clarified this point: an exchange of Researcher is a post-doc exchange, and a visiting scientist is a senior member of staff to give lectures/discuss potential collaborations or new projects.

Our planned visit to AFP will be considered as a Short Term Industrial Fellowship and should be reported. It would actually be greatly appreciated!
Need more! Lynda, can you remember your past year visit (a single day is enough) to some industry? BT? Microsoft?

3. WP3 - Content-based multimedia analysis (JRS)

WP3.1 - Multimedia Content Structuring

• 6 visual features, 4 audio features
• Football event ground truth - MPEG7 (28 games - time, people, events)
• Soon available to everybody (end of June)
• How to improve accessibility of football videos (also language issues)?

• Talk-show segmentation, music video indexing - drum transcription
• Talk-show: classification to 4 classes: speech, music, speech + music, others
• How to improve accessibility of talk-shows/music based on segmentation data?

• Object Re-detection: Automatically finding the same objects through the video (re-detecting other instances of already detected events)
• TrecVID summarization of unstructured data

WP3.3 - Audio/Speech Processing and Text Analysis

• Improving Text to Speech using ontologies
• Temporal alignment between audio and complementary text
  • Navigation in classical plays recordings
  • Possible to get data with legal agreement
  • Tools based on internal framework which cannot be deployed (i.e. it cannot be put in SVN repository)
  • Improving accessibility of classical plays
• Audio and Speech
  • Music video genre classification
  • Music instrument classification
  • Main melody extraction

WP3.4 - Content Description

D3.4 due by Month 18. Eurecom will do the internal review.
Raphael needs to do a quick check of the deliverable.

The VAMP validation service: http://vamp.joanneum.at/.

Activity lead by CWI: set up of a (semantic) wiki for gathering practical experiences for using MPEG-7 (examples, descriptions, profiles, etc.) and listing relevant tools. http://media.cwi.nl/mpeg7/wiki/

4. WP4 - Knowledge extraction (ITI)

WP4.1 - Multimedia ontology

Presentation of the COMM tutorial. Very interesting and potentially very useful. The tutorial should be available soon at: http://multimedia.semanticweb.org/COMM/

5. WP5 - Semantic Multimedia (KU)

WP 5.2 - Metadata Store

Update to the latest Sesame version. A tutorial on using K-Sems will be available in the next weeks.

WP 5.3 - Semantic Multimedia

• The TOC of D5.9 has been proposed and approved. Chapter 3 is due by 18/06/2007. Chapters are due by 25/06/2007. The deliverable will be ready for proof reading by end of June.
• Update status of the ongoing collaborations:
  • Browing news: metadata conversion done by CWI; image analysis done by QMUL; TV News video corpus provided by INA.
  • Rush explorer: everything done by GU (use of ontologies?)
  • Multimedia accessibility

WP 5.5 - KAT Multimedia Annotation Tool

Discussion about Web-based vs. Standalone tool: pro and cons.
RESOLUTION: a standalone tool will be developped (pb of man power for the web-based tool).

We need a good name for KAT!

6. WP6 - Framework for the integration of software tools (DCU)

TrecVid 2007: News, related, but different video genre
10 regions low-level features: color (dominant, layout, moments, etc.), edges (histogram), texture, shape (contour), geometric properties (bounding box, mass, center of mass)

7. WP7 - Activities to Spread Excellence (DFKI)

Newsletter: Chairs of the XG will answer to an interview from Thierry about the Incubator Group. This will be in the headline too.

K-Space book: still question about how many books K-Space will make? Most likely just our proposed one.
RESOLUTION: continue the work on the TOC we have proposed, it has a large acceptance from K-Space partners.