Generating and viewing links in video
User System Interaction

The project week is led by Lynda Hardman, and runs from 19th to 29th May 2015.

NOTE: This web page is dynamic and will change (slightly) throughout the week.

The Challenge

Large amounts of video are available on the Web and tools are becoming available to automatically provide annotations, or meaningful tags, which provide pointers to concepts on the Semantic Web.
How can we produce annotations on the video?
How can we find meaningful relations among these annotations?
How can we make use of these meaningful relations to present the (links in the) video to the user in an appropriate way?
Can we control the interaction using a second screen?

Table of contents


Tuesday 19

11:00 Introducing LinkedTV and goals of project week

Wednesday 20

New HTML5 video technologies for the future of TV by Silvia Pfeiffer.
Papers on finding and filtering links by Michiel Hildebrand: Thesaurus-based search in large heterogeneous collections, Searching in semantically rich linked data: a case study in cultural heritage Wordnet allows you to traverse the class hierarchy using hyponyms and hypernyms (after finding the definition of a word, click on the underlined S). More information on the linking and filtering:

Thursday 21

09:30 Wake up video

10:00 Discuss goals of project in groups and make a plan. This should include:

Friday 22

Sports day and Lynda not available.

Tuesday 26

Lynda available 11:00-17:00

Wednesday 27

Lynda available 09:30-12:30

Thursday 28

Lynda available 11:00-17:00

Friday 29

Lynda available 09:30-12:30

11:00 Final presentations
The presentation should last for 10-15 minutes, divided (roughly) as follows, order as you choose:

Finalise reports based on feedback from presentation.


Assignment 1

Individual assignment, (1-2 hours).
The goal of the assignment is to explore the types of related information users may request. The example domain is news.
Explore at least two established news sites (e.g., BBC, CNN) and select 2 different news topics (preferably video) that appear on two different news sites. (Giving a total of 4 news items.)
Write down three questions about the news topics you would like the answer to. (Total 6 questions.) State the form you want the information in.
Produce your report in HTML of approximately 2 pages (max. 1000 words). Illustrations (e.g. video stills) are desirable, and can be linked to or included. Publish the report on your web page and email the URL to on Wednesday 20th May, and at the latest before 09:30 Thursday 21st May 2015.

Assignment 2

On hold!
Individual assignment, (1-2 hours).
The goal of the assignment is to explore different discourse structures for the same information and to apply the same discourse structure to different information. The preferred medium is video, but may be textual or spoken language.
The example domain can be news, but does not have to be. It should be informative, such as, educational, societal interest, edutainment.
Describe the discourse structure of the 4 news items from assignment 1 (or your chosen domain). Compare the discourse structures. Feel free to use drawings to express the structures. (UML is required in the main group report.)
Apply one of the structures from the first news topic to the second news topic.
Apply one of the structures from the second news topic to the first news topic.
Produce your report in HTML of maximum 2 pages (max. 1000 words). Videos and illustrations are desirable, and can be linked to or included. Publish the report on your web page and email the URL to on Thursday 21st May, and at the latest before 09:30 Tuesday 26th May 2015.

Main Report

You are representatives of a start-up company that is developing automated interactive video technology. You are asked to develop a design for a client and present the core innovations to them.
The example news domain should not be seen as restrictive but the application should be informative, such as, educational, societal interest, edutainment (e.g. background information for a film, or a series such as House of Cards orBreaking Bad).

Example News scenario
A news agency wants to provide personalised access to multiple national and international news feeds to allow subscribers to:

On the basis of your chosen scenario create an application design. Document the desired functionality and the modelling needed throughout the application. Explain the required underlying domain and/or discourse structures. Be aware that while the domain structures are necessary for supplying the functionality, the user does not need to be aware, and perhaps should not be aware, of them. How much explicit semantics to expose to the end-user is one of the design decisions that should be documented.

Potential functionality to include:
marking presented topics as interesting;
pre-selecting preferences.

The report is a means of conveying your design to a client. In the report, explain the reasoning behind the design as folows.

Technical requirements of report:

Publish your report on a web page and email a single URL to on Friday afternoon 29th May or at the latest before 09:30 Monday 1st June 2015. Include the names of the people in the group both in the email and in the report.

Useful Web Sites

These show interesting interfaces:

These are more oriented to search.

Vox Populi, a system for generating video sequences based on argument structures that uses explicit representation of argumentation structure.

Semantic Web Resources

How Will We Interact with the Web of Data? by Tom Heath.
Semantic Web Challenge, in particular the 2008 winner paggr.

Wordnet is an existing English language thesaurus from Princeton that has been converted to RDF.
Dublin Core (DC), VRA Core are vocabularies for describing resources. VRA Core is specialised for works of visual culture as well as the images that document them.
SKOS, Simple Knowledge Organisation System, is a family of formal languages, built on RDF and RDFS, designed for the representation of structured controlled vocabularies, such as thesauri or classification schemes.
FOAF (Friend of a Friend) a means of creating links among people on the Web, also the FOAF project, in particular the explorer.

Random Useful Links

These are some links that may not be useful now for the course, but are useful resources about relevant topics.

Web Design

Semantic Web

Facet Browsing

Valid XHTML 1.0 Strict