NM2

Artificial Intelligence & Information Analysis

New media for a new millennium

The NM2 project will create a new  media genre that will be able for a suitable and interactive manipulation. Within this project, the creation of new production tools for the media industry in order to give the possibility of easy production of the new non-linear media genre, is also engaged. This new media genre will be characterized by the fact that the narrative presentation of the moving images will be personalized in order to suit the preference of the user.

AIIA Laboratory will contribute in this effort with its knowledge and experience in the field of video and image processing. The main objective of the AIIA lab is the extraction of semantic information from low level video and image data. In other words the automatic media content description. Is by this mean that narrative presentation of a media can be achieved.

The NM2 official web page can be found at this address http://www.ist-nm2.org/

NM2 is an Integrated Project (IP) of the European 6th Framework Program Priority 2 (Information Society Technology)
IST-2003-004124

Overview

In support of the objectives of the Lisbon summit and the eEurope 2005 action plan, NM2 (New Media for a New Millennium) will create prototype production tools for the media industry that will allow the easy production of non-linear media genres based on moving audiovisual images suitable for transmission over broadband networks.
The new media genres will be engaging and potentially profitable. They will be characterised by the fact that the narrative presentation of the moving image media is personalised to suit the preferences of the engager. NM2 will use a practice based research methodology and will deliver seven new media productions based on the same media tools exploring a range of non-linear narrative forms for different content genres as diverse as documentary, drama and news reporting.

These productions, developed in film schools, media labs and innovative production companies, will all be mentored by major broadcasters who will assess the new media genres and consider whether the concepts they embody are suitable for mainstream adoption by national broadcasters and distributors. This methodology, the strong focus on narrativity and machine based understanding of content will lead to the creation of prototype systems that are easy to use, relevant to the industry and optimised to the creation of media with good narrative structure and high production values, all of which are essential in the creation of compelling media.

NM2 will develop strong commercial understanding of the opportunities for production based on assessments of both user reception and of the potential market. The core media handling capability developed as part of media presentation capability is likely to have more generic uses in other media forms apart from cinematic media including games and music.

Objectives

The objectives can be characterised as:

  • Vision objectives

  • Project Objectives

  • Enabling objectives

These are illustrated in the figure below.

  • Narrative Authoring Language

    In this context the AiiA Lab will help in the construction of the so called NAL, by which semantic entities will be extracted with the use of an inference machine. Our role in this task is to identify the target facts that can exists within the content based video annotation and give specific notions that will be used.

  • Media Annotation

Media Annotation is a very time consuming process if we want to do it manually. Our lab will propose algorithms with which semi-automatic annotation can be realized. Among them the most popular are face detection, face tracking and shot detection. Other as well will be used and also developed within this project. The results of those algorithms will then be used to annotate multimedia essence files in an XML MPEG-7 compatible format.

  • Narrative Understanding

Narrative understanding is a high semantic processing task. It is the one which will identify the narrative structure of a multimedia subject. In this context the AiiA lab will provide knowledge of media annotation which will construct in later time the bases for extracting narrative understanding annotion.

  • Content Understanding

The Content understanding task will identify what is happening within a multimedia clip. AiiA lab will provide algorithms to do so. Those algorithms will combine low level features in order to provide more significant (human perception based) features.

Partners:

he NM2 consortium has 13 partners from 8 European countries

Aristotle University of Thessaloniki
Greece

AUTH is the bigger university in Greece with more than 2200 R&D personnel. The AIIA Lab at the Aristotle University of Thessaloniki is an active research group working for more than one decade in multimedia/digital image and video processing and related areas. Its topics of interest span the areas of biometrics, digital human-centred interfaces, indexing and retrieval by content, image/video processing, computer vision and watermarking.

rescom
Germany

Eurescom

Eurescom, the European Institute for Research and Strategic Studies in Telecommunications GmbH, was founded in 1991 by major European network operators and service providers. The organisation provides comprehensive services for initiating, managing and supporting distributed collaborative research programmes to network operators, service providers, suppliers and vendors. The success of multinational, multidisciplinary projects heavily depends on a reliable and flexible infrastructure that offers efficient administrative and technical support. Eurescom has developed an infrastructure that has proven to meet all requirements of multinational, collaborative projects with the lowest possible overhead.
BT
United Kingdom

BT is one of Europe’s leading providers of telecommunications services. Its principal activities include local, national and international telecommunications services, higher-value broadband and Internet products and services, and IT solutions. BT Exact, headquartered at Adastral Park (Martlesham Heath) in Suffolk, UK, is home to 3,500 of BT’s top scientists, engineers and business people. The employees include many who are world leaders in their specialist fields, working at the forefront of standards development and new technologies in areas such as multimedia, IP and data networks, mobile communications, network design and management, and business applications. BT Exact provides research, development and consulting services for BT – developing innovative technological ideas and solutions that translate into practical and marketable solutions for the businesses.

JOANNEUM RESEARCH
Austria

JOANNEUM RESEARCH, located in Graz, is a non-profit technology centre, concentrating onto applied R&D with a highly qualified staff of more than 380 people. They implement their know-how in all sectors of technology transfer and innovation. Their service includes specifically geared development tasks for small- and medium-sized companies, complex interdisciplinary national and international research assignments as well as tailored techno-economic consulting. The Institute of Information Systems & Information Management (http://www.joanneum.at/iis) focuses on web based information systems and digital media.

Telefónica
 I & D
Spain

Telefónica I+D is a 100% subsidiary of Telefónica S.A. Telefónica I+D was formed in 1988 in order to contribute to the technological innovation of the parent company, by performing research and development activities. Over the last few years, the line of work of Telefónica I+D has evolved to conform to the objective of becoming a services creation lab. This objective is driven by the emergence of interactive multimedia services, which are increasingly becoming a major force in the telecommunications market. Telefónica I+D is very active in all major telecommunicated-related areas where it can also offer a huge knowledge due to the experience obtained in the numerous projects in which Telefónica I+D has been involved, apart from the services deployed in Telefónica. Telefónica I+D has developed an Innovation Plan, with the objective of anticipating solutions to the challenges that the future information society will raise. All the activities in Telefónica I+D are carried out conforming to an in house methodology, supported with tools, which have been awarded an ISO 9001 Certification in 1994.

TNO
The Netherlands

TNO is an independent contract research organization, representing a wide variety of scientific disciplines, generating, marketing and applying technological knowledge for clients in the corporate and public sectors. Largest centre of innovation in the Netherlands bringing together expertise on ICT and telecommunications, but also on end-user behaviour, socio-cultural and commercial aspects.

Cambridge University CUMIS
United Kingdom
Cambridge University Moving Image Studio (CUMIS) designs and produces live action digital movies, CD ROMS, 3D models (real-time and fly throughs), animations, websites and interactive material for the University of Cambridge, for purposes of research, research dissemination, profiling and creative activity. It also produces documentary, drama, information and animation on a consultancy/commercial basis for appropriate organisations such as Screen East, the Arts Council of England, Anglia TV, and the NHS as well as local industry. It carries out research in collaboration with such local partners as Sony Computer Entertainment Europe and BT, and international partners such as MIT Media Lab, MLE and UNESCO. Its productions, which aim to push the envelope of digital media, have been exhibited in such venues as the Tate Modern, and at many international festivals. CUMIS also directly supports and contributes to University research and teaching, especially in the field of interactive digital media, working closely with CARET (Centre for Research in Applied Educational Technology), and running the Digital Research Studios of the Department of Architecture.
Goldsmiths College
United Kingdom

Goldsmiths College is the UK’s leading creative university. The Department of Computing is playing an increasingly large part in the College’s pre-eminence in the study and practice of creative, cognitive, cultural and social processes. The department is central to the development of a new inter-disciplinary research centre within the college – Goldsmiths Digital Studios – devoted to investigations of creative uses of IT and new media, and computational modelling of cognitive and cultural processes. On behalf of Goldsmiths College the Department of Computing is the main participant in NM2. Its research is focused on Artificial Intelligence, including intelligent design, knowledge representation and ontological engineering, applications of AI to visual reasoning and music, and modelling of human behaviour.

Illuminations Televidion Limited
United Kingdom

ITL is an established, highly regarded creative SME founded in 1982. The company is a leading producer and publisher of distinctive media about the arts, culture and history, and its regular clients and partners include broadcasters in the UK and abroad and leading museums. ITL has pioneered a number of innovative projects integrating network technologies with broadcast. With partners including BT and the University of Nottingham, the company developed the idea of “inhabited television” combining 3D networked virtual worlds with live broadcasting.

University of Art & Design Helsinki
Finland

Taideteollinen korkeakoulu (University of art and Design Helsinki, UIAH) gives education and pursues research in the fields of design, audio-visual communication, interactive media design and production, art education and arts. UIAH is the largest art and design school in Scandinavia: there are nearly 1600 students, 15% of which come from abroad, and 400 teachers. It has been a partner and coordinator in many national, Nordic and EU-funded projects. The area of interactive narrative production has been one of the central themes within the Media Lab’s education and research agendas since the mid-1990s. The Media Centre Lume facilitates all the major media resources, for example, TV, Theatre and Film studios as well as pre- and post-production facilities of UIAH. Lume has official national status as research and development centre to the Finnish media sector.

Malmö University
Sweden

Malmö University

The School of Arts and Communication, Malmö University, is a fairly new school, created only in 1998. It currently has four full professors, in Media and Communication Studies, Interaction Design, Informatics and Art and Technology. The research environment includes researchers from the social sciences, the humanities, from technology and from art disciplines. K3 coordinates the EU project Atelier (Architecture and Technology for inspirational Learning) and is also involved in the EU program Interact. Of particular interest for NM2 is the research program News media in the year 2003 (1998-2002), a program that dealt with creating and disseminating knowledge on ways to maintain and improve the quality of news production in digital media, with results practically applicable for Swedish news producers as well as of general scientific interest.

University of Ulster
United Kingdom
The University of Ulster is a large, modern university, formed in 1984 from the merger of the New University of Ulster and the Ulster Polytechnic. The University’s research strategy is designed to identify wealth-creating sectors, support NI industry, exploit intellectual property and provide and develop facilities for innovation and growth. The University of Ulster has been involved in EU framework projects as partners and as co-ordinator since 1990. Apart from involvement in the framework programme, the University of Ulster has also been involved in numerous other EU programmes including, Erasmus, Leonardo, Tacis, Comett, Public Health, Coal and Steel, Interreg, Life and Lingua.
Sony Netservices
Austria
Sony Netservices (SNS) was founded in April 2000 as a Joint Venture between Sony DADC and Sony Europe. SNS operates as a European software house offering B2B and B2C applications and has active experience and strengths in iDTV, e-Commerce and mobile solutions. With access to leading edge technology resources and in-house “know-how”, SNS offers their customers a highly professional and reliable consultancy, with assistance in the development of technology and technical concepts, the realisation and operation of solutions in the interactive business arena and communication solutions. With over one hundred employees in Salzburg, Berlin, Brussels and Amsterdam, SNS is a European Key Player in the provision of Internet, e-commerce and software solutions.