[go: up one dir, main page]

WO2007004110A3 - System and method for the alignment of intrinsic and extrinsic audio-visual information - Google Patents

System and method for the alignment of intrinsic and extrinsic audio-visual information Download PDF

Info

Publication number
WO2007004110A3
WO2007004110A3 PCT/IB2006/052088 IB2006052088W WO2007004110A3 WO 2007004110 A3 WO2007004110 A3 WO 2007004110A3 IB 2006052088 W IB2006052088 W IB 2006052088W WO 2007004110 A3 WO2007004110 A3 WO 2007004110A3
Authority
WO
WIPO (PCT)
Prior art keywords
intrinsic
extrinsic
information
source
extrinsic information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2006/052088
Other languages
French (fr)
Other versions
WO2007004110A2 (en
Inventor
Lalitha Agnihotri
Mauro Barbieri
Nevenka Dimitrova
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of WO2007004110A2 publication Critical patent/WO2007004110A2/en
Publication of WO2007004110A3 publication Critical patent/WO2007004110A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/022—Electronic editing of analogue information signals, e.g. audio or video signals
    • G11B27/028—Electronic editing of analogue information signals, e.g. audio or video signals with computer assistance
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/327—Table of contents
    • G11B27/329—Table of contents on a disc [VTOC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/18—Arrangements for synchronising broadcast or distribution via plural systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/59—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/76—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet
    • H04H60/81—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself
    • H04H60/82—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself the transmission system being the Internet
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G10L2021/105—Synthesis of the lips movements from speech, e.g. for talking heads

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • General Engineering & Computer Science (AREA)
  • Machine Translation (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A system and method are provided for the alignment of intrinsic and extrinsic audio-visual information using classifications of the information and is particularly useful for aligning intrinsic and extrinsic information of different languages. The system comprises an intrinsic content analyser (2,3) that is communicatively connected to an audio-visual source (1), such as a film source that may be in a dubbed language. The film is searched for intrinsic data that is extracted and classified. Further, the system comprises an extrinsic content analyser (5,6) communicatively connected to an extrinsic information source (4), such as an original language film screenplay available through the Internet. The system searches the extrinsic information source, retrieves and then classifies the extrinsic information. The intrinsic and extrinsic information is aligned by correlating (7) the classifications to provide a multi-source data structure. The correlation is independent of the language of the intrinsic and the extrinsic information.
PCT/IB2006/052088 2005-06-30 2006-06-26 System and method for the alignment of intrinsic and extrinsic audio-visual information Ceased WO2007004110A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US69565405P 2005-06-30 2005-06-30
US60/695,654 2005-06-30

Publications (2)

Publication Number Publication Date
WO2007004110A2 WO2007004110A2 (en) 2007-01-11
WO2007004110A3 true WO2007004110A3 (en) 2007-03-22

Family

ID=37478631

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/052088 Ceased WO2007004110A2 (en) 2005-06-30 2006-06-26 System and method for the alignment of intrinsic and extrinsic audio-visual information

Country Status (1)

Country Link
WO (1) WO2007004110A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8935269B2 (en) 2006-12-04 2015-01-13 Samsung Electronics Co., Ltd. Method and apparatus for contextual search and query refinement on consumer electronics devices
US8938465B2 (en) 2008-09-10 2015-01-20 Samsung Electronics Co., Ltd. Method and system for utilizing packaged content sources to identify and provide information based on contextual information
US9286385B2 (en) 2007-04-25 2016-03-15 Samsung Electronics Co., Ltd. Method and system for providing access to information of potential interest to a user

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8732154B2 (en) 2007-02-28 2014-05-20 Samsung Electronics Co., Ltd. Method and system for providing sponsored information on electronic devices
US8843467B2 (en) 2007-05-15 2014-09-23 Samsung Electronics Co., Ltd. Method and system for providing relevant information to a user of a device in a local network
US8115869B2 (en) 2007-02-28 2012-02-14 Samsung Electronics Co., Ltd. Method and system for extracting relevant information from content metadata
US8209724B2 (en) 2007-04-25 2012-06-26 Samsung Electronics Co., Ltd. Method and system for providing access to information of potential interest to a user
US9100723B2 (en) 2006-03-07 2015-08-04 Samsung Electronics Co., Ltd. Method and system for managing information on a video recording
US8863221B2 (en) 2006-03-07 2014-10-14 Samsung Electronics Co., Ltd. Method and system for integrating content and services among multiple networks
US8200688B2 (en) 2006-03-07 2012-06-12 Samsung Electronics Co., Ltd. Method and system for facilitating information searching on electronic devices
US8195650B2 (en) 2007-02-28 2012-06-05 Samsung Electronics Co., Ltd. Method and system for providing information using a supplementary device
US8510453B2 (en) * 2007-03-21 2013-08-13 Samsung Electronics Co., Ltd. Framework for correlating content on a local network with information on an external network
US8176068B2 (en) 2007-10-31 2012-05-08 Samsung Electronics Co., Ltd. Method and system for suggesting search queries on electronic devices
US8010536B2 (en) 2007-11-20 2011-08-30 Samsung Electronics Co., Ltd. Combination of collaborative filtering and cliprank for personalized media content recommendation
US8332414B2 (en) 2008-07-01 2012-12-11 Samsung Electronics Co., Ltd. Method and system for prefetching internet content for video recorders
GB201101496D0 (en) * 2011-01-28 2011-03-16 Ocean Blue Software Television content adaptor
WO2014018652A2 (en) 2012-07-24 2014-01-30 Adam Polak Media synchronization

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2117168A (en) * 1982-03-23 1983-10-05 Phillip Jeffrey Bloom Method and apparatus for use in processing signals
EP0540403A1 (en) * 1991-10-30 1993-05-05 Etablissement Public Télédiffusion de France Video analysis system for editing a broadcasted or recorded television program and its use for post-production techniques, particularly multilingual
EP0682344A2 (en) * 1994-05-12 1995-11-15 Elop Electro-Optics Industries Ltd., And Television Multilingue S.A. Movie processing system
GB2366110A (en) * 2000-06-23 2002-02-27 Ibm Synchronising audio and video.
US20020093591A1 (en) * 2000-12-12 2002-07-18 Nec Usa, Inc. Creating audio-centric, imagecentric, and integrated audio visual summaries
US20030107592A1 (en) * 2001-12-11 2003-06-12 Koninklijke Philips Electronics N.V. System and method for retrieving information related to persons in video programs
WO2004040576A1 (en) * 2002-11-01 2004-05-13 Synchro Arts Limited Methods and apparatus for use in sound replacement with automatic synchronization to images
US20050228663A1 (en) * 2004-03-31 2005-10-13 Robert Boman Media production system using time alignment to scripts

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2117168A (en) * 1982-03-23 1983-10-05 Phillip Jeffrey Bloom Method and apparatus for use in processing signals
EP0540403A1 (en) * 1991-10-30 1993-05-05 Etablissement Public Télédiffusion de France Video analysis system for editing a broadcasted or recorded television program and its use for post-production techniques, particularly multilingual
EP0682344A2 (en) * 1994-05-12 1995-11-15 Elop Electro-Optics Industries Ltd., And Television Multilingue S.A. Movie processing system
GB2366110A (en) * 2000-06-23 2002-02-27 Ibm Synchronising audio and video.
US20020093591A1 (en) * 2000-12-12 2002-07-18 Nec Usa, Inc. Creating audio-centric, imagecentric, and integrated audio visual summaries
US20030107592A1 (en) * 2001-12-11 2003-06-12 Koninklijke Philips Electronics N.V. System and method for retrieving information related to persons in video programs
WO2004040576A1 (en) * 2002-11-01 2004-05-13 Synchro Arts Limited Methods and apparatus for use in sound replacement with automatic synchronization to images
US20050228663A1 (en) * 2004-03-31 2005-10-13 Robert Boman Media production system using time alignment to scripts

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8935269B2 (en) 2006-12-04 2015-01-13 Samsung Electronics Co., Ltd. Method and apparatus for contextual search and query refinement on consumer electronics devices
US9286385B2 (en) 2007-04-25 2016-03-15 Samsung Electronics Co., Ltd. Method and system for providing access to information of potential interest to a user
US8938465B2 (en) 2008-09-10 2015-01-20 Samsung Electronics Co., Ltd. Method and system for utilizing packaged content sources to identify and provide information based on contextual information

Also Published As

Publication number Publication date
WO2007004110A2 (en) 2007-01-11

Similar Documents

Publication Publication Date Title
WO2007004110A3 (en) System and method for the alignment of intrinsic and extrinsic audio-visual information
KR102069698B1 (en) Apparatus and Method Correcting Linguistic Analysis Result
WO2005055196A3 (en) System & method for integrative analysis of intrinsic and extrinsic audio-visual data
CN103176963B (en) Chinese sentence meaning structure model automatic labeling method based on CRF ++
US8756064B2 (en) Method and system for creating frugal speech corpus using internet resources and conventional speech corpus
WO2007056535A3 (en) Method and apparatus for timed tagging of media content
CA2656425C (en) Recognizing text in images
Yilmaz et al. A longitudinal bilingual Frisian-Dutch radio broadcast database designed for code-switching research
US20120010873A1 (en) Sentence translation apparatus and method
WO2007064640A3 (en) Detecting repeating content in broadcast media
WO2010068068A3 (en) Information search method and information provision method based on user's intention
CA2629999C (en) Information exploration systems and methods
WO2007076080A3 (en) Analyzing content to determine context and serving relevant content based on the context
CA2520420A1 (en) Apparatus and method for spoken language understanding by using semantic role labeling
CN103956166A (en) Multimedia courseware retrieval system based on voice keyword recognition
Ostendorf et al. A sequential repetition model for improved disfluency detection.
CN104391885A (en) Method for extracting chapter-level parallel phrase pair of comparable corpus based on parallel corpus training
CN103246641A (en) Text semantic information analyzing system and method
WO2007106148A3 (en) Internet guide link matching system
AU2003303419A1 (en) Method and system to mark an audio signal with metadata
CN107943786A (en) A kind of Chinese name entity recognition method and system
Aker et al. Projection of argumentative corpora from source to target languages
DE602004013799D1 (en) REAL-TIME MEDIA DICTIONARY
WO2006040727A3 (en) A system and a method of processing audio data to generate reverberation
WO2010074426A3 (en) Translation service provision method and a system therefor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06765869

Country of ref document: EP

Kind code of ref document: A2