[go: up one dir, main page]

WO2007110822A1 - Procede et appareil pour capturer un contenu de donnes multiples - Google Patents

Procede et appareil pour capturer un contenu de donnes multiples Download PDF

Info

Publication number
WO2007110822A1
WO2007110822A1 PCT/IB2007/051023 IB2007051023W WO2007110822A1 WO 2007110822 A1 WO2007110822 A1 WO 2007110822A1 IB 2007051023 W IB2007051023 W IB 2007051023W WO 2007110822 A1 WO2007110822 A1 WO 2007110822A1
Authority
WO
WIPO (PCT)
Prior art keywords
identifier
data content
recorders
recorder
instructions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2007/051023
Other languages
English (en)
Inventor
Johannes Weda
Mauro Barbieri
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of WO2007110822A1 publication Critical patent/WO2007110822A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19665—Details related to the storage of video surveillance data
    • G08B13/19671—Addition of non-video data, i.e. metadata, to video stream
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • G11B27/3036—Time code signal

Definitions

  • the invention relates to capturing data content, more particularly to capturing data content by a plurality of recorders.
  • Capturing refers to the process of receiving a signal from a target in a capturing device.
  • the capturing device is capable of one or more of the following functions: digitizing, manipulating, compressing, storing or transmitting the captured signal.
  • the capturing device can be referred to as recorder.
  • the signal can be an audio or a video signal.
  • the signal may comprise temperature or pressure data. It is also possible to capture other forms of energy, such as infra-red, laser or X-rays.
  • a video camera can be used to capture audio/video signal.
  • Data content refers to all types of data including audio/video content.
  • Capturing an event by a number of video cameras is becoming a common practice among people.
  • a plurality of recorders are often used to capture data content of such an event for professional as well as personal recordings.
  • a plurality of recorders can also be used to capture a big scene with multiple events that take place simultaneously such as a carnival.
  • Capturing views of a target from different angles or capturing views of multiple targets can be performed by a plurality of recorders resulting in multiple data recordings.
  • the multiple data recordings are later edited and combined by a user or a service provider. The user usually searches for some visual or audible cues in the recordings in order to achieve effective synchronization. Synchronizing multiple recordings typically poses a difficult problem because audible or visual cues are difficult to find.
  • One technique comprises transmitting a time stamp to the recorders via a wireless connection to control the recorders.
  • the recorders are then controlled to perform the capturing at the time determined by the time stamp in relation to the common reference clock.
  • the capturing takes place substantially simultaneously.
  • the current techniques require prior synchronization of internal clocks of the recorders.
  • the time stamp should take into account the maximum transmission delay in the wireless network. Such requirements increase the complexity of capturing data content.
  • each of a plurality of recorders is arranged to capture data content of a respective or common target.
  • An identifier is received electronically in the plurality of recorders.
  • the identifier is associated to the data content of each one of the plurality of recorders.
  • the identifier is used for synchronizing the data content.
  • the recorder comprises receiving means for receiving an identifier electronically and processing means for associating the identifier to the captured data content.
  • the remote controller comprises generating means for generating an identifier to be associated with the captured data content of the plurality of recorders and transmitting means for transmitting the identifier electronically to the plurality of recorders.
  • the computer program is capable of controlling a recorder for capturing data content in an improved method.
  • a computer program and a medium containing a computer program containing instructions for implementing an improved method of capturing data content are disclosed herein.
  • the computer program contains instructions for receiving an identifier electronically in a recorder electronically, the recorder arranged to capture a data content of a target and for associating the identifier to the data content of the recorder.
  • Fig. 1 schematically shows a scene with a plurality of targets being captured by a plurality of recorders
  • Fig. 2 illustrates a method of capturing data content by a plurality of recorders
  • FIG. 3 schematically shows a first embodiment of a recorder for capturing data content
  • Fig. 4 schematically shows a second embodiment of a recorder for capturing data content
  • Fig. 5 schematically shows an embodiment of a remote controller for controlling recorders
  • Fig. 6 illustrates a method of synchronizing data content.
  • Corresponding numerals used in the various figures represent corresponding elements in the figures.
  • Fig. 1 schematically shows a scene 100 with a plurality of targets being recorded by a plurality of recorders.
  • a set of events or targets 160, 170, 180 are shown in the scene 100.
  • a plurality of recorders 110, 120, 130 are arranged to capture the targets 180, 170, 160 either individually or collectively.
  • a remote controller 150 can be optionally arranged to control the recorders 110, 120, 130.
  • a data capturing device capable of capturing signals and radiation such as light, sound, infra-red, laser or X-rays.
  • the invention is equally applicable to one or more of such data capturing devices.
  • a data capturing device capable of capturing light and sound from a scene of motion in the form of a sequence of images is a video camera.
  • a video camera can also be called a recorder.
  • this assumption does not exclude other types of data capturing devices.
  • Availability of cheaper cameras and availability of cameras in many mobile devices e.g. cell phones have accelerated their widespread personal use. Multiple cameras are often used in professional environments such as stage shows, news collection, surveillance and security applications. Data content captured by a camera can be manipulated, compressed, stored or transmitted.
  • data content provides a more objective and accurate capture of an event's spatial aspects.
  • Data content captured by a plurality of cameras can be edited and combined to obtain a permanent record of an event.
  • the editing can be done by a user or a service provider. There is a need to align the data content in time so that the editing can be carried out efficiently.
  • the recorded contents may sometimes contain a time stamp derived from respective internal clocks of the recorders, the internal clocks are not always synchronized. Attempts to synchronize the clocks manually may still result in an error of one second which translates to a mismatch of a large number of e.g. 30 frames in case of video recordings. A large error in synchronisation may adversely affect the editing.
  • Visual and audible cues are often used in synchronization and manual editing of video content. This is a difficult and time consuming process.
  • Fig. 2 illustrates a method 200 of capturing data content by a plurality of recorders.
  • a plurality of recorders 110, 120, 130 are arranged to capture data content of a respective or common target as explained in the description of Fig. 1.
  • an identifier 201 is received electronically in the plurality of recorders 110, 120, 130.
  • the identifier 201 is associated to the recorded content of each one of the plurality of recorders.
  • the identifier 201 can be a marker or a symbol.
  • the identifier 201 may represent a time source, a counter or a random number.
  • the identifier 201 is chosen such that it is easily identifiable in the recorded content at the time of editing.
  • the identifier 201 can be optionally received from an independent device such as a remote controller, capable of communicating to the plurality of recorders.
  • the identifier 201 is generated by any one of the plurality of recorders and transmitted electronically to other recorders, besides being locally received by the first recorder.
  • the identifier 201 might be sent at regular or irregular intervals to multiple recorders.
  • the transmission of the identifier can be performed automatically in case of recorders being continuously in use e.g. surveillance cameras.
  • the identifier can be modulated and transmitted through wired or wireless means. Examples of wireless means are radio frequency and infra-red.
  • the identifier 201 is associated to the recorded content of all the recorders immediately after it is received in the recorders. Data content is generally recorded in frames with delimiters.
  • the identifier can be associated with the frame number and/or the time of capture.
  • the identifier may be recorded along with the data content e.g. within an image frame of a video sequence. It is also possible to record the identifier separately e.g. in the header file or in a separate file.
  • a pointer to the data content and the identifier can be stored in an association table.
  • the identifier is optionally associated with the immediate next frame of data, without introducing a delay.
  • the identifier is associated with the data content substantially simultaneously in all the recorders. If the data content is transmitted to a central server, the identifier and the association information are also transmitted.
  • the identifier can be encoded and the encoded bits can be included in the compressed data stream.
  • the identifier can be included in the extra information space available in the compressed video and audio data, compressed according to one of the well-known data compression standards e.g. MPEG.
  • an identifier can be received after the cameras have started recoding an event.
  • a camera can optionally receive the identifier before capturing an event.
  • the identifier is associated with the time of reception noted from the camera's local clock.
  • the association information can be stored in a table for later use.
  • two cameras A and B are capturing an event.
  • a first identifier ID 1 is transmitted, optionally in the initial phase of capturing.
  • ID 1 is associated with the time of reception at time t ⁇ in camera A and time t 2 in camera B .
  • the time instances t ⁇ and t 2 are derived from the internal clocks of the recorders A and B which are not necessarily synchronized.
  • a third camera C When a third camera C is switched on, another identifier ID 2 can be received in the third camera C at time t 3 and also in both the cameras A and B . Accordingly, the identifier ID 2 can be associated with the time of reception at the respective cameras. Synchronization of data contents captured by the cameras A, B and C can be achieved manually or automatically by time alignment using the time information t 1 5 t 2 and t 3 . A time difference of the internal clocks of the recorders can be computed from the frame in which the identifier is included. From the time difference, time alignment of data content can be achieved. In case of the identifier being a symbol, time alignment is achieved by coinciding the frames that contain the identifier. Thus the method offers a simple and elegant scheme of synchronisation.
  • Fig. 3 schematically shows an embodiment of a recorder for capturing data content.
  • the recorder 300 comprises receiving means 310 and processing means 320.
  • the receiving means 310 is arranged to receive an identifier 301 electronically.
  • the identifier can be received either from one of the recorders or from a remote controller arranged to communicate with the recorders.
  • the identifier 301 may be received in a modulated signal. Accordingly, the receiving means 310 may be arranged to demodulate the signal and to decode the identifier.
  • the processing means 320 is arranged to associate the identifier to the data content.
  • the processing means 320 is optionally arranged to capture the identifier within an image frame or include it as extra information in a compressed data stream. It is also possible to store the identifier and associated frame number or time instant (derived from the local clock of the recorder) in a separate table.
  • Fig. 4 schematically shows a second embodiment of a recorder 400 for capturing data content.
  • the recorder 400 is arranged to include a recorder 300 as explained in the description of Fig. 3, generating means 410 for generating an identifier 411, and transmitting means 420 for transmitting the identifier 411 electronically to other recorders.
  • the identifier 411 can be a symbol or a number.
  • the identifier 411 can be optionally chosen to be a timing information derived from the internal clock of the recorder 400.
  • the transmitting means 420 can be optionally arranged to contain encoding means and modulating means.
  • the output signal 421 of the transmitting means 420 can be a radio -frequency or infra-red signal.
  • Fig. 5 schematically shows an embodiment of a remote controller for controlling recorders.
  • the remote controller 500 comprises generating means 510 and transmitting means 520.
  • the generating means 510 generates an identifier 511 that can be a symbol or a random number or timing information derived from the internal clock of the remote controller 500.
  • the identifier can be derived from a local clock source or from a random number generator optionally made available within the remote controller 500.
  • the remote controller can be optionally arranged to transmit commands for all the functions e.g. zoom, focus, record etc., of a recorder.
  • the remote controller 500 can be preferably arranged to control the functions of a plurality of recorders.
  • Fig. 6 illustrates a method of synchronizing data content 600.
  • Data content 601, 602 of a single or multiple targets captured by two recorders are received in respective detecting steps 610, 620.
  • a first identifier 611 and the second identifier 621 are detected from the data contents 601 and 602 respectively.
  • the detection of an identifier can be performed by a number of methods, corresponding to the method by which the identifier was associated to and included in the data content.
  • the possibilities include, but not restricted to inclusion in a separate file, an association table, a header information or within a data frame, typically in an image frame.
  • a frame number or a timestamp associated with the identifier can also be extracted.
  • the frames corresponding to the same identifier are matched in step 630 and time alignment of the two data streams 601 and 602 is achieved in the synchronization step 640.
  • the alignment can be verified by an additional step called a verification step.
  • a user can verify the contents manually.
  • the verification can be optionally carried out automatically by well known video content analysis techniques.
  • the verification step is typically required if there is an ambiguity due to one or more of the following instances : (a) identifier is found in two of the three data content; (b) identifier is identical at different instances of time; (c) one of the cameras was switched off for a duration within which the identifier was received.
  • the synchronization step and verification step may be repeated till a satisfactory time alignment is achieved.
  • a time difference between the local clocks of the respective recorders can be computed if respective timestamps are available and the time difference may be conveyed to a subsequent data editing system.
  • the synchronization can also be carried out by a set of computer instructions.
  • the disclosed method can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer.
  • several of these means can be embodied by one and the same item of computer readable software or hardware.
  • the mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Library & Information Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

La présente invention concerne un procédé pour capturer un contenu de donnés par une pluralité d'enregistreurs. La synchronisation temporelle d'enregistrements de données multiples est un procédé long et ennuyeux. Les procédés actuellement disponibles assurent la synchronisation temporelle en envoyant un horodatage pour déclencher les enregistreurs de manière sensiblement simultanée. Dans un procédé amélioré de capture du contenu de données par une pluralité d'enregistreurs présenté par l'invention, un identifiant arrive dans tous les enregistreurs de manière électronique et il est associé au contenu de données enregistrées. L'identifiant est utilisé dans la synchronisation du contenu de données.
PCT/IB2007/051023 2006-03-28 2007-03-23 Procede et appareil pour capturer un contenu de donnes multiples Ceased WO2007110822A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP06111834.5 2006-03-28
EP06111834 2006-03-28

Publications (1)

Publication Number Publication Date
WO2007110822A1 true WO2007110822A1 (fr) 2007-10-04

Family

ID=38283938

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2007/051023 Ceased WO2007110822A1 (fr) 2006-03-28 2007-03-23 Procede et appareil pour capturer un contenu de donnes multiples

Country Status (1)

Country Link
WO (1) WO2007110822A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008023501B4 (de) * 2008-05-09 2011-04-14 Visumotion Gmbh Verfahren und Anordnung zur synchronen Aufzeichnung von mindestens zwei Videodatenströmen unterschiedlicher Formate
US20110157389A1 (en) * 2009-12-29 2011-06-30 Cognex Corporation Distributed vision system with multi-phase synchronization
WO2013040030A1 (fr) * 2011-09-13 2013-03-21 Cognex Corporation Système de vision artificielle maître et esclave
US8896708B2 (en) * 2008-10-31 2014-11-25 Adobe Systems Incorporated Systems and methods for determining, storing, and using metadata for video media content
WO2017078810A1 (fr) * 2015-11-06 2017-05-11 Intel Corporation Données d'image de synchronisation capturées à partir d'un réseau de caméra avec des données non d'image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996025710A1 (fr) * 1995-02-14 1996-08-22 Atari Games Corporation Systeme a cameras multiples pour l'enregistrement d'images synchrone a partir de points de vue multiples
WO1998016059A1 (fr) * 1996-10-08 1998-04-16 Gte Laboratories Incorporated Dispositif video personnel, et systeme et procede de fabrication de ce dernier
US6353461B1 (en) * 1997-06-13 2002-03-05 Panavision, Inc. Multiple camera video assist control system
SE527463C2 (sv) * 2004-02-27 2006-03-14 Acutulus Ab Digitalt kanalmedium för televisionsutsändning av interaktiva program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1996025710A1 (fr) * 1995-02-14 1996-08-22 Atari Games Corporation Systeme a cameras multiples pour l'enregistrement d'images synchrone a partir de points de vue multiples
WO1998016059A1 (fr) * 1996-10-08 1998-04-16 Gte Laboratories Incorporated Dispositif video personnel, et systeme et procede de fabrication de ce dernier
US6353461B1 (en) * 1997-06-13 2002-03-05 Panavision, Inc. Multiple camera video assist control system
SE527463C2 (sv) * 2004-02-27 2006-03-14 Acutulus Ab Digitalt kanalmedium för televisionsutsändning av interaktiva program

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008023501B4 (de) * 2008-05-09 2011-04-14 Visumotion Gmbh Verfahren und Anordnung zur synchronen Aufzeichnung von mindestens zwei Videodatenströmen unterschiedlicher Formate
US8896708B2 (en) * 2008-10-31 2014-11-25 Adobe Systems Incorporated Systems and methods for determining, storing, and using metadata for video media content
DE112010005042B4 (de) * 2009-12-29 2016-11-24 Cognex Corporation Dezentrales Bildverarbeitungssystem mit Mehrphasensynchronisierung
CN102640490B (zh) * 2009-12-29 2016-04-20 康耐视公司 分布式多相同步的视觉系统
CN105915781B (zh) * 2009-12-29 2020-02-11 康耐视公司 一种用于同步多个视觉系统处理器的结果的方法
JP2013516146A (ja) * 2009-12-29 2013-05-09 コグネックス・コーポレイション マルチフェーズ同期化を有する分散視覚システム
US8704903B2 (en) * 2009-12-29 2014-04-22 Cognex Corporation Distributed vision system with multi-phase synchronization
WO2011090660A1 (fr) * 2009-12-29 2011-07-28 Cognex Corporation Système de vision distribué à synchronisation multiphase
US20150049212A1 (en) * 2009-12-29 2015-02-19 Cognex Corporation Distributed Vision System with Multi-Phase Synchronization
CN102640490A (zh) * 2009-12-29 2012-08-15 康耐视公司 分布式多相同步的视觉系统
US9325894B2 (en) 2009-12-29 2016-04-26 Cognex Corporation Distributed vision system with multi-phase synchronization
CN105915781A (zh) * 2009-12-29 2016-08-31 康耐视公司 分布式多相同步的视觉系统
US20110157389A1 (en) * 2009-12-29 2011-06-30 Cognex Corporation Distributed vision system with multi-phase synchronization
WO2013040030A1 (fr) * 2011-09-13 2013-03-21 Cognex Corporation Système de vision artificielle maître et esclave
WO2017078810A1 (fr) * 2015-11-06 2017-05-11 Intel Corporation Données d'image de synchronisation capturées à partir d'un réseau de caméra avec des données non d'image
US9654672B1 (en) 2015-11-06 2017-05-16 Intel Corporation Synchronized capture of image and non-image sensor data

Similar Documents

Publication Publication Date Title
CN106411915B (zh) 用于多媒体捕获的嵌入式装置
CN113906734B (zh) 同步控制装置、同步控制方法以及同步控制程序
KR102167276B1 (ko) 복수의 동영상 처리를 위한 장치 및 방법
WO2007110822A1 (fr) Procede et appareil pour capturer un contenu de donnes multiples
US8750579B2 (en) Image information processing apparatus and image information processing method
AU2019204751B2 (en) Embedded appliance for multimedia capture
CA2914803C (fr) Dispositif integre de capture multimedia
AU2013254937B2 (en) Embedded Appliance for Multimedia Capture
HK40061200A (en) Synchronous control device, synchronous control method, and synchronous control program
HK1194883A (en) Embedded appliance for multimedia capture
HK1194883B (en) Embedded appliance for multimedia capture
HK40061200B (zh) 同步控制装置、同步控制方法以及同步控制程序
AU2012202843A1 (en) Embedded appliance for multimedia capture
HK1136063B (en) Embedded appliance for multimedia capture
JP2015029210A (ja) ファイル再生システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07735235

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07735235

Country of ref document: EP

Kind code of ref document: A1