[go: up one dir, main page]

WO2000048401A1 - Appareil et procede de marquage en filigrane de signaux video - Google Patents

Appareil et procede de marquage en filigrane de signaux video Download PDF

Info

Publication number
WO2000048401A1
WO2000048401A1 PCT/GB2000/000454 GB0000454W WO0048401A1 WO 2000048401 A1 WO2000048401 A1 WO 2000048401A1 GB 0000454 W GB0000454 W GB 0000454W WO 0048401 A1 WO0048401 A1 WO 0048401A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
code
moving
images
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/GB2000/000454
Other languages
English (en)
Inventor
Jia Hong Yin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central Research Laboratories Ltd
Original Assignee
Central Research Laboratories Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central Research Laboratories Ltd filed Critical Central Research Laboratories Ltd
Priority to EP00902787A priority Critical patent/EP1151614A1/fr
Priority to AU24526/00A priority patent/AU2452600A/en
Priority to JP2000599212A priority patent/JP2002537697A/ja
Priority to KR1020017010189A priority patent/KR20010102075A/ko
Publication of WO2000048401A1 publication Critical patent/WO2000048401A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0021—Image watermarking
    • G06T1/0028—Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0021—Image watermarking
    • G06T1/005—Robust watermarking, e.g. average attack or collusion attack resistant
    • G06T1/0057—Compression invariant watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/913—Television signal processing therefor for scrambling ; for copy protection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/08—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division
    • H04N7/081—Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division the additional information signals being transmitted by means of a subcarrier
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/913—Television signal processing therefor for scrambling ; for copy protection
    • H04N2005/91307—Television signal processing therefor for scrambling ; for copy protection by adding a copy protection signal to the video signal
    • H04N2005/91335—Television signal processing therefor for scrambling ; for copy protection by adding a copy protection signal to the video signal the copy protection signal being a watermark

Definitions

  • the present invention relates to an apparatus for, and method of, encoding information into and decoding information from a sequence of moving images.
  • the technique of coding information into a sequence of video or cinematographic images is also known as electronic watermarking.
  • the invention is therefore particularly, but not exclusively, suitable for electronic watermarking all types of media having moving images stored thereon or involving the transmission or broadcast of moving image data.
  • data can be in either digital or analogue form.
  • data is transmitted in digital form.
  • One reason for this is because larger amounts of data can be transmitted in digital form than in analogue form.
  • Another is because digital signals are less prone to interference and can easily be recovered by using error correction techniques if received images are distorted.
  • side effects of facile access to digital data complaints of copyright infringement and for tampering or modification of content are increasing.
  • UK Patent Application GB-A-2 305 803 (Philips) describes a method of correcting errors which occur in a telecine scanning process. The method involves sampling an area of an image which includes a structure and comparing this sampled structure with subsequently sampled structures obtained from subsequent image frames. Use of motion vectors obtained is then made to correct picture steadiness.
  • the method of coding and decoding information into an image comprises: dividing the image into MxN blocks, selectively encoding (decoding) information into selected blocks in such a way as not to be visible to a human eye, wherein in a decoding stage, the decoding is synchronised to the occurrence of the blocks for analysis of image information.
  • the size of insertions and their positions are fixed by processing the image in a block-by- block manner, typically with a block size of 8 by 8 pixels.
  • the present invention arose to overcome this and associated problems.
  • a method of encoding information into a sequence of images comprising a first image and a subsequent image; the method comprising the steps of: locating an edge in the first image, locating a corresponding edge in a subsequent image, comparing relative positions of the corresponding edges in said images, thereby identifying at least one relatively moving edge; inserting a first code into said moving edge and inserting a second code into said static edge.
  • a corresponding apparatus is also provided.
  • the invention thus solves the problem of preserving both static and moving encoded information during subsequent image compression.
  • Another advantage of the present invention over the arrangement described in UK Patent Application GB-A-2305 803 (Philips) is the fact that the present invention is capable of diagrammatically encoding watermark code into a signal to be stored, or broadcast.
  • the apparatus and method identify moving, and therefore static edges, in an image sequence and treat moving and static edges as separate channels each carrying its own code(s).
  • identification information is encoded into both moving edges (which are not compressed to any extent) and static edges independently.
  • Both channels may carry identical codes if required.
  • different codes may be inserted into moving or static edges.
  • the code insertion technique of the present invention may be used to embed codes in moving edge pixels.
  • Means is advantageously provided to preselect said relative moving edges so that a code can be inserted into switchable sequences. If there is not movement in a sequence of images, no code is inserted and a different sequence may be selected.
  • coded information is inserted into an image in so called strongly featured regions of an image in such a way that the code is resistant to image compression and/or low pass filtering, but is not visible to the human eye.
  • strongly featured regions of images are textured regions or lines, or edges between two regions of different luminance or contrast. In such regions, it is possible to insert a relatively large amount of information without significantly altering the image.
  • Information encoded into an image may be used for a variety of purposes, for example:
  • Edge regions are known to have masking properties because of the way the human visual system works.
  • the local orientation of edges are important, and there are specific structures in the primary visual cortex of the human brain, for detecting the presence of an edge and its local orientation.
  • Coded information is preferably inserted into an image so that it does not alter the local orientation of certain features.
  • the insertions are preferably made along the length of a local section of edge.
  • the insertions are preferably made as a 2D function, by using for example an ellipse which is aligned to the local orientation of the edge.
  • apparatus for decoding information from an encoded moving image sequence comprising: means for identifying a region in an image in the sequence, means for determining whether the said region is a moving region or static region and means for recovering code from at least said moving image region.
  • FIG 1 shows diagrammatically an embodiment of an encoder according to the invention
  • Figure 2 shows an embodiment of a decoder according to the invention
  • Figure 3 shows a sketch with edges of images in bold
  • Figure 4 shows the sketch of Figure 3, with only moving edges highlighted in bold;
  • Figure 5 shows diagrammatically an embodiment of the invention, incorporated in a surveillance camera
  • Figure 6 is a diagrammatical view of a supermarket in which the surveillance camera of Figure 5 may be used;
  • Figure 7 is an example of an image of pedestrian flow through a supermarket check-out area
  • Figure 8 is a vector diagram representative of the pedestrian flow of Figure 7.
  • Figures 1 and 2 show block diagrams of an encoder 10 and decoder 20 respectively.
  • the invention will now be described in the encoding sequence with reference to Figure 1.
  • the signal is split into two portions: a moving image signal 22 and a static image signal 23. This can be according to a standard MPEG protocol or a different proprietary image analysis (compression) protocol.
  • a first code is inserted into the static image signal and a second code is inserted into the moving image signal. These signals are then transmitted via separate channels.
  • Moving edges and static edges may be defined as the following:
  • the static edge image SE(x,y) may be obtained using the following equation:
  • the coded information is treated the same as a moving image by any compression algorithm or protocol such as MPEG.
  • Static code is included in early sequences of a series of encoded images so that when compressed the encoded information remains in tact.
  • Decoder 20 receives encoded images signal 24.
  • the image signal 24 is split into a moving image signal 26.
  • Edge diffraction then occurs.
  • Edge detector 27 detects edges in moving images.
  • Edge detector 28 detects edges in static images.
  • Detected edge signals 29 and 30 are subtracted one from another at subtractor 31 and a static edge is decoded at static edge decoder 32.
  • Moving edges are decoded directly from a signal presented by moving edge detector 27 to the moving edge decoder 33.
  • Static edge decoded signals 34 and moving edge decoded signals 35 are added at 36 to provide an electronic watermark signal which indicates for example, the origin of a signal or the owner of copyright in an image sequence or piece of video footage.
  • the invention may be used to encode information onto all forms of recording media.
  • videotape video disc
  • compact disc CD or DVD
  • the invention may be incorporated into video broadcasting systems, video editing equipment, video monitoring equipment, televisions, computers or any other piece of electronic equipment used to produce or view video images, including a video cassette recorder and/or a set-top box.
  • the invention has been described, by way of example only, and it will be understood that variation may be made to the embodiments described without departing from the scope of the invention.
  • the invention may be deployed within shops or other public places in order to monitor activity of purchasers or members of the public.
  • the invention allows for the automation of data capture relating to motion of, say, shoppers and optionally, its subsequent encoding for transmission.
  • Figure 6 represents the layout of a typical supermarket.
  • the system to be implemented uses real-time video data from appropriately positioned Close Circuit Television (CCTV) cameras to monitor the customers arriving at entrance 102, check-outs 106 and exit 104.
  • CCTV Close Circuit Television
  • the system uses information extracted from video data to estimate net arrival/departure rate of customers and from this maintains an estimate of the number of customers inside the store at any time. This together with the information from the aforementioned areas enables the system to maintain estimates of the number of customers:
  • a correlation between the number of customers arriving at the check-outs and the number of customers arriving at the store at some earlier time allows the system to adaptively optimise parameters of a prediction model of the store.
  • This optimised prediction model enables the system to estimate impending customer demand for checkouts in advance of the need becoming apparent. This allows for timely staff redeployment to avoid any reduction in customer service.
  • Output from the system is preferably in two main forms:
  • the system will be capable of producing a statistical report concerning the arrival rate of customers and the length of time they stay in the store. This data will be suitable for planning overall staff levels and will be a useful source of marketing information.
  • Imaging equipment may be used in conjunction with a microprocessor dedicated to determining length of queues or regions of a store visited by an unusually large or small number of customers. This may be particularly advantageous in predicting employee allocation at check-outs for example.
  • the system may be configured to monitor automatically a specific region of a store or even a specific aisle or display. By adapting control and analytical software the system may be arranged to provide a statistical assessment of how popular or unpopular a particular type of marketing or location of a product is performing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)
  • Television Signal Processing For Recording (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un appareil et un procédé pour coder et décoder des informations contenues dans une séquence d'images dynamiques telle que les images vidéo. On connaît des schémas pour insérer des codes dans les images à des fins d'identification des propriétaires de ces images. Les schémas existants présentent cependant un défaut: certaines techniques de compression des données provoquent l'effacement ou la dégradation du code, au point que celui-ci n'est plus reconnaissable. La présente invention permet de résoudre ce problème grâce à l'identification des parties dynamiques et statiques d'une image dans une séquence d'images et à l'existence de deux canaux séparés, l'un pour la partie mobile d'une image et l'autre pour sa partie statique. On peut ensuite insérer un ou plusieurs codes dans le canal pour images statiques et dans celui pour images dynamiques, ce qui permet de préserver les séquences d'images dynamiques, même après la compression d'images ou le filtrage passe-bas.
PCT/GB2000/000454 1999-02-11 2000-02-11 Appareil et procede de marquage en filigrane de signaux video Ceased WO2000048401A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP00902787A EP1151614A1 (fr) 1999-02-11 2000-02-11 Appareil et procede de marquage en filigrane de signaux video
AU24526/00A AU2452600A (en) 1999-02-11 2000-02-11 Apparatus and method for videosignal watermarking
JP2000599212A JP2002537697A (ja) 1999-02-11 2000-02-11 ビデオ信号すかしのための装置および方法
KR1020017010189A KR20010102075A (ko) 1999-02-11 2000-02-11 비디오신호 워터마킹을 위한 장치 및 방법

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB9903126.2 1999-02-11
GB9903126A GB2347295A (en) 1999-02-11 1999-02-11 Encoding and decoding of watermarks into moving images using edge detection

Publications (1)

Publication Number Publication Date
WO2000048401A1 true WO2000048401A1 (fr) 2000-08-17

Family

ID=10847578

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2000/000454 Ceased WO2000048401A1 (fr) 1999-02-11 2000-02-11 Appareil et procede de marquage en filigrane de signaux video

Country Status (6)

Country Link
EP (1) EP1151614A1 (fr)
JP (1) JP2002537697A (fr)
KR (1) KR20010102075A (fr)
AU (1) AU2452600A (fr)
GB (1) GB2347295A (fr)
WO (1) WO2000048401A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2368136A1 (fr) 1999-03-18 2000-09-21 British Broadcasting Corporation Filigrane numerique
GB2386495B (en) * 1999-03-18 2003-10-29 British Broadcasting Corp Watermarking
KR101242494B1 (ko) 2006-07-24 2013-03-12 삼성전자주식회사 주파수 영역에서의 비디오 핑거프린팅 장치 및 방법
JP5321363B2 (ja) * 2009-09-01 2013-10-23 富士通株式会社 動画像符号化装置、動画像符号化方法及び動画像符号化用コンピュータプログラムならびに映像伝送装置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998006216A1 (fr) * 1996-08-07 1998-02-12 Central Research Laboratories Limited Procede et appareil de codage d'informations
WO1998017061A1 (fr) * 1996-10-15 1998-04-23 Ibm Japan Ltd. Procede d'escamotage de donnees et procede d'extraction de donnees

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19536691B4 (de) * 1995-09-30 2008-04-24 Bts Holding International B.V. Verfahren und Anordnung zur Korrektur von Bildstandsfehlern bei der fernsehmäßigen Filmabtastung

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998006216A1 (fr) * 1996-08-07 1998-02-12 Central Research Laboratories Limited Procede et appareil de codage d'informations
WO1998017061A1 (fr) * 1996-10-15 1998-04-23 Ibm Japan Ltd. Procede d'escamotage de donnees et procede d'extraction de donnees
EP0935392A1 (fr) * 1996-10-15 1999-08-11 Ibm Japan Ltd. Procede d'escamotage de donnees et procede d'extraction de donnees

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
M D SWANSON ET AL: "Object-based transparent video watermarking", IEEE WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING. PROCEEDINGS OF SIGNAL PROCESSING SOCIETY WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING,XX,XX, 23 June 1997 (1997-06-23), pages 369 - 374, XP002117815 *
MACQ B M ET AL: "CRYPTOLOGY FOR DIGITAL TV BROADCASTING", PROCEEDINGS OF THE IEEE,US,IEEE. NEW YORK, vol. 83, no. 6, 1 June 1995 (1995-06-01), pages 944 - 957, XP000518745, ISSN: 0018-9219 *
OHBUCHI R ET AL: "Data embedding algorithms for geometrical and non-geometrical targets in three-dimensional polygonal models", COMPUTER COMMUNICATIONS,NL,ELSEVIER SCIENCE PUBLISHERS BV, AMSTERDAM, vol. 21, no. 15, 1 October 1998 (1998-10-01), pages 1344 - 1354, XP004145248, ISSN: 0140-3664 *
TU ET AL.: "Image Sequence Coding using Data Classification", SPIE - APPLICATIONS OF DIGITAL IMAGE PROCESSING XIII, vol. 1349, 10 July 1990 (1990-07-10), San Diego, CA, USA, pages 145 - 154, XP000910486 *

Also Published As

Publication number Publication date
AU2452600A (en) 2000-08-29
EP1151614A1 (fr) 2001-11-07
JP2002537697A (ja) 2002-11-05
GB2347295A (en) 2000-08-30
KR20010102075A (ko) 2001-11-15
GB9903126D0 (en) 1999-04-07

Similar Documents

Publication Publication Date Title
US8761452B2 (en) System, method and computer program product for video fingerprinting
US7920713B2 (en) Recorded video broadcast, streaming, download, and disk distribution with watermarking instructions
US6381367B1 (en) Method and apparatus for compression compatible video fingerprinting
US20030123841A1 (en) Commercial detection in audio-visual content based on scene change distances on separator boundaries
US6842540B1 (en) Surveillance system
US6904096B2 (en) Video data processing device and video data processing method
US20020196370A1 (en) Adaptive overlay element placement in video
US6639996B2 (en) Image processing apparatus, image processing method and computer readable memory medium
CA2627267C (fr) Systeme, procede et produit de programme informatique pour empreinte video
WO2003010727A1 (fr) Procede et appareil de traitement de donnees image
JP4667697B2 (ja) 速い動きのシーンを検出する方法及び装置
JP2004529578A (ja) ビデオ信号中の字幕の検出
BE1007330A3 (nl) Inrichting voor het overdragen van een digitaal beeldsignaal.
KR101083100B1 (ko) 디지털 비디오 스트림 내의 컨텐트 아이템 검출
AU714103B2 (en) Method and apparatus for compression compatible video fingerprinting
GB2419489A (en) Method of identifying video by creating and comparing motion fingerprints
WO2000048401A1 (fr) Appareil et procede de marquage en filigrane de signaux video
US20050120367A1 (en) Commercial detection suppressor with inactive video modification
JPH10506505A (ja) 連続ディジタルビデオの同期化方法
US20060078155A1 (en) Method of detecting blocking artefacts
JP4157661B2 (ja) 動画像内の移動物体検出方法および装置
GB2402829A (en) Surveillance image recording system
KR20020070501A (ko) 압축 인코딩된 비디오의 압축 해제
WO2002102077A2 (fr) Procede et dispositif d'identification progressive de materiel video

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 1020017010189

Country of ref document: KR

ENP Entry into the national phase

Ref country code: JP

Ref document number: 2000 599212

Kind code of ref document: A

Format of ref document f/p: F

WWE Wipo information: entry into national phase

Ref document number: 2000902787

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 09890977

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 2000902787

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020017010189

Country of ref document: KR

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 2000902787

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1020017010189

Country of ref document: KR