KR20050062243A - A portable terminal with mounted digital camera which is capable of preventing an infringement of the portrait right, and a method for embedding an information on preventing the infringement of the portrait right at the portable terminal with mounted digital camera - Google Patents

Abstract

Disclosed are a portable terminal equipped with a digital camera capable of preventing infringement of a portrait right, and a method of inserting information for preventing portrait infringement in a portable terminal equipped with a digital camera. A strong watermark generated based on a combination of base station reception information and terminal specific information is inserted into an image or video signal captured by a digital camera. A semi-soft watermark for confirming forgery and alteration is additionally inserted into an image or video signal having a strong watermark embedded therein. In addition, such watermarks may be inserted into audio signals recorded in a portable terminal equipped with an audio recording apparatus.

Description

PORTABLE TERMINAL WITH MOUNTED DIGITAL CAMERA WHICH IS CAPABLE OF PREVENTING AN INFRINGEMENT OF THE PORTRAIT RIGHT, AND A METHOD FOR EMBEDDING AN INFORMATION ON PREVENTING THE INFRINGEMENT OF THE PORTRAIT RIGHT AT THE PORTABLE TERMINAL WITH MOUNTED DIGITAL CAMERA}

The present invention relates to a portable terminal equipped with a digital camera capable of preventing portrait rights infringement, and a method of inserting information for preventing portrait rights infringement in a portable terminal equipped with a digital camera. More specifically, the present invention relates to an apparatus and method for inserting watermark information capable of determining a photographer, a shooting area, and a shooting time in an image or video signal captured by a portable terminal equipped with a digital camera. The information can also be inserted into an audio signal recorded by the portable terminal.

In other words, the present invention relates to a device and a method for blocking digital content that is illegally photographed and distributed with a digital camera mounted on a portable terminal and tracking its distributor and author.

In order to implement the apparatus and method of the present invention, a digital copyright protection technology called watermarking technology is used. Watermarking can be defined and explained as follows.

Digital content, unlike computer software or hardware that can be protected from copying and redistribution using serial numbers or hard-locks, is very insecure and technically difficult. Watermarking and encryption technologies are being studied in order to protect copyright and redistribution of digital contents. Watermarking technology is not yet certified as encryption technology, but many people are interested in research because of its high utilization.

In other words, the watermarking technology inserts information that can be identified only by the copyright holder into various digital works such as images, audio, and video, and extracts the copyright holder hidden in the copyrighted work when unauthorized use or distribution is performed without the permission of the copyright holder. It is a technique for determining authenticity. If it is necessary to identify the original owner, such as disputes of ownership in the distribution of digital works, that is, digital content, a watermark embedded in the digital content can be detected to provide a basis for exercising the rights of ownership, copyright, and the like.

Watermarking technology can be used in applications such as broadcast monitoring, owner information display, owner verification, authentication, fingerprinting, copy control and confidential information transfer.

The present invention is a method for more active use of such a watermarking technology to apply a watermark to a portable terminal including a digital camera or a portable terminal capable of recording audio, which can prevent illegal portrait rights infringement and pornography production. .

Recently, due to the development of digital camera technology and mobile phone and portable terminal technology, digital cameras are becoming very compact, and high-performance digital cameras and camcorders are mounted on mobile phones and portable terminals.

The development of such technology has brought a lot of benefits to the convenience of life, but the problems caused by this are also seriously brought about, and the representative problem is the problem of the infringement of the portrait right. In the reality that illegal contents such as hidden cameras are spreading on the market and become a big social problem, the installation of such high performance digital cameras or camcorders in mobile phones or portable terminals that can be easily carried by the general public can cause great social problems. Can be.

In other words, since such high-performance equipment is installed in a portable terminal such as a mobile phone, the target party is whether the mobile phone user is playing a game on a mobile phone, sending a text message, using the Internet, or photographing me. I can't notice it. Therefore, even if you shoot yourself in front of me, this is naturally a sneak shot. In particular, when using such a portable terminal camera in a bathroom or bathroom, such a problem is a big problem.

However, it is not easy to legally regulate the installation of digital cameras in mobile phones and portable terminals, which are the direction of social trends and technological developments, and there is no special technology that can prevent such infringement.

Therefore, the present invention has proposed a method for preventing the infringement of the portrait right that can be illegally performed using watermarking technology. That is, the present invention provides a method for finding and tracking who, when and where illegally violated the portrait rights.

An object of the present invention by inserting the information and the information identifying the source and the user as a watermark in an image or video taken by a digital camera or the like mounted on a portable terminal, to prevent users from illegal shooting behavior in advance, It also prevents and prevents infringement of illegal portrait rights by finding out its source and users and taking legal measures.

Another object of the present invention is to insert a user's information as a watermark into an audio file recorded by an audio recording apparatus mounted on a portable terminal as a watermark, thereby preventing users from illegal recording behavior in advance. In this regard, illegal recording is prevented and prevented by finding out the source and the user and taking legal measures after the death.

Still another object of the present invention is to insert an image, a video or an audio by inserting, as a watermark, information that can identify whether the forgery is in a photographed or recorded image, a video, or an audio file, in addition to the source and user information. It also checks for forgery of the file.

In order to achieve the above object, the present invention provides a digital camera for shooting an image or video; A base station signal receiving unit communicating with a base station to receive information from the base station; An information combination unit combining base station reception information and terminal specific information from the base station signal receiving unit; And a first watermark inserting unit generating a first watermark based on the information combined by the information combining unit and inserting the first watermark in an image or video signal captured by the digital camera. to provide.

Preferably, the base station reception information includes at least one of GPS location information, current date and time information of the portable terminal.

Also preferably, the terminal unique information is the portable terminal number or a unique serial number of the portable terminal.

Also preferably, the first watermark is a robust watermark.

Also preferably, the portable terminal further includes a second watermark inserting unit for inserting a second watermark for checking whether or not forgery is inserted into the image or video signal in which the first watermark is inserted.

Also preferably, the second watermark is a semi-fragile watermark.

The portable terminal may further include an image / video compression unit configured to compress the image or video signal in which the first and second watermarks are inserted.

On the other hand, the portable terminal is composed of the first and second watermark inserting unit and a module, and may further include an image / video compression unit for compressing the image or video signal.

On the other hand, the portable terminal further comprises an image / video compression unit for compressing the image or video signal, the compression of the image or video signal is to be performed in the step before the insertion of the first and second watermark Can be.

In addition, the portable terminal may be any one of a cellular phone, a PCS, or a PDA.

In order to achieve another object of the present invention, the present invention provides an audio recording unit for recording an audio signal; A base station signal receiving unit communicating with a base station to receive information from the base station; An information combination unit combining base station reception information and terminal specific information from the base station signal receiving unit; And a first watermark inserting unit generating a first watermark based on the information combined by the information combining unit and inserting the first watermark into the audio signal recorded by the audio recording unit. do.

In order to achieve another object of the present invention, the present invention provides a method for inserting information into an image or video signal captured by the digital camera in a portable terminal equipped with a digital camera, by communicating with a base station from the base station Receiving information of the; Combining the base station reception information and terminal specific information; And generating a first watermark based on the combined information, and inserting the first watermark into an image or a video signal captured by the digital camera.

In order to achieve another object of the present invention, the present invention provides a method for inserting information into an audio signal recorded by the audio recording apparatus in a portable terminal equipped with an audio recording apparatus, by communicating with a base station from the base station Receiving information of the; Combining the base station reception information and terminal specific information; And generating a first watermark based on the combined information and inserting the first watermark into an audio signal recorded by the audio recording apparatus.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, a configuration of a portable terminal equipped with a digital camera will be described with reference to FIG. 1. The portable terminal is any portable information communication means including cellular phones, PCS, PDAs and the like. 1 is a block diagram showing the configuration of a portable terminal equipped with a digital camera according to the present invention.

Referring to FIG. 1, the portable terminal 100 of the present invention includes a digital camera 110 for capturing an image or a video, a base station signal receiver 120 for communicating with a base station, and receiving information from the base station, a base station signal receiver ( An information combining unit 130 that combines the base station reception information and the terminal specific information from the base station 120, a robust watermark (RW) generated by the information combined by the information combining unit 130, and photographed an image or RW inserting unit 140 for inserting into the video signal, SFW inserting unit 150 for inserting a semi-fragile watermark (SFW) that can determine whether the forgery in the RW-inserted image or video signal And an image / video compression unit 160 for compressing the image or video signal inserted with the RW and SFW, and a file storage unit 170 for storing the same as a file. .

The base station signal receiver 120 receives base station information, GPS location information, current date and time information, and the like from the base station. The base station reception information is transmitted to the information combination unit 130 and provides GPS location information and photographing time information of the portable terminal at the time of photographing. The base station reception information related to the location and time is information already provided by the mobile phone currently being serviced.

The information combination unit 130 receives the base station reception information from the base station signal receiving unit 120 and also receives the terminal specific information. The terminal specific information is information for tracking the photographer of the image or video, and may be, for example, information of a mobile phone number or a unique serial number of the terminal. The information combining unit 130 combines the base station reception information with the terminal specific information to generate the combination information, and the combination information serves as a basis for generating a watermark for checking a photographer and a source later.

As described above, the watermark embedding apparatus in the portable terminal 100 of the present invention is classified into two types, a robust watermark (RW) inserter and a semi-fragile watermark (SFW) inserter. Are distinguished.

RW is the most well-known watermark, which means a watermark that is robust against compression and various external attacks, and it survives even if there are various external attacks on the watermarked digital content.

SFW is a watermark that is strong for compression but weak for other external attacks. SFW is identical in that it is vulnerable to a variety of attacks other than fragile watermark (FW) and compression, but differs in the robustness to compression. In other words, the FW is fragile against all external attacks including compression, whereas in the case of SFW, the embedded watermark survives the compression. In the situation where compression is being performed because of the file size for most digital contents, SFW is used as an alternative because FW has a problem in its effectiveness.

Referring back to FIG. 1, in the RW inserting unit 140, an RW is generated based on information combined in the information combining unit 130 (that is, information in which base station reception information and terminal unique information are combined). The RW is inserted into an image or video signal captured by the digital camera 110. As such, the information such as the base station reception information and the terminal unique information, which can identify the photographer or its source, is generated and inserted as a robust RW against various external attacks, so that when the captured image or video file becomes a problem, Information can be obtained reliably.

In the SFW inserting unit 150, an SFW for checking whether or not a forgery is inserted into the image or video signal in which the RW is inserted is inserted. Since the watermark for detecting forgery is generated and inserted as SFW as described above, if the recorded image or video file has an external attack such as deformation or forgery, the watermark for detecting forgery is easily checked. . However, due to the characteristics of the SFW, it is not broken in the compression process in the portable terminal 100.

As such, the image or video signal having the RW and SFW inserted therein is compressed by the image / video compression unit 160, and the compressed image or video signal is stored in the file storage unit 170 as a file.

As described above, in the portable terminal 100 equipped with the digital camera according to the present invention, an image in which the terminal unique information for identifying the portable terminal 100 and the location, date, and time information of a photographing time point are photographed as watermarks. Alternatively, since it is inserted into the moving picture file, it is possible to determine who is the portable terminal (i.e., mobile phone) that has captured the image or moving picture file through the watermark detection device, and the location and time of the shooting.

Therefore, when a photographer photographs illegal images or videos such as a sneak camera with a portable terminal equipped with a digital camera and distributes such illegal contents to the Internet network or by distributing them to a large number of people by email or wireless transmission, By detecting the watermark information (RW watermark) embedded in the distributed image or video file, it is possible to accurately track illegal shooters and distributors and take legal measures.

In addition, by detecting watermark information (SFW watermark) embedded in the distributed image or video file, it is also possible to check whether the photographed and distributed image or video file is forged / modulated.

In addition to capturing an image or a moving image as described with reference to FIG. 1, the portable terminal may also store an audio signal using an audio recording apparatus mounted in the portable terminal. Audio signals are also digital content as important as images or video and can be used for illegal crimes such as unauthorized theft, eavesdropping, and forgery.

Therefore, in order to prevent this characteristic watermark insertion technology of the present invention is applied to a portable terminal including an audio recording device, it is possible to prevent crimes, such as illegal recording using the portable terminal and trace its origin, Figure 2 This will be described in detail with reference to FIG. 2 is a block diagram showing the configuration of a portable terminal 200 including an audio recording apparatus according to the present invention.

The configuration of the portable terminal 200 of FIG. 2 is substantially the same as the basic configuration of the portable terminal 100 of FIG. 1, and the following description mainly focuses on the differences, and a description of the same configuration will be omitted.

2, the portable terminal 200 of the present invention includes an audio recording unit 210 for recording an audio signal, a base station signal receiving unit 220 for communicating with a base station and receiving information from the base station, and a base station signal receiving unit ( An information combining unit 230 that combines base station reception information and terminal specific information from the mobile station 220 and a robust watermark (RW) generated by the information combined by the information combining unit 230 to generate a recorded audio signal. RW inserting unit 240 to be inserted into the SFW inserting unit 250 for inserting a semi-fragile watermark (SFW) that can check whether the forgery in the audio signal inserted into the RW, the RW and And an audio compression unit 260 for compressing the audio signal into which the SFW is inserted, and a file storage unit 270 for storing the SFW as a file.

The interior of the portable terminal 200 of FIG. 2 except that the digital camera 110 of FIG. 1 is replaced by the audio recording unit 210 and the image / video compression unit 160 is replaced by the audio compression unit 260. The configuration and operation process are the same as the internal configuration and operation process of the portable terminal 100 of FIG.

That is, except that the image or video signal of FIG. 1 is replaced with the audio signal in FIG. 2, the SFW capable of confirming the configuration and forgery / modulation of the base station reception information and the terminal specific information are inserted into the audio signal as RW. The same applies to the configuration of the audio signal.

As described above, in the portable terminal 200 equipped with the audio recording apparatus according to the present invention, terminal unique information for identifying the portable terminal 200 and location, date, and time information of a recording time point are recorded as a watermark. Since the audio file is inserted into the audio file, the portable terminal (i.e., mobile phone) whose audio signal such as voice is recorded later through the watermark detection device, and the recorded place and time can be confirmed.

Therefore, when a recorder makes an illegal eavesdropping or voice recording with a portable terminal equipped with an audio recording device and distributes such illegal content to the Internet network or by distributing it to a large number of people by email or wireless transmission, the distributed audio is distributed. By detecting the watermark information (RW) embedded in the file, it is possible to accurately track illegal recording and distributors and take legal measures.

In addition, by detecting watermark information (SFW) embedded in the distributed audio file, it is also possible to confirm whether or not the recorded and distributed audio file is forged / modulated.

Meanwhile, various embodiments of a time point at which a watermark is inserted into an image / video / audio signal photographed or recorded by a portable terminal according to the present invention and a time point at which the signal is compressed will be described. The insertion position and the compression position of the watermark may be changed according to the system environment and system requirements.

First, FIG. 3 is a block diagram illustrating a configuration of compressing an image / video or an audio signal after embedding a watermark according to an embodiment of the present invention, which is the same as that of the overall configuration diagram of the portable terminal in FIGS. 1 and 2. Yes.

Referring to FIG. 3, the image / video / audio signal is first compressed by the image / video or audio compressor 330 after the watermark is inserted in the RW inserter 310 and the FW inserter 320.

This method is the easiest and strongest method of embedding a watermark, and inserts a watermark into raw data in the same manner as a general watermarking method. It is the easiest to implement and is a powerful way to inject watermarks into various attacks.

4 is a block diagram illustrating a configuration of compressing an image / video or an audio signal simultaneously with embedding a watermark according to another embodiment of the present invention.

Referring to FIG. 4, the watermark embedding process in the RW inserting unit 410 and the SFW inserting unit 420 into the image / video / audio signal and the compression process in the image / video or audio compression unit 430 Is performed simultaneously.

The method can insert watermark information at the same time as compression, thereby ensuring the security of the watermark embedding module. That is, since the watermark embedding module is separately separated in the portable terminal, other watermark embedding methods may not completely exclude data compression without passing through the watermark embedding module. However, in this method, since the watermark embedding module is inserted into the compression module, data cannot be compressed by avoiding the watermark embedding module.

5 is a block diagram illustrating a configuration of compressing an image / movie or audio signal before inserting a watermark according to another embodiment of the present invention.

Referring to FIG. 5, the image / video / audio signal is first compressed by the image / video or audio compressor 530, and then watermarked by the RW inserter 510 and the FW inserter 520.

This method is a method of embedding a watermark in a compressed data stream, which requires advanced technology among watermark embedding techniques. Watermark insertion rate is the fastest way to weaken the attack, but it is easy to use when the system resources are low, such as a portable terminal.

While the invention has been particularly shown and described with reference to the above embodiments, it has been used merely for the purpose of illustration and those of ordinary skill in the art to which the invention pertains may have as defined in the appended claims. It should be understood that various modifications may be made without departing from the spirit and scope.

As described above, according to the present invention, by inserting information identifying the origin and the user as a watermark in an image or video photographed by a digital camera or the like mounted on a portable terminal, the user can preempt illegal shooting behavior. It is effective in preventing and preventing illegal infringement of copyrights by restraining it, and finding out its source and user even after death.

In addition, by inserting the information and the user's information as a watermark into the audio file recorded by the audio recording device mounted on the portable terminal, users can prevent illegal recording behavior in advance, and the source after the fact And by detecting the user and taking legal measures, there is an effect of preventing and preventing illegal recording.

In addition, by inserting information that can identify whether the forgery in the photographed or recorded image, video or audio file in addition to the source and the user can know the information, and also to check whether the image, video or audio file is forgery It can be effective.

1 is a block diagram showing the configuration of a portable terminal equipped with a digital camera according to the present invention.

2 is a block diagram showing the configuration of a portable terminal equipped with an audio recording apparatus according to the present invention.

3 is a block diagram illustrating a configuration of compressing an image / video or an audio signal after embedding a watermark according to an embodiment of the present invention.

4 is a block diagram illustrating a configuration of compressing an image / video or an audio signal simultaneously with embedding a watermark according to another embodiment of the present invention.

5 is a block diagram illustrating a configuration of compressing an image / movie or audio signal before inserting a watermark according to another embodiment of the present invention.

Explanation of symbols on main parts of drawing

100: portable terminal 110: digital camera

120, 220: base station signal receiving unit 130, 230: information combining unit

140, 240: RW insertion part 150, 250: SFW insertion part

160: image / video compression unit 170, 270: file storage unit

210: audio recording unit 260: audio compression unit

Claims (16)

A digital camera for taking an image or video; A base station signal receiving unit communicating with a base station to receive information from the base station; An information combination unit combining base station reception information and terminal specific information from the base station signal receiving unit; And And a first watermark inserting unit generating a first watermark based on the information combined by the information combining unit and inserting the first watermark in an image or video signal captured by the digital camera. Handheld terminal. The method of claim 1, The base station reception information comprises at least one of GPS location information, current date and time information of the portable terminal. The method of claim 1, The terminal specific information is a portable terminal, characterized in that the portable terminal number or a unique serial number of the portable terminal. The method of claim 1, And the first watermark is a robust watermark. The method of claim 1, And a second watermark inserting unit for inserting a second watermark for checking forgery and alteration in the image or video signal in which the first watermark is inserted. The method of claim 5, And the second watermark is a semi-fragile watermark. The method of claim 5, The mobile terminal of claim 1, further comprising an image / video compression unit configured to compress the image or video signal having the first and second watermarks embedded therein. The method of claim 5, And a first / second watermark inserting unit and a module, and further comprising an image / video compressing unit compressing the image or video signal. The method of claim 5, And an image / video compression unit for compressing the image or video signal, wherein the compression of the image or video signal is performed in a step before inserting the first and second watermarks. The method according to any one of claims 1 to 9, The portable terminal is any one of a cellular phone, a PCS, or a PDA. An audio recording unit for recording an audio signal; A base station signal receiving unit communicating with a base station to receive information from the base station; An information combination unit combining base station reception information and terminal specific information from the base station signal receiving unit; And And a first watermark inserting unit generating a first watermark based on the information combined by the information combining unit and inserting the first watermark into the audio signal recorded by the audio recording unit. terminal. The method of claim 11, And a second watermark inserting unit for inserting a second watermark for forgery checking into the audio signal in which the first watermark is inserted. In a portable terminal equipped with a digital camera, a method for inserting information into an image or video signal captured by the digital camera, Communicating with a base station to receive information from the base station; Combining the base station reception information and terminal specific information; And Generating a first watermark based on the combined information, and inserting the first watermark into an image or a video signal captured by the digital camera. The method of claim 13, And inserting a second watermark for checking forgery and alteration in the image or video signal in which the first watermark is inserted. In a portable terminal equipped with an audio recording device, a method for inserting information into an audio signal recorded by the audio recording device, Communicating with a base station to receive information from the base station; Combining the base station reception information and terminal specific information; And Generating a first watermark based on the combined information, and inserting the first watermark into an audio signal recorded by the audio recording apparatus. The method of claim 15, And inserting a second watermark for confirming whether or not forgery is inserted into the audio signal into which the first watermark is inserted.