JP2000182324A - Data processing device and data recording medium - Google Patents

Abstract

(57) [Summary] [Problem] Even if distributed audio data Dau supplied via a network N has been subjected to information embedding processing by any digital watermarking method, it can be performed by a playback device that is a home appliance. In addition, it is possible to appropriately perform the reproduction process of the distributed audio data Dau according to embedded information such as copyright information. An acquisition unit that receives a network signal Sn on a network N and acquires distribution audio data Dau in which copyright information and the like are embedded, and an electronic watermarking method used when embedding copyright information and the like And a control unit 115 for acquiring information indicating the embedded digital watermark information, and extracting the embedded information by an appropriate digital watermarking method based on the obtained digital watermark information to be used. The data is embedded in the recording medium and recorded on a recording medium.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data processing apparatus and a data recording medium, and more particularly to a digital watermarking method, such as a general-purpose data reproducing apparatus, for digital data such as music data obtained by electronic distribution or from a recording medium. And a process for embedding a digital watermark (embedded information) by a predetermined digital watermark scheme adopted in the above.

[0002]

2. Description of the Related Art In recent years, while digitization of video data, audio data, and the like has progressed, it has become a major problem that digital data can be easily copied completely from original data. One solution to such a problem is to use digital watermarking technology. It should be noted that Japanese Patent Application Laid-Open Nos.
Japanese Patent Publication No. 191395 discloses details of a digital watermarking technique. Digital watermarking technology is not a direct method of making original digital data, such as video data and audio data, to be reproduced, impossible to copy. This is a technique for restricting copying of the digital data by embedding copyright information related to the right. For example, by embedding copyright information indicating the author's name (source of information) as digital watermark in digital data such as video data and audio data, the copyright information ( The digital watermark is also copied. With this, when a copyright owner finds digital data such as video data and audio data created by illegal copying, the illegality can be proved by copyright information embedded in the digital data. Becomes

[0003] The digital watermarking technique will be specifically described below. FIG. 18 shows a digital watermarking technique for an image, in which information (related information) Dwmi related to the copyright holder of this data is inserted into video digital data (supply digital data) to be supplied from a distributor to a user. An example of the processing to be performed will be described. This related information is called digital watermark or embedded information. Here, in order to simplify the explanation, as shown in FIG.
Is a grayscale still image, and its size is 50 pixels vertically × 50 pixels horizontally. Each pixel P constituting the image F takes an integer value in the range of 0 to 99 as a luminance level (pixel value) indicating its brightness.

In the above digital watermark insertion process, first,
The image F is subdivided into a plurality of blocks B each including a predetermined number of pixels (vertical 10 pixels × horizontal 10 pixels). That is,
The original still image F is subdivided into 25 blocks (5 vertical blocks × 5 horizontal blocks) as shown in FIG.
At this time, the pixel values constituting the image data corresponding to each block (small image) B are represented as values of each element in a matrix of 10 rows and 10 columns. Next, the matrix is subjected to a discrete cosine transform (DCT) to obtain a transform matrix of 10 rows and 10 columns. Numerical values arranged in the lower right part of the transformation matrix are numerical values representing high-frequency components of image data corresponding to the original image.

[0005] It is known that human vision has a characteristic that the sense of change in high-frequency components of image data is duller than the sense of change in low-frequency components. In other words, even if the original image is subjected to image processing for changing the value of the high-frequency component to a slightly different value, the difference between the image (reconstructed image) subjected to this image processing and the original image is recognized by humans. It is extremely difficult to recognize visually. Here, the reconstructed image is specifically an image corresponding to image data reconstructed from an inverse transform matrix obtained by performing an inverse discrete cosine transform on the transform matrix. Digital watermarking technology for images utilizes the above-described human visual characteristics, and operates on the high-frequency components of the original image without causing the viewer to feel the deterioration of the image quality of the original image. It is possible to embed information in image data corresponding to.

[0006] Such digital watermarking techniques include not only for images but also for audio. Some digital watermarking techniques can extract or remove embedded information from image data or audio data in which the information is embedded. Further, according to such digital watermark technology, when digital data is copied from a digital recording medium to a digital recording medium, not only can the embedded information embedded in the digital data be copied, but also the digital recording can be performed. Even when digital data recorded on a medium is once converted into analog data by a DA converter and recorded on the analog recording medium, the embedded information may be retained in the analog data recorded on the analog recording medium. It is possible.

Hereinafter, a digital watermarking technique for audio will be described. FIG. 19 conceptually shows information embedding processing and information extraction processing for digital audio data.
The processing Pad for inserting the signature data (embedding information) Dwmi into the digital audio data recorded as the audio data file ODau is performed, and the digital audio data with the signature data inserted is converted into the audio data file SDau with the signature data inserted. Is recorded as Processing for extracting signature data Dwmx inserted into digital audio data based on digital audio data recorded as audio data file ODau and digital audio data recorded as audio data file SDau with signature data inserted Pex is performed.

FIG. 20 shows the flow of the information embedding process. As the first processing, digital audio data is divided into blocks (step S1). This process is a process of dividing digital audio data into data groups (blocks) composed of a fixed number of sampling data, which are convenient for the subsequent process. Next, Fourier transform processing is performed on each block (step S2). The details of the arithmetic processing for the Fourier transform will be described later. Thereafter, the following data conversion is performed as a process of inserting a digital watermark (embedded information). Here, the digital watermark is composed of a plurality of bits of digital data (signature data), and each bit of the signature data corresponds to each block.

First, a process of confirming whether the value of each bit constituting the block sequence of the signature data (bit sequence of the signature data) is 0 or 1 is performed (step S3). No digital watermark is inserted into a block whose corresponding bit value is 0. For a block in which the value of the corresponding bit is 1, the imaginary part and the real part of a function (hereinafter referred to as a Fourier transform function) obtained by performing a Fourier transform of music data corresponding to the block as an electronic watermark insertion process. The process of exchanging the parts and multiplying the real part by -1 is performed (step S
4). This process is performed for each block. Then, a Fourier inverse transform process is performed on the Fourier transform function for each block (step S5). Thus, the audio data of each block is restored. The details of the inverse Fourier transform process will be described later. Through the above processing, embedded information that cannot be detected by human beings only by listening to voice is inserted into the digital voice data.

Hereinafter, each processing in the digital watermarking technique will be described. First, the Fourier transform and the inverse Fourier transform will be briefly described. The Fourier transform used in inserting a digital watermark (embedded information) is called a discrete Fourier transform, and is defined as follows. Discrete one-dimensional real-valued function f (n) (n ∈ Z, 0 ≤ n <N)
Is given, the function obtained by the discrete Fourier transform of f (n) is defined by the discrete one-dimensional complex function F (k) (kkZ, 0 ≦ k <N) given by (Equation 1). You. Here, Z indicates a set of whole integers. (Equation 1)
Satisfies the conditions given by (Equation 2) and (Equation 3).

[0011]

(Equation 1)

(Equation 2)

(Equation 3) The discrete inverse Fourier transform will be described below. Given a discrete one-dimensional real-valued function f (n) (n ∈ Z, 0 ≤ n <N), a discrete one-dimensional complex-valued function F (k) (k ∈ Z, 0 ≤
If k <N) is a function obtained by the discrete Fourier transform of f (n), the following (Equation 4) holds. Here, Z indicates a set of whole integers. (Equation 4) satisfies the conditions given by (Equation 5) and (Equation 6).

(Equation 4)

(Equation 5)

(Equation 6) Next, a specific digital watermark embedding process for audio data will be described. With reference to FIG. 21, a description will be given of blocking of audio data. Blocking means that a sample value Sound (i) of digital audio data to be inserted with a digital watermark (insertion target audio data) is represented as a set of blocks made up of power-of-two (2 ⁿ ) samples. I do. Here, the number of all blocks obtained by blocking the audio data to be inserted is (t + 1), the first block is block B _0, and k (arbitrary value)
The second block is a block _Bk , and the last block is a block _Bt . Further, the sample value of the k-th block B _k is set to B _k (j). The relationship between the sample value Sound (i) of the audio data to be inserted and the value B _k (j) of each sample in the block is expressed by the following (Equation 7).

[0012]

(Equation 7) Here, Z represents a set of whole integers, and k and j are k, j∈Z
The, i is satisfy ^{i = 2 n k + j (} 0 ≦ j <2 n). In addition,
Needless to say, the variables n and k used here are the variables n and k in the equation (Equation 1) defining the general discrete first-order Fourier transform and the equation (Equation 4) defining the discrete first-order inverse Fourier transform. k means another variable.

Next, a process for inserting a digital watermark will be described.
I do. First, the k-th block B above_kAudio data
Sample value) B_k(j) is obtained by the discrete Fourier transform.
Data to F_k(m). Here, k is the block B₀~ B _t
Any block of B_kAnd k ∈ Z,
k ∈ [0, t (total number of blocks)]. Also, insert
Data bit sequence is defined by a one-dimensional discrete integer function U (d)
And the above data F_k (m) (m ∈ Z, m ∈ [1, 2ⁿ])
Each bit of the insertion data bit string defined by the function U (d)
Data obtained by performing the process of embedding information according to the value of
F '_k(m). Where d, d_n Is
Condition (d, d_n∈ Z) is satisfied. And d_n Is d_n<2n-1
If so, U (d) becomes U (d) = 1 or 0. d is d ∈
[1, d_n], U (d) becomes U (d) = 0.
Then, F ’_k (m) is calculated by the following (Equation 8) to (Equation 15).
Is represented. Where m is m ∈ Z, m ∈ [1, 2^n-1]
Fulfill.

[0014]

(Equation 8)

(Equation 9)

(Equation 10)

[Equation 11]

(Equation 12)

(Equation 13)

[Equation 14]

(Equation 15) Here, (Equation 8) to (Equation 11) are obtained by performing a discrete Fourier transform on 2 ⁿ data (sample values) B _k (j).
^This is applied to a low frequency component of ⁿ data (frequency components) F _k (m). In addition, the above (Equation 12)
To (Equation 15) are used for high-frequency components of 2 ⁿ data (frequency components) F _k (m) obtained by performing discrete Fourier transform of 2 ⁿ data (sample values) B _k (j). Is applied. Also, (Equation 9), (Equation 11), (Equation 13),
As shown in (Equation 15), no digital watermark is inserted into a block in which the value of the corresponding bit in the signature data bit string is 0. On the other hand, (Equation 8), (Equation 1
As shown in (0), (Equation 12) and (Equation 14), for a block in which the value of the corresponding bit in the signature data bit string is 1, music corresponding to this block is inserted as a digital watermarking process. Data (sample value) B _k (j)
Is performed by exchanging the imaginary part and the real part of the data F _k (m) obtained by the Fourier transform of, and multiplying the real part by −1. Further, the digital watermark insertion processing is performed so that the embedding target audio data does not give a listener a sense of incongruity due to the embedding of information corresponding to the embedding target audio data, and the corresponding high-frequency Fourier transform data corresponds to the low-frequency Fourier transform data. And a pair. Here, the m-th Fourier transform data F ′ _k (m) on which the digital watermark insertion processing has been performed is the (2 ⁿ ) on which the digital watermark insertion processing has been performed.
−m + 1) -th Fourier transform data F ′ _k (2 ⁿ −m + 1).

Next, a process of extracting a digital watermark will be described. FIG. 22 shows a flow of an embedded information extraction process. First, the audio data subjected to the information embedding process is divided into blocks (step S11a) and the Fourier transform of the audio data of each block (step S12a). Further, the audio data that has not been subjected to the information embedding processing is divided into blocks (step S11b), and the Fourier transform of the audio data of each block (step S12b). Then, the data obtained as a result of the Fourier transform is compared for each corresponding block between the audio data block to which the information embedding processing is applied and the audio data block to which the information embedding processing is not applied ( Step S13). As a result of the comparison, if the data match between the two blocks, the embedded information is not embedded in the block on which the information embedding process has been performed, and it is determined that the signature data bit is 0 (step S14). ). If the data is different between the two blocks, the digital watermark is embedded in the block on which the information embedding process has been performed, and it is determined that the signature data bit is 1 (step S15). By repeating this process for each block, a bit string (embedded information) constituting the signature data is extracted.

Next, a specific process of inserting and extracting a digital watermark (embedded information) will be described. First, a process of inserting embedded information into each block will be described. In the following description of the insertion process, the audio data (sample value) in one block to be inserted with signature data is
und (n), and a signature data bit string inserted into data obtained by Fourier transform of the audio data Sound (n) in the one block is syomei [u]. In addition, data obtained by performing discrete Fourier transform on the audio data Sound (n) to be inserted is defined as F [Sound] (p), and a process of embedding a signature data bit string in the data F [Sound] (p) is performed. The data obtained by this is F '[Sound] (p). Here, the audio data Sou
nd (n) is a function defined on the integer space, and has an integer value as its value. Note that n is n = 0,
1, ... N. Also, the signature data bit string syomei [u]
Is also a function defined on the integer space (see Equation 16),
It is a function that has only 0 and 1 as its value. Note that u
Is u = 0,1.

[0017]

(Equation 16) Further, when the audio data Sound (n) is Fourier-transformed, the corresponding Fourier-transformed data F [Sound] (p) (Equation 17) is obtained.

[Equation 17] At this time, F [Sound] (p) is a function defined on the integer space, and has a complex number as its value. In addition,
p is p = 0, 1,... N. Here, the real part of the Fourier transform data F [Sound] (p), which is the above complex number, is expressed as Re {F
[Sound] (p)} and its imaginary part Im {F [Sound] (p)}, F '[Sound] (p) is a signature data bit sequence syomei
Depending on the value of [u], it can be expressed using the above (Equation 8) to (Equation 15).

At this time, assuming that the signature data bit string inserted in the Fourier transform data F [Sound] (p) corresponding to one block is syomei [0] = 1, the Fourier transform data F [Sound] (p) Of the first bit F [Sound] (1) and the value of the Nth bit F [Sound] (N), (Equation 8) and (Equation 1)
0), (Equation 12), and (Equation 14), information embedding processing is performed. The following (Equation 18) to (Equation 21) represent the Fourier transform data obtained by this information embedding processing.
F '[Sound] (1) and F' [Sound] (N) are shown.

[0019]

(Equation 18)

[Equation 19]

(Equation 20)

(Equation 21) Again, Re and Im respectively represent the real and imaginary parts of the complex number in {}.

On the other hand, audio data So corresponding to one block
The signature data bit string inserted into und (n) is syomei [1] =
If it is 0, 2 of the Fourier transform data F [Sound] (p)
The value F [Sound] (2) of the bit and the value F of the (N-1) th bit
For [Sound] (N-1), the above (Equation 9), (Equation 11),
Information embedding processing is performed using (Equation 13) and (Equation 15). The following (Equation 22) to (Equation 25) represent the Fourier transform data F ′ [So
und] (2) and F '[Sound] (N-1).

[0021]

(Equation 22)

(Equation 23)

(Equation 24)

(Equation 25) The data obtained by performing the information embedding process on the Fourier transform data F [Sound] (p) corresponding to the sound data Sound (n) corresponding to one block by using the above (Equation 8) to (Equation 15). By performing inverse discrete Fourier transform on F ′ [Sound] (p), information embedded sound data Sound ′ (n) is obtained as shown in (Equation 26).

(Equation 26) Next, the process of extracting embedded information will be briefly described.
In this extraction process, a process of performing Fourier transform on Sound (n) and Sound '(n), respectively, and comparing respective Fourier transform data is performed. Then, as shown below, the signature bit data is set to 1 if the values are different, and the signature data bit is set to 0 if the values are the same, and the signature data bit string is extracted.

The algorithm is briefly described below. {}
N moves from 1 to N in order. {If F [Sound] (n) = F [Sound ']) (n), then syomei [n-1] = 1 if F [Sound] (n) = F [Sound']) (n) , Syomei [n-1] = 0}

[0023]

As described above, in recent years, as a method of protecting the copyright of image data and audio data, a copyright holder or the like, which is related information for the purpose of displaying the source of such data, is displayed. A digital watermarking technique for embedding the indicated information has been put to practical use. However, there are various digital watermarking schemes for embedding relevant information in digital data, and at present, digital data with copyright information embedded therein can be handled by a reproducing apparatus employing a predetermined digital watermarking scheme. Have difficulty.

On the other hand, a system (electronic distribution system) for distributing video data and audio data via a network instead of distributing them on a distribution medium (data recording medium) has been considered. In such an electronic distribution system, video data distribution has a large technical problem due to its large data amount, but music data distribution has a relatively small data amount compared to video data. Therefore, it is easy to realize even with the limited network bandwidth at present, and it is about to be implemented. Therefore,
There is a need for a system in which related information (embedded information) for specifying a copyright holder or the like is embedded in music data to be electronically distributed by an electronic watermarking method so that an information source of music data can be identified.

The present invention has been made to solve the above-mentioned problems, and can optimally perform electronic distribution of audio data. In addition, the present invention has a copyright on such electronically distributed audio data. It is an object to obtain a data processing device that can be protected. SUMMARY OF THE INVENTION It is an object of the present invention to provide a data processing apparatus capable of converting digital data on which information embedding processing has been performed by various digital watermarking methods into data that can be processed by a predetermined digital watermarking method. The present invention provides a data recording medium storing digital data having a data structure capable of optimally performing electronic distribution of audio data and protecting copyright of such electronically distributed audio data. The purpose is to: An object of the present invention is to obtain a data recording medium that stores digital data having a data structure that can be processed by a predetermined digital watermarking method as digital data to which information embedding processing has been performed by various digital watermarking methods. .

[0026]

A data processing apparatus according to the present invention (claim 1) provides a different electronic device which is obtained by embedding relevant information in digital data to be supplied from a distributor to a user. What is claimed is: 1. A data processing apparatus for receiving and processing various information-embedded digital data corresponding to a watermark method, comprising: a data acquisition unit for acquiring required information-embedded digital data as input digital data; A method information acquisition unit for acquiring usage method information indicating a used digital watermarking method used for embedding of related information; and, based on the acquired usage method information, the input digital data from the input digital data by the used digital watermarking method. Information extraction means for extracting relevant information, and the input digital data or a predetermined data processing Processing the digital data obtained by subjecting, in which the extracted relevant information or processed information obtained by processing the relevant information and a information embedding means embeds the above predetermined watermarking method.

According to a second aspect of the present invention, in the data processing apparatus according to the first aspect, the related information embedded in the information-embedded digital data is information related to a copyright holder of the supplied digital data. Things.

According to a third aspect of the present invention, in the data processing apparatus according to the first aspect, the information embedding means embeds the related information or the processed information in the input digital data by the predetermined digital watermarking method. Is used to generate output digital data.

According to a fourth aspect of the present invention, in the data processing apparatus according to the third aspect, a data reproducing unit for reproducing the output digital data is provided.

According to a fifth aspect of the present invention, in the data processing device according to the third aspect, a data recording unit for recording the output digital data is provided.

According to a sixth aspect of the present invention, in the data processing apparatus according to the first aspect, the related information is removed from the input digital data based on the use method information acquired by the method information acquisition means. Information removing means for generating information-removed digital data as the processed digital data, and the information embedding means embeds the relevant information or the processed information in the information-removed digital data by the predetermined digital watermarking method and outputs the data. It is configured to generate digital data.

According to a seventh aspect of the present invention, in the data processing device according to the sixth aspect, a data reproducing unit for reproducing the output digital data is provided.

The present invention (claim 8) is the data processing device according to claim 6, further comprising a data recording unit for recording the output digital data.

According to a ninth aspect of the present invention, in the data processing apparatus according to the first aspect, the information-embedded digital data comprises a fixed-length first data portion and a variable-length second data portion. In the first data portion, use method information indicating the use digital watermark method is embedded according to the use digital watermark method, and the method information obtaining means is configured to perform the following operation from the first data portion of the input digital data.
In this configuration, usage mode information indicating the usage digital watermark mode is acquired.

According to a tenth aspect of the present invention, in the data processing apparatus according to the first aspect, the information-embedded digital data has a data structure including a plurality of data packets, and a predetermined data among the plurality of data packets is provided. In the header of the packet, the usage method information indicating the used digital watermarking method is inserted, and the method information obtaining unit is configured to use the usage method information indicating the used digital watermarking method from the header of a predetermined data packet in the information embedded digital data. It is configured to acquire information.

According to the present invention (claim 11), in the data processing apparatus according to claim 1, an auxiliary data portion is added to the information-embedded digital data, and the auxiliary data portion indicates the use digital watermarking scheme. Method information is inserted, and the method information obtaining means obtains, from the auxiliary data part accompanying the information-embedded digital data, usage method information indicating the used digital watermarking method.

According to a twelfth aspect of the present invention, in the data processing apparatus according to the first aspect, the data acquisition means is configured to transmit the information-embedded digital data from at least one of a plurality of data recording media and a plurality of data communication paths. Acquirable configuration, the method information acquisition means, depending on which of the plurality of data recording media and a plurality of data communication paths from the information embedded digital data,
The above-described digital watermarking scheme is determined, and usage scheme information corresponding to the determination result is obtained.

According to a thirteenth aspect of the present invention, in the data processing device according to the first aspect, the information embedded digital data is converted into audio digital data, video digital data,
Alternatively, it is multiplex digital data obtained by multiplexing audio digital data and video digital data.

According to a fourteenth aspect of the present invention, in the data processing apparatus according to the first aspect, the data acquisition means includes an antenna for receiving a broadcast wave from a broadcasting station, and a reception output from the antenna. And a reception wave decoder for outputting the information embedded digital data.

According to a fifteenth aspect of the present invention, in the data processing device according to the first aspect, the data acquisition means reads the information-embedded digital data stored in the large-capacity storage device from the mass storage device. It has the structure which has.

According to a sixteenth aspect of the present invention, in the data processing device according to the fifteenth aspect, the data reading device includes an access for reading the information-embedded digital data from a DVD-ROM, a DVD-RAM, or a semiconductor recording medium. It is configured to have a device.

According to a seventeenth aspect of the present invention, in the data processing device according to the first aspect, the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking systems. The information embedding digital data includes usage method information corresponding to the plurality of digital watermarking schemes as usage scheme information indicating the usage digital watermarking scheme. Based on the use method information corresponding to the method, from the input digital data,
In this configuration, it is possible to extract relevant information corresponding to each of the plurality of digital watermarking schemes.

According to the present invention (claim 18), in the data processing device according to claim 1, the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking systems. The information embedding means may be configured to embed a predetermined one of the plurality of pieces of related information in the input digital data by the predetermined digital watermarking method to generate output digital data.

According to a nineteenth aspect of the present invention, in the data processing apparatus according to the first aspect, the information-embedded digital data is obtained by embedding a plurality of related information in the supplied digital data by a plurality of digital watermarking methods. The information embedding means may include a predetermined number of pieces of related information among the plurality of pieces of related information, in the input digital data, a corresponding digital watermarking scheme among the plurality of digital watermarking schemes, or the plurality of pieces of related information. It is configured to generate output digital data by embedding by a corresponding digital watermarking method different from any of the digital watermarking methods.

According to a twentieth aspect of the present invention, in the data processing apparatus according to the sixth aspect, the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking methods. The information embedding means may be configured to embed a predetermined one of the plurality of pieces of related information in the processed digital data by the predetermined digital watermarking method to generate output digital data.

According to a twenty-first aspect of the present invention, in the data processing apparatus according to the sixth aspect, the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking methods. The information embedding means may include a predetermined number of related information of the plurality of pieces of related information in the processed digital data, the corresponding digital watermarking method of the plurality of digital watermarking methods, or the plurality of pieces of related information. It is configured to generate output digital data by embedding by a corresponding digital watermarking method different from any of the digital watermarking methods.

A data recording medium according to the present invention (claim 22) records information-embedded digital data obtained by embedding relevant information in digital data to be supplied from a distributor to a user. A medium having a fixed length first digital data;
And a variable-length second data portion. The first data portion includes usage method information indicating a digital watermarking method used for embedding related information in the supply digital data. Embedded in the second
The related information is embedded in the data portion of the second data portion using the appropriate digital watermarking scheme based on the usage scheme information. It has a data structure capable of extracting or removing related information.

According to a twenty-third aspect of the present invention, in the data recording medium according to the twenty-second aspect, the usage mode information is embedded in a first data portion of the information-embedded digital data by a predetermined digital watermarking scheme. Is what it is.

According to a twenty-fourth aspect of the present invention, in the data recording medium according to the twenty-second aspect, the first data portion of the information-embedded digital data includes, as the usage method information, information related to the supplied digital data. The information includes a plurality of use method information indicating different use digital watermarking methods used in the embedding process.

[0050] The data recording medium according to the present invention (claim 25) is an information embedding digital data obtained by embedding related information as digital data in supply digital data to be supplied from a distributor to a user. A data recording medium recording information associated with the information-embedded digital data and usage method information indicating a used digital watermarking method used for embedding the related information in the supply digital data; Has a data structure capable of performing a process of extracting or removing the related information using an appropriate digital watermarking method based on the usage method information.

According to a twenty-sixth aspect of the present invention, in the data recording medium according to the twenty-fifth aspect, a different digital watermarking scheme used for embedding related information in the supplied digital data is used as the usage scheme information. A plurality of usage method information is recorded.

[0052]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present inventor has conducted further studies on a digital watermarking technology and a digital data distribution system in recent years. As a new problem, when the digital distribution system is adopted in a digital distribution system, It has been found that there are various problems as the current digital watermarking system, which is a major problem. In other words, unlike the distribution of music data on a data recording medium, the supply of music data by electronic distribution can be performed very easily, and the number of distribution sources is considered to be very large. It is not feasible to unify the digital watermarking method among the distribution sources. Also, in the electronic distribution system, music data is extremely easy to obtain and there is a high possibility of illegal copying.Therefore, unifying the digital watermarking method into a single method requires that the music data be decoded when the digital watermarking method is decrypted. This is undesirable from the viewpoint that unauthorized use of data cannot be controlled.

Hereinafter, problems in such an electronic distribution system and countermeasures thereof will be specifically described. FIG.
Shows the flow of digital music data in the electronic distribution system. As shown in FIG.
Is connected to the receiving and recording device 200, and on this network N, there is information embedded digital data in which information is embedded by various electronic watermarking methods.
Here, three schemes (A scheme, B scheme, and C scheme) are cited as digital watermarking schemes, and the receiving and recording apparatus 200 stores digital audio data Da, Db, Dc is supplied. Further, the reception recording device 200 is configured to record the received digital data Do1 on the data recording medium Rd. Further, in this system, the digital data Do2 recorded on the data recording medium Rd is reproduced by the reproducing device 300 equipped with the data recording medium Rd. It is assumed that a personal computer is used as the reception and recording device 200, and a semiconductor player or a DVD player, which is a home appliance, is assumed as the playback device 300. In the electronic distribution system having such a configuration, first, the digital audio data Da, Db, Dc
Is received by the receiving and recording apparatus 200, and the received digital audio data is output to the data recording medium Rd as output digital data Do1. Then, the output digital data Do1 is recorded on the data recording medium Rd.

Next, the reproduction digital data Do2 read from the data recording medium Rd is reproduced in the reproducing apparatus 300 on which the data recording medium Rd is mounted.
By the way, the playback device 300 is a household electrical appliance, and once sold, it is difficult to change the specifications after that. Therefore, the digital watermarking method used in the playback device 300 is changed. It is difficult to do.
Therefore, in such a music data electronic distribution system, although it is necessary to supply the reproduction apparatus 300 with digital music data corresponding to a predetermined digital watermarking method, the distribution source of each digital music data is different. There is a problem that it is impossible to unify the digital watermarking method into a single method.

In order to solve such a problem, the present inventors first made the personal computer as the receiving and recording apparatus compatible with digital data processed by various digital watermarking systems by changing software. We focused on the point that is possible. However, simply changing the software does not allow the receiving and recording device 200 to specify in which digital watermarking method information has been embedded in the received digital data. Extraction of embedded information cannot be performed. In other words, the arithmetic process in the process of extracting or removing embedded information from digital data is the reverse of the arithmetic process of embedding information in digital data, and is the same in the information embedding process and the information extraction process. Is used. For this reason, unless the digital watermarking scheme used in the information embedding process can be specified, the above described embedded information extraction process or removal process cannot be performed.

Therefore, the present inventors have further studied and as a result, in such an electronic distribution system, in a receiving / recording device constituted by a personal computer, an information embedding process corresponding to received digital data is performed. By installing a function to specify the used digital watermarking system, digital data embedded with information by various digital watermarking systems can be used as a device-specific digital watermarking system employed in a playback device that is the home appliance. (For example, a general-purpose digital watermarking system).

For example, the digital data Da, Db, and Dc recorded in the three systems described above, that is, the A system, the B system, and the C system, are converted into digital data Dx corresponding to a device-specific electronic watermark system. be able to. Specifically, embedded information is extracted from the received digital data by the same digital watermarking scheme as that used for the information embedding processing, and the embedded digital information is extracted from the received digital data. The embedding information corresponding to the method is embedded by an electronic watermark method unique to the device. Thus, regardless of the digital watermarking method used for the received digital data, the playback device, which is a home appliance, does not care about the digital watermarking method corresponding to the received digital data. Therefore, the reproduction process can be appropriately performed.

Hereinafter, embodiments of the present invention will be described. Embodiment 1 FIG. FIG. 1 is a block diagram for explaining a data processing device according to the first embodiment of the present invention. The data processing device 110 according to the first embodiment includes a network N
Various information-embedded digital data Dau corresponding to different digital watermarking schemes are obtained from the above network signal Sn, and each of the information-embedded digital data is processed so as to correspond to a predetermined digital watermarking scheme. Digital data corresponding to the digital watermarking method is recorded on a data recording medium.

Here, for the sake of explanation, the data processing device 110 performs the above-described various information embedding digital data D
As shown in FIG. 23, au receives digital data Da, Db, and Dc corresponding to each of the three digital watermarking schemes (scheme A, scheme B, and scheme C). The digital data Da is distributed audio data and digital data obtained by embedding relevant information (embedded information) related to the supplied audio data as an electronic watermark in the supplied audio data to be supplied to the user from the distribution source. Db is distributed audio data obtained by embedding the related information in other supplied audio data by the method B, and digital data Dc is distributed audio data obtained by embedding the relevant information in the other supplied audio data by the method C. It is. In addition, the above-mentioned predetermined digital watermarking system is a general-purpose digital watermarking system employed in a playback device as a home appliance such as a semiconductor player or a DVD player.

That is, the data processing device 110 according to the first embodiment
an acquisition unit (data acquisition means) for acquiring the information-embedded digital data Dau, which is one of the digital data Da, Db, and Dc, as input digital data from n
111. Here, the acquisition unit 111 converts the network signal Sn received from the network N via the interface 111a into digital data by a decoding process by transmitting and receiving a transmission signal to and from the network N. And a received signal decoder 111b. Specifically, the reception signal decoder 111b is configured to decode the network signal Sn and output the information-embedded digital data Dau as input digital data (distribution audio data).

The data processing apparatus 110 has a function (method information obtaining means) for obtaining, from the input digital data, usage mode information indicating a digital watermarking scheme used for embedding the related information in the supplied audio data. ) And an extraction unit 112 for extracting embedded information (related information) from the input digital data by the use digital watermarking method based on the acquired use method information. Here, the control unit 11
5 is a CPU for controlling various arithmetic processing and data processing
And a RAM that stores an operation program of the CPU and that also operates as an execution memory. Therefore, in the control unit 115, the method information obtaining means is mounted on the CPU. The extracting unit 112 is configured by a custom LSI. The extraction unit 112 extracts the embedded information from the digital data Da by the digital watermarking method A.
And a system B extracting unit 112b for extracting embedded information from the digital data Db by the digital watermarking system B, and a system C extracting unit 112c for extracting embedded information from the digital data Dc by the digital watermarking system C.

The data processor 110 inserts the extracted embedded information into the input digital data (distributed audio data) by the predetermined digital watermarking method to generate output digital data (information embedding means). 113 and a storage unit 114 for storing the output digital data. Here, the insertion unit 113 is configured by a custom LSI, and the recording unit 114 is a DVD-ROM for writing and reading the output digital data to and from a DVD-RAM disk.
A RAM drive is mounted.

In the data processing device 110,
The acquisition unit 111, the extraction unit 112, the embedding unit 113,
The recording unit 114 and the control unit 115 include a data bus Dbus
The operation of the acquisition unit 111, the extraction unit 112, the embedding unit 113, and the recording unit 114 is controlled by the control unit 115. That is, in addition to the method information obtaining operation of obtaining the used digital watermarking method information from the input digital data, the control unit 115 obtains the information-embedded digital data Dau from the network signal Sn by the obtaining unit 111, and extracts the information. Information extraction processing by the embedding unit 11
3 and the writing operation of the output digital data in the recording unit 114 is controlled.

In the data processing apparatus 110 according to the first embodiment, the digital data acquisition unit 111 receives a network signal Sn from a network N via a communication line, decodes the network signal Sn, and decodes the received signal. Although the configuration including the network interface 111a and the reception signal decoder 111b for acquiring the data Dau has been described, the configuration of the digital data acquisition unit is not limited to this. For example, the digital data acquisition unit 111 includes an antenna for receiving broadcast radio waves and a reception wave decoder for demodulating a reception output from the antenna, and acquires an output of the reception wave decoder as information embedded digital data Dau. It may be.

The digital data acquisition section comprises a modem device connected to a telephone line or a coaxial cable, and converts an analog transmission signal from the telephone line or a coaxial cable into the information embedded digital data by the modem device. This information embedded digital data may be obtained as input digital data.
Further, the digital data acquisition unit is a DVD-RO
A large-capacity storage device that reads the information-embedded digital data Dau from a large-capacity data storage medium that can handle multimedia data, such as a disk recording medium such as M, DVD-RAM, and CD-ROM, or a semiconductor medium, may be used. .

Further, in the first embodiment, the extraction unit 112 and the embedding unit 113 of the data processing device are each configured by a separate custom LSI, but the extraction unit 112 and the embedding unit 113 are formed by one custom LSI. LS
I. Since the extraction unit 112 and the embedding unit 113 perform many common processes,
It is desirable to configure them with one custom LSI from the viewpoint of reducing the number of parts. Further, in the first embodiment, the extraction unit 112 and the insertion unit 113 of the data processing device are configured by a custom LSI, but these parts include a CPU that performs arithmetic processing and an execution program that stores the arithmetic program. You may comprise from RAM as a memory. In particular, in this case, it is possible to share components such as a CPU and a memory between the extraction unit 112 and the insertion unit 113 and the control unit 115, and it is possible to effectively reduce the number of components. . Further, in the first embodiment, the recording unit of the data processing device is configured by a DVD-RAM drive.
A large-capacity writable storage device capable of handling multimedia data, such as a drive or a semiconductor media writing device, may be used.

(Data Structure of Digital Data) Next, the data structure of the information embedded digital data Dau obtained from the network signal Sn on the network N and the output digital data output from the insertion unit 113 will be described. These digital data have the same data structure, and FIG. 2 shows the data structure of the information embedded digital data Dau. This information-embedded digital data Dau includes a first data portion Dau1 and a second data portion Dau2. Although the size of the information-embedded digital data Dau is variable,
The data portion Dau1 has a fixed size. Therefore, in the data processing device that has acquired the information embedded digital data Dau, the first data portion Dau1 and the second
Can be identified from the data portion Dau2.

Here, the digital data in the first data portion Dau1 indicates a digital watermarking scheme to be used by a predetermined digital watermarking scheme, that is, a general-purpose scheme among the digital watermarking schemes A, B, and C. Usage method information is inserted. On the other hand, in the digital data in the second data part, related information (embedded information) such as copyright information is embedded as an electronic watermark by the electronic watermark method indicated by the usage method information.

Although FIG. 2 does not show the output digital data output from insertion section 113, in the first embodiment, the data structure of the output digital data is also the data structure of information embedded digital data Dau. Is the same as That is, the output digital data is composed of a first data portion having a fixed length and a second data portion having a variable length. The digital data of the first data portion includes the usage mode information indicating the used digital watermarking mode. In addition, related information (embedded information) is embedded in the digital data of the second data portion by a used digital watermarking method.

In the first embodiment, the first digital data embedded in information and the first digital data in output digital data are used.
Although the size of the data portion is fixed length, when the attribute information indicating the attribute is added to these digital data, the size of the first data portion can be variable length. However, in this case, it is necessary to insert size information indicating the size of the first data portion into the attribute information. Further, even when the information-embedded digital data and the output digital data include information indicating the end point of the first data portion, the size of the first data portion can be variable.

In the first embodiment, in the information embedded digital data and the output digital data, the data portions are arranged such that the variable length second data portion is located immediately after the fixed length first data portion. However, in the information embedded digital data and the output digital data, the data portions may be arranged such that the fixed-length first data portion is located immediately after the variable-length second data portion. Furthermore, in the information-embedded digital data and the output digital data, the first data portion, which is a fixed-length data portion, and the second data portion, which is a variable-length data portion, are dispersedly mixed at a plurality of locations. Is also good.

(Data Structure of Usage Method Information) Next, the data structure of the usage method information Ium indicating the above-described digital watermarking method will be described. This usage method information is embedded in the first data portion of the information-embedded digital data Dau by a general-purpose digital watermarking method (for example, digital watermarking method A). Here, the usage method information is 2-bit data. The control unit 11 in the data processing device 110
In step 5, based on the value of the data, usage method information indicating the digital watermarking method used in the process of embedding the related information in the supplied audio data is acquired.

FIG. 3 shows the values of the first and second bits in 2-bit data as usage method information.
Here, the value “00” of the use method information means that the input digital data does not have the embedded information by the digital watermark method. Also, the value “0” of the usage method information
“1”, “10”, and “11” mean that the input digital data has related information (embedded information) embedded by digital watermarking schemes A, B, and C, respectively. Next, the operation will be described.

(Acquisition of Digital Data) First, in the data processing device 110, a process of acquiring required digital data from the network signal Sn on the network N is performed by the acquisition unit 111. Here, the required digital data is digital audio data, and copyright information is added to the supplied audio data to be supplied from the distribution source to the user by a predetermined digital watermarking method (for example, digital watermarking method A). Information embedded digital data (distribution audio data) in which related information such as
Dau. Specifically, a network signal (transmission signal) transmitted from the network N via the network cable and corresponding to the required digital data.
Sn is the network interface 1 of the acquisition unit 111.
11a. The received network signal Sn is converted to the required digital data Dau by a decoding process in a received signal decoder. The required digital data Dau acquired in this manner is passed through the data bus Dbus to the extraction unit 112, the insertion unit 113, and the control unit 115.
Sent to

In this case, the data processing device 110
In, the data conversion process is performed on all the acquired digital data, but only the digital audio data selected by the user of the device among the received digital data is converted. Processing may be performed. Also, here, a case has been described where the digital data received by the data processing device is only the information embedded digital data Dau, but the digital data received by the data processing device is subjected to data conversion processing. If it is possible to determine that the digital data is the target digital data, the data processing device may be configured to receive other types of digital data other than the information embedded digital data Dau.

(Acquisition of Usage Method Information) and Acquisition Unit 11
The information embedded digital data Dau obtained in step 1
Extraction unit 112 and control unit 1 via data bus Dbus
It is sent to 15. In the control unit 115, since the information-embedded digital data Dau is composed of the fixed-length first data portion Dau1 and the variable-length second data portion Dau2, the first data portion in the information-embedded digital data Dau is Based on the control signal from the control unit 115, the extraction unit 112 performs a process of acquiring the usage method information from the first data portion. That is, in the extraction unit 112, based on the control signal from the control unit 115,
First data portion D of information embedded digital data Dau
From au1, usage method information inserted by a predetermined digital watermarking method is extracted. Here, since the digital data of the first data portion includes 2-bit data having the value “01” as usage method information, the extraction unit 112 uses Usage method information indicating the digital watermarking method A is obtained. Then, the obtained usage method information is stored in the execution memory of the control unit 115.

Here, the predetermined digital watermarking method is as follows.
Although the general-purpose digital watermarking scheme A is used, depending on the configuration of the control unit 115, any of schemes A, B, and C may be used for the embedding processing of the usage scheme information. May be used. In addition, here, the first data portion includes only the use mode information, but other information may be included.

(Extraction of embedded information) The second data portion Dau2 of the information-embedded digital data Dau sent from the acquisition unit 111 to the extraction unit 112 via the data bus Dbus contains the above-mentioned usage method information acquired. The related information is embedded by the digital watermarking method A shown in FIG. The extraction unit 112 extracts related information (embedded information) from the information-embedded digital data Dau based on the usage mode information stored in the execution memory of the control unit 115.
Then, the extracted embedded information is stored in the control unit 115.
Is temporarily recorded in the execution memory.

(Re-embedding of embedded information) In the inserting section 113, the embedded information held in the execution memory of the control section 115 is embedded in the information embedding digital data Dau from the acquisition section 111 by a predetermined digital watermarking method. The embedding process is performed again to generate output digital data. At this time, the embedded information embedded in the second data portion of the information-embedded digital data Dau is embedded again in the second data portion Dau2 of the information-embedded digital data Dau by a predetermined digital watermarking method. At the time of the re-embedding process of the embedded information, the digital watermarking method used is such that the first data portion Dau1 of the information-embedded digital data Dau is used so that the embedded information is embedded by the predetermined digital watermarking method. Is inserted. The digital watermarking scheme used in this case is the default digital watermarking scheme. Then, the created output digital data is supplied to the recording unit 114 via the data bus Dbus.

(Recording of Output Digital Data) When output digital data is supplied from the insertion unit 113 to the recording unit 114 via the data bus Dbus, the output digital data is stored in the DVD-RAM disc by the recording unit 114. Is stored in At this time, since a file system is constructed on the DVD-RAM disc, the obtained output digital data is recorded on the DVD-RAM disc with an arbitrary file name. Here, the digital audio data is recorded with an arbitrary file name using the file system of the DVD-RAM disk, but the present invention is not limited to this.

For example, digital audio data is simply DV
The recording may be performed from the beginning of the recording area of the D-RAM disk. Digital audio data DVD-
At the time of recording on the RAM disk, an empty area of the disk may be searched as appropriate, and digital audio data may be written into this empty area. Further, the user of the apparatus may specify a write destination area of the DVD-RAM disc, and digital audio data may be written to the specified write destination area. In the first embodiment, the digital audio data is stored in the DVD-RAM
The file name when recorded on the disc is arbitrary, but the file name may be specified by the user, and the file name described in the attribute information attached to or included in the digital data is used. You may make it.

As described above, in the data processing apparatus 110 according to the first embodiment, the acquisition unit that acquires the information embedded digital data Dau in which the related information such as the copyright information is embedded as the electronic watermark from the network signal Sn on the network N. 111, and a control unit 115 for obtaining usage mode information indicating a digital watermarking mode used when embedding copyright information or the like. According to the obtained usage mode information,
Extracting embedded information such as copyright information from information embedded digital data Dau using an appropriate digital watermarking method,
By embedding the embedding information such as the copyright information again in the information embedding digital data Dau by a predetermined digital watermarking method, and generating the output digital data and recording it on the recording medium, the received information embedding digital data Dau is Even if the related information is embedded by a digital watermarking method, the playback device, which is a home appliance, reproduces the information embedded digital data Dau recorded on the recording medium by embedding copyright information or the like. It can be performed appropriately according to the information.

That is, by embedding the used digital watermarking system information in the information-embedded digital data on which the related information has been embedded by the digital watermarking system,
The data processing device that has acquired the information-embedded digital data can determine which digital watermarking method is used to embed the related information. This allows the data processing device to use other methods to extract incorrect information when extracting embedded information,
Extraction and removal of embedded information can be performed without erroneously altering parts other than embedded information by using another method when removing embedded information. As a result, distributors that distribute digital data such as audio data to users can embed relevant information as digital watermarks in the supplied digital data using the required digital watermarking method. Becomes In other words, the distribution source of the digital data, particularly when the digital data is recorded on the recording medium by the user side, according to the content of the digital data,
It is possible to select a method that causes the least deterioration due to information embedding. In addition, it is possible to select an optimal method according to the communication speed at the time of transmitting the digital data.

When the information-embedded digital data obtained from the network N is recorded on a writable recording medium, the digital watermarking method used for the information embedding process on the digital data written on the recording medium is as follows. It can be different from the digital watermarking scheme used for the information embedding process at the distribution source for the supplied digital data. As a result, it is possible to insert the embedded information into the digital data by a digital watermarking scheme according to the device from which the digital data is reproduced.

Embodiment 2 FIG. 4 is a block diagram for explaining a data processing device according to the second embodiment of the present invention. The data processing apparatus 120 according to the second embodiment acquires digital audio data (distributed audio data) Dau as input audio data from a network signal Sn on the network N, and indicates an attribute of the distributed audio data Dau. Audio data attribute information (hereinafter also simply referred to as attribute information) is acquired, and based on the control information included in the attribute information, the information is embedded in the input audio data and the input audio data is reproduced. I have.

Here, the information-embedded digital audio data Dau is digital audio data (supplied audio data) to be supplied from the distributor to the user at the distributor.
The information is obtained by embedding information by various electronic watermarking methods. Further, the audio data attribute information is transmitted from the distribution source along with the audio data Dau when transmitting the information embedded digital audio data Dau. As the transmission form of the audio data attribute information, there is a form in which the audio data Dau is arranged and transmitted at a predetermined position (fixed position) in the transmitted audio data Dau, a form in which the audio data Dau is multiplexed and transmitted, There is a form in which the data is transmitted as data of a file different from the audio data Dau to be transmitted.

Hereinafter, an electronic distribution system of audio data including the data processing device 120 according to the second embodiment will be described in detail. In this electronic distribution system, the information-embedded digital audio data Dau is electronically distributed together with the corresponding audio data attribute information from the distribution source via a network N by a network signal Sn.

Here, the audio data attribute information has a data structure including at least used digital watermark system information (used system information). The use method information is information indicating a digital watermark method (used digital watermark method) used when the relevant information is embedded in the supplied audio data by the distribution source. It goes without saying that the audio data attribute information may include other information in addition to the above-mentioned usage method information.

Further, depending on the mounting method of the digital watermarking method, even if information corresponding to each of the plurality of digital watermarking methods is embedded in one target audio data to be embedded, a plurality of pieces of embedded information are mutually exchanged. May not affect each other. For example, in one digital watermarking method, information is embedded in a high-frequency area of target audio data, and in another digital watermarking method, information is embedded in a low-frequency area of target audio data.

(Data Structure of Used Digital Watermarking Method Information)
In the second embodiment, in order to cope with such a case, the used digital watermarking system information is used for each of a plurality of digital watermarking systems to determine whether or not each system has been used for information embedding processing in the supplied audio data. It has a data structure that can set method usage information indicating whether the method is used. FIG. 5 is a diagram showing a data structure of the used digital watermarking system information Ium. The used digital watermarking system information Ium includes a plurality of systems respectively corresponding to a plurality of digital watermarking systems (here, n digital watermarking systems) which may be used at the time of the information embedding process at the distributor. Usage status information Ium (1), Ium
, Ium (n).

More specifically, method (1) usage status information Ium
(1) indicates whether or not the digital watermarking method (1) has been used for the information embedding process on the supplied audio data. The value "1" of the information Ium (1) indicates that the digital watermarking method (1) has been used for the information embedding process at the distributor, while the value "0" of the information Ium (1) is This indicates that the digital watermark method (1) is not used for the information embedding process at the distribution source. The method (2) usage information Ium (2),..., Method (n) usage information Ium (n) is also the same as the method (1) usage information Ium (n).
Similarly to (1), this indicates whether or not the digital watermarking schemes (2),..., (N) have been used for the information embedding processing on the supplied audio data. And the information Ium (2), ...
., Ium (n) value "1" indicates that the corresponding digital watermarking scheme (2),..., (N) has been used for the information embedding process at the distribution source. 2),
,..., Ium (n) value “0” indicates that the corresponding digital watermarking scheme (2),..., (N) is not used for the information embedding process at the distribution source.

(Data Structure of Embedded Information) The embedded information in the digital audio data with embedded information is:
The data structure includes at least reproduction permission information. The reproduction permission information is information indicating whether or not reproduction of the information-embedded digital audio data Dau acquired as the input digital audio data is permitted. The value "1" of the reproduction permission information indicates that the reproduction of the audio data is permitted, and the value "0" of the reproduction permission information indicates that the reproduction of the audio data is not permitted.

(Structure of Data Processing Apparatus) The data processing apparatus 120 according to the second embodiment obtains the information embedded digital audio data (distributed audio data) Dau as input digital audio data from a network signal Sn on the network N. An acquisition unit (data acquisition unit) 121 for acquiring audio data attribute information transmitted along with the distributed audio data Dau, and an extraction unit for extracting embedded information from the information-embedded digital data Dau based on a control signal 122.

Here, the acquisition unit 121 includes a network interface 121a for transmitting / receiving a network signal Sn to / from the network N;
It is composed of a digital audio data Dau embedded with information and a received signal decoder 121b for generating audio data attribute information by performing a decoding process on the network signal Sn from 21a. The extracting unit 122 includes a method (1) extractor 121a1 corresponding to the digital watermarking methods (1), (2),..., (N), and a method (2) extractor 121a2.
, ..., method (n) having an extractor 121an,
Based on the control signal, a required extractor is configured to extract embedded information in the information-embedded digital audio data Dau.

For example, the above method (1) extractor 121a1
Is configured to extract embedded information from the digital audio data Dau with embedded information by the digital watermarking method (1). The above method (2) The extractor 121a2 is configured to extract embedded information from the digital audio data Dau with information embedded by the digital watermarking method (2). The method (n) extractor 121an is configured to extract embedded information from the digital audio data Dau with information embedded by the digital watermarking method (n).

The data processing apparatus 120 according to the second embodiment converts the embedded information extracted by the extraction section 122 into the information by a predetermined digital watermarking method adopted in a playback apparatus as a home appliance. It has an insertion unit 124 that re-embeds the embedded digital data Dau to generate output digital data, and a recording unit 125 that records the output digital data.

Further, the data processing apparatus 120 according to the second embodiment includes a reproducing section 123 for reproducing the information-embedded digital audio data Dau acquired by the acquiring section 121 based on a control signal, and the above-mentioned sections 121 to 125 Is controlled by a corresponding control signal. Here, the reproducing unit 123 is an audio decoder 123 that converts the information-embedded digital data Dau into an audio signal.
a and a speaker 123b for converting the audio signal into audio. The control unit 126 includes a CPU that performs various arithmetic processing and data processing, and a RAM (random access memory) that stores an operation program of the CPU, and controls the operation of each of the units 121 to 125. Configuration. The RAM
The device also serves as an execution memory for temporarily storing audio data and audio data attribute information output from the above-described units.

The control unit 126 specifically determines the value of each system usage status information based on the used digital watermarking system information included in the audio data attribute information acquired by the acquisition unit 121. In accordance with the determination result, the embedded information extraction processing in the scheme extractor corresponding to each digital watermarking scheme is controlled, and based on the reproduction permission information included in the extracted embedded information, the audio data Dau in the reproduction unit 123 is output. Is controlled. Specifically, here, if the value of the reproduction permission information included in all the scheme use status information constituting the used digital watermark scheme information is “1”, the control unit 126 sets the reproduction unit 123
The reproduction of the audio data Dau is permitted in the reproduction unit 12.
3 is controlled to reproduce the audio data Dau.

In the data processing device 120, the above-described units are mutually connected by a data bus Dbus, and the acquisition unit 121, the insertion unit 124, and the recording unit other than the extraction unit 122 and the reproduction unit 123 are connected. The part 125 also
It is controlled by the control unit 126.

The extracting unit 122 and the inserting unit 124
Are each realized by a custom LSI. The recording unit 125 is realized by a DVD-RAM drive, and stores the output digital audio data in a DV format.
The data is recorded on a D-RAM disk. Next, the operation will be described.

(Acquisition of Voice Data Dau and its Attribute Information Dpr) The network signal Sn supplied from the network N via the network cable is acquired by the acquisition unit 121.
Is received by the network interface 121a, the received network signal Sn is output to the received signal decoder 121b. In the reception signal decoder 121b, digital audio data Dau embedded with information and audio data attribute information Dpr transmitted accompanying the audio data Dau are generated by decoding the network signal Sn. The audio data Dau acquired by the acquisition unit 121 in this way is sent to the extraction unit 122 and the insertion unit 124 via the data bus Dbus, and the audio data attribute information Dpr is sent to the control unit 126 via the data bus Dbus. Sent. In the control unit 126, the supplied audio data attribute information is temporarily stored in a RAM as an execution memory.

(Extraction of Embedded Information) The control unit 126
Then, based on the used digital watermarking system information included in the audio data attribute information Dpr, the extraction unit 1 receives
An operation for controlling 22 is performed. That is, a control signal is supplied to the corresponding scheme extractor in accordance with the value of each scheme usage status information constituting the used digital watermark scheme information. Specifically, first, the control unit 126 refers to the value of the method (1) use status information in the used digital watermark method information.
If the value of this method (1) usage status information is “1”, the method (1) of the extraction unit 122 extracts the embedded information in the input voice data Dau by the digital watermarking method (1) for the extractor 122a1. Is output.
Thereby, in the method (1) extractor 122a1, information embedded in the audio data Dau sent to the extraction unit 122 by the digital watermark method (1) is extracted by the digital watermark method (1). The embedded information extracted in this way is temporarily recorded in the execution memory of the control unit 126 via the data bus Dbus. On the other hand, if the value of the method (1) usage status information is “0”, the control signal for instructing the method (1) extractor 122a1 of the extraction unit 122 to extract the embedded information in the input voice data Dau. Is not output.

Next, the control unit 126 refers to the value of the method (2) use status information in the used digital watermark method information. If the value of the method (2) usage status information is "1", the method (2) of the extracting unit 122 sends the input audio data D to the extractor 122a2 by the digital watermarking method (2).
A control signal instructing extraction of embedded information in au is output. As a result, in the method (2) extractor 122a2, information embedded in the audio data Dau sent to the extraction unit 122 according to the digital watermarking method (2) is
It is extracted by the digital watermarking method (2). The embedded information extracted in this way is temporarily recorded in the execution memory of the control unit 126 via the data bus Dbus. On the other hand, if the value of the method (2) usage status information is “0”, the method (2) extractor 122a2 of the extracting unit 122:
No control signal for instructing extraction of the embedded information in the input voice data Dau is output. In this way, in the control unit 126, the process of supplying the control signal to the corresponding scheme extractor according to the value of the scheme usage status information is performed for all scheme usages that may be used at the distribution source. This is sequentially performed for each situation information (method (1) usage status information to method (n) usage status information). In response to this, each system extractor inputs input audio data Dau based on a control signal from control unit 126. Of the embedded information is performed. Thereby, a plurality of embedded information can be obtained.

(Reproduction of audio data Dau) Then, the control unit 126 determines the value of the reproduction permission information included in all the embedded information obtained by the above-described embedded information extraction processing. A control signal indicating whether or not to reproduce the input digital audio data Dau is transmitted to the reproduction unit 1.
23. In other words, if the value of the reproduction permission information included in all the system usage status information constituting the used digital watermarking system information is “1”, the control unit 126 causes the reproduction unit 1
The reproduction of the audio data Dau at 23 is permitted. Then
Under the control of the control unit 126, the audio data Dau is obtained
21 to the reproducing unit 123 via the data bus Dbus. In the reproducing unit 123, the received audio data Dau
Is converted into an audio signal by the decoding process in the audio decoder 123a, and the audio corresponding to the audio signal is reproduced and output from the speaker.

(Re-embedding of embedded information) In the data processing device 120, independently of the reproduction process of the audio data Dau acquired by the acquisition unit 121, the embedded information extracted from the audio data Dau is independent. Is again embedded in the audio data Dau by a predetermined digital watermarking method. Here, the predetermined digital watermarking scheme is a digital watermarking scheme employed in a playback device as a home appliance. That is, as described above, the control unit 126 uses the digital watermarking scheme used for embedding the information in the target audio data at the distribution source based on the value of each scheme usage status information in the used digital watermarking scheme information. The embedding information embedded by each digital watermarking method is supplied to the insertion unit 124 based on the result of the judgment. The insertion unit 124 has the audio data D supplied from the acquisition unit 121.
The embedded information supplied from the control unit 126 is embedded in au again by the above-mentioned predetermined digital watermarking method, and output digital audio data is generated.

(Recording of Output Digital Audio Data) The output digital audio data generated by the insertion section 124 is
The data is supplied to the recording unit 125 and is recorded on a recording medium based on a control signal from the control unit 126. Here, the recording unit 1
25 is realized by a DVD-RAM drive,
The output digital audio data is stored on a DVD-RAM disk. In the second embodiment, if the value of the reproduction permission information included in all the scheme usage status information that constitutes the used digital watermark scheme information is “1”, the control unit transmits the audio data Dau Of the audio data D in the reproduction unit 123.
The conditions for permitting au playback are not limited to this. For example, the reproduction may be permitted if the value of at least one reproduction permission information included in all of the method use status information constituting the used digital watermark method information is “1”. Also, a weighting factor is set for each system usage status information that constitutes the used digital watermarking system information, and the product of the weighting factor and the value of the reproduction permission information included in each system usage status information is used for all the system usage statuses. The reproduction of the audio data Dau may be permitted depending on whether or not the total sum of the situation information exceeds a certain threshold.

As described above, in the second embodiment, the network signal Sn on the network N is received, and the digital audio data Dau and the audio data attribute information Dau are embedded.
an acquisition unit 121 for acquiring pr; audio data attribute information Dpr
The embedded information embedded in the audio data Dau by various electronic watermarking schemes is extracted based on each scheme usage status information in the used digital watermarking scheme information included in the audio data Dau, and the audio data Dau is extracted based on each embedded information. Therefore, the data processing device that receives the audio data Dau controls the reproduction of the audio data Dau based on the embedding information embedded in the audio data Dau by various electronic watermarking methods at the distributor. Can be performed correctly.

Further, since each of the above embedded information is re-embedded in the audio data Dau by a predetermined electronic watermarking method and recorded on the recording medium, the source of the audio data Dau uses various electronic watermarking methods. Even when information is embedded, it is possible to convert embedded information corresponding to various electronic watermarking schemes in the audio data Dau into embedded information corresponding to a predetermined electronic watermarking scheme.
As a result, similarly to the first embodiment, even in a playback device, which is a home appliance that employs a predetermined digital watermarking method, a playback device is supplied from a network in accordance with embedded information embedded by various digital watermarking methods. It is possible to satisfactorily perform the reproduction processing of the digital voice data Dau embedded with information.

In the second embodiment, the acquired information-embedded digital audio data (distributed audio data) Dau is reproduced by the reproducing unit 123, but the embedded information is re-inserted into the distributed audio data Dau. The obtained data may be reproduced by the reproducing unit 123. In the second embodiment, it is assumed that the information-embedded digital data is obtained by embedding a plurality of pieces of related information in the supply digital data by a plurality of digital watermarking methods. A predetermined number of related information of the plurality of related information is embedded by a corresponding digital watermarking method of the plurality of digital watermarking methods or a corresponding digital watermarking method different from any of the plurality of digital watermarking methods. The output digital data may be generated.

Embodiment 3 FIG. 6 is a block diagram for explaining a data processing device according to the third embodiment of the present invention. The data processing device 130 according to the third embodiment includes information-embedded audio data (embedded information) obtained by embedding information into digital audio data (supply audio data) to be supplied from a distribution source to a user by various electronic watermarking methods. (Distributed voice data) Dau is obtained from the network signal Sn on the network N or various data recording media, and it is determined whether or not the obtained distributed voice data Dau is data in which information is embedded by a predetermined digital watermarking method. According to the determination result, the acquired distributed voice data Dau is
The embedded information is reinserted. Here, the predetermined digital watermarking scheme is a general-purpose scheme used in a playback device or the like as a home appliance. Further, in the data processing device 130, the acquired audio data Dau
When the embedded information is embedded by a predetermined digital watermarking method, the audio data Dau is recorded as it is on the data recording medium. On the other hand, when the embedded information of the acquired audio data Dau is embedded by a digital watermarking method other than the predetermined electronic watermarking method, the embedded information is extracted from the audio data Dau by the corresponding electronic watermarking method, Re-embedded audio data obtained by embedding the embedded information in the audio data Dau again by a predetermined digital watermarking method is recorded on a recording medium.

Hereinafter, a sound data supply system including the data processing device 130 according to the third embodiment will be described in detail. In this supply system, the distribution audio data may be supplied by electronic distribution from the network N or may be supplied by distribution of a data recording medium.

(Data Structure of Audio Data) In the third embodiment, the supplied distributed audio data has a data structure that does not particularly include information on the digital watermarking method. For this reason, the data processing device 130 is configured to determine the digital watermarking scheme used in the process of embedding the information in the supplied audio data based on the audio data acquisition path. In other words, for digital data such as the audio data, the digital watermarking scheme is determined in advance according to the supply form, and by specifying the acquisition route, the digital watermarking scheme used for the information embedding process for this data is specified. Is possible. For example, when audio data is supplied via a network, a digital watermarking method according to a protocol used for communication is used. When audio data is supplied by a recording medium, a digital watermarking method according to the type of the recording medium is used. For this reason, in the audio data supply system of the third embodiment, the method of including the information (used electronic watermarking system information) indicating the digital watermarking system corresponding to the information-embedded digital audio data to be electronically distributed according to the first embodiment is described. In the second embodiment, the method of including the used digital watermark method information in the audio data attribute information attached to the digital audio data to be distributed electronically is unnecessary.

(Structure of Data Processing Apparatus) The data processing apparatus 130 of the third embodiment obtains the above-mentioned information-embedded digital audio data as distribution audio data from a network signal Sn on the network N, and also acquires the digital audio data from a data recording medium. An acquisition unit (data acquisition unit) 131 that acquires the information-embedded digital audio data as distribution audio data, and an extraction unit 132 that extracts embedded information from the distribution audio data based on a control signal. Here, the acquisition unit 131 performs a decoding process on the network interface 131a for transmitting and receiving the network signal Sn to and from the network N, and performs a decoding process on the network signal Sn from the interface 131a to obtain the information-embedded digital audio data ( A receiving signal decoder 131b for generating distribution audio data) and a DVD-ROM
It has a DVD-ROM drive 131c for reading information-embedded digital audio data from a disc, and a semiconductor memory access device 131d for reading information-embedded digital audio data from a semiconductor recording medium. Further, the extraction unit 132 outputs the digital watermark method (A),
It has a method (A) extractor 132a, a method (B) extractor 132b, and a method (C) extractor 132c corresponding to (B) and (C). , Embedded information in digital audio data with embedded information is extracted.

For example, the method (A) extractor 132a
The embedded information is extracted from the digital audio data with embedded information by the digital watermarking method (A). The method (B) extractor 132b is configured to extract embedded information from digital audio data with embedded information by a digital watermarking method (B). Further method (c)
The extractor 132c is configured to extract embedded information from digital audio data with embedded information by the digital watermarking method (C).

Further, the data processing device 130 of the third embodiment converts the embedded information extracted by the extraction unit 132 into the information by a predetermined digital watermarking method adopted in a playback device as a home appliance. It has an insertion unit 133 that re-embeds the embedded digital audio data to generate output audio data, and a recording unit 134 that records the output audio data. Here, the insertion unit 133 converts the extracted embedded information by the digital watermarking method (A).
Method A for embedding the above information embedded digital voice data
It has an inserter 133a. Further, the data processing device 130 according to the third embodiment includes the above-mentioned units 131 to 134
Is controlled by a corresponding control signal. In the data processing device 130, the units 131 to 135 are mutually connected by a data bus Dbus.

The extracting section 132 and the inserting section 133
Are each realized by a custom LSI. The recording unit 134 is equipped with a DVD-RAM drive, and outputs the output digital audio data to a DVD-R.
It is recorded on an AM disk. Here, the control unit 135 includes a CPU that performs various arithmetic processing and data processing, and a RAM that stores an operation program of the CPU.
(Random access memory), and controls the operation of each of the units 131 to 134. The RAM also has a role of an execution memory for temporarily storing audio data output from each of the units and information on a used digital watermarking method.

Further, the control unit 135 specifically includes:
There is a table 135a for associating the audio data acquisition path with the digital watermarking method. This table 13
5a is stored in the nonvolatile memory in the control unit 135. In addition, the control unit 135 generates information (used digital watermark) indicating the digital watermarking scheme used in the information embedding process on the acquired audio data, based on the information (acquisition path information) indicating the audio data acquisition path. Method information), and re-insertion determination means for determining whether or not to re-insert the embedded information into the acquired audio data according to the used digital watermarking method information. .

Here, the digital watermarking method for digital audio data obtained from the network signal Sn on the network N is based on information (URL: Uniform Resource L) of the connection destination of the network N connected at the time of obtaining the audio data.
ocator) and the communication protocol used for acquiring the audio data. The digital watermarking scheme for digital audio data stored in a data recording medium is determined by the type of the recording medium. Therefore, if the acquisition route of the audio data is known, the control unit 135 can determine one system as the digital watermarking system corresponding to the audio data by referring to the table 135a. In the third embodiment, the acquisition section 131 determines the acquisition route of the audio data. According to the determination result, information indicating the acquisition path of the audio data is transmitted from the acquisition section 131 to the control section 135. It is supplied to.

Further, in the third embodiment, the digital watermarking system B corresponds to the audio data obtained from the network signal Sn on the network N, and the DVD-RO
It is assumed that the audio data obtained from M corresponds to the digital watermark system A, and the audio data obtained from the semiconductor recording medium corresponds to the digital watermark system C. The default digital watermarking scheme adopted in a playback device or the like as a home appliance is a digital watermarking scheme A.

In the third embodiment, a DVD-ROM disc and a semiconductor memory are shown as data recording media.
-ROM disks and the like are considered as storage media for digital data. Since a specific digital watermarking method is also used in advance for each of these recording media, digital data stored in each of these recording media is also acquired by a corresponding electronic device based on the acquisition route. The watermark method can be determined. Next, the operation will be described.

(Acquisition of Digital Audio Data) In the data processing device 130 of the third embodiment, digital audio data is acquired from a network signal Sn on the network N or a recording medium. For example, the network signal Sn on the network N is transmitted to the network interface 131 of the acquisition unit 131 via a network cable.
The received signal decoder 131b generates digital audio data (distributed audio data) Dau with information embedded by decoding the received network signal Sn. Further, the digital audio data recorded on the DVD-ROM disc is stored in the DVD-RO of the acquisition unit 131.
The data is read by the M drive 131c. Further, the digital audio data recorded in the semiconductor memory is read by the semiconductor memory access device 131d of the acquisition unit 131. The distribution audio data acquired by the acquisition unit 131 is supplied to the extraction unit 132 and the insertion unit 133, and this digital audio data is supplied to the control unit 135 together with path information indicating the acquisition path, and is stored in the execution memory. Is stored.

Then, the control unit 135 refers to the correspondence between the data acquisition path and the digital watermark method described in the table 135a based on the path information. The acquisition unit 135
It is determined which digital watermarking method the digital audio data supplied from has been subjected to the information embedding process. This determination result is temporarily stored in the execution memory of the control unit 135.

(Extraction of embedded information) The extraction unit 132
Then, embedded information is extracted from the digital audio data acquired by the acquisition unit 131 by a digital watermarking scheme according to a control signal from the control unit 135. For example, when the control unit 135 determines that the acquired digital audio data corresponds to the digital watermarking system A, the extraction unit 132 performs the extraction process on the digital audio data by the digital watermarking system A. It is controlled to be performed. Specifically, in accordance with a control signal from the control unit 135, the method A extraction unit 132 extracts embedded information. If the control unit 135 determines that the obtained digital audio data corresponds to the digital watermarking system B, the extracting unit 132 sets the system B extracting unit 132b
The embedded information is extracted by the control unit 135, and the obtained digital audio data is
In the extraction unit 132, the embedded information is extracted by the method C extraction unit 132c.

(Determination of Reinsertion of Embedded Information) When the digital audio data acquired by the acquisition unit 131 corresponds to the digital watermarking system A, the control unit 135 is used.
Then, it is determined that it is not necessary to embed the embedding information included in the digital audio data again by another digital watermarking method. This is because the embedding information of the digital audio data can be extracted by a reproducing apparatus employing a predetermined digital watermarking method (method A), for example, an existing reproducing apparatus for reproducing a DVD-RAM disk. On the other hand, when the digital audio data acquired by the acquisition unit 131 corresponds to the digital watermarking system B, the control unit 135 embeds the embedding information in the digital audio data again by the digital watermarking system A. It is determined that it is necessary.

(Re-embedding of embedded information) If the digital audio data corresponds to the digital watermarking system A and the control unit 135 determines that the re-embedding process for the digital audio data is unnecessary, the control unit 135 Thus, no control signal is supplied to the insertion unit 133, and the digital audio data stored in the execution memory of the control unit 135 is supplied to the recording unit 134. On the other hand, if the digital audio data corresponds to the digital watermarking system B and the control unit 135 determines that the digital audio data needs to be re-embedded, the insertion unit 133 sends the digital audio data to the control unit 135. Is embedded in the digital audio data (distributed audio data) with the digital watermarking method A to embed information in the distributed audio data again.

(Recording of Digital Audio Data) The digital audio data determined to correspond to the digital watermarking system A by the control unit 135 is recorded in the recording unit 134 without being re-embedded by the insertion unit 133. Is done. On the other hand, the digital audio data determined by the control unit 135 to correspond to a system other than the digital watermarking system A is
After the re-embedding process is performed by the digital watermarking method A in 3, it is stored in the recording unit 134. As described above, in the third embodiment, in addition to the configuration of the data processing device 110 of the first embodiment, the control unit 135 receives digital audio data in which information is embedded by a digital watermark method, and obtains the audio data. Based on the information indicating the path, the digital audio data is configured to have a means for determining which digital watermarking method it corresponds to, so that the audio data transmitted from the distribution source of the audio data to the network N It is not necessary to include digital watermarking system information corresponding to this. Further, it is not necessary to include digital watermarking system information corresponding to the audio data stored in the recording medium. Further, when the distributed audio data corresponds to a predetermined digital watermarking scheme adopted in a playback device or the like as a home appliance, the distributed audio data is recorded as it is on a recording medium, while the distributed audio data is When a system other than the digital watermarking system is used, data obtained by re-embedding the embedded information in the distributed audio data with the predetermined digital watermarking system for the distributed audio data is recorded on a recording medium. In addition, it is possible to prevent information from being written into digital audio data that does not require re-embedding processing, and it is possible to minimize the processing of digital audio data that causes deterioration in sound quality.

Embodiment 4 FIG. 7 is a block diagram illustrating a data processing device according to a fourth embodiment of the present invention. The data processing device 140 according to the fourth embodiment reads multiplexed digital data obtained by multiplexing digital video data and digital audio data from a data recording medium, extracts embedded information from the digital audio data by a digital watermark method, In addition to displaying an image of the embedded information, a process of embedding the embedded information in the digital audio data again is performed. Here, the digital audio data included in the multiplexed digital data is data (distributed audio data) obtained by embedding relevant information into the supplied audio data to be supplied from the distribution source to the user by using a digital watermark method. is there. Also,
The extraction of the embedded information is performed by an appropriate digital watermarking method, and the re-embedding process is performed by using a predetermined digital watermarking method adopted in a playback device or the like as a home appliance. The appropriate digital watermarking scheme is the same as the used digital watermarking scheme used for the information embedding process for the supplied audio data. The multiplex digital data corresponds to a program such as one program or movie, and is called a video object. In the following description of the fourth embodiment, the digital video data and digital audio data are referred to as video data and audio data, respectively.

(Data Structure of Video Object) FIG.
Indicates the data structure of the video object. In the fourth embodiment, the video object is an MPE
1 in G (Moving Picture Experts Group) 2 system
And a plurality of video object units (VOBU: Video Obje).
ct Unit). In the portion corresponding to one VOBU in the multiplexed digital data,
Video data and audio data are multiplexed by time division processing. The digital data corresponding to this one VOBU has a data amount corresponding to a reproduction time of about 15 frames (= 0.5 seconds). Here, one VO
The unit for time-dividing the data in the BU is 2048 bytes, and a portion including the 2048-byte data, which is the time-division unit, is called a packet. A packet composed of video data is called a video packet, and a packet composed of audio data is called an audio packet. For example, here, the video object Vob has a first VOB
U (# 1) Vob1 to n-th VOBU (#n) Vobn. The first VOBU (# 1) Vob1 is composed of first video packet (# 1) Pv1 to k-th video packet (#k). Pvk
And a first voice packet (# 1) Pa1 to an m-th voice packet (#m) Pam.

FIG. 9 shows the data structure of the voice packet. The audio packet Pa is composed of a packet header Pah and an audio data part Pad. The audio data portion Pad stores an audio stream that is a code string constituting audio data, and information is embedded in the audio stream by an appropriate digital watermarking method. On the other hand, the packet header Pah stores various types of information necessary for reproducing the audio data. That is, the packet header Pah stores the packet type flag Fpk, the reproduction time information Irt, the substream ID information Iss, and the used digital watermarking system information Ium.
Here, the packet type flag Fpk is information for identifying what type of packet the corresponding packet is. The playback time information Irt is information indicating a time at which data stored in a corresponding packet is played, and a relative time based on the playback time of the data at the head of the video object is used as the playback time. ing.

[0130] In a video object that is multiplexed digital data, since a plurality of types of audio streams can be multiplexed, information for identifying each audio stream is required. Therefore, the sub-stream ID information Iss is stored in the packet header Pah as information for specifying each of a plurality of types of audio streams included in the video object. For example, the substream ID information Iss indicates a serial number set for each audio stream. Further, the used digital watermarking system information Ium indicates what kind of digital watermarking system is used to embed information in the audio stream stored in the audio data portion Pad of the audio packet Pa. .

FIG. 10 shows values stored in the packet header Pah as used digital watermarking system information Ium. Here, the used digital watermarking system information Ium is represented by a 2-bit value (a value of the first bit and a value of the second bit). The value “00” of the system information Ium indicates that the digital watermarking system A is used for the information embedding process for the audio data. Similarly, the values “01”, “10”, and “11” of the system information Ium indicate that the digital watermarking systems B, C, and D are used for the information embedding process for the audio stream, respectively. Is shown. In the fourth embodiment, the data structure of the video object has been described in which the audio packet used for the supplied audio data is stored in the audio packet constituting the video object.
The video object may have a data structure in which the used digital watermarking scheme is stored in a video packet or another type of packet.

Further, in the fourth embodiment, the case where the used digital watermarking system information corresponding to the supplied audio data is stored in the packet header Pah of each audio packet Pa has been described. However, the present invention is not limited to this. For example, the used digital watermark method information may be stored not in all audio packets constituting the video object, but in only some audio packets.

Further, the used digital watermarking system information may be stored in a recording area of a DVD-ROM disc separately from the video object. Also, the used digital watermark method information is
It may be embedded in an audio stream stored in the audio data portion by an appropriate method. Further, in the fourth embodiment, a packet in which the packet type flag Fpk, the reproduction time information Irt, the substream ID information Iss, and the used digital watermarking system information Iuw are stored in the packet header Pah as the audio packet Pa is shown. However, the packet header Pah of the voice packet Pa includes the information Fpk, I
Various information other than rt, Iss and Iuw may be stored.

(Configuration of Data Processing Apparatus 140 of Fourth Embodiment) This data processing apparatus 140 is a DVD-RO for reading a video object from a DVD-ROM disc.
An acquisition unit 141 that has an M drive and acquires a video object based on a control signal; and a separation unit that is configured by a custom LSI and separates video data and audio data from the acquired video object based on the control signal. 142. Also, the data processing device 14
0, an extraction unit 143 configured by a custom LSI and extracting embedded information from the used digital watermarking system information Ium stored in the header Pah of the audio packet Pa in the separated audio data based on the control signal;
It is configured by a custom LSI and based on the control signal,
And an insertion unit 146 that embeds the extracted embedded information in the separated audio data again by a predetermined digital watermarking method to generate output audio data.

The extracting section 143 includes a method A extractor 143a, a method B extractor 143b, and a method C extractor 14 corresponding to the digital watermarking methods (A), (B), (C), and (D).
3c, a system C extractor 143d, and is configured to extract embedded information in input audio data by a required extractor based on a control signal. For example, the scheme A extractor 143a is configured to extract embedded information from input audio data (distribution audio data) by a digital watermarking scheme A. Method B extractor 14
3b is configured to extract embedded information from the input audio data by the digital watermarking method B. Further, the scheme C extractor 143c is configured to extract embedded information from the input audio data by the digital watermark scheme C. Further, the scheme D extractor 143d is configured to extract embedded information from the input audio data by the digital watermark scheme D.

[0136] The data processing unit 140 is a video reproducing unit that displays an image of the separated video data and an image of embedded information such as copyright information extracted from audio data based on the control signal. 144, and an audio reproduction unit 145 that reproduces the output audio data. Here, the video reproduction unit 144 converts the video data into an analog video signal by signal processing such as decoding, and decodes embedded information such as copyright information from the extraction unit 143, and a video decoder 144a. A television receiver 144b that performs image display using an analog video signal as input and performs image display of the embedded information decoded. The audio reproducing unit 145 includes an audio decoder 145a that decodes the audio data and outputs an audio signal, and a speaker 145b that converts the audio signal into audio and outputs the audio. Further, the data processing device 140 includes a recording unit 147 that records output audio data output from the insertion unit 146 based on a control signal, a CPU that performs various arithmetic processing and data processing, and an operation program of the CPU. And a RAM (random access memory) in which a control unit 148 controls the operations of the units 141 to 147 in accordance with the control signal. Here, the RAM of the control unit 148 also has a function of an execution memory that temporarily stores data from the separation unit 142, embedded information from the extraction unit 143, and data from the insertion unit 146.

In the fourth embodiment, the audio reproducing section 145 reproduces the acquired input audio data (distribution audio data). Alternatively, output audio data obtained by embedding the embedded information again by a predetermined digital watermarking method may be reproduced. In the fourth embodiment, as the data processing device, the acquisition unit 141 has a DVD-ROM drive. However, the acquisition unit 141 of the data processing device includes a DVD-RAM drive, a CD-ROM drive, and a semiconductor device. Any device having a large-capacity storage device capable of handling multimedia data, such as a memory reading device, may be used. In the fourth embodiment, the data processing device having both the video reproducing unit 144 for reproducing the video data and the audio reproducing unit 145 for reproducing the audio data is described as the device for reproducing the obtained video object. The data processing device may have only one of the video reproduction unit and the audio reproduction unit, or may have a device that reproduces data such as subtitles in addition to the video reproduction unit and the audio reproduction unit. . Furthermore, in the fourth embodiment, the separation unit 14
2, the extracting unit 143 and the inserting unit 144 are configured by a custom LSI.
To 144 may be constituted by a CPU that performs various types of arithmetic processing and a RAM that stores the operation program and also serves as an execution memory. In this case, in particular, these parts 14
The constituent devices can be shared between the control units 148 and the control unit 148.

Next, the operation will be described. In the following description, for the sake of simplicity, it is assumed that the video object is continuously recorded on the DVD-ROM disc from the head of the data recording area.

(Reading of Video Object) In the acquisition section 141, based on the control signal from the control section 148, the multiplexed digital data as the video object is sequentially transmitted in packet units from the head of the recording area of the DVD-ROM disc. The data is read, and the read data is sequentially sent to the separating unit 142 in packet units.

(Separation of Video Object) The separation unit 142 reads the packet type flag Fpk stored in the packet header of each packet (video packet and audio packet). In the separating unit 142, the video packet and the audio packet are identified based on the packet type flag Fpk, and these packets are separated from the video object. Then, under the control of the control unit 148, the packet determined to be a video packet is sent to the video playback unit 144 and the control unit 148, and the packet determined to be an audio packet is sent to the extraction unit 143, the insertion unit 146, and the audio playback. It is sent to the unit 145 and the control unit 148.

(Extraction of Embedded Information) The control unit 148
Then, the digital watermark method information Ium stored in the packet header Pah of the voice packet Pa is read. Then, the control section 148 determines the value of the used digital watermarking scheme information Ium, and outputs a control signal corresponding to the value of the scheme information to the extracting section 143. Then, on the basis of the control signal, the extraction unit 143 uses a scheme extractor corresponding to an appropriate digital watermarking scheme to extract the audio packet Pa.
Embedded information is extracted from the audio stream stored in the audio data portion Pad. This embedded information includes information corresponding to the copyright display character string of the copyright holder. For example, if the value of the used digital watermarking system information Ium is determined to be "00", the extracting unit 143 uses the system A extractor 143a based on the control signal to output the digital watermarking system A. Extracts embedded information. Similarly, when the value of the digital watermarking system information Ium to be used is “01”, “10”, or “11”, the extracting unit 143 uses the system B extractor 143b, The method C extractor 143c or the method D extractor 143d extracts the embedded information according to the digital watermarking method B, C, or D.

(Reproduction of Video Data) When the video packet separated by the separation unit 142 is supplied to the video reproduction unit 144, the video reproduction unit 144 converts the video packet into a video packet based on a control signal from the control unit. MPEG stored
The video data that has been subjected to the encoding processing of the two systems is subjected to decoding processing of the MPEG2 system by the video decoder 144a. When a video signal obtained by the decoding process in the video decoder 144a is output to the TV receiver 144b, the video signal is reproduced and displayed on the TV receiver 144b.

(Display of Copyright Information) The extraction unit 143
When the copyright display character string information is supplied as embedded information to the video reproducing unit 144, the information is converted into a display signal by the decoder 144a and output to the TV receiver 144b. Then, the TV receiver 144b
In, a copyright display character string is superimposed and displayed on a display image corresponding to a video signal. Here, the copyright display character string information, which is copyright information, is displayed so as to be overlaid on the display image of the video signal, but the copyright information is displayed by display means other than the TV receiver. Alternatively, the image display of the copyright information may not be particularly performed.

(Reproduction of Audio Data) When the audio packet Pa separated from the video object Vob by the separation unit 142 is supplied to the audio reproduction unit 145, the audio reproduction unit 145 outputs the audio data portion of the audio packet Pa. The audio decoder 145a performs LPCM decoding processing on the audio stream stored in the Pad (that is, audio data on which LPCM encoding processing has been performed). As a result, an audio signal is generated in the audio decoder 145a, and the audio signal is converted into audio by the speaker 145b and output. Also, the data processing device 14
0, the reproduction process of the video data and the audio data as described above is performed. On the other hand, similarly to the data processing devices according to the first to third embodiments, the embedding information of the distribution audio data is re-embedded. And the output audio data obtained by the re-embedding process is recorded.

(Determination of Reinsertion of Embedded Information)

The voice packet P from the separation unit 142
If the audio data in a corresponds to the digital watermarking system A, the control unit 148 replaces the embedded information included in the digital audio data with the digital audio data again.
It is determined that there is no need to embed by another digital watermarking method. This is because the embedded information of the audio data can be extracted by a reproducing apparatus employing a predetermined digital watermarking method (method A), for example, an existing reproducing apparatus corresponding to a DVD-RAM disk. On the other hand, the separation unit 142
If the audio data in the audio packet Pa received from the device corresponds to the digital watermarking system B, the control unit 148 determines that it is necessary to embed the embedding information in the audio data again by the digital watermarking system A. You.

(Re-embedding of embedded information)

When the audio data corresponds to the digital watermarking system A and the control unit 148 determines that the re-embedding process for the digital audio data is unnecessary, the control unit 148 sends a control signal to the insertion unit 146. Is not supplied, and the audio data stored in the execution memory of the control unit 148 is supplied to the recording unit 147. On the other hand, if the audio data is compatible with the digital watermarking system B, and the control unit 148 determines that re-embedding of the audio data is necessary, the insertion unit 146 controls the control unit 148. Based on the signal, a process of embedding the embedding information in the audio data again by the digital watermarking method A is performed.

(Recording of Digital Audio Data)

The audio data determined to correspond to the digital watermarking system A by the control unit 148 is recorded in the recording unit 147 without being subjected to the re-embedding process in the insertion unit 146. On the other hand, the audio data determined to correspond to a method other than the digital watermarking scheme A by the control unit 148 is subjected to re-embedding processing by the digital watermarking scheme A by the insertion unit 146, and then stored in the recording unit 147. . As described above, in the data processing device 140 according to the fourth embodiment, the data processing device 140 according to the first embodiment
Of the data processing apparatus 110 of the present embodiment, an acquisition unit 141 equipped with a DVD-ROM drive is provided instead of the acquisition unit 111, and a separation unit 142 for separating video packets and audio packets from video objects read from a DVD-ROM disc. And a video playback unit 144 for playing back video data. The video playback unit displays embedded information extracted from the data portion of the audio packet based on the used digital watermarking system information stored in the header of the audio packet. The copyright information can be confirmed by video. Further, when the digital audio data corresponds to a predetermined digital watermarking method adopted in a playback device or the like as a home appliance, the digital audio data is recorded as it is on a recording medium, and the digital audio data is stored in the predetermined electronic device. When a system other than the watermark system is supported, data obtained by embedding embedded information in the digital audio data again by a predetermined digital watermark system is recorded on a recording medium, so that audio data that does not require re-embedding processing is recorded. It is possible to prevent the information writing process from being performed again on the data, and it is possible to minimize the processing on the audio data, which causes the sound quality deterioration and the like.

In the fourth embodiment, the DVD-R
Although an OM disc in which a video object is recorded from the head of the recording area is shown, a DVD-ROM disc has auxiliary information such as management information recorded in the head of the recording area. Yes,
A video object may be recorded following the recording area of the management information. Embodiment 4
Although the case where the video object is continuously recorded in the recording area of the DVD-ROM disc has been described, the recording form of the video object on the DVD-ROM disc is not limited to this. For example,
When the management information includes the recording start position of the video object in the recording area of the DVD-ROM disc and TOC (Table of Contents) information indicating the recording size, the management information in the recording area of the DVD-ROM disc is included. It is possible to record video objects in an arbitrary part in a distributed manner.

In the fourth embodiment, the case where the reading of the video object is sequentially performed from the head of the recording area of the DVD-ROM disc has been described.
When the management information includes scenario information including an access order to each recording area in the disc, the video object distributed and stored in a plurality of recording areas in the disc is stored in each recording area. Can be accessed in any order and read. In particular, when the data processing device has a function of receiving a signal by a user operation, the reading order of the above-described recording areas is determined based on the signal by the user operation when reading a video object. It can be changed as appropriate. Further, in the fourth embodiment, the case has been described where the audio packet separated from the video object by the separation unit is directly supplied to the audio reproduction unit, but the audio packet is transmitted to the audio reproduction unit via the extraction unit. It may be sent.

In the fourth embodiment, a case has been described in which only audio data includes embedded information. However, video data may also include embedded information. In this case, a video extraction unit for extracting embedded information from the video data may be provided, and the video packet separated from the video object may be supplied to the video playback unit via the video extraction unit. Further, in the fourth embodiment, the embedding information in the audio data includes information indicating a copyright display character string of the copyright holder. However, the embedding information in the audio data indicates the copyright display character string. In addition to the information, the information may include information indicating the name of an individual whose reproduction is permitted by the copyright holder, the date on which the reproduction is permitted by the copyright holder, and the like. In particular, when the video object can be copied, the embedded information in the audio data may include copy generation information and the like.

Embodiment 5 FIG. FIG. 11 is a block diagram for explaining a data processing device according to the fifth embodiment of the present invention. The data processing device 150 according to the fifth embodiment includes:
Digital audio data (distributed audio data) obtained by embedding information by digital watermarking in digital audio data (supplied audio data) to be supplied from the distribution source to the user is transmitted to the electronic device used for the embedding process. An extraction process that acquires from the data recording medium as input audio data together with information indicating the watermarking method and extracts embedded information from the input audio data, and data obtained by removing the embedded information from the input audio data (processed audio data). Data), a reproduction process for reproducing the processed audio data,
And a re-embedding process for embedding the embedding information in the processed audio data again by a predetermined digital watermarking method.

The data processing device 150 according to the fifth embodiment has a configuration capable of supporting a plurality of digital watermarking schemes. This is because a plurality of digital watermarking schemes may be used for one audio data. That is, depending on the mounting method of the digital watermarking method, even if information is embedded in one audio data by a plurality of digital watermarking methods, the embedded information may not affect each other. For example, in one digital watermarking scheme, information is embedded in high-frequency components of audio data, and in another digital watermarking scheme, information is embedded in low-frequency components of audio data. The information and the information embedded in the low frequency components do not affect each other. The data processing device 150 can handle such a case. Here, the digital watermarking system used for the information embedding process for the supplied audio data is any one of the four systems A, B, C, and D. Extraction of embedded information is performed by an appropriate digital watermarking method,
The re-embedding process is performed using a predetermined digital watermarking scheme adopted in a playback device or the like as a home appliance. The appropriate digital watermarking scheme is the same as the digital watermarking scheme used for embedding information in the supplied audio data.

(Data Structure of Distribution Voice Data) FIG.
Shows the data structure of the distribution audio data recorded on the data recording medium. This distributed audio data Dde
TOC (Table of Contents) information I indicating the contents of music
to and various individual audio data Da1 to Dan encoded by the LPCM (Linear Pulse Code Modulation) method. This TOC information Ito is recorded at the head of the recording area of the data recording medium.
The C information Ito includes information used when reproducing various audio data Da1 to Dan recorded on the recording medium. Here, the information used when reproducing the audio data includes, specifically, the audio data recording start position information Isp, the audio data recording end position information Iep, and the song title information Isp.
na, quantization number information Iqu, sampling rate information Isa,
Channel number information Ich, used digital watermarking system information Iwm, and the like are included.

[0157] In the recording area of the data recording medium, the audio data Da1 to Dan encoded by the LPCM method are sequentially recorded in a portion subsequent to the TOC information Ito. Here, the LPCM method is cited as the method of encoding the audio data, but the audio data encoding method is not limited to this, and other methods such as the AC3 method, the Mpeg Audio method, and the DTS (Digital Theater System) method are used. It may be an encoding method. Here, the AC3 system is an audio compression encoding system mainly for movie audio such as 5.1 ch and 2 ch, and is used in DVD-VIDEO and the like. The DTS method is also used mainly for 5.1c
This is an audio compression encoding method for audio for movies such as h and 2ch, and is used in movie theaters, DVD-VIDEOs, and the like.

FIG. 13 shows the data structure of the used digital watermarking system information Ium. In the fifth embodiment, the digital watermarking method used for embedding the information in the supplied audio data is any of the above four methods (method A, method B, method C, and method D). The watermark method information includes four pieces of use state information I corresponding to each method.
us, that is, system A use status information Iusa, system B use status information Iusb, system C use status information Iusc, and system D use status information Iusd. Then, a value “0” or a value “1” is set in each usage status information. For example, when the value of the predetermined usage information is set to “1”, it indicates that the digital watermarking method corresponding to the usage information is used for embedding information in the supplied audio data. On the other hand, when the value of the predetermined usage status information is set to “0”, it indicates that the digital watermarking method corresponding to the usage status information is not used for the information embedding process on the supplied audio data. The data recording medium may record not only TOC information and audio data but also other information.
The TOC information includes not only audio data reproduction information, but also
Other information such as information indicating the reproduction order of the audio data may be included. Further, the audio data reproduction information includes audio data recording start position information Isp, audio data recording end position information Iep, song name information Ina, quantization number information Iqu, sampling rate information Isa, channel number information Ich, and digital watermarking system information Ium. In addition, other information such as composer information and copyright information may be included.

Further, in the fifth embodiment, the case where audio data is recorded in the data recording medium in a state where it is encoded is shown. May be recorded on the data recording medium in a state of being multiplexed with other data by the multiplexing method. Further, in the fifth embodiment, the case where the TOC information is recorded at the head of the recording area of the data recording medium is shown. As long as the recording location of the information can be identified, the TOC information may be recorded in any recording area of the data recording medium.

(Structure of Data Processing Apparatus) The data processing apparatus 150 according to the fifth embodiment has a DVD for reading out information or data recorded on a DVD-ROM disc.
A ROM drive, and based on the control signal, the above D
An acquisition unit 151 for acquiring the TOC information Ito and the plurality of audio data Da1 to Dan from the VD-ROM disk;
It has a TOC information holding area 152a for storing the TOC information Ito acquired by the acquiring unit 151, and has a holding unit 152 for storing the TOC information Ito based on a control signal. The holding unit 152 includes a DRAM (Dynamic Ra).
ndom Access Memory).

The data processing device 150 is constituted by a custom LSI, and extracts embedded information in audio data based on the used digital watermarking system information Ium included in the obtained TOC information Ito according to a control signal. An extraction unit 153 for performing information extraction processing, and a custom LS
And the used digital watermarking system information Ium included in the obtained TOC information Ito according to the control signal.
A removal unit 154 that performs an information removal process of removing embedded information in the distributed audio data to generate processed audio data based on the control signal, and based on the control signal, the extracted embedded information is stored in a predetermined manner. And an insertion unit 155 for generating output audio data by re-embedding the processed audio data by the digital watermarking method.

Here, the extracting unit 153 includes a scheme A extractor 153 corresponding to the digital watermarking schemes A, B, C, and D.
a, a system B extractor 153b, a system C extractor 153c, and a system C extractor 153d, which are configured to extract embedded information in distribution audio data by a required extractor based on a control signal. I have. For example, the system A extractor 153a is configured to extract embedded information from distribution audio data (input audio data) by the digital watermarking system A. The scheme B extractor 153b is configured to extract embedded information from the input audio data by the digital watermark scheme B. Further, the method C extractor 14
Reference numeral 3c denotes a configuration for extracting embedded information from the input audio data by the digital watermarking method C. Further, the scheme D extractor 153d is configured to extract embedded information from the input audio data by the digital watermark scheme D.

The removing unit 154 includes a system A remover 154 corresponding to the digital watermarking systems A, B, C, and D.
a, a system B remover 154b, a system C remover 154c, and a system C remover 154d, which are configured to remove embedded information in distribution audio data by a required remover based on a control signal. I have. For example, the scheme A remover 154a is configured to remove embedded information from distribution audio data (input audio data) by the digital watermarking scheme A. The scheme B remover 154b is configured to remove embedded information from input audio data by the digital watermark scheme B. Further, the method C remover 15
Reference numeral 4c denotes a configuration for removing embedded information from the input audio data by the digital watermarking method C. Further, the scheme D remover 154d removes embedded information from the input audio data by the digital watermark scheme D.

[0164] The data processing device 150 includes an audio reproducing unit 1 for reproducing the processed audio data based on the control signal.
And a recording unit 157 that records the output audio data based on the control signal. Here, the audio reproducing unit 156 includes an audio decoder 156a that decodes the output audio data and outputs an audio signal, and 156b that converts the audio signal into audio and outputs the audio.
In the audio reproducing unit 156, individual audio data is reproduced in the order of the audio data reproduction information Da1 to Dan recorded in the TOC information. Further, the data processing device 150 includes a CPU for performing various arithmetic processing and data processing, and a RAM (random access memory) storing an operation program of the CPU.
The control unit 158 controls the operation of each unit 151 to 157 according to the control signal. R of this control unit 158
The AM has a function as an execution memory that temporarily stores the audio data from the acquisition unit 151, the removal unit 154, and the embedded information from the extraction unit 153.

In the fifth embodiment, the processed audio data obtained by the audio reproducing section 156 is reproduced. However, the audio reproducing section 156 embeds the processed audio data in the distributed audio data. The output audio data obtained by embedding the information again by a predetermined digital watermarking method may be reproduced. In the fifth embodiment, as the data processing device, the acquisition unit 151
Although the one having a D-ROM drive has been shown, the acquisition unit 151 of the data processing device has a DVD-RAM drive,
Any device having a large-capacity storage device capable of handling multimedia data, such as a D-ROM drive and a semiconductor memory reading device, may be used. Embodiment 5
Then, as the data processing device, the extracting unit 153 and the removing unit 1
54, the insertion part 155 is configured by a custom LSI, but these parts 153 to 155
It may be composed of a CPU that performs various arithmetic processes and a RAM that stores the operation program and also serves as an execution memory. In this case, in particular, these parts 153-155
And the control unit 158 can share the constituent devices. In the above-described fifth embodiment, the holding unit 152 having the DRAM mounted thereon has been described.
Any storage device such as a RAM suitable for temporary storage may be mounted.

Next, the operation will be described. In the following description of the operation, for the sake of simplicity, it is assumed that the TOC information Ito is continuously recorded as information of a predetermined size at the head of the storage area of the DVD-ROM disc.

(Reading of TOC Information) The Acquisition Unit 15
1, the DV signal based on the control signal from the control unit 158
Information of a predetermined size is read from the head of the recording area of the D-ROM disc, and the read information, that is, the TOC information Ito, is supplied to the holding unit 152.

(Storing of TOC Information) In the holding section 152, based on the control signal from the control section 158, the entire TOC information Ito acquired by the acquiring section 151 (that is,
All audio data reproduction information I included in the OC information Ito
r1 to Irn) are stored in the DRAM as they are, that is, without data processing. In the DRAM, a part of all the audio data reproduction information Ir1 to Irn included in the TOC information Ito, for example, only the audio data reproduction information corresponding to the individual audio data to be reproduced next is recorded. Is also good.

(Reading of Audio Data) Next, the control unit 158 sets the TOC information I stored in the holding unit 152.
From to, individual audio data Da1 to D to be played back
The audio data reproduction information Ir1 to Irn corresponding to an is sequentially obtained in the reproduction order of the individual audio data. Further, the control unit 158 acquires the audio data recording start position information Isp and the audio data recording end position information Iep from the acquired audio data reproduction information. Then, a control signal corresponding to the audio data recording start position information Isp is supplied from the control unit 158 to the acquisition unit 151. The acquisition unit 151 performs a process of acquiring individual audio data to be reproduced from a DVD-ROM disc based on a control signal from the control unit 158. The individual sound data acquired by the acquiring unit 151 is supplied to the extracting unit 153 and the removing unit 154.
At the time of this data acquisition processing, the control unit 158 monitors which part of the recording area of the DVD-ROM disk is reading data, and the reading processing in the recording area is performed. When the position coincides with the position indicated by the acquired audio data recording end position information Iep, the acquisition unit 151 is controlled by the control unit 158 so that the individual audio data acquisition process is stopped. Thereafter, the control unit 158 performs a process of acquiring the audio data reproduction information corresponding to the individual audio data from the holding unit in order to acquire the individual audio data to be reproduced next. Processing for acquiring is performed.

(Extraction of Embedded Information) The control unit 158
In, a process of extracting used digital watermarking system information from audio data reproduction information corresponding to individual audio data to be reproduced is performed. Then, the control unit 158 performs a process of determining the value of the usage status information corresponding to each digital watermark scheme in the used digital watermark scheme information Ium. A control signal corresponding to the determination result of the value of the use status information is output from the control unit 158 to the extraction unit 153. Then, in the extraction unit 153, embedded information is extracted from the individual audio data to be reproduced by a method extractor corresponding to an appropriate digital watermarking method, based on the control signal. For example, when the value of the method A use status information Iuma in the use digital watermarking method information Ium is “1”, the extraction unit 153 uses the method A based on the control signal.
The extraction information is extracted by the extractor 153a according to the digital watermarking method A. On the other hand, when the value of the method A use state information Iuma in the used digital watermark method information Ium is “0”, the extraction unit 153 does not perform the extraction processing of the embedded information by the method A extractor 153a. Other system B extractor 153b, system C extractor 15
3c and the method D extractor 153d, like the method A extractor 153a, the method B use state information Iumb and the method C use state information Ium in the used digital watermarking method information Ium.
In accordance with the value of umc, method D usage status information Imd, extraction processing of embedded information by the corresponding digital watermarking method B, C, or D is performed.

(Removal of embedded information) The control unit 158
In, a control signal corresponding to the used digital watermarking system information obtained from the audio data reproduction information corresponding to the audio data to be reproduced is output to the removing unit 154. Then, based on the control signal, the removal unit 154 removes embedded information from the individual audio data to be reproduced by a scheme extractor corresponding to an appropriate digital watermarking scheme. For example, in the control unit 158, the used digital watermarking system information Ium
The value of the method A use status information Iuma in is determined.
As a result of this determination, if the value of the method A use status information Iuma is “1”, the removing unit 154 performs the removal processing of the embedded information by the digital watermarking method A based on the control signal from the control unit 158. . On the other hand, as a result of the above determination,
If the value of the method A use status information Iuma is “0”, the removing unit 154 does not perform the process of removing the embedded information according to the digital watermarking method A. Similarly, the control unit 158 sequentially determines the values of other method usage information. When the value is “1”, the embedded information is removed by the method remover corresponding to the method usage information for which the value has been determined, while the value is “0”. In the case of, the embedded information removal processing by the scheme remover corresponding to the scheme usage status information for which the value has been determined is not performed. Then, the removal unit 1
The distributed audio data after the removal processing in 54, that is, the processed audio data, is supplied to the audio reproducing unit 156.

(Reproduction of Individual Audio Data) Audio Reproduction Unit 15
In step 6, the transmitted individual audio data is subjected to LPCM decoding processing by an audio decoder 156a to be converted into an audio signal, and this audio signal is converted to a speaker 156b.
Is converted to voice and output. Further, in the data processing device 150, while the above-described audio data reproduction process is performed, as in the data processing devices of the first to fourth embodiments, the re-embedding information re-embedding process and the re-embedding process for the individual audio data are performed. Recording of the output audio data obtained by embedding is performed.

(Determination of Re-embedding of Information) When the individual audio data from the acquisition unit 151 corresponds to the digital watermarking system A, the control unit 158 includes the individual audio data in the It is determined that it is not necessary to embed the embedded information again by another digital watermarking method. This is because the embedding information of the individual audio data can be extracted by a reproducing apparatus employing a predetermined digital watermarking method (method A), for example, an existing reproducing apparatus corresponding to a DVD-RAM disk. On the other hand, when the individual audio data from the acquisition unit 151 corresponds to the digital watermarking system B, the control unit 158 determines that it is necessary to embed the embedded information in the audio data again by the digital watermarking system A. Is determined.

(Information Re-Embedding) If the individual voice data corresponds to the digital watermarking system A and the control unit 158 determines that the re-embedding process for the individual voice data is unnecessary, the control unit 158 No control signal is supplied to the insertion unit 155, and the individual audio data stored in the execution memory of the control unit 158 is supplied to the recording unit 157. On the other hand, if the individual audio data corresponds to the digital watermarking system B and the control unit 158 determines that the individual audio data needs to be re-embedded,
In the insertion unit 155, based on the control signal from the control unit 158, the digital watermarking method A
The processing for embedding the embedding information again is performed.

(Recording of Individual Audio Data) The control unit 15
8, the individual audio data determined to correspond to the digital watermarking system A is recorded in the recording unit 157 without being subjected to the re-embedding process in the insertion unit 155. On the other hand, the individual voice data determined to correspond to a system other than the digital watermarking system A by the control unit 158 is re-embedded by the insertion unit 155 according to the digital watermarking system A, and then the recording unit 1
57. As described above, the data processing device 150 according to the fifth embodiment includes the data processing device 150 according to the first embodiment.
10 has a DVD-ROM drive for reading distribution audio data from a DVD-ROM disc, and includes TOC information Ito and a plurality of TOC information included in the distribution audio data read from the DVD-ROM disc. An acquisition unit 151 for acquiring the individual audio data Da1 to Dan is provided. The individual audio data is stored in the TOC information Ito as audio data reproduction information Ir1 to Irn corresponding to each individual audio data. Since the embedded information such as the copyright information in the data is removed and reproduced, the individual audio data distributed by the recording medium is reproduced well without deteriorating the sound quality due to the embedded information such as the copyright information. be able to. Further, when the individual audio data corresponds to a predetermined digital watermarking scheme adopted in a playback device or the like as a home appliance, the individual audio data is recorded as it is on a recording medium, and the individual audio data is stored in the predetermined electronic device. When a method other than the watermark method is supported, output audio data obtained by embedding embedded information in the individual audio data again by a predetermined digital watermark method is recorded on a recording medium, so that re-embedding processing is unnecessary. It is possible to prevent information from being written into the individual audio data, and to minimize the processing on the digital audio data, which may be a factor of sound quality deterioration or the like.

In the fifth embodiment, an example is shown in which the TOC information is recorded at the head of the recording area of the DVD-ROM disc. If you can recognize
The TOC information may be recorded in any part of the recording area of the DVD-ROM disc. For example, DVD-ROM
If a file system is constructed in the recording area of the disc, and if the information recorded on the disc can be accessed according to the file name, the TOC information is recorded with a predetermined file name added thereto. By doing so, the TOC information can be read regardless of the physical arrangement of the TOC information on the recording medium.

In the fifth embodiment, the individual audio data is reproduced in the order of the audio data reproduction information corresponding to each individual audio data recorded in the TOC information. However, if the user has a mechanism for accepting selection of individual audio data to be reproduced by the user, the user can specify individual audio data to be reproduced next. Also, TOC
If the information includes information indicating the reproduction order of the individual audio data (reproduction order information), the control unit determines the reproduction order of the individual audio data with reference to the reproduction order information. It is also possible to

Furthermore, in the fifth embodiment, the audio reproducing section decodes the supplied individual audio data by the audio decoder and reproduces the data by the speaker. However, the configuration of the audio reproducing section is not limited to this. Not something. For example, the audio reproducing unit includes the audio decoder and the speaker, and can output an analog audio signal obtained by decoding individual audio data by an audio decoder to another recording device via an audio cable or the like. It may be configured.
Further, the data processing device according to the fifth embodiment is configured to output the individual audio data supplied to the audio reproduction unit to another digital data recording device via a digital transmission cable or the like as digital data. It may be.
In the fifth embodiment, a recording medium (DVD-ROM disc) mounted on a DVD-ROM drive of the acquisition unit
The information embedded digital data obtained by embedding the relevant information in the supply digital data to be supplied to the user from the distribution source as the digital data, and the supplied digital data accompanying the information embedded digital data. And usage method information indicating the digital watermarking method used in the process of embedding the related information. In this case, the information-embedded digital data has a data structure capable of extracting or removing the related information using an appropriate digital watermarking scheme based on the usage scheme information. Further, on the recording medium (DVD-ROM disc), a plurality of use method information indicating different digital watermarking methods used for embedding the related information in the supply digital data is recorded as the use method information. May be.

Embodiment 6 FIG. FIG. 14 is a block diagram for explaining a data processing device according to the sixth embodiment of the present invention. The data processing device 160 according to the sixth embodiment includes:
A first radio wave received from a broadcast station and embedded from digital broadcast data (supplied voice data) to be supplied to a user from a distributor by using the received broadcast radio wave and embedding information by a digital watermarking method. Digital audio data (distributed audio data) is acquired, and the embedded information (hereinafter also referred to as first embedded information) is extracted and removed from the distributed audio data, and the embedded information is processed. Processing information (hereinafter also referred to as second embedded information) is generated, and second digital audio data (processed audio data) obtained by removing the distribution audio data is added to another digital audio data different from the digital watermarking method. The third digital audio data (output audio data) is generated by embedding processing information by a watermark method.

Here, the digital watermarking system used for the information embedding process for the supplied audio data is any one of the three systems A, B and C. Further, the extraction of the first embedded information is performed by an appropriate digital watermarking method, and the re-embedding process is performed by using at least a predetermined electronic watermarking method adopted in a playback device or the like as a home appliance. Is being done. Also,
The appropriate digital watermarking scheme is the same as the digital watermarking scheme used for embedding information in the supplied audio data. Furthermore, the distributed audio data is LPC
The encoding processing is performed by the M method, and the first embedded information is inserted into the distributed audio data by a predetermined digital watermark method (method A).

(Data Structure of First Embedded Information) FIG.
FIG. 5A shows the data structure of the first embedded information. This first embedded information Iwm1 includes copyright holder information Icr, digital watermarking method information for recording Irm, recording apparatus identification number information Idi, copy generation information Icg, copy source identification information Ics, and the like. This first embedded information I
wm1 has a data structure whose data length is constant. For this reason, the same information as the first embedded information is repeatedly inserted into the distributed audio data having a different data length depending on the length of the music or the like.

FIG. 16 (a) shows the value of the electronic watermarking method information at recording time Irm included in the first embedded information Iwm1. The digital watermark system information I used at the time of recording
rm is information for identifying a digital watermarking scheme used when the data processing apparatus 160 inserts embedded information into recording audio data to be subjected to recording processing. That is, the first embedded information is embedded in the distribution audio data by the predetermined digital watermarking method. When the distributed audio data or the processed audio data obtained by processing the distributed audio data is recorded on a recording medium, the information corresponding to the first embedded information is re-embedded by another digital watermarking method. Is The digital watermark method information Irm used at the time of recording is information for identifying a digital watermark method to be used for the re-embedding process.

The digital watermarking system information Irm used at the time of recording is represented by 2 bits. Specifically, the value “00” of the information Irm indicates that the information embedding process by the digital watermark method is not performed on the audio data recorded on the recording medium. The value “01” of the information Irm is
This indicates that information embedding processing according to the digital watermarking method A is performed on audio data recorded on a recording medium. Further, the values “10” and “11” of the information Irm indicate that the information embedding process by the digital watermarking schemes B and C is performed on the audio data recorded on the recording medium.

Here, the LPCM method is cited as an example of the audio data encoding method, but the audio data encoding method is not limited to this, and the AC3 method, Mpeg Au
Other encoding schemes such as the Dio scheme and the DTS scheme may be used. Also, here, the data processing device 160
2 shows a case where audio data is transmitted alone by broadcast radio waves, but the transmission form of the audio data is not limited to this. For example, audio data may be transmitted to the data processing device 160 as a video object (multiplex digital data) obtained by multiplexing video data and audio data. Further, here, a case is shown where distribution audio data is generated by embedding information in the supplied audio data by a predetermined digital watermarking scheme, but the type of the digital watermarking scheme used for the information embedding process for the supplied audio data is shown. When the information is transmitted to the data processing device, any digital watermarking method can be used for the information embedding process for the supplied audio data. Also, here, the case where the same information is repeatedly embedded as the first embedded information in the distributed audio data is shown, but different information is embedded as the first embedded information in the distributed audio data. It may be. Also, here, the first embedded information Iwm1 includes:
Copyright holder information Icr, digital watermark method information Ir used during recording
m, recording device identification number information Idi, copy generation information Icg,
Although the case where the copy source identification information Ics and the like are included is shown, any information such as recording date and time information Ird may be recorded in the first embedded information Iwm1 in addition to the above information.

(Data Structure of Second Embedded Information) FIG.
5 (b) shows the data structure of the second embedded information inserted into the audio data (distributed audio data or processed audio data) recorded on the recording medium by the digital watermarking method. The second embedded information Iwm2 is the digital watermarking system information Irm used for recording in the first embedded information Iwm1.
Is a data structure including the used digital watermarking system information Ium. This used digital watermarking system information Ium
Is information indicating which digital watermarking method was used to embed information in the distributed audio data or the processed audio data. The value of the used digital watermark method information Ium and the meaning of this value are the same as the value of the used digital watermark method information Irm during recording and the meaning of this value. In other words, the used digital watermarking system information Ium is represented by 2 bits as shown in FIG. Specifically, the value “00” of the information Ium indicates that the information embedding process by the digital watermark method has not been performed on the audio data recorded on the recording medium. Further, the value of the information Ium “0”
"1" indicates that the information embedding process according to the digital watermarking method A has been performed on the audio data recorded on the recording medium. Further, the values of the information Ium “10”, “1”
"1" indicates that the information embedding process by the digital watermarking schemes B and C has been performed on the audio data recorded on the recording medium.

Here, the data structure of the second embedded information is the same as the data structure of the first embedded information, but the second embedded information is the same as the first embedded information. In comparison, a data structure in which information of another item such as copy date / time information is increased, or a data structure in which information of some items in the first embedded information, for example, copy generation information is deleted, may be used. Although the case where the used digital watermarking system information Ium is included in the second embedded information Iwm2 is shown here, the attribute information of the audio data is recorded on the recording medium separately from the distributed audio data or the processed audio data. In this case, if the used digital watermark method information Ium is recorded as the attribute information, the second embedded information Iwm2 may not include the used digital watermark method information.

(Structure of Data Processing Apparatus) The data processing apparatus 160 of the sixth embodiment receives an (First digital audio data), and an acquisition unit 161 for acquiring distribution audio data from the broadcast radio wave Bw based on the control signal. The data processing device 160 includes a custom LSI. The extraction unit 162 performs an information extraction process of extracting embedded information in the distributed audio data as first embedded information Iwm1 according to a control signal. A removing unit 163 configured to remove embedded information Iwm1 in the distributed audio data to generate processed audio data (second digital audio data) in accordance with a control signal, and a custom LSI;
Based on the control signal, the second embedded information Iwm2 obtained by processing the first embedded information Iwm1 is re-embedded into the processed audio data by various digital watermarking methods, and output audio data (third digital audio data ) For generating an insertion section 164.

Here, the extracting section 162 includes a scheme A extractor 162a corresponding to the digital watermarking schemes A, B, and C.
It has a method B extractor 162b and a method C extractor 162c, and is configured to extract embedded information Iwm1 in distribution audio data by a required extractor based on a control signal. For example, the method A extractor 162a
Is configured to extract embedded information Iwm1 from distribution audio data (input audio data) by digital watermarking method A. The scheme B extractor 162b extracts the embedded information Iwm1 from the input audio data by the digital watermark scheme B. Further, the scheme C extractor 162c is configured to extract the embedded information Iwm1 from the input audio data by the digital watermark scheme C.

The removing unit 163 has a method A remover 163a, a method B remover 163b, and a method C remover 163c corresponding to the digital watermarking methods A, B, and C, respectively. The embedded information Iwm1 in the distributed audio data is removed by a required remover. For example, the method A remover 163a
The configuration is such that the embedded information Iwm1 is removed from the distributed audio data by the digital watermarking method A. The scheme B remover 163b is configured to remove the embedded information Iwm1 from the distributed audio data by the digital watermark scheme B. Further, the scheme C remover 163c is configured to remove the embedded information Iwm1 from the distributed audio data by the digital watermark scheme C.

Further, the data processing unit 160 stores the output audio data in the recording unit 166 based on the control signal.
A device information holding unit 165 for holding device unique number information for identifying the device, a CPU for performing various arithmetic processing and data processing, and a RAM (random access memory) for storing an operation program of the CPU. And a control unit 167 that controls the operation of each unit 161 to 166 in accordance with the control signal. Here, the device information holding unit 167 has an EEPROM mounted therein, and the device unique number information is stored in the device unique number holding area 165a. The recording unit 166 is a DVD-
A RAM drive is mounted, and the output audio data is recorded on a DVD-RAM disk.
Further, the control unit 167 controls the EEPRO of the holding unit 165.
Based on the device unique number information stored in the M recording area, the first embedded information is processed to perform the embedded information processing for creating the second embedded information. Further, the RAM of the control unit 167 temporarily stores the audio data from the removal unit 163 and the insertion unit 164, the first embedded information Iwm1 from the extraction unit 162, and the second embedded information Iwm2 generated by the control unit 167. The function of the execution memory to be stored in the memory is also used. Although the acquisition unit 161 has a configuration including an antenna and a decoder, the configuration of the acquisition unit is not limited to this. For example, the acquisition unit may include a receiving device that receives a transmission signal via a wired line, such as a network interface or a modem device. Further, the acquisition unit includes a DVD-ROM drive,
A configuration having a large-capacity storage device capable of accessing multimedia data, such as a VD-RAM drive, a CD-ROM drive, or a semiconductor memory access device, may be used. Here, as the data processing apparatus, the extraction unit, the insertion unit, and the removal unit are configured by different custom LSIs. However, since the processing performed by each unit is similar, the viewpoint of reducing the number of parts is required. Therefore, it is desirable to configure these parts with one custom LSI.

Further, in the sixth embodiment, as the data processing device, the extracting unit 162, the removing unit 163, the inserting unit 1
Although 64 has been described as being configured by a custom LSI, these portions 162 to 164 may be configured by a CPU that performs various arithmetic processing and a RAM that stores an operation program and also serves as an execution memory. In this case, the components can be shared between these parts 162 to 164 and the control unit 167. Further, the device information holding unit 165 has a configuration in which an EEPROM is mounted, but the device information holding unit may be mounted with any device as long as it is a nonvolatile memory. Also, the case where the device information holding unit holds device-specific information for identifying the device has been described. May be held. In particular, when the device information holding unit holds a number for identifying a user of the device, the device information holding unit stores
A reader such as a C card or a magnetic card may be mounted, and the user of the apparatus may insert a card in which his or her own identification number information is recorded into the reader and notify the apparatus of the user identification number. . Also, here, the recording unit 166
Although a D-RAM drive is provided, the recording unit may be any type of large-capacity writable storage device that can access multimedia data, such as a CD-R drive or a semiconductor memory access device. A recording device may be provided. Next, the operation will be described.

(Reading of audio data) The acquisition unit 16
In 1, when the broadcast radio wave Bw from the broadcast station Bc is received by the antenna and the broadcast radio wave Bw is input to the reception decoder 161b, the broadcast radio wave Bw is distributed audio data (first audio data) by decoding processing in the reception decoder 161b. Digital audio data). The distribution audio data is supplied to the extraction unit 162 and the removal unit 163.

(Extraction of Embedded Information) The extraction unit 162
In the processing, based on a control signal from the control unit 167, a process of extracting the first embedded information Iwm1 from the distribution audio data acquired by the acquisition unit 161 by a predetermined digital watermarking scheme is performed. Then, the extracted first embedded information Iwm1 is temporarily recorded in the execution memory of the control unit 167.

(Removal of Embedded Information) The remover 163
Then, based on the control signal from the control unit 167, a process of deleting the first embedded information Iwm1 from the distribution audio data acquired by the acquisition unit by a predetermined digital watermarking scheme and generating processed audio data is performed. . This processed audio data is supplied to the insertion unit 164.

(Processing of embedded information) The control unit 167
In the processing, the first embedded information Iwm1 stored in the execution memory is processed to create the second embedded information Iwm2. That is, information such as copyright holder information, digital watermark method information used for recording, recording device identification number information, copy generation information, and copy source identification information included in the first embedded information and recorded in the device information holding unit. The second embedded information is created based on the specified device unique number.

At this time, the values described in the first embedded information Iwm1 are directly copied to the second embedded information Iwm2 for the copyright holder information and the digital watermarking method information used at the time of recording. In the recording device identification number information in the second embedded information Iwm2, the device unique number recorded in the device information holding unit 165 is recorded as it is. This makes it possible to specify the owner of the copied audio data. In the second embedded information Iwm2, a value obtained by adding 1 to the value recorded in the first embedded information Iwm1 is recorded as the value of the copy generation information. This makes it possible to specify the number of times the copy of the distribution audio data is the copy of the original audio data.

Further, in the copy source identification information in the second embedded information Iwm2, the recording device identification number information in the first embedded information Iwm1 is recorded. This makes it possible to specify the device that made the copy of the distributed audio data, and by tracing back this copy source identification information, it is possible to specify the user or device that committed a problem when an illegal copy was found. The second created in this way
Is transmitted to the insertion unit 164.

(Re-embedding of First Embedded Information) In the inserting section 164, based on the control signal, the removing section 163
A process of embedding the second embedding information generated by the control unit 167 into an electronic watermark in the processed audio data output from the controller 167 to generate output audio data (third digital audio data) is performed. At this time, the second embedding information Iwm2 is repeatedly embedded in the processed audio data a plurality of times in accordance with the length of the audio data over a portion from the beginning to the end. Particularly, the first embedding process of the second embedding information Iwm2 is performed by a predetermined digital watermarking method. For the second and subsequent embedding information processing, the digital watermarking system indicated by the digital watermarking system information for recording used in the first embedded information Iwm1 is used. By performing only the first second embedding process Iwm2 according to a predetermined digital watermarking method, when extracting the second embedding information Iwm2 from the output audio data, the embedding information at the head of the output audio data is obtained. Can be extracted by a predetermined digital watermarking scheme. Further, based on the second embedded information Iwm2 extracted in this way, it is possible to extract or remove the embedded information in a part other than the head part of the output audio data. The output audio data created in this way is supplied to the recording unit 166.

(Recording of Output Audio Data) The Insertion Unit 64
Is supplied to the recording unit 166,
In the recording unit 166, the output audio data is stored in a DVD-RAM disk based on a control signal from the control unit 167. Here, the output audio data is DVD-RA
Recording is performed sequentially from the first recording area of the M medium.
As described above, in the data processing device 160 of the sixth embodiment, instead of the acquisition unit 111 in the data processing device 110 of the first embodiment, an antenna for receiving the broadcast radio wave Bw from the broadcast station and the received broadcast radio wave Bw are used. It has a receiving decoder for decoding and has an acquisition unit 161 for acquiring distribution audio data as an output of the decoder, and performs extraction processing and removal processing of embedded information (first embedded information) Iwm1 in the distributed audio data, The embedding information Iwm1 is processed to generate processed embedding information (second embedding information) Iwm2, and the second digital audio data (processed audio data) obtained by removing the distribution audio data is subjected to the digital watermarking method. Embedded in the processed embedded information Iwm2 by another digital watermarking system different from the third digital audio data. Because it generates an (output sound data), and can be added or deleted information to the embedded information in the distributed audio data.

When digital data such as the processed audio data is recorded, additional information such as a device identification number (for example, a CPU identification number) and date and time assigned to the device that performs the recording is stored in the memory. By embedding in digital data, when a copyright owner finds an illegal copy of digital data, more detailed information for proving illegality can be extracted from the digital data. Furthermore, by recording copy permission information and the like in digital data such as the processed audio data by a predetermined digital watermarking method, a recording device corresponding to the predetermined digital watermarking method can record the copy permission information in accordance with the content of the copy permission information. It is also possible to directly restrict copying such as not permitting copying of the digital data. However, in this case, it goes without saying that it is impossible to restrict illegal copying with a recording device that performs copying without referring to copy permission information embedded by the digital watermarking method.

In the sixth embodiment, the distribution audio data is obtained by receiving broadcast radio waves.
The distribution audio data may be obtained by receiving a transmission signal transmitted through a wired line such as an Ethernet or a telephone line by a network card or a modem device. Further, the data processing apparatus according to the sixth embodiment does not process all of a plurality of distributed audio data obtained by receiving broadcast waves, but processes only distributed audio data to be processed selected by a user of the apparatus. You may do so. Further, in the sixth embodiment,
The supply of the distributed audio data by the broadcast wave is not limited to the case where the audio data is performed alone, and may be performed in a state where the audio data is multiplexed with the video data. In this case, the video object transmitted by the broadcast wave The distribution audio data can be extracted from the multiplex digital data.
Further, in the sixth embodiment, the case where the output audio data is sequentially recorded from the head recording area of the DVD-RAM medium in the recording unit 166 has been described.
However, the recording method of the output audio data is not limited to this. For example, an empty area in the medium at that time may be appropriately searched according to the recording situation, and the output audio data may be written into this empty area. Further, the output audio data may be written to a write destination area of a medium designated by a user of the apparatus. Furthermore, D
A file system may be constructed in the VD-RAM disk, and writing of output audio data may be performed based on the file name. In this case, since the output audio data is recorded via the file system, the physical location of the output audio data in the recording area of the recording medium may be anywhere.

Embodiment 7 FIG. FIG. 17 is a block diagram for explaining a data processing device according to the seventh embodiment of the present invention. The data processing device 170 according to the seventh embodiment includes:
In addition to the configuration of the data processing apparatus 120 according to the second embodiment, the data processing apparatus 120 includes a removing unit 173 that removes embedded information in distribution audio data. The data processing device 170 according to the seventh embodiment obtains the information-embedded digital audio data (distributed audio data) Dau from the network signal Sn on the network N as input digital audio data, and attaches it to the distributed audio data Dau. Acquiring section 171 for acquiring audio data attribute information transmitted by
And an extracting unit 172 for extracting embedded information from the information-embedded digital data Dau based on the control signal, and a removing unit 173 for removing embedded information from the information-embedded digital data Dau based on the control signal. .

Here, the acquisition unit 171 includes a network interface 171a for transmitting and receiving a network signal Sn to and from the network N;
It is composed of a digital audio data Dau embedded with information and a received signal decoder 171b for generating audio data attribute information by performing a decoding process on the network signal Sn from 71a. The extracting unit 172 includes a method 1 extractor 171a1, a method 2 extractor 171a2,... Corresponding to the digital watermarking methods (1), (2),.
, System n Extractor 171an is configured to extract embedded information in information embedded digital audio data Dau by a required extractor based on a control signal. These scheme extractors have exactly the same configuration as that in the second embodiment.

[0204] The removing unit 173 is a system corresponding to the digital watermarking schemes (1), (2), ..., (n).
1 remover 173a1, method 2 remover 173a2, ...,
It has a system n remover 173an, and is configured to remove embedded information in the information-embedded digital audio data Dau by a required remover based on a control signal. For example, the scheme 1 remover 173a1 is configured to remove embedded information from the digital audio data Dau with embedded information by the digital watermarking scheme (1). The scheme 2 remover 173a2 is configured to remove embedded information from the digital audio data Dau with embedded information by the digital watermarking scheme (2). The system n remover 173an is used to store information embedded digital audio data Dau.
Therefore, embedded information is removed by the digital watermarking method (n).

The data processing device 170 according to the seventh embodiment converts the embedded information extracted by the extraction unit 172 into the information by a predetermined digital watermarking method adopted in a playback device as a home appliance. It has an embedding unit 174 that re-embeds the removed digital data to generate output digital data, and a recording unit 177 that records the output digital data. Further, the seventh embodiment
The data processing device 170 includes a reproducing unit 175 that reproduces the information-removed digital audio data from the removing unit 173 based on a control signal, and a control unit 177 that controls the units 171 to 176 with corresponding control signals. have. Here, the reproducing unit 175 is an audio decoder 175 that converts the information embedded digital data Dau into an audio signal.
a, and a speaker 175b for converting the audio signal into audio. The control unit 177 includes a CPU that performs various arithmetic processing and data processing, and a RAM (random access memory) that stores an operation program of the CPU, and controls the operation of each of the units 171 to 176. Configuration. The RAM
The device also serves as an execution memory for temporarily storing audio data and audio data attribute information output from the above-described units.

The control section 177 specifically determines the value of each scheme usage status information based on the used digital watermark scheme information included in the audio data attribute information acquired by the acquisition section 171. According to the determination result, the embedded information extraction processing by the scheme extractor corresponding to each digital watermarking scheme and the embedding information removal processing by the scheme remover corresponding to each digital watermarking scheme are controlled, and the extracted embedded information is controlled. Is configured to control the reproduction process of the audio data in the reproduction unit 175 based on the reproduction permission information included in. Specifically, in this case, if the value of the reproduction permission information included in all the scheme usage status information constituting the used digital watermark scheme information is “1”, the control unit 1
Reference numeral 77 permits the reproduction of the audio data by the reproduction unit 175, and controls the reproduction unit 175 to reproduce the audio data. Further, in the data processing device 170, the above-mentioned units are mutually connected by a data bus Dbus, and the extraction unit 172, the removal unit 17
The acquisition unit 171, the insertion unit 172, and the recording unit 176 other than the reproduction unit 3 and the reproduction unit 175 are also controlled by the control unit 177. The extraction unit 17
2. The insertion unit 172 and the removal unit 173 are each realized by a custom LSI. The recording unit 176
Is realized by a DVD-RAM drive, and the output digital audio data is recorded on a DVD-RAM disk. Next, the operation will be described.

(Acquisition of Voice Data Dau and its Attribute Information Dpr) The network signal Sn supplied from the network N via the network cable is acquired by the acquisition unit 171.
Is received by the network interface 171a, the received network signal Sn is output to the received signal decoder 171b. The reception signal decoder 171b generates the information-embedded digital audio data Dau and the audio data attribute information Dpr transmitted along with the audio data Dau by decoding the network signal Sn. The audio data Dau acquired by the acquisition unit 171 in this way is sent to the extraction unit 172 and the removal unit 173 via the data bus Dbus, and the audio data attribute information Dpr
Is sent to the control unit 177 via the data bus Dbus.
In the control unit 177, the supplied audio data attribute information is
It is temporarily stored in a RAM as an execution memory.

(Extraction of Embedded Information) The control unit 177
Then, an operation of controlling the extraction unit 172 by a control signal is performed based on the used digital watermarking system information included in the audio data attribute information Dpr. That is, a control signal is supplied to the corresponding scheme extractor in accordance with the value of each scheme usage status information constituting the used digital watermark scheme information. Specifically, as in the second embodiment, in the control unit 177, a process of supplying a control signal to a corresponding scheme extractor in accordance with the value of the scheme usage information may be used by the supply source. This is sequentially performed for all of the method usage status information (method (1) usage status information to method (n) usage status information) having the presence, and in accordance with this, each system extractor outputs a control signal from the control unit 177 to the control signal. Based on the input voice data Dau, extraction processing of embedded information is performed. Thereby, a plurality of embedded information can be obtained.

(Removal of embedded information) The control unit 177 performs an operation of controlling the removal unit 173 by a control signal based on the used digital watermarking system information included in the audio data attribute information Dpr. . In other words, a control signal is supplied to the corresponding scheme remover according to the value of each scheme usage status information constituting the used digital watermark scheme information. Specifically, first, the control unit 177 refers to the value of the method (1) use status information in the used digital watermark method information. If the value of the method 1 use status information is "1", a control signal for instructing the remover 173a1 of the removing unit 173 to remove embedded information in the input audio data Dau by the digital watermarking method (1) is issued. Is output. As a result, in the method 1 remover 173a1, the removal unit 17
The information embedded in the audio data Dau sent to the third device by the digital watermark method (1) is removed by the digital watermark method (1). On the other hand, if the value of the method 1 use status information is “0”, the remover 173a1
No control signal for instructing removal of the embedded information in the input voice data Dau is not output.

Next, the control unit 177 refers to the value of the method 2 use status information in the used digital watermark method information. If the value of the method 2 usage status information is "1", a control signal for instructing the remover 173a2 of the removing unit 173 to remove embedded information in the input audio data Dau by the digital watermarking method (2) is issued. Is output. As a result, the method 2 remover 173a2 uses the digital watermarking method (2) in the audio data Dau sent to the removing unit 173.
Is removed by the digital watermarking method (2). On the other hand, the value of the method 2 use status information is “0”
If, the control signal instructing the removal of the embedded information in the input voice data Dau is not output to the remover 173a2. In this way, in the control unit 177, the process of supplying the control signal to the corresponding scheme remover according to the value of the scheme usage state information is performed for all the scheme usage states that may be used at the distribution source. Information (method 1 usage status information to method n usage status information) is sequentially performed. In response to this, each system remover removes embedded information in input audio data Dau based on a control signal from control unit 177. Processing is performed.

(Reproduction of audio data Dau) Then, the control unit 177 determines the value of the reproduction permission information included in all the embedded information obtained by the above-described embedded information extraction processing, and according to the determination result, A control signal indicating whether or not to reproduce the input digital audio data Dau is transmitted to the reproduction unit 1.
It is output to 75. In other words, if the value of the reproduction permission information included in all the system usage status information constituting the used digital watermarking system information is “1”, the control unit 177 causes the reproduction unit 1
The reproduction of the audio data Dau at 75 is permitted. Then
Under the control of the control unit 177, the audio data Dau is removed by the removal unit 1
The data is sent to the reproducing unit 175 from the data bus 73 via the data bus Dbus. In the reproducing unit 175, the received audio data Dau
Is converted into an audio signal by the decoding process in the audio decoder 175a, and the audio corresponding to the audio signal is reproduced and output from the speaker 175b.

(Re-embedding of embedded information) In the data processing device 170, the audio data Dau is reproduced independently of the reproduction process of the audio data Dau from the removing unit 173.
The process of embedding the embedding information extracted from au into the audio data Dau from the removing unit is performed again by a predetermined digital watermarking method. Here, the default digital watermark method is
This is a digital watermarking method used in a playback device as a home appliance. That is, as described above, the control unit 177 uses the digital watermarking scheme used for embedding the information in the target audio data at the distribution source based on the value of each scheme usage status information in the used digital watermarking scheme information. Is determined, and based on the determination result,
The embedded information embedded by each digital watermark method is
It is supplied to the insertion section 174. And this insertion part 1
At 74, the embedding information supplied from the control unit 177 is re-embedded into the audio data from the removing unit 173 by the above-described predetermined digital watermarking method, and output digital audio data is generated.

(Recording of Output Digital Audio Data) The output digital audio data generated by the insertion section 174 is
The data is supplied to the recording unit 176, and is recorded on a recording medium based on a control signal from the control unit 177. Here, the recording unit 1
76 is realized by a DVD-RAM drive,
The output digital audio data is stored on a DVD-RAM disk. In the seventh embodiment, if the value of the reproduction permission information included in all the scheme usage status information constituting the used digital watermark scheme information is “1”, the control unit transmits the audio data Dau in the reproduction unit 175. The reproduction unit 175 permits reproduction of the audio data D by the reproduction unit 175.
The conditions for permitting au playback are not limited to this. For example, the reproduction may be permitted if the value of at least one reproduction permission information included in all of the method use status information constituting the used digital watermark method information is “1”. Also, a weighting factor is set for each system usage status information that constitutes the used digital watermarking system information, and the product of the weighting factor and the value of the reproduction permission information included in each system usage status information is used for all the system usage statuses. The reproduction of the audio data Dau may be permitted depending on whether or not the total sum of the situation information exceeds a certain threshold.

As described above, in the seventh embodiment, the network signal Sn on the network N is received and the digital audio data Dau and the audio data attribute information Dau are embedded.
An acquisition unit 171 for acquiring pr is provided, and extracts and removes embedded information in the audio data Dau based on each scheme usage status information included in the audio data attribute information Dpr as the used digital watermark scheme information. Since the reproduction control of the processed audio data is performed based on the information, the data processing device that has received the audio data Dau, based on the embedded information embedded in the audio data Dau by various electronic watermarking methods at the distributor. , Audio data Dau
Can be correctly controlled. Further, in the seventh embodiment, the embedded information in the distributed audio data is embedded and recorded again in the processed audio data obtained by removing the embedded information from the distributed audio data by a predetermined digital watermarking method. Even in a playback device that is a home appliance adopting a predetermined digital watermarking method,
In addition to the effect that reproduction control of distributed audio data recorded on a recording medium can be performed in accordance with the embedded information, the amount of embedded information in the distributed audio data recorded on the recording medium can be reduced according to the second embodiment. When reproducing distributed audio data recorded on this recording medium, it is possible to reduce the deterioration of sound quality due to the embedded information. In the seventh embodiment, the processed audio data is reproduced by the reproducing unit 175. However, the output audio data obtained by embedding the embedded information in the processed audio data again is reproduced by the reproducing unit 175. It may be. In the seventh embodiment, it is assumed that the information-embedded digital data is obtained by embedding a plurality of pieces of related information in the supply digital data by a plurality of digital watermarking methods, and the inserting unit is added to the processed digital data. A predetermined number of related information of the plurality of related information is embedded by a corresponding digital watermarking method of the plurality of digital watermarking methods or a corresponding digital watermarking method different from any of the plurality of digital watermarking methods. The output digital data may be generated.

[0215]

As described above, according to the data processing apparatus of the present invention (claim 1), information obtained by embedding the related information in the supply digital data to be supplied from the distributor to the user. Data acquisition means for acquiring embedded digital data as input digital data, and method information acquisition means for acquiring usage method information corresponding to the input digital data and indicating a used digital watermarking method used in the processing of embedding the related information. Information extracting means for extracting the relevant information from the input digital data based on the acquired information of the used digital watermarking system, and converting the relevant information or the processing information obtained by the processing into the input digital data or its data processing. Embedded in the processed digital data obtained by The formula, its related information it is possible to determine whether it is inserted in the supply digital data. For this reason, erroneous information may be extracted using another method when extracting related information, or a part other than embedded related information may be extracted using another method when removing related information. This related information can be extracted or removed without being erroneously modified.

As a result, the distribution source that distributes digital data such as audio data to users embeds relevant information as digital watermarks in the supplied digital data to be supplied using a required digital watermarking method. It becomes possible. In other words, the distribution source of the digital data, especially when the digital data is recorded on the recording medium by the user side, is most likely to cause deterioration due to the embedding of information according to the content of the digital data. Fewer methods can be selected. In addition, it is possible to select an optimal method according to the communication speed at the time of transmitting the digital data.

In the case where the information-embedded digital data obtained from the network is recorded on a writable recording medium, the digital watermarking system used for the information embedding process for the digital data written on the recording medium is supplied. It can be different from the digital watermarking scheme used for digital data embedding at the distributor. by this,
It is possible to insert embedded information into digital data by a digital watermarking method according to the device from which the digital data is reproduced.

According to the present invention (Claim 2), Claim 1
In the data processing device of the above, since the related information is information related to the copyright holder of the supplied digital data,
It is possible to protect the copyright of the supplied digital data to be supplied from the distributor to the user.

According to the present invention (Claim 3), Claim 1
In the data processing device, the related information or the processing information obtained by processing the related information is embedded in the input digital data by a predetermined digital watermark to generate the output digital data. Even if the related information is embedded by the digital watermarking method, the playback device, which is a home appliance, performs the playback process of the information-embedded digital data based on the output digital data. Can be appropriately performed according to the conditions.

According to the present invention (claim 4), claim 3
Since the data processing device of the above is provided with a data reproducing unit for reproducing the output digital data, it is possible to control the reproduction of the acquired information-embedded digital data according to the related information.

According to the present invention (claim 5), claim 3
Since the data processing device of the present invention includes a data recording unit for recording the output digital data, even if the acquired information-embedded digital data corresponds to any digital watermarking system, the digital watermarking system can convert the digital data into a predetermined digital watermarking system. Can be stored in a recording medium used in a playback device that is a home appliance.

According to the present invention (claim 6), claim 1
In the data processing device, the relevant information or processing information is embedded in the processing digital data obtained by performing predetermined data processing on the input digital data by a predetermined digital watermarking method. From those corresponding to various digital watermarking methods,
It can be replaced with the default digital watermarking method.

According to the present invention (claim 7), claim 6
Since the data processing device of the above is provided with a data reproducing unit for reproducing the output digital data, it is possible to control the reproduction of the acquired information-embedded digital data according to the related information. When the processed digital data is digital audio data obtained by removing embedded information in the input digital data, reproduction of the information-embedded digital data is performed based on the processed digital data while suppressing deterioration in sound quality. It can be carried out.

According to the present invention (claim 8), claim 6
Since the data processing device of the present invention includes a data recording unit for recording the output digital data, even if the acquired information-embedded digital data corresponds to any digital watermarking system, the digital watermarking system can convert the digital data into a predetermined digital watermarking system. And digital data with little noise can be stored in a recording medium used in a playback device that is a home appliance.

According to the present invention (claim 9), claim 1
Wherein the information-embedded digital data is composed of a fixed-length first data portion and a variable-length second data portion. Since it is configured to acquire from the first data portion of the embedded digital data, the method information acquiring means can easily detect the position of the use method information in the information-embedded digital data.

According to the present invention (claim 10), in the data processing apparatus according to claim 1, the information-embedded digital data has a data structure including a plurality of data packets, and the method information acquiring means includes the information-embedded data. From the header of a given data packet in digital data,
Since the use method information indicating the use digital watermarking method is configured to be used, the method information acquisition means can easily detect the use method information in the information-embedded digital data.

According to the present invention (claim 11), in the data processing apparatus according to claim 1, an auxiliary data portion is added to the information-embedded digital data, and the method information obtaining means is added to the information-embedded digital data. Since the use method information indicating the use digital watermarking method is acquired from the accompanying auxiliary data portion, the method information acquisition means can easily detect the use method information in the information-embedded digital data.

According to the present invention (claim 12), in the data processing apparatus according to claim 1, the digital watermarking scheme to be used is determined according to the acquisition path of the information-embedded digital data, and the usage corresponding to the determination result is determined. Since the method information is obtained, it is not necessary to include the corresponding digital watermark method information in the distribution digital data transmitted from the distributor to the network. Further, it is not necessary to include digital watermarking system information corresponding to the distribution digital data stored in the recording medium. As a result, data processing for supply digital data to be supplied from the distribution source to the user can be reduced.

According to the present invention (claim 13), in the data processing device of claim 1, the information embedded digital data is obtained by multiplexing audio digital data, video digital data, or audio digital data and video digital data. Multiplexed digital data, various digital data such as audio digital data, video digital data, multiplexed digital data, etc., and related information embedded therein are converted from those corresponding to various digital watermarking schemes to predetermined values. Can be converted to a format compatible with the digital watermarking method.

According to this invention (Claim 14), in the data processing apparatus of Claim 1, the data acquisition means includes an antenna for receiving a broadcast wave from a broadcasting station, and a reception output from the antenna for demodulating the reception output. With the configuration including the reception wave decoder for outputting the information-embedded digital data, the information-embedded digital data can be obtained from the broadcast wave from the broadcasting station.

According to the present invention (claims 15 and 16),
The data processing device according to claim 1, wherein the data acquisition unit includes a data reading device that reads digital data with embedded information from the mass storage device.
The information-embedded digital data can be obtained from a DVD-ROM, a DVD-RAM, or a semiconductor recording medium.

According to the present invention (claim 17), in the data processing apparatus according to claim 1, the information embedded digital data is embedded with relevant information for the supply digital data by a plurality of digital watermarking systems, respectively. Since related information is extracted by the corresponding digital watermarking method, various related information can be embedded in the supplied digital data by the optimal digital watermarking method.

According to the present invention (claim 18), in the data processing device according to claim 1, related information corresponding to supplied digital data is embedded in the information-embedded digital data by a plurality of digital watermarking systems. Since the predetermined information of the related information is embedded in the input digital data by the predetermined digital watermarking method, various necessary related information embedded in the information embedding digital data is changed to the one corresponding to the predetermined digital watermarking method. it can.

According to the present invention (claim 19), in the data processing device according to claim 1, related information corresponding to supply digital data is embedded in the information-embedded digital data by a plurality of digital watermarking systems. A predetermined number of related information among the related information are embedded in the input digital data by a corresponding digital watermarking method of the plurality of digital watermarking methods or a corresponding digital watermarking method different from any of the plurality of digital watermarking methods. Therefore, required various types of related information embedded in the information-embedded digital data can be adapted to the required digital watermarking system.

According to the present invention (claim 20), in the data processing device according to claim 6, the information embedded digital data is embedded with related information corresponding to the supplied digital data by a plurality of digital watermarking systems, respectively. Since the predetermined information of the related information is embedded in the processed digital data by the predetermined digital watermarking method, the information embedding digital data including various related information is made to correspond to the required information of various related information to the predetermined digital watermarking method. Can be converted to new digital data.

According to the present invention (claim 21), in the data processing apparatus of claim 6, information corresponding to supply digital data is embedded in the information-embedded digital data by a plurality of digital watermarking systems, respectively. A predetermined number of related information of the related information is embedded in the processed digital data by a corresponding digital watermarking method of the plurality of digital watermarking methods or by a corresponding digital watermarking method different from any of the plurality of digital watermarking methods. Therefore, the information-embedded digital data including various related information can be converted into new digital data corresponding to a required predetermined digital watermarking system from required various kinds of related information.

According to the data recording medium of the present invention (claim 22), information-embedded digital data obtained by embedding the related information in the supply digital data to be supplied from the distribution source to the user is recorded. In the data recording medium, the information-embedded digital data is embedded in the first data portion of a fixed length with usage method information indicating the digital watermarking system used, and the digital data of the variable length is embedded in the second data portion. Since the above-mentioned related information is embedded according to the method, the device that has acquired the information-embedded digital data can determine what kind of digital watermarking method the embedded information is inserted into the information-embedded digital data. When extracting embedded information, other methods may be used to extract incorrect information or Without or modified erroneously portion other than the embedded information by using another method when removing, it is possible to perform extraction or removal of the embedded information. Further, the device that has acquired the information-embedded digital data can easily detect the position of the usage method information in the information-embedded digital data.

As a result, the distribution source that distributes digital data such as audio data to users embeds relevant information as digital watermarks in the supplied digital data to be supplied using a required digital watermarking method. It becomes possible. In other words, the distribution source of the digital data, especially when the digital data is recorded on the recording medium by the user side, is most likely to cause deterioration due to the embedding of information according to the content of the digital data. Fewer methods can be selected. In addition, it is possible to select an optimal method according to the communication speed at the time of transmitting the digital data.

In the case where the information-embedded digital data obtained from the network is recorded on a writable recording medium, the digital watermarking system used for the information embedding process for the digital data written on the recording medium is supplied. It can be different from the digital watermarking scheme used for digital data embedding at the distributor. by this,
It is possible to insert embedded information into digital data by a digital watermarking method according to the device from which the digital data is reproduced.

According to the present invention (claim 23), in the data recording medium according to claim 22, the first data portion of the information-embedded inserted digital data is provided with a predetermined digital watermark format according to the used digital watermark format. Is embedded, so that the usage method information indicating the used digital watermarking method can be easily extracted.

According to the present invention (claim 24), in the data recording medium according to claim 22, a plurality of use method information corresponding to different use digital watermarking methods is embedded as the use method information. The device that has acquired the digital data can control the reproduction of the information-embedded digital data based on the plurality of usage method information.

According to the data recording medium of the present invention (claim 25), an information-embedded digital data obtained by embedding relevant information as digital data in supply digital data to be supplied from a distributor to a user. A data recording medium that records data and usage method information indicating a digital watermarking method used for embedding the related information in the supplied digital data, which is attached to the information-embedded digital data; Has a data structure capable of extracting or removing the relevant information by using an appropriate digital watermarking method based on the usage method information. Perform processing and playback processing on digital data with embedded information based on it It can be.

Further, in the same manner as in the twenty-second aspect, it is possible to determine what digital watermarking method the embedded information is inserted into the information-embedded digital data, and use another method when extracting the embedded information. Extraction and removal of embedded information without the need to extract incorrect information or use other methods to erroneously alter the non-embedded information when removing embedded information Becomes

According to the present invention (claim 26), in the data recording medium of claim 25, a plurality of use method information corresponding to different use digital watermarking methods is embedded as the use method information. The device that has acquired the digital data can perform processing and reproduction on the information-embedded digital data based on the plurality of usage method information.

[Brief description of the drawings]

FIG. 1 is a block diagram for explaining a data processing device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a data structure of distributed audio data Dau supplied by a network signal to the data processing device of the first embodiment.

FIG. 3 is a diagram for specifically describing digital watermarking system information used included in the distributed audio data Dau, and includes 2-bit data first and second as digital watermarking system information used;
Indicates the value of a bit.

FIG. 4 is a block diagram for explaining a data processing device according to a second embodiment of the present invention.

FIG. 5 is a diagram showing a data structure of used digital watermarking system information included in audio data attribute information supplied to the data processing apparatus according to the second embodiment.

FIG. 6 is a block diagram illustrating a data processing device according to a third embodiment of the present invention.

FIG. 7 is a block diagram for explaining a data processing device according to a fourth embodiment of the present invention.

FIG. 8 is a diagram showing a data structure of a video object to be processed by the data processing device according to the fourth embodiment.

FIG. 9 is a diagram showing a data structure of an audio packet included in the video object.

FIG. 10 is a diagram showing values of 2-bit data stored as used digital watermarking system information Iwm in a header Pah of the audio packet and a meaning indicated by the values.

FIG. 11 is a block diagram illustrating a data processing device according to a fifth embodiment of the present invention.

FIG. 12 is a diagram showing a data structure of distribution audio data recorded on a data recording medium to be processed by the data processing device of the fifth embodiment.

FIG. 13 is a diagram showing a data structure of used digital watermarking system information Iwm included in TOK information in the distribution audio data.

FIG. 14 is a block diagram illustrating a data processing device according to a sixth embodiment of the present invention.

FIG. 15 shows a data structure of embedded information (first embedded information) in distribution audio data supplied to the data processing apparatus according to the sixth embodiment through broadcast waves (FIG. 15A), and the first embedded information; Data structure of processed embedding information (second embedding information) obtained by processing data (Fig. (B))
FIG.

FIG. 16 shows the value of the digital watermarking method information for recording use Irm included in the first embedded information Iwm1 and its meaning (FIG.
(a)) and the value of the digital watermarking method information for recording use Ium included in the second embedded information Iwm2 and its meaning (FIG. (b)).

FIG. 17 is a block diagram illustrating a data processing device according to a seventh embodiment of the present invention.

FIG. 18 is a diagram for describing a method of embedding information (digital watermark) related to a copyright holder of digital video data as digital watermark technology,
The array of pixels that make up an image (Figure (a)), and the array of pixels in blocks obtained by subdividing this image (Figure
(b)).

FIG. 19 is a diagram conceptually showing information embedding processing and information extraction processing for digital audio data.

FIG. 20 is a diagram showing a flow of the information embedding process.

FIG. 21 is a diagram for explaining how audio data is blocked in the information embedding process.

FIG. 22 is a diagram showing a flow of the information extraction processing.

FIG. 23 is a conceptual diagram showing a flow of digital music data in an electronic distribution system as a premise of the present invention.

[Explanation of symbols]

110, 120, 130, 140, 150, 160, 1
70 data processing device 111, 121, 131, 141, 151, 161, 1
71 Acquisition unit 111a, 121a, 131a, 171a Network interface 111b, 121b, 131b, 171b Received signal decoder 112, 122, 132, 143, 153, 162, 1
72 Extraction unit 112a, 132a, 143a, 153a, 162a
Method A extractor 112b, 132b, 143b, 153b, 162b
Method B extractor 112c, 132c, 143c, 153c, 162c
Method C extractor 112d, 143d, 153d Method D extractor 113, 124, 133, 146, 155, 164, 1
74 Insertion section 114, 125, 134, 147, 157, 167, 1
76 Recorder 115, 126, 135, 148, 158, 167, 1
77 Control unit 122a1, 172a1 Method 1 extractor 122a2, 172a2 Method 2 extractor 122an, 172an Method n extractor 123a, 145a, 156a, 175a Audio decoder 123b, 145b, 156b, 175b Speaker 131c, 141a, 151a DVD-ROM drive 131d Semiconductor media reading device 133a System A inserter 135a Table 142 Separation unit 144 Video playback unit 144a TV receiver 144b Video decoder 145, 156,175 Audio playback unit 152 Holding unit 152a TOK information holding area 154, 163, 173 Removal unit 154a, 163a System A remover 154b, 163b System B remover 154c, 163c System C remover 154d System D remover 161a Antenna 161b Receive decoder 165 Device information holding unit 165a Device unique number holding area 172a1 Method 1 remover 172a2 Method 2 remover 172an Method n remover Bc Broadcasting station Bw Broadcasting radio wave Dau Distributed audio data Da1, Da2,..., Dan audio data # 1, # 2 , ..., #
n Dau1 First data part Dau2 Second data part Dbus Data bus Ium (1) Method 1 usage information Ium (2) Method 2 usage information Ium (n) Method n usage information Iusa Method A usage information Iusb Method B usage information Iusc Method C usage information Iusd Method D usage information Vob Video object Pah Audio packet header Fpk Packet type flag Irt Reproduction time information Idss Substream ID Ium Digital watermarking method information Iwm1, Iwm2 First, Second Embedded information Icr Copyright information Irm Digital watermark method information used during recording Idi Recording device identification number information Icg Copy generation information Ics Copy source information Itc TOC information Ir1 Playback information for audio data # 1 Ir2 Playback information for audio data # 2 Irn audio Reproduction information for data #n Isp audio data recording start position information Iep audio data Recording end position information Ina Song Information Iqu quantization number information Isa sampling rate information Ich channel number information Iwm used watermarking method information Pad audio data unit Pa1, Pa2, ..., Pam voice packets # 1, #
2,..., #M Pv1, Pv2,.
2, ..., # n

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 1/387 G10L 9/00 E (72) Inventor Kensho Minami 1006 Kazuma, Kadoma, Osaka Prefecture Matsushita Electric Industrial (72) Inventor Masayuki Kozuka 1006 Kadoma Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (26)

[Claims] 1. Data processing for receiving and processing various information-embedded digital data corresponding to different digital watermarking schemes, obtained by embedding relevant information in supply digital data to be supplied from a distributor to a user. An apparatus, comprising: data acquisition means for acquiring required information-embedded digital data as input digital data; and usage method information indicating a digital watermarking method used for embedding the related information corresponding to the input digital data. Information extracting means for obtaining the relevant information from the input digital data by the used digital watermarking method based on the obtained usage method information; and the input digital data or The processed digital data obtained by performing predetermined data processing is Broadcast or data processing device, characterized in that the processing information obtained by processing the relevant information, and a data embedding unit embeds the default digital watermarking method. 2. The data processing apparatus according to claim 1, wherein the related information embedded in the information-embedded digital data is information related to a copyright holder of the supplied digital data. apparatus. 3. The data processing device according to claim 1, wherein the information embedding means embeds the related information or the processed information in the input digital data by the predetermined digital watermarking method to generate output digital data. A data processing device having a configuration. 4. The data processing device according to claim 3, further comprising a data reproducing unit for reproducing the output digital data. 5. The data processing device according to claim 3, further comprising a data recording unit that records the output digital data. 6. The data processing apparatus according to claim 1, wherein the related information is removed from the input digital data based on the use method information acquired by the method information acquisition means, and the information-removed digital data is converted to the information-removed digital data. An information removing unit that generates as processed digital data, wherein the information embedding unit generates the output digital data by embedding the related information or the processed information in the information removed digital data by the predetermined electronic watermarking method. An information processing apparatus, comprising: 7. The data processing device according to claim 6, further comprising a data reproducing unit that reproduces the output digital data. 8. The data processing device according to claim 6, further comprising a data recording unit that records the output digital data. 9. The data processing apparatus according to claim 1, wherein the information-embedded digital data comprises a fixed-length first data portion and a variable-length second data portion. In the data portion, use method information indicating the use digital watermark method is embedded by the use digital watermark method, and the method information acquiring means converts the use digital information from the first data portion of the input digital data. A data processing apparatus characterized in that usage system information indicating a watermark system is obtained. 10. The data processing apparatus according to claim 1, wherein the information-embedded digital data has a data structure including a plurality of data packets, and a header of a predetermined data packet among the plurality of data packets has a header. The method information obtaining means obtains, from the header of a predetermined data packet in the information-embedded digital data, the use method information indicating the used digital watermark method. A data processing apparatus characterized in that the data processing apparatus is configured to perform the following. 11. The data processing apparatus according to claim 1, wherein the information-embedded digital data has an auxiliary data portion attached thereto, and the auxiliary data portion includes usage mode information indicating the used digital watermarking mode. Wherein the method information acquiring means is configured to acquire usage method information indicating the usage digital watermarking method from an auxiliary data portion attached to the information-embedded digital data. . 12. The data processing device according to claim 1, wherein the data acquisition means is configured to acquire the information-embedded digital data from at least one of a plurality of data recording media and a plurality of data communication paths. The method information obtaining means determines the digital watermarking method to be used according to which of the plurality of data recording media and the plurality of data communication paths the information embedded digital data is obtained from. A data processing apparatus configured to acquire usage method information corresponding to the data processing method. 13. The data processing device according to claim 1, wherein the information-embedded digital data is audio digital data, video digital data, or multiplex digital data obtained by multiplexing audio digital data and video digital data. A data processing device characterized by the above-mentioned. 14. The data processing device according to claim 1, wherein said data acquisition means outputs an information-embedded digital data by demodulating an antenna for receiving a broadcast wave from a broadcast station and a reception output from the antenna. A data processing device comprising: 15. The data processing device according to claim 1, wherein the data acquisition means has a data reading device that reads the information-embedded digital data stored in the mass storage device. Characteristic data processing device. 16. The data processing device according to claim 15, wherein the data reading device is a DVD-ROM, a DVD-ROM,
A data processing device comprising an access device for reading the information-embedded digital data from a RAM or a semiconductor recording medium. 17. The data processing apparatus according to claim 1, wherein the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking methods. The embedded digital data includes usage method information corresponding to the plurality of electronic watermarking methods as usage method information indicating the usage electronic watermarking method, and the information extracting unit supports the plurality of electronic watermarking methods. A data processing apparatus configured to extract related information corresponding to each of the plurality of digital watermarking schemes from the input digital data based on usage scheme information to be used. 18. The data processing apparatus according to claim 1, wherein the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking methods. The embedding means includes:
A data processing apparatus, wherein a predetermined one of the plurality of pieces of related information is embedded by the predetermined digital watermarking method to generate output digital data. 19. The data processing apparatus according to claim 1, wherein the information-embedded digital data is obtained by embedding a plurality of pieces of related information in the supply digital data by a plurality of digital watermarking methods. The embedding means includes:
A predetermined number of related information of the plurality of related information is embedded and output by a corresponding digital watermarking method of the plurality of digital watermarking methods or a corresponding digital watermarking method different from any of the plurality of digital watermarking methods. A data processing device configured to generate digital data. 20. The data processing apparatus according to claim 6, wherein the information-embedded digital data is obtained by embedding a plurality of related information in the supply digital data by a plurality of digital watermarking methods. The embedding means includes:
A data processing apparatus, wherein a predetermined one of the plurality of pieces of related information is embedded by the predetermined digital watermarking method to generate output digital data. 21. The data processing apparatus according to claim 6, wherein the information-embedded digital data is obtained by embedding a plurality of related information in the supplied digital data by a plurality of digital watermarking methods. The embedding means includes:
A predetermined number of pieces of related information among the plurality of pieces of related information are embedded and output by a corresponding digital watermarking method among the plurality of digital watermarking methods or a corresponding digital watermarking method different from any of the plurality of digital watermarking methods. A data processing device configured to generate digital data. 22. A data recording medium which records information-embedded digital data obtained by embedding relevant information in supply digital data to be supplied from a distribution source to a user, wherein the information-embedded digital data is: It is composed of a fixed-length first data portion and a variable-length second data portion, and the first data portion has a digital watermarking scheme used for embedding related information in the supply digital data. The related information is embedded in the second data portion according to the used digital watermarking scheme indicated by the usage scheme information, and an appropriate digital watermarking scheme is determined based on the usage scheme information. And a data structure capable of extracting or removing the related information from the second data portion. Data recording medium. 23. The data recording medium according to claim 22, wherein the usage mode information is embedded in a first data portion of the information-embedded digital data by a predetermined digital watermarking scheme. Data recording medium. 24. The data recording medium according to claim 22, wherein the first data portion of the information-embedded digital data is used as the use mode information in a process of embedding related information in the supply digital data. And a plurality of usage mode information indicating different usage digital watermarking modes. 25. Information embedding digital data obtained by embedding relevant information as digital data in a supply digital data to be supplied from a distribution source to a user, and the above-mentioned supply accompanying the information embedding digital data. A data recording medium that records usage method information indicating a used digital watermarking method used for embedding related information in digital data, wherein the information-embedded digital data is an appropriate electronic data based on the usage method information. A data recording medium having a data structure capable of extracting or removing the related information using a watermark method. 26. The data recording medium according to claim 25, wherein a plurality of use method information indicating different digital watermarking methods used for embedding related information in the supply digital data is recorded as the use method information. A data recording medium characterized by being recorded.