JP2004118948A - Playback device - Google Patents

Abstract

An object of the present invention is to enable continuous output of audio without muting during reproduction of video data.
The number of audio frames in which audio data of video recording data has been replaced is detected, and masking means is controlled based on the detected value. Also, the number of video frames from the beginning of the video recording data to the appearance of the audio data is detected, and the audio data is inserted into a portion of the video recording data where no audio data exists based on the detected value. Also, a difference between the last video frame display time and the last audio frame display time of the video recording data is detected, and the audio data is inserted into a portion of the video recording data where no audio data exists in the video recording data.
[Selection] Fig. 9

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a reproducing apparatus, and more particularly to a reproducing apparatus for reproducing a recording medium on which a video signal and an audio signal are recorded in an MPEG transport format.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, as a method for recording video data and accompanying audio data in the form of an MPEG transport stream, there is a method described in Japanese Patent Application No. 2001-96561. Regarding the format of the transport stream, see ITU Recommendation H.264. 222.0, “General-purpose encoding system for moving images and accompanying audio”.
[0003]
In such a system, video data and audio data are each recorded after being compressed. The compression method is not particularly defined in the MPEG format. In addition, a video access block composed of a plurality of frames is formed with a time length of about 0.5 to 1 second in consideration of accessibility of editing and reproduction, and video recording data is configured by the plurality of video access blocks. I do. Here, the frame data length of the video may be variable, but the data length of the audio frame is fixed, and the audio data constituting the video access block is composed of a plurality of audio frames. When recording only audio data, an audio access block is configured from a plurality of audio frames, and audio recording data is configured from the plurality of audio access blocks. In order to access the access block unit, the data length and the number of display frames of this access block are stored as management information in another recording area.
[0004]
With the data structure of the above configuration, it is possible to easily replace only the audio data between the video data in the video recording data and the audio data accompanying the video data with the audio data in another audio recording data. .
[0005]
Also, when recording video data and accompanying audio data, by preparing a dummy packet having dummy data of the same size as the audio data, a separate audio signal is added to the video in addition to the main audio. Output.
[0006]
Such applications are used, for example, to create background music or narration in recorded video.
[0007]
[Problems to be solved by the invention]
When audio data of video recording data is replaced with audio data of another audio recording data and output, the replaced audio data has a fraction in audio access units with respect to video data in video access units. This is not a problem in the case of simultaneous playback of simple video data and audio data, but since the access unit is a video access block or audio access block, immediately after simultaneous playback, the audio data following the audio recording data continues immediately after the simultaneous playback. , A discontinuous point occurs. Therefore, it was necessary to mute the audio at the switching point.
[0008]
In addition, video data may be subjected to inter-frame compression, whereas audio data is not subjected to inter-frame compression. Therefore, audio data corresponding to video data displayed at the same time is video data on the transport stream. It is placed after. As a result, the audio data corresponding to the video data in the video access block is located in the video access block and another video access block located behind the video access block. Also, there is no audio data at the head of the video recording data.
[0009]
Therefore, when reproducing the video data of the second video recording data following the first video recording data and simultaneously reproducing the audio data of the audio recording data simultaneously, the first video recording data and the second video recording data are reproduced. Audio data cannot be transmitted at the boundary with the video recording data, and the buffer of the audio decoder underflows. Therefore, a mute process is also required.
[0010]
Similarly, when playing back part of the audio recording data and then simultaneously playing back the video data of the video recording data and the audio data following the audio recording data, transmitting the audio data at the beginning of the video recording data Cannot be performed, and the buffer of the audio decoder underflows. Therefore, a mute process is also required.
[0011]
SUMMARY OF THE INVENTION It is an object of the present invention to enable continuous output without muting audio when reproducing video data as described above.
[0012]
[Means for Solving the Problems]
To solve this problem, the present invention
A memory that can be divided into a main data area, a replacement audio data area, and an insertion audio data area;
Memory writing side control means;
A memory read-side control unit capable of outputting data of a main data area of the memory as reproduction data,
Reading means for reading a target video access block or audio access block from data recorded on a recording medium according to an instruction of the memory writing side control means,
Management information detection means for detecting management information data indicating a data size and an output time of a video access block and an audio access block from data read from a recording medium by the reading means;
Using the time difference between the display time of the last video data and the display time of the last audio data in the continuous video access block, or the time difference between the start of the first video access block and the number of video frames until the audio data is arranged As a means for determining the number of audio frames corresponding to the time difference, a blank packet number detecting means for detecting the number of blank packets from the beginning of the first video access block until the audio data is arranged,
According to the instruction of the memory writing side control means, when the output data of the reading means is constituted by an audio access block, while outputting a continuous audio access block or a continuous audio frame from the output data of the reading means, When the output data of the reading means is constituted by a video access block, a continuous video access block is output from the output data of the reading means, and the data relating to the number of audio frames in the audio data of the output is converted to the data. Mask means for storing in an inserted audio data area of a memory;
According to an instruction of the memory writing side control means, data of the inserted audio data area of the memory is inserted into the output of the mask means in packet units from the beginning of the video access block until the audio data is arranged. Or insertion means for directly outputting the output of the mask means,
Audio data extracting means for extracting only audio data from the output of the mask means and storing the audio data as replacement audio data in the replacement audio data area of the memory under the memory control of the memory writing side control means When,
The replacement of the audio data in the video access block in the inserted data output from the insertion means according to the instruction of the memory writing side control means from the replacement data area of the memory. Of the audio data for audio data excluding the audio data for the number of audio frames in which the insertion has been made, and the data is replaced with the audio data, or the output of the mask means from the insertion means is output as it is in the video data. Replacement means for replacing the audio data in the access block with replacement audio data from the replacement data area of the memory and outputting the output, and writing the output as main data in the main data area of the memory; ,
It is constituted so that it may have.
[0013]
That is, the present invention is configured to detect the discontinuity of the audio data at the edit point at which the output data switches, and to correct the discontinuity, whereby the audio mu is generated at the edit point at which the output data switches. The audio data can be continuously reproduced without performing.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
The invention according to claim 1 is
When simultaneously playing back the video data of the video recording data and the audio data of the audio recording data, one or more continuous video access blocks in the video recording data are output, and the audio data in the video access block is converted to the audio data. Replacing with audio data in one or more continuous audio access blocks in the audio recording data and outputting;
When simultaneously reproducing the video data of the video recording data and the audio data of the audio recording data and then reproducing the audio data subsequent to the audio recording data, one or more consecutive video accesses in the video recording data may be performed. And outputting the block by replacing the audio data in the video access block with the audio data in one or more audio access blocks in the audio recording data, and then outputting the block in the one or more audio access blocks. Outputting the remaining audio data that has not been replaced among the audio data, and then outputting one or more consecutive audio access blocks arranged next to the audio access block;
If the video data of the video recording data and the audio data subsequent to the audio recording data are simultaneously reproduced successively after reproducing the audio data of the audio recording data, one consecutive one of the audio recording data may be reproduced. Outputting the audio access block described above, and then outputting one or more continuous video access blocks in the video recording data, and converting the audio data in the video access block to the one in the audio recording data. Output by replacing with audio data in one or more successive audio access blocks arranged next to the above audio access block,
It is configured as follows.
[0015]
According to this, the number of audio frames in which the audio data of the video recording data is replaced is detected, and the mask means is controlled based on the detected value. When the audio data of the data is simultaneously reproduced and the audio data subsequent to the audio recording data is reproduced, continuous audio data can be output.
[0016]
The present invention according to claim 2 provides:
Means for determining the number of audio frames from the beginning of the first video access block to the position where the audio data is arranged, when reproducing the video access block;
When reproducing the video access block, a packet number detecting means for detecting the number of packets from the beginning of the first video access block until the audio data is arranged,
With
Based on the position of an audio access block in audio recording data or the position of a video access block in video recording data, the number of packets, and the number of audio frames,
After reproducing the audio data of the audio recording data, when simultaneously reproducing the video data of the video recording data and the subsequent audio data in the audio recording data, one or more of the consecutive ones of the audio recording data are Outputting an audio access block, and then outputting one or more continuous video access blocks in the video recording data while outputting one or more other audio access blocks arranged next to the audio access block. The audio data for the number of audio frames calculated by the means for calculating the number of audio frames from the beginning is inserted in packet units from the beginning of the video access block until the audio data is arranged. Inside Iodeta and a remaining audio data not subjected to the insertion of the audio access block, and outputs replaced by a subsequent separate audio access block of audio data,
It is configured as follows.
[0017]
According to this configuration, the number of video frames from the beginning of the video recording data to the appearance of the audio data is detected, and the audio data is inserted into a portion of the video recording data where no audio data exists based on the value. When the audio data of the audio recording data is reproduced and the video data of the video recording data and the audio data subsequent to the audio recording data are reproduced at the same time, continuous audio data can be output.
[0018]
The present invention according to claim 3 provides:
Means for determining the number of audio frames corresponding to the time difference between the display time of the last video data and the display time of the last audio data when reproducing the video access block;
When reproducing the video access block, a packet number detecting means for detecting the number of packets from the beginning of the first video access block until the audio data is arranged,
With
Based on the position of an audio access block in audio recording data or the position of a video access block in video recording data, the number of packets, and the number of audio frames,
When simultaneously reproducing the video data of the first video recording data and the audio data of the audio recording data, and simultaneously reproducing the video data of the second video recording data and the audio data subsequent to the audio recording data, ,
While outputting one or more consecutive video access blocks in the first video recording data, the audio data in the video access block is converted into audio in one or more consecutive audio access blocks in the audio recording data. Replace with data and output,
Next, while outputting one or more continuous video access blocks in the second video recording data, the one or more audio access blocks and the zero or more audio access blocks arranged next to each other are output. From the remaining audio data that has not been replaced, the audio data of the number of audio frames is transferred from the head of the video access block in the second video recording data to the position where the audio data is arranged. Insert in units,
Next, the audio data of one or more consecutive video access blocks in the second video recording data is further arranged next to the remaining audio data not replaced and inserted and the audio access block. Output by replacing with audio data of one or more audio access blocks,
It is configured as follows.
[0019]
According to this, the display time of the last video frame and the display time of the last audio data of the video recording data are detected, and the audio data is inserted into a portion where no audio data exists in the video recording data based on the values. After the video data of the first video recording data and the audio data of the audio recording data are reproduced simultaneously, the video data of the second video recording data and the audio data following the audio recording data are simultaneously reproduced. During playback, continuous audio data can be output.
[0020]
The present invention according to claim 6 provides:
A memory that can be divided into a main data area and a replacement audio data area;
Memory writing side control means;
A memory read-side control unit capable of outputting data of a main data area of the memory as reproduction data,
Reading means for reading a target video access block or audio access block from data recorded on a recording medium according to an instruction of the memory writing side control means,
Management information detection means for detecting management information data indicating a data size and an output time of a video access block and an audio access block from data read from a recording medium by the reading means;
According to the instruction of the memory writing side control means, when the output data of the reading means is constituted by an audio access block, while outputting a continuous audio access block or a continuous audio frame from the output data of the reading means, When the output data of the reading means is constituted by a video access block, a mask means for outputting a continuous video access block from the output data of the reading means;
Audio data extracting means for extracting only audio data from the output of the mask means and storing the audio data as replacement audio data in the replacement audio data area of the memory under the memory control of the memory writing side control means When,
According to the instruction of the memory writing side control means, the audio data in the video access block in the data output from the mask means is replaced and replaced with the replacement audio data from the replacement data area of the memory. Or a replacement means for outputting the output of the mask means as it is, and writing the output as main data in a main data area of the memory,
Is provided.
[0021]
According to this, the number of audio frames in which the audio data of the video recording data is replaced is detected, and the mask means is controlled based on the detected value. When the audio data of the data is simultaneously reproduced and then the audio data subsequent to the audio recording data is reproduced, continuous audio data can be output.
[0022]
The present invention according to claim 7 provides:
A memory that can be divided into a main data area, a replacement audio data area, and an insertion audio data area;
Memory writing side control means;
A memory read-side control unit capable of outputting data of a main data area of the memory as reproduction data,
Reading means for reading a target video access block or audio access block from data recorded on a recording medium according to an instruction of the memory writing side control means,
Management information detection means for detecting management information data indicating a data size and an output time of a video access block and an audio access block from data read from a recording medium by the reading means;
Using the time difference between the display time of the last video data and the display time of the last audio data in the continuous video access block, or the time difference between the start of the first video access block and the number of video frames until the audio data is arranged As a means for determining the number of audio frames corresponding to the time difference, a blank packet number detecting means for detecting the number of blank packets from the beginning of the first video access block until the audio data is arranged,
According to the instruction of the memory writing side control means, when the output data of the reading means is constituted by an audio access block, while outputting a continuous audio access block or a continuous audio frame from the output data of the reading means, When the output data of the reading means is constituted by a video access block, a continuous video access block is output from the output data of the reading means, and the data relating to the number of audio frames in the audio data of the output is converted to the data. Mask means for storing in an inserted audio data area of a memory;
According to an instruction of the memory writing side control means, data of the inserted audio data area of the memory is inserted into the output of the mask means in packet units from the beginning of the video access block until the audio data is arranged. Or insertion means for directly outputting the output of the mask means,
Audio data extracting means for extracting only audio data from the output of the mask means and storing the audio data as replacement audio data in the replacement audio data area of the memory under the memory control of the memory writing side control means When,
The replacement of the audio data in the video access block in the inserted data output from the insertion means according to the instruction of the memory writing side control means from the replacement data area of the memory. Of the audio data for audio data excluding the audio data for the number of audio frames in which the insertion has been made, and the data is replaced with the audio data, or the output of the mask means from the insertion means is output as it is in the video data. Replacement means for replacing the audio data in the access block with replacement audio data from the replacement data area of the memory and outputting the output, and writing the output as main data in the main data area of the memory; ,
Is provided.
[0023]
According to this, the display time of the last video frame of the video recording data and the display time of the last audio data are detected, and based on the values, the audio data is recorded in a portion of the video recording data where no audio data exists. The audio data of the first video recording data and the audio data of the audio recording data are reproduced simultaneously, and then the audio data following the video data of the second video recording data and the audio recording data When playing back simultaneously, it is possible to output continuous audio data.
[0024]
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 shows the structure of video recording data when recording video data and audio data accompanying the video data. Video recording data is composed of a plurality of video access blocks. The video access blocks are indicated by MOBU0 to MOBU4 in the figure. Each video access block is composed of a plurality of video frames and a plurality of audio frames. The video frames are indicated by V00 to V43 in the figure, and the audio frames are indicated by a00 to a41 in the figure. For example, the video access block MOBU1 includes video frames V10 to V15 and audio frames a04 to a05 and a10 to a15.
[0025]
The video data and the audio data are transport-packetized and arranged in a time-division manner in packet units. In the figure, VTSP is a packet for storing video data, and ATSP is a packet for storing audio data. This transport packet includes a header, an adaptation field, and a payload. The adaptation field may store time information for displaying (outputting) a video frame or an audio frame. In some cases, the adaptation field does not exist. The actual video data or audio data is stored in the payload portion.
[0026]
The video access block is composed of a plurality of video frames such that the video display time is about 0.4 to 1 second. Since the data length of the video access block (the number of transport packets) and the number of video frames are recorded on the recording medium as management information, it is possible to perform read control on a video access block basis based on the management information. .
[0027]
Here, the video data is compressed by MPEG, and the data length of one video frame is variable.
On the other hand, the data length of one audio frame is fixed.
[0028]
The output cycle of the video frame and the output cycle of the audio frame are different.
Therefore, the number of video frames and the number of audio frames existing in one video access block are both variable.
[0029]
In addition, since video uses MPEG for inter-frame compression, audio data output at the same time as video data is placed after. Therefore, the audio frame corresponding to the display time of the video data (for example, V10 to V15 of MOBU1) existing in a certain video access block is arranged after the corresponding video frame (for example, a10 to a19, and the video frame period). Since the audio frame periods are different, they are not exactly the same).
[0030]
As a result, the audio data corresponding to the video data existing in a certain video access block is arranged in the video access block (MOBU1) and the video access block (MOBU2) arranged immediately thereafter. Also, no audio data exists at the head of the video recording data.
[0031]
FIG. 2 shows an audio recording data structure when only audio data is recorded. The audio recording data is composed of a plurality of audio access blocks AOBU0 to AOBU3. Each audio access block is composed of a plurality of audio frames A00 to A37. The audio frames A00 to A37 have the same configuration as the audio frames a00 to a41 in the video access block, and include a plurality of audio transport packets.
(First Embodiment)
FIG. 3 shows the configuration of the playback device according to the first embodiment of the present invention.
[0032]
Here, reference numeral 301 denotes a read circuit of the recording medium, and error correction code added data 332 including a target video access block or audio access block from AV recording data of the recording medium in accordance with an instruction 339 of the memory writing side control circuit 309. Is read.
[0033]
An error correction circuit 302 corrects an error in the read error correction code added data 332, and outputs corrected data 333.
Reference numeral 303 denotes a management information detection circuit which converts management data (the data length of the video access block, the number of video frames and the arrival time, the data length of the audio access block, and the audio frame) from the data 333 after error correction of the reproduced data from the recording medium. Number and arrival time), and outputs detection information 334 to the memory writing side control circuit 309.
[0034]
Reference numeral 304 denotes a mask circuit. When the output data 333 of the error correction circuit 302 is composed of an audio access block in accordance with an instruction 340 of the memory writing control circuit 309, audio access continuous from the output data 333 of the error correction circuit 302 is performed. A signal 335 obtained by extracting a block or a continuous audio frame is output. When the output data 333 of the error correction circuit 302 is composed of a video access block, an output signal 335 obtained by extracting a continuous video access block from the output data 333 of the error correction circuit 302 is output.
[0035]
Reference numeral 306 denotes a memory, to which main data 337 as an output of the replacement circuit 305 and an output 336 of the audio data extracting circuit 307 are input. The memory 306 has a main data area 306a and a replacement audio data area 306b.
[0036]
The audio data extracting circuit 307 extracts only the audio data (payload portion in the audio transport packet) from the output 335 of the mask circuit 304 and outputs it as replacement audio data 336.
[0037]
The replacement circuit 305 replaces the audio data in the video access block in the output signal 335 output from the mask circuit 304 with the replacement audio data 338 from the memory 306 and outputs the data. The output 335 of 304 is directly output as the main data 337, the number of audio frames of the replaced audio data is detected, and the signal 342 is output to the memory writing side control circuit 309.
[0038]
A memory dividing circuit 308 sends an instruction 344 to the memory writing control circuit 309 so as to control the memory 306 by dividing the memory 306 into a plurality of storage areas.
The memory writing side control circuit 309 inserts the data length and output time of the audio access block which is the output 334 of the management information detection circuit 303, the data length and output time of the video access block which is the output 334 of the management information detection circuit 303, and inserts them. (A) memory control by an instruction 343 for writing the output 336 of the audio data extracting circuit 307 to the memory 306 as the replacement audio data 336 based on the number of audio frames 342 replaced by the replacement circuit 305; (B) By sending an instruction 341 to the replacement circuit 305, a memory control by the instruction 343 for writing the output of the replacement circuit 305 into the memory 306 as the main data 337; The audio data 336 and 338 are stored in the memory 306. (D) control of the read circuit 301 by the instruction 339, (e) control of the mask circuit 304 by the instruction 340, and (f) control of the replacement circuit 305 by the instruction 341. Control.
[0039]
Reference numeral 310 denotes a memory read side control circuit which reads the main data 346 from the memory 306 by sending an instruction 347 to the memory 306 in accordance with a request 351 of the AV decoder circuit 312.
[0040]
The AV decoder circuit 312 decodes the main data 346 from the memory 306 and outputs a video signal 349 and an audio signal 350.
Next, the actual operation of each block in FIG. 3 will be described.
[0041]
FIG. 4 shows an output form at the time of reproducing the video recording data. For example, a case where video access blocks MOBU1 to MOBU3 of video recording data are reproduced from a recording medium will be described.
[0042]
First, the management information 334 is read, and the memory write control side circuit 309 determines the position of the error correction code added data including MOBU1 to MOBU3 from the management information 334. The recording medium reading circuit 301 reads the error correction code additional data 332 including MOBU1 to MOBU3 from the recording medium.
[0043]
The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. The control circuit 309 operates the mask circuit 304 based on the detected management information 334 so as to output only the data of MOBU1 to MOBU3 from the corrected data 333. The output signal 335 of the mask circuit 304 passes through the replacement circuit 305 as it is, and its data 337 is recorded in the memory 306. The signal 346 read from the memory 306 is supplied to the AV decoder 312, and the video signal 349 and the audio signal 350 are output. Accordingly, the signal 346 output to the AV decoder 312 has the form shown in FIG.
[0044]
Similarly, FIG. 5 shows an output form at the time of reproducing audio recorded data. For example, a case where audio access blocks AOBU1 and AOBU2 of audio recording data are reproduced from a recording medium will be described.
[0045]
First, the management information 334 is read, and from the management information 334, the position of the error correction code additional data 332 including AOBU1 to AOBU2 is determined by the memory writing side control circuit 309, and the recording medium reading circuit 301 reads the AOBU1 from the recording medium. To read the error correction code additional data 332 including .about.AOBU2.
[0046]
The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. The control circuit 309 sends an instruction 340 to the mask circuit 304 to operate the mask circuit 304 so as to output only the data of AOBU1 to AOBU2 from the corrected data 333 based on the detected management information 334. The output signal 335 of the mask circuit 304 passes through the replacement circuit 305 as it is, and its data 337 is recorded in the memory 306. The signal 346 read from the memory 306 is supplied to the AV decoder 312, and outputs an audio signal 350. Therefore, the signal 346 output to the AV decoder 312 has the form shown in FIG.
[0047]
FIG. 6 shows an output form in the case where the video data of the video recording data and the audio data for inserting the audio recording data are simultaneously reproduced. For example, when reproducing from the recording medium the insertion audio data for the audio data existing in the video access blocks from the audio access blocks AOBU0 to AOBU3 of the audio recording data simultaneously with the video data of the video access blocks MOBU0 to MOBU04 of the video recording data. Will be described.
[0048]
In accordance with the instruction 344 of the memory dividing circuit 308, the memory writing side control circuit 309 divides the memory 306 into a main data area 306a and a replacement audio data area 306b.
[0049]
First, the management information 334 is read out, the number of video frames existing in MOBU0 to MOBU4 is calculated from the management information 334, and error correction codes including audio access blocks AOBU0 to AOBU3 of audio recording data corresponding to the data are added. The position of the data is determined by the memory writing side control side circuit 309. The recording medium reading circuit 301 reads the error correction code additional data 332 including AOBU0 to AOBU3 from the recording medium.
[0050]
The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. The mask circuit 304 is operated such that only the data of AOBU0 to AOBU3 is output from the corrected data 333 based on the detected management information 334. The output signal 335 of the mask circuit 304 extracts only the audio data present in the payload portion of the audio packet by the audio data extraction circuit 307, and writes the extracted data 336 to the replacement audio data area 306 b of the memory 306.
[0051]
Next, the recording medium reading circuit 301 reads out the error correction code additional data 332 including the video access blocks MOBU0 to MOBU4 in the video recording data from the recording medium. The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. The mask circuit 304 is operated so as to output only the data of MOBU0 to MOBU4 from the corrected data 333 based on the detected management information 334. The output signal 335 of the mask circuit 304 is converted by the replacement circuit 305 into the audio data 338 stored in the replacement audio data area 306 b of the memory 306 by converting the audio data (payload portion of the audio packet) existing in the video access block. Output after replacement. The output 337 of the replacement circuit 305 is written to the main data area 306a of the memory 306. The data 346 read from the main data area 306a of the memory 306 is supplied to the AV decoder 312, and the AV decoder 312 outputs a video signal 349 and an audio signal 350. Therefore, the signal 346 output to the AV decoder takes the form shown in FIG.
[0052]
Actually, since the size of the memory 306 is finite, writing to the replacement audio data area 306b and writing to the main data area 306a are alternately repeated.
[0053]
The reason why the replacement operation is performed on the writing side is that only one replacement circuit is required when, for example, performing digital output 348 (isochronous output of IEEE1394) in addition to the internal AV decoder. It is. In FIG. 3, reference numeral 345 denotes an output from the main data area 306a of the memory 306, and 311 denotes a 1394 ISO output circuit.
[0054]
FIG. 7 shows an output form in the case where the video data of the video recording data and the audio data of the audio recording data are reproduced at the same time, and then the audio data is reproduced from the audio data following the audio recording data.
[0055]
For example, at the same time as reproducing the video data of the video access blocks MOBU0 to MOBU1 of the video recording data on the recording medium, the audio data for the audio data existing in the video access block is shifted from the audio access block AOBU0 of the audio recording data on the recording medium Will be described.
[0056]
In accordance with an instruction from the memory dividing circuit 308, the memory writing side control circuit 309 divides the memory 306 into a main data area 306a and a replacement audio data area 306b.
[0057]
First, the management information 334 is read, the number of video frames existing in MOBU0 to MOBU1 is calculated from the read management information 334, and an error correction code including audio access blocks AOBU0 to AOBU1 of audio recording data corresponding to the data is calculated. The position of the additional data is determined by the memory writing side control side circuit 309. The recording medium reading circuit 301 reads the error correction code additional data 332 including AOBU0 to AOBU1 from the recording medium.
[0058]
The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. The mask circuit 304 is operated such that only the data of AOBU0 to AOBU1 is output from the corrected data 333 based on the detected management information 334. From the output signal 335 of the mask circuit 304, only the audio data existing in the payload portion of the audio packet is extracted by the audio data extraction circuit 307, and the extracted data 336 is written to the replacement audio data area 306b of the memory 306. .
[0059]
Next, the readout circuit 301 reads out the error correction code additional data 332 including the video access blocks MOBU0 to MOBU1 in the video recording data from the recording medium. The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. The mask circuit 304 is operated such that only the data of MOBU0 to MOBU1 is output from the corrected data 333 based on the detected management information 334. The output signal 335 of the mask circuit 304 is replaced by the replacement circuit 305, and the audio data (payload portion of the audio packet) existing in the video access block is stored in the replacement audio data area 306 b of the memory 306. Is replaced and output. The output 345 of the replacement circuit 305 is written to the main data area 306a of the memory 306. Data 346 read from the main data area 306a of the memory 306 is supplied to the AV decoder 312, and a video signal 349 and an audio signal 350 are output. Actually, since the memory size is limited, writing to the replacement audio data area 306b and writing to the main data area 306a are alternately repeated.
[0060]
Next, the memory writing side control circuit 309 recognizes the audio frame A13 of the audio recording data in which the audio frame is inserted at the end of the MOBU1 by the number of replacement frames 342 sent from the replacement circuit 305 as shown in FIG. I do.
[0061]
Next, the recording medium reading circuit 301 reads the error correction code additional data 332 including AOBU1 to AOBU3 in the audio recording data from the recording medium. The error correction code additional data 332 is corrected by the error correction circuit 302, and the corrected data 333 is output. Then, from the detected management information 334, the data is extracted from the corrected data 333 in frame units. That is, the mask circuit 304 is operated so as to output only the data of the audio frames A14 to AOBU2 of AOBU1. The output signal 335 of the mask circuit 304 passes through the replacement circuit 305 as it is, and its data 337 is recorded in the main data area 306 a of the memory 306. The signal 346 read from the main data area 306a of the memory 306 is supplied to the AV decoder 312, and outputs an audio signal 350. Therefore, the signal 346 output to the AV decoder takes the form shown in FIG.
[0062]
FIG. 8 shows an output form in the case where the transition from audio data reproduction of audio recording data to simultaneous reproduction of video data of video recording data and continuous audio data of audio recording data is performed. At this time, the operation procedure shown in FIG. 6 may be performed after the operation procedure shown in FIG.
[0063]
However, since the audio output of the first half is output by the audio access block, simultaneous playback of the video data of the second half of the video recording data and the audio data of the audio recording data is performed from the data of the next audio access block from which the first half of the audio output was performed. It will be good to change.
[0064]
As described above, by detecting the number of audio frames in which the audio data of the video recording data is replaced and controlling the mask circuit 304 based on the detected value, the video data of the video recording data and the audio data of the audio recording data are detected. When the audio data subsequent to the audio recording data is reproduced after the simultaneous reproduction of the audio data, the audio data can be continuously output.
(Second embodiment)
FIG. 9 shows a configuration of a reproducing apparatus according to the second embodiment of the present invention.
[0065]
Here, a data reading circuit 901 reads error correction code added data 932 including a target video access block or audio access block from the AV recording data of the recording medium in accordance with an instruction 939 of the memory writing side control circuit 909.
[0066]
An error correction circuit 902 corrects an error in the read error correction code-added data 932, and outputs corrected data 933.
Reference numeral 903 denotes a management information detection circuit which derives management information (the data length of the video access block, the number of video frames, the arrival time, the audio access time, etc.) from the corrected data 933 obtained by correcting the data reproduced from the recording medium by the error correction circuit 902. (The data length of the block, the number of audio frames, and the arrival time), and outputs detection information 934.
[0067]
Reference numeral 904 denotes a mask circuit. When the output data 933 of the error correction circuit 902 is constituted by an audio access block in accordance with an instruction 940 of the memory writing side control circuit 909, audio access continuous from the output data 933 of the error correction circuit 902 is performed. A signal 935 obtained by extracting a block or a continuous audio frame is output. When the output data 933 of the error correction circuit 902 is composed of a video access block, a continuous video access block is extracted from the output data 933 of the error correction circuit 902. The output signal 935 is output.
[0068]
Reference numeral 906 denotes a memory to which an output signal 935 of the mask circuit 904, an output 937 of the replacement circuit 913, and an output 938 of the audio data extracting circuit 907 are input.
[0069]
A memory dividing circuit 908 instructs the memory writing side control circuit 909 to divide the memory 906 into a plurality of storage areas 906a, 906b, and 906c and control the memory 906.
[0070]
The audio data extracting circuit 907 extracts only audio data (payload portion in the audio transport packet) from the output 935 of the mask circuit 904 and outputs it as replacement audio data 938.
[0071]
Reference numeral 905 denotes an insertion circuit, which is a signal in which the audio data 942 read from the insertion audio data area 906c of the memory 906 is inserted into the output signal 935 of the mask circuit 904 in units of audio transport packets in accordance with an instruction 941 of the memory writing side control circuit 909. , Or the signal 935 is output as the signal 936 as it is.
[0072]
The replacement circuit 913 replaces the audio data in the video access block in the data signal 936 output from the insertion circuit 905 with the replacement audio data 944 from the replacement audio area 906b of the memory 906. The output signal 937 is output as the output signal 937, or the output 936 of the insertion circuit 905 is output as it is as the output signal 937, and the number of audio frames of the replaced audio data is detected and used as the output signal 943 to the control circuit 909.
[0073]
A time difference detection circuit 914 detects a time difference between the display time of the last video data and the display time of the last audio data of the continuous video access block from the output signal 935 of the mask circuit 904, and outputs the detected time difference signal 945. Alternatively, from the output 935 of the mask circuit 904, the number of video frames existing from the beginning of the continuous video access block until the audio data is arranged is detected as a time difference and output as a time difference signal 945.
[0074]
Reference numeral 915 denotes a blank packet number detection circuit, which outputs the number of packets from the beginning of a continuous video access block to the position where audio data is arranged as a blank packet number 946 to the control circuit 909 from the output signal 935 of the mask circuit 904.
[0075]
An audio frame number conversion circuit 916 calculates the number (= X) of audio frames 947 corresponding to the time difference signal 945 and outputs the calculated number to the control circuit 909.
[0076]
The memory write side control circuit 909 is replaced by the replacement information circuit 913 with the data length and output time of the audio access block, the data length and output time of the video access block, which are the detection information 934 of the management information detection circuit 903. The number of audio frames output signal 943, the number of blank packets 946 output from the blank packet number detection circuit 915, and the number 947 of audio frames output from the audio frame number conversion circuit 916 are input. Then, based on these inputs, the control circuit 909 writes the output 938 of the audio data extracting circuit 907 as replacement audio data 938 in the replacement audio data area 906b of the memory 906, and the mask circuit 904. Memory control 948 for writing the output signal 935 of the memory 906 to the inserted audio data area 906c of the memory 906, the memory control 948 for writing the output 937 of the replacement circuit 913 to the main data area 906a of the memory 906, and the inserted audio data area of the memory 906. A memory control 948 for reading the insertion audio data 942 from the replacement audio data 906c from the replacement audio data area 906b of the memory 906; And control 939 of the plus sign additional data reading means 901, an instruction 940 for controlling the mask circuit 904 and an indication 941 for controlling the insertion circuit 905 performs.
[0077]
A memory read side control circuit 910 reads main data 951 from the main data area 906a of the memory 906 according to a request from the AV decoder circuit 912. The AV decoder 912 decodes the main data 951 from the memory 906 and outputs a video signal 953 and an audio signal 954. 911 is a 1394 ISO output circuit, 950 is a signal from the main data area 906a to the output circuit 911, and 952 is an output from the output circuit 911.
[0078]
FIG. 11 shows an output form when shifting from audio reproduction to simultaneous reproduction without taking any measures (main data 951 output to the AV decoder 912). At the connection point between the audio access block AOBU1 and the video access block MOBU0, there is a period during which several frames of audio data cannot be transmitted. When such data is supplied to the AV decoder 912, the audio buffer underflows and the audio may be muted. This problem can be solved by the configuration shown in FIG.
[0079]
FIG. 10 shows an output form in the case of shifting from audio reproduction to simultaneous reproduction based on the configuration of FIG. 9 (main data 951 output to the AV decoder 912).
First, the memory dividing circuit 908 instructs the memory writing control circuit 909 to divide the memory 906 into a main data area 906a, an insertion audio data area 906c, and a replacement audio data area 906b.
[0080]
Next, the management information, that is, the detection information 934 from the management information detection circuit 903 is read out to the control circuit 909, and based on the management information, the position of the error correction code additional data 932 including AOBU0 to AOBU1 is determined by the memory write control side circuit 909. Judgment is made, and the reading circuit 901 reads the error correction code additional data 932 including AOBU0 to AOBU1 from the AV recording data of the recording medium.
[0081]
The error correction code additional data 932 is corrected by the circuit 902, and the corrected data 933 is output. Based on the detected management information 934, the mask circuit 904 is operated so as to output only the data of AOBU0 to AOBU1 from the corrected data 933. The output signal 935 of the mask circuit 904 passes through the insertion circuit 905 and the replacement circuit 913 without change, and the output data 937 of the replacement circuit 913 is recorded in the main data area 906 a of the memory 906. The signal 951 read from the main data area 906a of the memory 906 is supplied to the AV decoder 912, and outputs an audio signal 954.
[0082]
Next, the read circuit 901 reads the error correction code additional data 932 including the video access block MOBU0 in the video recording data. The data 932 is error-corrected by the circuit 902. Only the video access block MOBU0 is extracted from the error-corrected data 933 by the mask circuit 904. The output signal 935 of the mask circuit 904 is used by a time difference detection circuit 914 to measure a time difference signal 945 corresponding to the number of video frames from the beginning of MOBU0 until audio data appears. The number of video frames is converted into the number 947 of audio frames by the audio frame number conversion circuit 916 (the number of frames is set to X = 2).
[0083]
In addition, the blank packet number detection circuit 915 measures the number of blank packets 946 from the beginning of the video access block to the generation of audio data with respect to the output signal 935 of the mask circuit 904.
[0084]
Next, the read circuit 901 reads the error correction code additional data 932 including the audio access block AOBU2 in the audio recording data. Data 932 is corrected in circuit 902. From the error-corrected data 933, only data for the number 947 of the audio frames in the audio access block AOBU2 is extracted by the mask circuit 904. That is, only data corresponding to A20 and A21 shown in FIG. 10 is extracted by the mask circuit 904. The output 935 of the mask circuit 904 is recorded in the inserted audio data area 906c of the memory 906.
[0085]
Next, the read circuit 901 reads the error correction code additional data 932 including the audio access block AOBU2 and the subsequent data in the audio recording data. Data 932 is corrected in circuit 902. The error-corrected data 933 is output from the (X + 1) th audio frame by the mask circuit 904, excluding the number of audio frames X = 2 in the first audio access block AOBU2. That is, as shown in FIG. 10, A22, A23,... Are output. The output signal 935 of the mask circuit 904 is extracted only by the audio data extraction circuit 907 (only the payload portion of the audio packet), and the extracted audio data 938 is stored in the replacement audio data area 906b of the memory 906. I do.
[0086]
Next, the read circuit 901 reads the error correction code additional data 932 including the video access blocks MOBU0 to MOBU1 in the video recording data. Data 932 is error-corrected by circuit 902. Only the video access blocks MOBU0 to MOBU1 are extracted from the error-corrected data 933 by the mask circuit 904. Based on the number of audio frames 947 and the number of blank packets 946, as shown in FIG. 10, audio frames X = 2 (A20, A21) ) Are evenly inserted by the insertion circuit 905 in units of transport packets until the audio data of the output signal 935 of the mask circuit 904 is generated. The output signal 936 of the insertion circuit 905 is replaced by a replacement circuit 913 and replaced with the replacement audio data 944 from the memory 906 as shown in FIG. The output signal 937 of the replacement circuit 913 is stored in the main data area 906a of the memory 906. The data 951 read from the main data area 906a is supplied to the AV decoder 912, and the AV decoder 912 outputs a video signal 953 and an audio signal 954.
[0087]
As described above, by detecting the number of video frames from the beginning of the video recording data to the appearance of the audio data, and inserting the audio data into a portion where the audio data does not exist in the video recording data based on the value, When the video data of the video recording data and the audio data subsequent to the audio recording data are simultaneously reproduced after reproducing the audio data of the audio recording data, continuous audio data can be output.
[0088]
FIG. 12 shows an output form in the case of transition from simultaneous reproduction to simultaneous reproduction (main data 951 output to the AV decoder 912).
First, the memory division circuit 908 instructs the memory write-side control circuit 909 to divide the memory 906 into three parts: a main data area 906a, an insertion audio data area 906c, and a replacement audio data area 906b.
[0089]
Next, the reading circuit 901 reads the error correction code additional data 932 including the audio access blocks AOBU0 to AOBU1 in the audio recording data. The data 932 is error-corrected by the circuit 902. From the error-corrected data 933, only the audio access blocks AOBU0 to AOBU1 are extracted by the mask circuit 904. The output signal 935 of the mask circuit 904 is extracted only by the audio data extraction circuit 907 (only the payload portion of the audio packet), and the extracted data 938 is stored in the replacement audio data area 906 b of the memory 906.
[0090]
Next, the reading circuit 901 reads the error correction code additional data 932 including the video access blocks MOBU0 to MOBU1 in the first video recording data. Data 932 is error-corrected by circuit 902. Only the video access blocks MOBU0 to MOBU1 are extracted by the mask circuit 904 from the error-corrected data 933. The output of the mask circuit 904 passes through the insertion circuit 905 as it is. Output after replacement. The output signal 937 of the replacement circuit 913 is stored in the main data area 906a of the memory 906. The memory writing control circuit 909 detects the number of replaced audio frames based on the output signal 943 from the replacement circuit 913. From this, the memory writing side control circuit 909 can recognize that Z = 4 audio frames of AOBU1 have been replaced.
[0091]
Data 951 read from the main data area is supplied to an AV decoder 912, and the AV decoder 912 outputs a video signal 953 and an audio signal 954.
At the same time, the output signal 935 from the mask circuit 904 is used by the time difference detection circuit 914 to measure the difference between the display time (PTS) of the last video frame of MOBU1 and the display time of the last audio frame. This measured value is sent as a time difference signal 945 to the audio frame number conversion circuit 916, where it is converted into the number 947 of audio frames (the number of frames is Y = 2).
[0092]
Next, the reading circuit 901 reads the error correction code additional data 932 including the video access block MOBUa in the second video recording data. The data 932 is error-corrected by the circuit 902. The error-corrected data 933 is extracted only by the video access block MOBUa by the mask circuit 904. As for the output signal 935 of the mask circuit 904, the number of packets 946 from the head of the video access block to the generation of audio data is measured by the blank packet number detection circuit 915.
[0093]
Next, the reading circuit 901 reads the error correction code additional data 932 including the audio access block AOBU2 in the audio recording data. Data 932 is error-corrected by circuit 902. The error-corrected data 933 is output from the (Z + 1) th audio frame, excluding Z = 4 audio frames of the audio access block AOBU1, by the mask circuit 904 (A14, A15,...).
[0094]
The output signal 935 of the mask circuit 904 is written into the inserted audio data area 906c of the memory 906.
Next, the read circuit 901 reads the error correction code additional data 932 including the audio access blocks AOBU2 to AOBU3 in the audio recording data. Data 932 is error-corrected by circuit 902. The error-corrected data 933 is output by the mask circuit 904 from the (Y + Z + 1) th audio frame, excluding Y + Z audio frames in the audio access blocks AOBU2 to AOBU3 (A16, A17,...). The audio signal extracting circuit 907 extracts only the audio data (only the payload portion of the audio packet) from the output signal 935 of the mask circuit 904, and stores the extracted data 938 in the replacement audio data area 906 b of the memory 906.
[0095]
Next, the read circuit 901 reads the error correction code additional data 932 including the video access blocks MOBUa to MOBUb in the video recording data. The data 932 is error-corrected by the circuit 902. Only the video access blocks MOBUa to MOBUb are extracted from the error-corrected data 933 by the mask circuit 904. Based on the number of audio frames 947 and the number of blank packets 946, Z audio frames read from the inserted audio data area 906c of the memory 906 until the audio data of the output signal 935 of the mask circuit 904 is generated in transport packet units. Insert evenly between. The output signal 936 of the insertion circuit 905 is replaced by the replacement audio data 944 from the memory 906 and output by the replacement circuit 913. The output signal 937 of the replacement circuit 913 is stored in the main data area 906a of the memory 906. Data 951 read from the main data area 906a is supplied to an AV decoder 912, and the AV decoder 912 outputs a video signal 953 and an audio signal 954.
[0096]
As described above, the difference between the display time of the last video frame and the display time of the last audio frame of the video recording data is detected, and based on that value, the audio data is recorded in a portion where no audio data exists in the video recording data. Insertion enables continuous audio data output when simultaneously playing back video data and audio recording data, and then simultaneously playing video data of video recording data and audio data following audio recording data. It becomes.
[0097]
In the above-described embodiment, when the video data of the video recording data and the audio data of the audio recording data are simultaneously reproduced, the audio data in the video recording data is replaced with the audio data of the audio recording data. In the case where a dummy data area having the same size as the audio data is provided in advance in the recording data and the data in the dummy area is replaced with the audio data of the audio recording data, the first and second embodiments are also applicable. The same effect can be obtained with the same configuration.
[0098]
Further, in the above-described embodiment, the video compression method is MPEG, but a similar effect can be obtained if the method is inter-frame compression.
Further, in the above description, all are realized by the signal processing circuit, but a part can be realized by a microprocessor or the like.
[0099]
【The invention's effect】
As described above, according to the present invention, by detecting the number of audio frames in which the audio data of video recording data has been replaced, and controlling the masking means based on the value, the video data and audio data of the video recording data can be detected. When reproducing the audio data subsequent to the audio data after reproducing the audio data of the recording data at the same time, it is possible to output continuous audio data.
[0100]
Also, by detecting the number of video frames from the beginning of the video recording data to the appearance of the audio data, and inserting the audio data into a portion of the video recording data where no audio data exists based on the value, the audio recording data is obtained. When the video data of the video recording data and the audio data subsequent to the audio recording data are simultaneously reproduced after the reproduction of the audio data, continuous audio data can be output.
[0101]
Further, a difference between the last video frame display time and the last audio frame display time of the video recording data is detected, and the audio data is inserted into a portion of the video recording data where no audio data exists based on the detected value. When the video data of the video recording data and the audio data of the audio recording data are simultaneously reproduced and then the video data of the video recording data and the audio data following the audio recording data are simultaneously reproduced, the output of the continuous audio data is performed. Becomes possible.
[Brief description of the drawings]
FIG. 1 is a diagram showing the configuration of video recording data when recording video data and audio data attached to the video data according to the present invention.
FIG. 2 is a diagram showing the structure of audio recording data when only audio data is recorded according to the present invention.
FIG. 3 is a diagram showing a configuration of a playback device according to the first embodiment of the present invention.
FIG. 4 is a diagram showing an output form at the time of reproducing video recorded data in the apparatus of FIG. 3;
FIG. 5 is a diagram showing an output form at the time of reproducing audio recorded data in the apparatus of FIG. 3;
FIG. 6 is a diagram showing an output form in the case of simultaneously reproducing video data of video recording data and audio data of audio recording data in the apparatus of FIG. 3;
FIG. 7 is a diagram showing an output form in a case where video data of video recording data and audio data of audio recording data are reproduced at the same time in the apparatus of FIG. 3, and then reproduction is started from audio data following audio recording data;
8 is a diagram showing an output form in a case where the apparatus shown in FIG. 3 reproduces audio data of audio recording data and then shifts to simultaneous reproduction of video data of video recording data and audio data of audio recording data.
FIG. 9 is a diagram showing a configuration of a playback device according to a second embodiment of the present invention.
FIG. 10 is a diagram showing an output form in the case of shifting from audio reproduction to simultaneous reproduction in the apparatus of FIG. 9;
FIG. 11 is a diagram showing an output form in a case where a transition is made from audio reproduction to simultaneous reproduction when no measures are taken;
FIG. 12 is a diagram showing an output form in the case of shifting from simultaneous reproduction to simultaneous reproduction in the apparatus of FIG. 9;
[Explanation of symbols]
301 Readout circuit
303 Management information detection circuit
304 mask circuit
305 replacement circuit
306 memory
307 Audio Data Extraction Circuit
309 Memory write side control circuit
310 memory read side control circuit
901 Readout circuit
903 Management information detection circuit
904 mask circuit
905 insertion circuit
906 memory
907 Audio data extraction circuit
909 Memory write side control circuit
910 Memory read side control circuit
913 replacement circuit
914 Time difference detection circuit
915 Blank Packet Number Detection Circuit
916 Audio frame number conversion circuit

Claims (11)

An apparatus for reproducing video data and audio data recorded on a recording medium,
The recording medium configures audio recording data by a plurality of audio access blocks that are units of reproduction or editing composed of a plurality of audio frames, and includes a plurality of video data of a plurality of video frames and a plurality of video data related to the video data. The video data is configured by a plurality of video access blocks, which are units of reproduction or editing composed of audio data of an audio frame, and the audio data and the video data are recorded.
The device comprises:
When simultaneously reproducing the video data of the video recording data and the audio data of the audio recording data, one or more continuous video access blocks in the video recording data are output, and the audio data in the video access block is output. Is replaced with audio data in one or more continuous audio access blocks in the audio recording data, and is output.
When simultaneously reproducing the video data of the video recording data and the audio data of the audio recording data and then reproducing the audio data subsequent to the audio recording data, one or more consecutive video accesses in the video recording data may be performed. And outputting the block by replacing the audio data in the video access block with the audio data in one or more audio access blocks in the audio recording data, and then outputting the block in the one or more audio access blocks. Outputting the remaining audio data that has not been replaced among the audio data, and then outputting one or more consecutive audio access blocks arranged next to the audio access block;
If the video data of the video recording data and the audio data subsequent to the audio recording data are simultaneously reproduced successively after reproducing the audio data of the audio recording data, one consecutive one of the audio recording data may be reproduced. Outputting the audio access block described above, and then outputting one or more continuous video access blocks in the video recording data, and converting the audio data in the video access block to the one in the audio recording data. Output by replacing with audio data in one or more successive audio access blocks arranged next to the above audio access block,
A reproducing apparatus characterized by being configured as described above. An apparatus for reproducing video data and audio data recorded on a recording medium,
The recording medium configures audio recording data by a plurality of audio access blocks that are units of reproduction or editing composed of a plurality of audio frames, and includes a plurality of video data of a plurality of video frames and a plurality of video data related to the video data. The video data is configured by a plurality of video access blocks, which are units of reproduction or editing composed of audio data of an audio frame, and the audio data and the video data are recorded.
In the video access block, video data and audio data are arranged in time division on a packet basis, and audio data corresponding to video data output at the same time is arranged after the video data.
The device comprises:
Means for determining the number of audio frames from the beginning of the first video access block until the audio data is arranged, when reproducing the video access block;
When reproducing the video access block, a packet number detecting means for detecting the number of packets from the beginning of the first video access block until the audio data is arranged,
With
Based on the position of the audio access block in the audio recording data or the position of the video access block in the video recording data, the number of packets, and the number of audio frames,
After reproducing the audio data of the audio recording data, when simultaneously reproducing the video data of the video recording data and the subsequent audio data in the audio recording data, one or more of the consecutive ones of the audio recording data are Outputting an audio access block, and then outputting one or more continuous video access blocks in the video recording data while outputting one or more other audio access blocks arranged next to the audio access block. The audio data for the number of audio frames calculated by the means for calculating the number of audio frames from the beginning is inserted in packet units from the beginning of the video access block until the audio data is arranged. Inside Iodeta and a remaining audio data not subjected to the insertion of the audio access block, and outputs replaced by a subsequent separate audio access block of audio data,
A reproducing apparatus characterized by being configured as described above. An apparatus for reproducing video data and audio data recorded on a recording medium,
The recording medium configures audio recording data by a plurality of audio access blocks that are units of reproduction or editing composed of a plurality of audio frames, and includes a plurality of video data of a plurality of video frames and a plurality of video data related to the video data. The video data is configured by a plurality of video access blocks, which are units of reproduction or editing composed of audio data of an audio frame, and the audio data and the video data are recorded.
In the video access block, video data and audio data are arranged in time division on a packet basis, and audio data corresponding to video data output at the same time is arranged after the video data.
The device comprises:
When reproducing the video access block, means for determining the number of audio frames corresponding to the time difference between the display time of the last video data and the display time of the last audio data,
When reproducing the video access block, a packet number detecting means for detecting the number of packets from the beginning of the first video access block until the audio data is arranged,
With
Based on the position of the audio access block in the audio recording data or the position of the video access block in the video recording data, the number of packets, and the number of audio frames,
When simultaneously reproducing the video data of the first video recording data and the audio data of the audio recording data, and simultaneously reproducing the video data of the second video recording data and the audio data subsequent to the audio recording data, ,
While outputting one or more consecutive video access blocks in the first video recording data, the audio data in the video access block is converted into audio in one or more consecutive audio access blocks in the audio recording data. Replace with data and output,
Next, while outputting one or more continuous video access blocks in the second video recording data, the one or more audio access blocks and the zero or more audio access blocks arranged next to each other are output. From the remaining audio data that has not been replaced, the audio data of the number of audio frames is transferred from the head of the video access block in the second video recording data to the position where the audio data is arranged. Insert in units,
Next, the audio data of one or more consecutive video access blocks in the second video recording data is further arranged next to the remaining audio data not replaced and inserted and the audio access block. Output by replacing with audio data of one or more audio access blocks,
A reproducing apparatus characterized by being configured as described above. A dummy data area having a size corresponding to the size of the audio data is provided in the video access block, and when the video data of the video recording data and the audio data of the audio recording data are simultaneously reproduced, the audio data of the video access block is reproduced. 4. The apparatus according to claim 1, wherein the dummy data of the video access block is replaced with audio data of the audio recording data, instead of replacing the audio recording data with the audio data. The reproducing device according to the item. 5. The reproducing apparatus according to claim 1, wherein the reproducing apparatus reproduces video data and audio data recorded on a recording medium in an MPEG2 transport stream format. An apparatus for reproducing video data and audio data recorded on a recording medium,
The recording medium configures audio recording data by a plurality of audio access blocks that are units of reproduction or editing composed of a plurality of audio frames, and includes a plurality of video data of a plurality of video frames and a plurality of video data related to the video data. The video data is configured by a plurality of video access blocks, which are units of reproduction or editing composed of audio data of an audio frame, and the audio data and the video data are recorded.
The device comprises:
A memory that can be divided into a main data area and a replacement audio data area;
Memory writing side control means;
A memory read-side control unit capable of outputting data of a main data area of the memory as reproduction data,
Reading means for reading a target video access block or audio access block from data recorded on the recording medium according to an instruction of the memory writing side control means,
Management information detection means for detecting management information data indicating a data size and an output time of a video access block and an audio access block from data read from a recording medium by the reading means;
According to the instruction of the memory writing side control means, when the output data of the reading means is constituted by an audio access block, while outputting a continuous audio access block or a continuous audio frame from the output data of the reading means, When the output data of the reading means is constituted by a video access block, a mask means for outputting a continuous video access block from the output data of the reading means;
Audio data extracting means for extracting only audio data from the output of the mask means and storing the audio data as replacement audio data in the replacement audio data area of the memory under the memory control of the memory writing side control means When,
According to the instruction of the memory writing side control means, the audio data in the video access block in the data output from the mask means is replaced and replaced with the replacement audio data from the replacement data area of the memory. Or a replacement means for outputting the output of the mask means as it is, and writing the output as main data in a main data area of the memory,
A playback device comprising: An apparatus for reproducing video data and audio data recorded on a recording medium,
The recording medium configures audio recording data by a plurality of audio access blocks that are units of reproduction or editing composed of a plurality of audio frames, and includes a plurality of video data of a plurality of video frames and a plurality of video data related to the video data. The video data is configured by a plurality of video access blocks, which are units of reproduction or editing composed of audio data of an audio frame, and the audio data and the video data are recorded.
In the video access block, video data and audio data are arranged in time division on a packet basis, and audio data corresponding to video data output at the same time is arranged after the video data.
The device comprises:
A memory that can be divided into a main data area, a replacement audio data area, and an insertion audio data area;
Memory writing side control means;
A memory read-side control unit capable of outputting data of a main data area of the memory as reproduction data,
Reading means for reading a target video access block or audio access block from data recorded on the recording medium according to an instruction of the memory writing side control means,
Management information detection means for detecting management information data indicating a data size and an output time of a video access block and an audio access block from data read from a recording medium by the reading means;
Using the time difference between the display time of the last video data and the display time of the last audio data in the continuous video access block, or the time difference between the start of the first video access block and the number of video frames until the audio data is arranged As a means for determining the number of audio frames corresponding to the time difference, a blank packet number detecting means for detecting the number of blank packets from the beginning of the first video access block until the audio data is arranged,
According to the instruction of the memory writing side control means, when the output data of the reading means is constituted by an audio access block, while outputting a continuous audio access block or a continuous audio frame from the output data of the reading means, When the output data of the reading means is constituted by a video access block, a continuous video access block is output from the output data of the reading means, and the data relating to the number of audio frames in the audio data of the output is converted to the data. Mask means for storing in an inserted audio data area of a memory;
According to an instruction of the memory writing side control means, data of the inserted audio data area of the memory is inserted into the output of the mask means in packet units from the beginning of the video access block until the audio data is arranged. Or insertion means for directly outputting the output of the mask means,
Audio data extracting means for extracting only audio data from the output of the mask means and storing the audio data as replacement audio data in the replacement audio data area of the memory under the memory control of the memory writing side control means When,
The replacement of the audio data in the video access block in the inserted data output from the insertion means according to the instruction of the memory writing side control means from the replacement data area of the memory. Of the audio data for audio data excluding the audio data for the number of audio frames in which the insertion has been made, and the data is replaced with the audio data, or the output of the mask means from the insertion means is output as it is in the video data. Replacement means for replacing the audio data in the access block with replacement audio data from the replacement data area of the memory and outputting the output, and writing the output as main data in the main data area of the memory; ,
A playback device comprising: When reproducing the audio recording data, the memory is not divided, the masking means performs masking so as to output only the continuous audio access blocks, and the writing side control means uses the output of the masking means as the main data in the memory. Is configured to write to
When reproducing video recording data, the memory is not divided, the masking means performs masking so as to output only continuous video access blocks, and the writing side control means uses the output of the masking means as main data in the memory. Configured to write,
When the video data in the video recording data and the audio data in the audio recording data are reproduced at the same time, the memory is divided into a main data area and a replacement audio data area, and the masking means continues the audio recording data. Masking is performed so that only the audio access block is output, the audio data extracting means extracts only audio data from the output of the masking means, and the writing control means inserts the output of the audio data extracting means as replacement audio data. Then, the masking means masks the video recording data so as to output only a continuous video access block, and the writing side control means inserts the video recording data from the replacement audio data area. Replacement audio Reading data, the replacement means replaces the audio data being output from the mask means with replacement audio data read from the replacement audio data area, and the writing-side control means The output of the replacement means is written as main data in the main data area, and after simultaneously reproducing the video data in the video recording data and the audio data in the audio recording data, the subsequent audio data in the audio recording data is reproduced. When reproducing, the memory is divided into a main data area and a replacement audio data area.First, the masking means masks the audio recording data so as to output only continuous audio access blocks. The audio data extracting means is an output of the mask means. From the audio data extracting unit, the writing-side control unit stores the output of the audio data extracting unit as replacement audio data in the replacement audio data area, and then, the mask unit controls the video recording. The data is masked so as to output only a continuous video access block, the writing-side control means reads replacement audio data from the replacement audio data area, and the replacement means The audio data being output is replaced with replacement data read from the replacement audio data area, and the writing-side control means writes the output of the replacement means as main data in the main data area, and After writing the video recording data in the main data area, The replacement means detects the number of replaced audio frames, and based on the replaced number of audio frames, the mask means replaces the audio recording data with the audio data replaced by the replacement means. The audio data is masked so as to be output from the audio data, and the writing-side control means is configured to write the output of the mask means as main data in a main data area,
After reproducing the audio recording data, when simultaneously reproducing the video data in the video recording data and the audio data subsequent to the audio recording data, the memory is divided into a main data area and a replacement audio data area, First, the mask means masks audio recording data so as to output only continuous audio access blocks, and the writing-side control means writes the output of the mask means as main data in the main data area, and outputs a predetermined audio data. After writing the recording data in the main data area, the masking means masks the audio recording data so as to output only the audio access block following the audio access block next to the audio data written in the main data area. The audio data extracting means extracts only audio data from the output of the mask means, and the writing-side control means stores the output of the audio data extracting means as replacement audio data in the replacement audio data area. Next, the masking means masks the video recording data so as to output only a continuous video access block, and the writing-side control means converts replacement audio data from the replacement audio data area. Reading, the replacement means replaces the audio data being output from the mask means with replacement audio data read from the replacement audio data area, and the writing control means comprises a replacement means. Is output to the main data area as main data. Burn them,
7. The reproducing apparatus according to claim 6, wherein the reproducing apparatus is configured as follows. When simultaneously playing back the video data in the video recording data and the audio data subsequent to the audio recording data after reproducing the audio recording data,
The memory is divided into a main data area and a replacement audio data area and an insertion audio data area,
The mask means masks the audio recording data so as to output only a continuous audio access block, and the writing-side control means writes the output of the mask means in the main data area,
After writing predetermined audio recording data in the main data area, the masking means masks the video recording data so as to output only continuous video access blocks, and the means for determining the number of audio frames includes the masking means. After detecting the number of video frames from the beginning of the output data of the means until audio data is detected, the time of the number of video frames is converted into the number of audio frames,
The blank packet number detecting means detects, from the output of the mask means, the number of blank packets from the head of the head video access block in the video recording data until the audio data is arranged,
The masking means masks the audio recording data so as to output data for the number of audio frames continuous from an audio access block next to the audio data written in the main data area, and the writing-side control means Writing the output of the masking means into the insertion audio data area as insertion audio data,
Next, the masking means masks the audio recording data so as to output only continuous audio frames from the audio data next to the audio data stored in the insertion audio data area, and the audio data extracting means includes the masking means. Extracting only audio data from the output of the above, the writing-side control means stores the output of the audio data extracting means as replacement audio data in the replacement audio data area,
Next, the masking means masks the video recording data so as to output only a continuous video access block, the writing side control means reads out audio data for insertion from an insertion audio data area, and the inserting means Inserting the insertion audio data read from the insertion audio data area in a packet unit during a period from the beginning of the output of the mask means to the appearance of the audio data,
The writing-side control means reads replacement audio data from the replacement audio data area, and the replacement means reads the audio data being output from the insertion means from the replacement audio data area. Replacement with replacement audio data, the writing-side control means writes the output of the replacement means to the main data area,
The playback device according to claim 7, wherein the playback device is configured as follows. A case where the video data in the first video recording data and the audio data of the audio recording data are simultaneously reproduced, and then the video data in the second video recording data and the audio data subsequent to the audio recording data are simultaneously reproduced. To
The memory is divided into a main data area and a replacement audio data area and an insertion audio data area,
First, the masking means masks the audio recording data so as to output only a continuous audio access block, the audio data extracting means extracts only the audio data from the output of the masking means, and the writing-side control means extracts the audio data. Storing the output of the means as replacement audio data in the replacement audio data area, and then masking the video recording data so as to output only a continuous video access block; The writing-side control means reads the replacement audio data from the replacement audio data area, and the replacement means reads the audio data being output from the mask means from the replacement audio data area. Replace with audio data for The writing-side control unit writes the main data area output of interpolation up replacement unit as the main data,
The means for determining the number of audio frames includes, as a time difference, a difference between the display time of the last video data and the display time of the last audio data of the continuous video access block in the first video recording data from the output of the mask means. , Convert this time difference to the number of audio frames,
The blank packet number detecting means detects the number of blank packets from the output of the mask means to the beginning of the first video access block in the second video recording data until the audio data is arranged,
The masking means masks the audio recording data so as to output data for the number of audio frames continuous from an audio access block next to the audio data written in the main data area, and the writing-side control means Writing the output of the masking means as insertion audio data in the insertion audio data area,
Next, the masking means masks the audio recording data so as to output only continuous audio data from the audio data next to the audio data stored in the insertion audio data area, and the audio data extracting means operates the masking means of the masking means. Extracting only audio data from the output, the memory writing side control means stores the output of the audio data extracting means in the replacement audio data area as replacement audio data,
The masking means masks the second video recording data so as to output only a continuous video access block, the writing-side control means reads out audio data for insertion from an insertion audio data area, and the insertion circuit During the period from the beginning of the output of the mask means to the appearance of the audio data, the insertion audio data read from the insertion audio data area is inserted evenly in packet units,
The writing-side control means reads replacement audio data from the replacement audio data area, and the replacement means reads the audio data being output from the insertion means from the replacement audio data area. Replace with data, write the output of the replacement means as main data in the main data area,
The playback device according to claim 7, wherein the playback device is configured as follows. A dummy data area of a size corresponding to the size of the audio data is provided in the video access block, and when the video data of the video recording data and the audio data of the audio recording data are reproduced at the same time, the replacement circuit includes 7. The apparatus according to claim 6, wherein instead of replacing the audio data of the access block with the audio data of the audio recording data, the dummy data of the video access block is replaced with the audio data of the audio recording data. 11. The reproducing apparatus according to any one of up to 10.

Images