JP2008145976A - Content reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a content reproducing device capable of synchronously reproducing video of a lyrics telop etc., corresponding to an audio signal of a live musical performance etc., which is generated in real time. <P>SOLUTION: Audio data 8 including guide melody data, and music data including a lyrics data track 9 are stored; a live musical performance sound input from an audio input unit 1 and the audio data are compared and synchronized with each other, and a clock signal is generated based upon the synchronism (a performance clock predictive generator 3). The lyrics data track is sequenced with the clock signal (a video sequencer 10) to display lyrics in synchronism with the externally input live musical performance sound. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a content reproduction apparatus that displays a video synchronized with an audio signal input from the outside.

  In the performance by the karaoke apparatus, the lyrics telop is displayed in synchronization with the performance of the music (for example, Patent Document 1). This is because the performance track for performance and the lyrics track for displaying the lyrics telop are previously stored in the song data in parallel.

JP 2000-99044 A

  In recent years, not only karaoke apparatuses but also television broadcasts and the like are often used to display lyrics in accordance with the singer's singing. Also, in television broadcasting, not limited to lyrics, a news program or the like in which a person's remarks are written in text is displayed as a telop and displayed on the screen as a superimpose (telop). As a superimpose display, the display is widely performed.

  Each of these is a playback and display of a telop synthesized with video in advance. For example, live performances of live performances (so-called live broadcasts) are performed in real time. It was not a superimpose display.

  An object of the present invention is to provide a content reproduction apparatus capable of synchronously reproducing a video such as a lyrics telop in association with an audio signal generated in real time such as a live performance.

  The invention of claim 1 is a content data storage unit that stores content data in which audio time-series data and video time-series data are recorded in association with each other in time series, an audio signal input unit that inputs an audio signal from the outside, Auxiliary information input unit for inputting auxiliary information from the outside, and a calculation process for calculating the corresponding position on the time axis and the traveling speed of the audio signal by comparing the audio signal and the audio time-series data, and A clock prediction generation unit that corrects the calculation process based on auxiliary information and generates a reproduction clock that is synchronized with the audio signal by preceding the time required for the calculation process, and a reproduction clock generated by the clock prediction generation unit And a video playback unit for playing back the video time-series data based on the video time series data.

  According to a second aspect of the present invention, in the first aspect of the present invention, a video signal input unit for inputting a video signal from the outside, a video signal input by the video signal input unit and a video signal reproduced by the video reproduction unit are combined. And a video synthesizing unit that outputs the image.

  The invention of claim 3 is the invention of claim 2, further comprising: an auxiliary information extraction unit that extracts auxiliary information from the video signal input by the video signal input unit and supplies the auxiliary information to the clock prediction generation unit. It is characterized by.

According to a fourth aspect of the present invention, in the first aspect of the invention, a video signal input unit that inputs a video signal synchronized with the audio signal from the outside, and auxiliary information is extracted from the video signal input by the video signal input unit. And an auxiliary information extraction unit that supplies the clock prediction generation unit.

According to a fifth aspect of the present invention, in the first to fourth aspects of the present invention, the clock prediction generation unit further instructs the video reproduction unit to reproduce the video time-series data based on the auxiliary information. It was made to do.

  According to a sixth aspect of the present invention, in the first to fifth aspects of the invention, the auxiliary information input unit inputs progress position information of the audio signal as auxiliary information, and the clock prediction generation unit is based on the auxiliary information. The contrast position of the audio time-series data in the calculation process is corrected.

  According to a seventh aspect of the present invention, in the first to fifth aspects of the invention, the auxiliary information input unit inputs progress speed information of the audio signal as auxiliary information, and the clock prediction generation unit is based on the auxiliary information. The traveling speed in the calculation process is corrected.

  According to an eighth aspect of the present invention, in the first to seventh aspects of the invention, the video time-series data stored in the content data storage unit is sequence data including video data to be displayed and timing data indicating the display timing. The video reproduction unit includes a sequence processing unit for reproducing the sequence data.

  According to a ninth aspect of the present invention, in the first to seventh aspects of the invention, the video time-series data stored in the content data storage unit is video data including a moving image, and the video reproduction unit stores the video data A video playback unit for playback is included.

  According to a tenth aspect of the present invention, in the first to ninth aspects of the invention, the content data storage unit further stores device control time-series data for controlling the external device in time series, and the clock prediction generation unit generates An external device control unit that reads out the device control time-series data based on a reproduction clock and outputs a control signal is further provided.

  The invention according to claim 11 is the invention according to any one of claims 1 to 10, further comprising an audio reproduction unit that reproduces the audio time-series data based on the reproduction clock generated by the clock prediction generation unit. .

  According to a twelfth aspect of the present invention, in the invention of the eleventh aspect, the audio time-series data stored in the content data storage unit includes a plurality of tracks formed in parallel, and the clock prediction generation unit includes the plurality of clock prediction generation units. A reproduction clock is generated by using one track corresponding to the audio signal among the tracks, and the audio reproduction unit selects a part or all of the plurality of tracks not used by the clock prediction generation unit. It is characterized by playing.

[Action]
In the present invention, a reproduction clock synchronized with the audio signal is generated based on the audio signal and various auxiliary information, and the video time-series data is reproduced based on the reproduction clock, whereby the video (and audio) synchronized with the audio signal is reproduced. ) Can be played. Note that the audio signal may be output for reproduction via this device, or may be reproduced by another path that bypasses this device.
In addition, the calculation processing of the corresponding position on the time axis and the traveling speed for generating the reproduction clock is a complicated and heavy process, and therefore a certain amount of time is required after the audio signal (video signal) is input. . Therefore, the progress of the audio signal is predicted based on the auxiliary information, and the reproduction clock is advanced by the time required for the calculation process. As a result, it is possible to synchronize the reproduced video (and sound) with the input audio signal without delay.

  According to the present invention, since the video can be reproduced in synchronization with the input audio signal without delay, the same music for karaoke prepared separately even in a scene where a lyrics telop cannot be prepared in advance, such as a live performance The lyrics telop synchronized with the performance can be displayed using the lyrics telop for

Embodiments of the present invention will be described with reference to the drawings.
<< first embodiment >>
FIG. 1 is a block diagram of a content reproduction apparatus according to the first embodiment of the present invention. This content playback device is a device that plays back and outputs video sequence data (Display Sequence Data) 9 in synchronization with an audio signal input from an audio input unit (Audio In) 1. In the following description, a case where lyrics of live performance are displayed using song data used for performance of a karaoke song will be described as an example.

  The content playback apparatus includes an audio input unit 1 to which an audio signal is input from the outside, an auxiliary information input unit (Aux Info) 2 to which auxiliary information is input, an audio output unit (Audio Out) 11 to which an audio signal is output, and video A video output unit (Video Out) 12 for outputting the karaoke song data including the audio data (Audio Data) 8 and the video sequence data 9 (Song Data) 7, and the input audio signal And a video sequencer (Graphic Sequencer) 10 that reproduces the video sequence data 9.

  When displaying the lyrics of a live performance, the audio signal input from the audio input unit 1 is a performance sound of the live performance. The performance sound of the live performance is input from an electronic musical instrument played by the user of the content reproduction apparatus. Moreover, it may be input via a microphone that collects a user's live performance sound, or may be distributed via a public broadcast network, the Internet, or the like. In the case of karaoke song data, the audio data 8 is sequence data (performance track) implemented in a format such as MIDI. The sequence data is composed of event data that is information for executing a tone generation operation and a mute operation, and timing data that indicates the read timing of the event data. In the case of karaoke song data, the video sequence data 9 is a lyrics track for displaying lyrics. The performance track and the lyrics track are displayed in synchronization by being reproduced at the same clock.

  The signal processing unit 6 includes a performance clock prediction generation unit (Time Alignment & Tempo Tracker) 3. The performance clock prediction generation unit 3 compares the audio signal input from the audio input unit 1 with the audio data in the song data, and compares the position and speed based on the auxiliary information input from the auxiliary information input unit 2. The reproduction position information (timing information) and the tempo information synchronized with the audio signal are generated. Further, a reproduction clock is generated based on the generated reproduction position information (timing information) and tempo information.

  The performance clock prediction generation unit 3 divides the audio signal input from the audio input unit 1 into frames of several tens of milliseconds, and analyzes the spectrum, volume, and the like for each frame. On the other hand, the audio data stored in the storage unit 7 is read out. When the audio data is the above-described MIDI sequence data, the spectrum and volume of the musical sound that should be sounded at each timing are analyzed based on the event data. When the stored audio data is audio waveform data (ADPCM, MP3, etc.), the audio data input from the audio input unit 1 is divided into frames, and the spectrum and volume for each frame are divided. Analyze etc.

  The time axis in which the spectrum and its change curve are most approximated by comparing the spectrum and volume information of the audio signal input from the audio input section 1 with the information of the audio data spectrum and volume read from the storage section 7. The upper corresponding position is detected, and the time information of the music data at the corresponding position is used as the musical performance position information. That is, it detects which position in the music data the performance sound of the live performance is playing.

  By detecting the performance position, that is, synchronous detection, the position on the time axis of the music data of the currently input audio signal is determined, and the progress speed, that is, the tempo of the audio signal is determined. Then, the position on the time axis, that is, performance position information and timing information (information on when the beat timing is passed) and tempo information are output to the video sequencer 10. Note that the tempo and beat timing may be determined using, for example, the technique described in Japanese Patent Laid-Open No. 9-16171.

  The video sequencer 10 reads the video sequence data 9 which is a lyrics telop in accordance with the clock signal and reproduces the video of the lyrics telop. Since the clock signal is synchronized with the externally input audio signal, that is, the live performance sound as described above, the lyrics telop reproduced by the video sequencer 10 and output from the video output unit 12 is used for the live performance. It will be synchronized.

  It should be noted that since some processing time is required for synchronization detection and clock signal generation by the performance clock prediction generation unit 3, there is a possibility that the current performance position is shifted by the required processing time. Therefore, the performance clock prediction generation unit 3 needs to predict the current performance position when there is no processing time and output a reproduction clock. Usually, since the performance has a constant tempo, the performance position (position on the time axis of the audio signal) can be predicted based on the tempo information and the required processing time. Based on the predicted performance position, performance position information and a clock signal are generated. Thereby, the lyrics telop output from the video output unit 12 is more accurately synchronized with the audio signal output from the audio output unit 11. Note that if the performance is stopped, restarted, or the performance position jumps, synchronization may be lost, but in this embodiment, reliable performance is performed using auxiliary information input from the auxiliary information input unit 2 described later. Determine position and confirm synchronization.

Here, with reference to FIG. 2, FIG. 3, the display method of the song data of a karaoke song and a lyrics telop is demonstrated.
In FIG. 2, the song data includes a header, a musical sound track for playing a karaoke song, a guide melody track for generating a guide melody, and a lyrics track for displaying a lyrics telop, as shown in FIG. It consists of a mark track or the like on which jump marks indicating the song separation positions are written. On the mark track, for example, jump marks indicating the first, second, chorus, climax, intro, interlude, ending and the like are written.

Each track is described according to the MIDI format. For example, a musical tone track and a guide melody track are composed of event data such as note-on event data and note-off event data and timing data indicating the read timing of each event data, as shown in FIG. The note-on event data includes pitch data, and designates the pitch and volume of a musical sound generated by the note-on. This musical sound continues until the corresponding note-off event data is read out.
The timing data can be composed of duration data indicating the time interval between the event data, absolute time data indicating the absolute time from the start time of the music, and the like.

  The music track and guide melody track event data consists of note event data that indicates the pitch, volume, on / off, etc. of the music as described above. / Muted. The musical sound track is composed of a plurality of tracks (parts) for generating musical sounds of a large number of musical instruments, and the guide melody track is composed of single melody MIDI data for guiding the singing melody.

  The lyric track is sequence data that implements various data for displaying the karaoke song name and lyrics, and is composed of lyric display data read based on timing data as shown in FIG. .

  The lyric display data includes all data related to lyric display for one line, display on timing, display off timing, character string data (including the number of display points, display coordinates, character spacing data, etc.), color 1 data , Color 2 data, lyric color change data, etc.

  With reference to FIG. 5B, the display mode of the lyrics telop by the lyrics display data will be described. In the graph of this figure, the vertical axis represents time and the horizontal axis represents the x-coordinate of the lyrics telop (monitor screen). Prior to ton when the performance of a song reaches the location of the lyrics, the lyrics for one line are displayed in advance in color 1. The singer needs to display the lyrics in advance in order to view and interpret the lyrics telop. The display continues in color 1 until the performance of the song progresses to the lyrics. When the performance of the song reaches the location of the lyrics, the display color is changed from color 1 to color 2 (wipe) in order from the left as the song progresses. After the wipe is completed, the telop is erased after being displayed in color 2 for a while (te).

  The color change data of the lyrics is composed of a plurality of plotting data indicating the main points of the wipe (time-x coordinate) curve as shown in FIG. The video sequence unit 10 performs color change (wipe) by interpolating the plotting data with a quadratic curve. The video sequence unit 10 generates a lyrics telop synchronized with the video / audio of the live performance without delay, based on the reproduction clock and the performance position information input from the performance clock prediction generation unit 3.

  Here, referring again to FIG. 1, it is difficult for the performance clock prediction generation unit 3 to determine the performance position and to accurately determine the synchronization only with the audio signal input from the audio input unit 1. Therefore, reliable performance position determination and synchronization determination are performed using the auxiliary information input from the auxiliary information input unit 2.

The auxiliary information is, for example, information input by a user, information input by a staff member at a live venue, information detected from a live video, or the like. While performing, the user inputs auxiliary information using an operator (for example, a foot pedal). In addition, a plurality of staff members including a cameraman and a voice staff are engaged in the live venue for live broadcasting, and one of them inputs auxiliary information for synchronized playback on the karaoke apparatus. The auxiliary information includes start information indicating that the song has started, stop information indicating that the song has been paused, end information indicating that the song has ended, and indicating that the performance position of the song jumps from normal progress. Jump information and the like. When a user performs a performance, the performance may be performed differently from a recorded normal performance, such as repeating a specific performance. Also, in the case of live performances, there are cases where the third chorus is omitted due to time constraints, or the chorus is repeated according to the audience's reaction, and the performance is different from the recorded normal performance. .
In such a case, the user or the attendant at the venue jumps (or predicts where to jump) as jump information. The jump position may be specified by a jump mark in the music data, but may be specified by a time axis value in the music data. As described above, jump marks include marks indicating first, second, rust, climax, intro, interlude, and ending, and are associated with time axis values in song data according to each song. The It is preferable that the jump mark is originally added to the song data as shown in FIG. 2. However, for song data that does not have a jump mark, the user or the attendant at the live venue provides auxiliary information at the start of the song. You may make it input the data of a jump mark track. In addition, when the user inputs jump information using the foot pedal during the performance, it is configured so that it can be input by a simple operation such as No. 1 by stepping, No. 2 by 2 times, Rust by 3 times, etc. Just keep it.

  In addition, a beat signal input manually (tapping) at the start of a song or when the tempo changes is also sent as auxiliary information input by a user or an attendant at a live venue. This beat signal is not highly accurate and is not sent continuously from the beginning to the end of the song, so it cannot be used as a tempo clock signal as it is, but the tempo determination and beat timing are not It can be used as information for determining.

  The performance clock prediction generation unit 3 refers to the auxiliary information as described above input from the auxiliary information input unit 2 to determine where the current performance position is, reads out the surrounding audio data, Contrast with the input audio signal. In addition, the beat signal input intermittently is referred to, the approximate beat timing and tempo are grasped, and the input audio signal and the audio data are compared with the approximate beat timing and tempo (time axis scaling). Facilitates synchronization.

<< Second Embodiment >>
FIG. 4 is a block diagram of a content reproduction apparatus according to the second embodiment of the present invention. In FIG. 4, the same components as those of the first embodiment shown in FIG.

  In the content reproduction apparatus of this embodiment, the storage unit 7 stores video data (Video Data) 14 instead of the video sequence data 9 (see FIG. 1). As a functional unit for reproducing the video data 14, a video reproducing unit (Video Player) 15 is provided instead of the video sequencer 10 (see FIG. 1). As the video playback unit 15, a playback device (or playback software) with a variable frame rate is used. Thereby, video reproduction synchronized with the clock signal input from the performance clock prediction generation unit 3 can be performed.

<< Third Embodiment >>
FIG. 5 is a block diagram of a content reproduction apparatus according to the third embodiment of the present invention. In FIG. 5, the same components as those of the first embodiment shown in FIG.

  In the content reproduction apparatus of this embodiment, the storage unit 7 stores external sequence data (Aux Sequence Data) 17 for controlling external devices in addition to the video sequence data 9. An external sequencer 18 is provided as a functional unit for sequencing the external sequence data 17. The control data sequenced by the external sequencer 18 is output from the control signal output unit 19 to the external device.

  The control signal output unit 19 is connected to a production device such as an automatic performance piano, lighting equipment, fireworks, and fountains. By controlling the device in synchronism with the audio signal input from the audio signal input unit 1, a live piano is played in synchronization with the live performance, lighting is changed, and fireworks are ignited. Such effects can be added.

<< Fourth embodiment >>
FIG. 6 is a block diagram of a content reproduction apparatus according to the fourth embodiment of the present invention. In FIG. 6, the same components as those of the first embodiment shown in FIG.

  The content reproduction apparatus of this embodiment includes an audio reproduction unit 21 as a functional unit that reproduces the audio data 8A. The audio data 8A may be the same (same track) as the audio data 8 used as a reference for detecting synchronization with the audio signal, or may be another. For example, in the case of the song data shown in FIG. 2, since there are a plurality of performance data tracks that sequence a musical tone including a guide melody track, one of them (for example, the guide melody track) is used as a reference (audio data 8), and the other Can be used as audio data 8A for reproduction. Further, audio waveform data such as ADPCM and MP3 may be stored as the audio data 8A for reproduction.

  When the audio data 8A for reproduction is sequence data such as MIDI, the audio reproducing unit 21 has functions of a sequencer and a sound source. When the audio data 8A for reproduction is audio waveform data, the audio reproducing unit 21 includes a decoder.

  The audio signal of the audio data 8 </ b> A reproduced by the audio reproducing unit 21 is input to the mixer 22. The audio signal input from the audio input unit 1 is also input to the mixer 22. The mixer 22 mixes the input audio signal and the reproduced audio signal and outputs them from the audio output unit 11.

  Thereby, in synchronism with the input audio signal (live performance sound), a video such as a lyrics telop can be reproduced, and further, an audio signal is reproduced, mixed and output to the input audio signal. be able to. For example, an accompaniment sound can be added in accordance with the user's performance sound (melody).

<< Fifth Embodiment >>
FIG. 7 is a block diagram of a content reproduction apparatus according to the fifth embodiment of the present invention. In FIG. 7, the same components as those of the first embodiment shown in FIG.

  The content reproduction apparatus according to this embodiment includes a video input unit 24 in addition to the audio input unit 1. For example, live video is input to the video input unit 24. Further, this content reproduction apparatus includes a video mixer 26.

  The video signal input to the video input 24 is input to the video mixer 26. The video reproduced by the video sequencer 10 is also input to the video mixer 26. The video mixer 26 combines the video signal input from the video input unit 24 and the video reproduced by the video sequencer 10. The video (video signal) synthesized by the video mixer 26 is output from the video output unit 12.

  For example, if the input video signal is a live video and the video reproduced by the video sequencer 10 is a lyrics telop, the lyrics telop is superimposed on the live video and the synthesized video is output to the outside. Displayed.

<< Sixth Embodiment >>
FIG. 8 is a block diagram of a content reproduction apparatus according to the sixth embodiment of the present invention. In FIG. 8, the same components as those of the fifth embodiment shown in FIG.

  In the content playback apparatus of this embodiment, not only the video signal input from the video input unit 24 is synthesized and output, but also the video image is analyzed, and the performance clock prediction generation unit uses the analysis result as auxiliary information. 3 is supplied. A pattern recognition unit (Pattern Recognition) 28 is provided as a functional unit for performing this analysis. When recognizing a live performance, the pattern recognition unit 28 performs the following pattern recognition and inputs it to the performance clock prediction generation unit 3 as auxiliary information.

Recognize the movement of the singer's mouth and recognize the beginning of singing and general phrases.
Recognize the player's actions and recognize the general phrases, repetitions, end of music, etc.
Changes in lighting (changes in screen brightness) recognize the start of music and the approximate beat.

  The performance clock prediction generation unit 3 captures this recognition result as auxiliary information, so that the performance position, beat timing, tempo, etc. can be easily recognized without auxiliary information input from the outside, and input from the outside. When auxiliary information exists, the performance position, beat timing, tempo, etc. can be easily recognized with higher accuracy.

<< Reading >>
In the third embodiment, the example in which the external device control function by the external sequence data 17, the external sequencer 18 and the like is added to the first embodiment is shown. The external device control function is added to the second and fourth to sixth embodiments. Any form may be provided, and any form is within the technical scope of the present invention.

  Similarly, the audio data reproduction function by the audio data 8A, the audio reproduction unit 21 and the like of the fourth embodiment, and the video synthesis function by the video input unit 24 and the video mixer 26 of the fifth embodiment are respectively the first implementation. Any form other than the form may be combined, and any form is within the technical scope of the present invention. In addition, the video analysis function by the video input unit 24 and the pattern recognition unit 28 of the sixth embodiment may be combined with any embodiment other than the first embodiment and the fifth embodiment, and any of these modes is the technology of the present invention. Within the scope.

In the above-described embodiment, the description has been given mainly on the user performance or the live performance relay at another point as an example. However, the present invention is not limited to this, and the video is reproduced in synchronization with the audio signal. Any scene can be applied. For example, the present invention can be applied to a caption display device for television, a multilingual subtitle display device for movies, a language learning device, and the like.
In the above embodiment, an example in which an audio signal or a video signal is transmitted through a network or broadcast is shown. However, the audio signal, the video signal, and auxiliary information are stored in a medium or storage such as a DVD or HDD, It is also possible to use the content reproducing apparatus in such a form that a reproduced one is input as an audio signal, a video signal, and auxiliary information.

  In the above embodiment, the content playback device is described as being installed on the local (karaoke box) side. However, the content playback device is installed on the distribution side (for example, a live venue), and an audio signal and a video synchronized with the audio signal are provided. May be distributed together.

The block diagram of the content reproduction apparatus which is 1st Embodiment of this invention The figure which shows the structure of the music data memorize | stored in the content reproduction apparatus The figure explaining the display system of the lyrics telop The block diagram of the content reproduction apparatus which is 2nd Embodiment of this invention The block diagram of the content reproduction apparatus which is the 3rd Embodiment of this invention The block diagram of the content reproduction apparatus which is 4th Embodiment of this invention The block diagram of the content reproduction apparatus which is 5th Embodiment of this invention The block diagram of the content reproduction apparatus which is the 6th Embodiment of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Audio input part 2 Auxiliary information input part 3 Performance clock prediction production | generation part 6 Signal processing part 7 Memory | storage part 8 Audio | voice data 8A (For reproduction) Audio data 9 Video sequence data 10 Video sequencer 11 Audio output part 12 Video output part 14 Video Data 15 Video playback unit 17 External sequence data 18 External sequencer 19 Control signal output unit 21 Audio playback unit 22 Mixer 24 Video input unit 26 Video mixer 28 Pattern recognition unit

Claims (12)

A content data storage unit for storing content data in which audio time-series data and video time-series data are recorded in association with each other in time series;
An audio signal input section for inputting an audio signal from the outside;
An auxiliary information input unit for inputting auxiliary information from the outside;
Performing a calculation process of calculating the corresponding position on the time axis and the speed of progress of the audio signal by comparing the audio signal and the audio time-series data, and correcting the calculation process based on the auxiliary information, A clock prediction generation unit that generates a reproduction clock synchronized with the audio signal in advance by a time required for calculation processing;
A video reproduction unit for reproducing the video time-series data based on the reproduction clock generated by the clock prediction generation unit;
A content playback apparatus comprising: A video signal input unit for inputting a video signal from the outside;
A video synthesis unit that synthesizes and outputs the video signal input by the video signal input unit and the video signal reproduced by the video reproduction unit;
The content reproduction apparatus according to claim 1, further comprising: An auxiliary information extraction unit that extracts auxiliary information from the video signal input by the video signal input unit and supplies the auxiliary information to the clock prediction generation unit;
The content reproduction apparatus according to claim 2, further comprising: A video signal input unit for inputting a video signal synchronized with the audio signal from the outside;
An auxiliary information extraction unit that extracts auxiliary information from the video signal input by the video signal input unit and supplies the auxiliary information to the clock prediction generation unit;
The content reproduction apparatus according to claim 1, further comprising:   5. The content reproduction according to claim 1, wherein the clock prediction generation unit further instructs the video reproduction unit to reproduce the video time-series data based on the auxiliary information. apparatus. The auxiliary information input unit inputs the progress position information of the audio signal as auxiliary information,
The content reproduction apparatus according to claim 1, wherein the clock prediction generation unit corrects a comparison position of the audio time-series data in the calculation process based on the auxiliary information. The auxiliary information input unit inputs the traveling speed information of the audio signal as auxiliary information,
The content reproduction device according to claim 1, wherein the clock prediction generation unit corrects the progress speed in the calculation process based on the auxiliary information. The video time-series data stored in the content data storage unit is sequence data including video data to be displayed and timing data indicating the display timing thereof,
The content reproduction apparatus according to claim 1, wherein the video reproduction unit includes a sequence processing unit that reproduces the sequence data. The video time-series data stored in the content data storage unit is video data including a moving image,
The content reproduction apparatus according to claim 1, wherein the video reproduction unit includes a video reproduction unit that reproduces the video data. The content data storage unit further stores device control time-series data for controlling external devices in time series,
The content reproduction according to any one of claims 1 to 9, further comprising an external device control unit that reads out the device control time-series data based on the reproduction clock generated by the clock prediction generation unit and outputs a control signal. apparatus.   The content reproduction apparatus according to claim 1, further comprising an audio reproduction unit that reproduces the audio time-series data based on a reproduction clock generated by the clock prediction generation unit. The audio time-series data stored in the content data storage unit is composed of a plurality of tracks formed in parallel,
The clock prediction generation unit generates a reproduction clock using one track corresponding to the audio signal among the plurality of tracks,
The content reproduction device according to claim 11, wherein the audio reproduction unit reproduces a part or all of the plurality of tracks that are not used by the clock prediction generation unit.

Images