JP2006054517A - Information presenting apparatus, method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to readily and surely view video or listen to audio desired by the user among video or audio that is broadcast. <P>SOLUTION: A signal processing section 16 converts a received TV signal of a particular channel during broadcasting into a compressed moving picture file and sequentially records the file to a moving picture file DB 22 of a HDD 20. Further, a speech recognition section 18 sequentially receives a speech signal included in the received TV signal, converts the speech signal into character data through speech recognition and sequentially records the character data to a character data DB 23. A character data searching section 34 searches the character data wherein a searching phrase is included as a character string and, when the corresponding character data are extracted, displays a date and time and a reception channel, at a point of time when the speech signal corresponding to the corresponding character data is received, on a display apparatus 30 as information of a reproduction object moving picture. Notifying a moving picture reproduction section 28 about the above information allows the display apparatus 30 and a loudspeaker 32 to reproduce moving pictures for several minutes before and after a timing when the searching phrase is uttered as a speech. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information presentation apparatus, method, and program, and more particularly to an information presentation apparatus having a function of recording a broadcast video signal or audio signal, an information presentation method applicable to the information presentation apparatus, and a computer. The present invention relates to an information presentation program for causing the information presentation apparatus to function.

  When reserving recording of a desired television program by a television broadcast program recording device (VTR), various information necessary for reserving recording of the desired program, that is, channel, date (month / day), recording start time and recording end A method of keying in the time is common, but this method has the disadvantages that the operation is complicated and an input error tends to occur, and various recording reservation methods have been proposed.

  For example, Patent Document 1 acquires program information related to a broadcast program, acquires viewing history information about the user's past program viewing, and learns the preference of the program viewed by the user from the program information and viewing history information. Then, using the learning results, search for programs that can be viewed from programs scheduled to be broadcast in the future, determine programs that are highly viewable and have no overlapping recording candidates, and automatically select those recording candidates. In other words, there is disclosed a technique for automatically making a recording reservation for a program that matches a user's preference without making a complicated recording reservation operation.

  In relation to the above, in Patent Document 2, a key sound source is registered in advance via a keyboard or a microphone, and the audio signal included in the television signal is compared with the key sound source. That realizes digest recording by automatically extracting and recording only desired scenes such as program highlight scenes by controlling the audio signal storage unit and the video signal storage unit based on a detection signal indicating a match with Is disclosed.

Patent Document 3 stores an input video signal and features values in a form suitable for search from the video signal (for example, color average value for each block obtained by dividing a representative frame into four parts, or audio for an audio signal. The keyword selected from the text data obtained by the analysis is calculated and recorded in the video feature value storage device, and the calculated feature value is similar to any of the feature values of another video signal already recorded. The video related information indicating that these feature values are related is recorded in the video related information storage device, and the user viewing the video signal is requested to view the related video. In this case, a technique for displaying a related video signal on a reproduction display device is disclosed.
JP-A-11-345446 JP 09-009199 A JP 2000-308017 A

  However, the program that the user desires to watch is not always selected according to a certain standard (user preference or the like), and the user desires to watch a program that does not match the user's preference or the like at normal times. There is also. For example, when a large incident occurs suddenly on a certain day, a user who is interested in knowing the occurrence of the incident through a fragmented report that leaks out can confirm the details of the incident after returning home on that day. There is a high possibility of wanting to watch a program that reports on On the other hand, the techniques described in Patent Document 1 and Patent Document 2 are techniques for making a recording reservation based on information set in advance (a result learned from viewing history information or a key sound source registered in advance). Therefore, even if a program that the user wants to watch suddenly occurs as described above, it is impossible to reserve recording of the program.

In addition, a technology that allows a user to set a recording reservation from the outside is also proposed. For example, when a major incident occurs as described above, a special report that reports the incident in detail is provided. In many cases, the program organization is changed, such as when a program is broadcast suddenly, and the program organization is different from the program table distributed in advance. And since it is not easy for the user to know the program organization after the change, even if the above technique is used, the recording reservation is set so that the program broadcast suddenly with the program organization change is correctly recorded. It is difficult.

Further, the technology described in Patent Document 3 presents a video that the user desires to view when a user who is viewing a video desires to view a video related to the video that is being viewed. However, when the video desired by the user is not related to the video being viewed, or when the user is not viewing the video, the video desired by the user is presented. Is impossible. For this reason, when a user wants to view a certain video, the user first has to search for and view the video he / she wants to watch or a video related thereto, which is very inconvenient. For example, when a user knows that a major incident has occurred, one user wants to watch a program reporting the incident, while another user's interest is the stock price trend of the company related to the incident. For example, the video that the user desires to view varies greatly depending on the user. On the other hand, in the technique described in Patent Document 3, since the relation between the video signals is determined based on the automatically calculated feature value, the user can watch the video searched and extracted as the related video. If the desired video is not included or the search conditions are relaxed to avoid this (for example, a larger number of keywords are recorded as feature values of individual videos, and any one keyword is a feature value. For example, a video that is recorded as a video) is searched and extracted as a related video.

  In addition, the above problem is not limited to the case of viewing a video broadcast by a television broadcast or the like, but may also occur when listening to a sound broadcast by a radio broadcast or the like.

  The present invention has been made in consideration of the above facts, and is an information presentation apparatus and an information presentation method capable of easily and surely viewing or listening to a desired video or audio among broadcasted video or audio. And to obtain an information presentation program.

  In order to achieve the above object, an information presentation apparatus according to the invention described in claim 1 includes a receiving means for receiving a video signal or an audio signal being broadcast, and a recording medium for receiving the video signal or the audio signal received by the receiving means. Obtained by the voice recognition by the voice recognition means, the voice recognition means for converting the voice signal contained in the received video signal or the received voice signal into character information by voice recognition, and the voice recognition means Character information recording means for recording character information on the recording medium together with information associated with the video signal or audio signal recorded on the recording medium, and character information recorded on the recording medium by the character information recording means by the user Search means for searching for the specified search target phrase, and character information in which the search target phrase exists is extracted by the search by the search means. The video signal or audio signal corresponding to the character information is read out from the recording medium and reproduced, or the video signal or audio signal corresponding to the character information containing the search target phrase is specified. Presenting means for presenting possible information.

  According to the first aspect of the present invention, the video signal or audio signal being broadcast is received by the receiving means, and the video signal or audio signal received by the receiving means is recorded on the recording medium by the recording means. For example, an analog or digital television signal can be applied as the video signal being broadcast. In this case, the recording means may be configured to record the television signal received by the receiving means on a recording medium after converting the television signal received by the receiving means into a compressed digital video signal. preferable. By recording the compressed video signal, the data amount of the video signal to be recorded on the recording medium can be reduced, and the capacity of the recording medium necessary for recording the video signal can be reduced. Further, for example, a radio signal can be applied as an audio signal during broadcasting. In this case as well, it is preferable to configure the recording means so that the received radio signal is converted into a compressed digital audio signal and then recorded on the recording medium. The recording medium is preferably a randomly accessible recording medium such as a hard disk.

  Further, the invention described in claim 1 includes voice recognition means for converting voice signals included in the video signal received by the receiving means or voice signals received by the receiving means into character information by voice recognition. The character information obtained by the voice recognition by the recognition unit is recorded on the recording medium by the character information recording unit together with information associated with the video signal or the audio signal recorded on the recording medium by the recording unit. Therefore, when the video signal is received by the receiving means, the received video signal (and the audio signal included in the video signal) and the character information obtained by characterizing the voice represented by the audio signal included in the video signal are displayed. When the audio signal is received by the receiving means in association with each other, the received audio signal and character information obtained by characterizing the audio represented by the audio signal are associated with each other and recorded on the recording medium. Each will be recorded.

  According to the first aspect of the present invention, the search means searches for the search target phrase specified by the user for the character information recorded on the recording medium by the character information recording means, and the presentation means searches by the search by the search means. When character information in which the target word / phrase exists is extracted, a video signal or audio signal corresponding to the character information is read out from the recording medium and reproduced, or presented in the character information in which the search target word / phrase exists. Information that can identify the corresponding video signal or audio signal is presented. Thereby, if the user designates a specific phrase as a search target phrase, a video signal or an audio signal including the voice that utters the specific phrase is searched, and the corresponding video signal or audio signal exists When the video signal or audio signal is extracted, the corresponding video signal or audio signal is reproduced or information that can identify the corresponding video signal or audio signal is presented.

  Thus, according to the first aspect of the present invention, the video signal and the audio signal received by the receiving unit are recorded on the recording medium without performing the narrowing down of the recording target based on the information indicating the user's preference at the normal time. In addition, by searching for the specified search target phrase with respect to the character information obtained by voice recognition, the video signal or the audio signal including the voice that utters the specified search target phrase is searched. Even if the user suddenly becomes interested in a new matter, if a word or phrase related to the matter of interest is designated as a search target word, a video signal containing audio that utters the search target word or If the audio signal is broadcast, the user views the video signal or the audio signal by reproducing the video signal or the audio signal or presenting information that can identify the video signal or the audio signal. Door can be.

  Also, for example, when a user knows that a major incident has occurred, and the user wants to watch or listen to a program reporting the incident, the phrase that identifies the incident that occurred is specified as the search target phrase. For example, if only the video signal or audio signal of the program reporting the incident that occurred is searched, and the user's interest is the trend of the stock price of the company related to the incident, If the name is designated, only the video signal or audio signal of the program reporting on the company is surely searched. Therefore, a video signal or audio signal that the user wants to watch or listen to is not searched, or conversely, a large amount of video signal or audio signal including a video signal or audio signal that the user does not want to watch or listen to Can also be avoided. Therefore, according to the first aspect of the present invention, it is possible to easily and reliably view or listen to the video or audio desired by the user among the broadcast video or audio.

  In the first aspect of the invention, as described in the third aspect, for example, the date and time when the audio signal before the conversion of the information that associates the character information with the video signal or the audio signal is broadcast to the character information is broadcast. When the character information in which the search target phrase exists is extracted, the presenting means includes the date information that is recorded together with the extracted character information. The broadcasted video signal or audio signal is reproduced / presented, or the information including date and time information recorded together with the extracted character information is presented as information that can identify the corresponding video signal or audio signal. Can be configured.

  Further, in the first aspect of the invention, when there are a plurality of video or audio channels that the user may watch, for example, as described in claim 4, the receiving means, the recording means The voice recognition means and the character information recording means are provided in the same number as the number of channels of the video signal or audio signal to be recorded, and the search means is designated for the character information recorded on the recording medium by the individual character information recording means. What is necessary is just to comprise so that each search object phrase may be searched. As a result, the video signal or audio signal to be recorded (for example, the video or audio of all channels that the user may watch) is recorded on the recording medium, and the audio signal included in the recorded video signal or The recorded voice signal is converted into character information by voice recognition, and the obtained character information is recorded on a recording medium together with information associated with the recorded video signal or voice signal. And the search means searches the specified search target word / phrase for the character information recorded on the recording medium by the individual character information recording means, so the video signal or audio signal of a plurality of recorded channels is searched. As a result, all the video signals or audio signals including the voice that utters the designated search target phrase are extracted. Therefore, according to the fourth aspect of the present invention, the user can watch all the video or audio including the audio that utters the search target phrase among the video or audio broadcast on a plurality of channels to be recorded. Is possible.

  In the first aspect of the invention, the search target word / phrase is specified by the user, for example, as described in claim 5, when the user inputs the search target word / phrase via the input means, or the user inputs the search target word / phrase. Can be done by speaking. When a search target phrase is specified by the user speaking the search target phrase, the search target phrase search by the search means performs voice recognition on the voice when the user utters the search target phrase, and the voice This can be realized by using character information obtained by recognition.

  According to a sixth aspect of the present invention, there is provided an information presentation method for receiving a video signal or audio signal being broadcast, recording the received video signal or audio signal on a recording medium, and an audio signal included in the received video signal. Alternatively, the received voice signal is converted into character information by voice recognition, and the character information obtained by voice recognition is recorded on the recording medium together with information associated with the video signal or voice signal recorded on the recording medium, and recorded. A search target phrase specified by a user is searched for character information recorded on a medium, and when character information including the search target phrase is extracted by the search, a video signal or an audio signal corresponding to the character information is extracted. Is read out from the recording medium and reproduced, or a video signal or an audio signal corresponding to the character information in which the search target phrase exists exists. Since presenting the information to a constant, as in the invention of claim 1 wherein, the user of the broadcast video or audio it is possible to easily and reliably view or listen to desired by video or audio.

  According to a seventh aspect of the present invention, there is provided an information presentation program comprising: a computer having receiving means and a recording medium for receiving a video signal or audio signal being broadcast; and a recording medium for receiving the video signal or the audio signal received by the receiving means. Recording means for recording to, voice signal included in the received video signal or voice recognition means for converting the received voice signal into character information by voice recognition, character information obtained by voice recognition by the voice recognition means Is recorded on the recording medium together with information associated with the video signal or audio signal recorded on the recording medium, and the character information recorded on the recording medium by the character information recording means is designated by the user. Search means for searching for a search target phrase, and characters in which the search target phrase is present by the search by the search means When the information is extracted, the video signal or the audio signal corresponding to the character information is read out from the recording medium and reproduced, or the video signal corresponding to the character information in which the search target phrase is present or It functions as a presentation means for presenting information that can identify the audio signal.

  A program according to a seventh aspect of the invention is a program for causing a computer including the receiving unit and the recording medium to function as the recording unit, the voice recognition unit, the character information recording unit, the search unit, and the presentation unit. Therefore, when the computer executes the information presentation program according to the invention described in claim 7, the computer functions as the information presentation apparatus according to claim 1, and is similar to the invention according to claim 1. In addition, it is possible to easily and reliably view or listen to the video or audio desired by the user among the broadcast video or audio.

  As described above, the present invention receives a video signal or audio signal being broadcast and records it on a recording medium, and converts the audio signal contained in the received video signal or the received audio signal into character information by voice recognition. Then, the obtained character information is recorded on a recording medium together with information associated with the recorded video signal or audio signal, the search target phrase specified by the user is searched for the recorded character information, and the character in which the search target phrase exists When information is extracted, a video signal or audio signal corresponding to the character information is read out from a recording medium and reproduced, or presented, or a video signal or audio corresponding to character information in which a search target phrase exists Since information that can identify the signal is presented, it is possible to easily and reliably view or listen to the desired video or audio of the broadcast video or audio. It is possible to have an excellent effect that.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a moving image recording / reproducing apparatus 10 according to the present embodiment. The moving image recording / reproducing apparatus 10 corresponds to the information presenting apparatus according to the present invention (specifically, the information presenting apparatus described in claim 2), and is installed at the user's home, for example.

  The moving image recording / reproducing apparatus 10 includes a TV tuner 14 connected to an antenna 12. By receiving electromagnetic waves in the TV frequency band such as VHF and UHF by the antenna 12, a signal in the TV frequency band is input from the antenna 12 to the TV tuner 14, and the TV tuner 14 converts the input signal in the TV frequency band. Based on this, an analog television signal (TV signal) broadcast by a broadcasting station of a preset channel is demodulated. Further, the TV tuner 14 has a built-in timer, and continues demodulation (reception) of the TV signal of a preset channel from the preset reception start time to the reception end time. The antenna 12 and the TV tuner 14 correspond to the receiving means according to the present invention. A signal processing unit 16 and a voice recognition unit 18 are connected to the TV tuner 14, and TV signals demodulated by the TV tuner 14 are sequentially input to the signal processing unit 16, and video signals included in the demodulated TV signals Of the audio signals, only the audio signals are sequentially input to the audio recognition unit 18.

  The signal processing unit 16 converts analog TV signals sequentially input from the TV tuner 14 into digital moving image data, and divides the converted moving image data every predetermined time (for example, 1 hour). By compressing (encoding) the moving image data according to a predetermined moving image compression format (for example, mpeg1 / 2/4), compressed moving image files that conform to the predetermined moving image compression format are sequentially generated. Note that the above compressed video file is the elapsed time when the compressed image file is played back from the beginning when the compressed video file is generated for the purpose of synchronizing the video and audio during playback of the moving image (video and audio). The time information (time stamp) indicating is sequentially inserted into the compressed video data and the compressed audio data included in the compressed image file by the signal processing unit 16. In addition, the signal processing unit 16 sets reception start date and time information indicating the date and time when the input of the TV signal corresponding to each compressed moving image file from the TV tuner 14 is started in the header of each compressed moving image file.

  Note that the broadcast date / time (reception date / time) of the TV signal before being compressed into compressed video data and compressed audio data is set in the time information sequentially inserted into the compressed video data and compressed audio data and the header of the compressed video file. It can be determined from the reception start date / time information, and these information correspond to the date / time information described in claim 3.

  Further, the TV tuner 14 simultaneously outputs reception channel information indicating the channel of the TV signal to be output when the TV signal is output to the signal processing unit 16. The signal processing unit 16 sets the reception channel information input from the TV tuner 14 in the header of the generated compressed moving image file. Therefore, based on the signal (information) input from the TV tuner 14, a compressed moving image file having a format as shown in FIG. 2A as an example is generated by the signal processing unit 16. The signal processing unit 16 is connected to an HDD (Hard Disk Drive) 20, and the HDD 20 stores a moving image file DB (database) 22 for accumulating and storing the compressed moving image file. The signal processing unit 16 sequentially stores and stores the generated compressed image file in the moving image file DB 22 of the HDD 20. Therefore, the moving image file DB 22 of the HDD 20 stores the moving image file DB 22 as a compressed moving image file without narrowing down the recording target based on the information indicating the user's preference during normal operation of the TV signal received by the TV tuner 14. Will be recorded. Thus, the signal processing unit 16 corresponds to the recording means according to the present invention.

  On the other hand, a speech dictionary 26 is connected to the speech recognition unit 18, and a large number of pattern data referred to for pattern matching during speech recognition processing is stored in the speech dictionary 26. The voice recognition unit 18 converts the voice signal sequentially input from the TV tuner 14 into digital voice data, and then sequentially extracts voice data for one phrase or one word from the voice data obtained by the conversion, and extracts the extracted voice. Voice recognition is performed by matching the data with pattern data stored in the voice dictionary 26 (pattern matching), and generation of character data (text data) representing the recognition result is repeated. As a result, character data representing the content of the voice represented by the input voice signal is obtained. The voice recognition unit 18 divides the character data obtained by the above-described voice recognition into character data corresponding to a predetermined amount of voice data, and the corresponding voice signal is transmitted to the TV tuner 14 for each divided character data. Is added with date / time information indicating the date / time input (≈ the date / time received by the TV tuner 14).

  In addition, the voice recognition unit 18 converts the character data obtained by the voice recognition process and date / time information added to the character data into a file by using information for a predetermined time (for example, one hour) as a unit. The reception start date / time information indicating the date / time when the input of the audio signal corresponding to each character data file is started from the TV tuner 14 is set in the header of the (file). The broadcast date / time (reception date / time) of the TV signal including the audio signal corresponding to the audio data used to generate the character data can be determined from the date / time information added to the character data. 3 corresponds to the date and time information described in 3.

  When the TV tuner 14 outputs an audio signal to the audio recognition unit 18, it also outputs reception channel information indicating a TV signal channel corresponding to the audio signal to be output, and the audio recognition unit 18 is output from the TV tuner 14. The input reception channel is set in the header of each character data file. Therefore, based on the signal (information) input from the TV tuner 14, a character data file having a format as shown in FIG. 2B is generated by the voice recognition unit 18 as an example. The voice recognition unit 18 is connected to the HDD 20, and the HDD 20 stores a character data DB 24 for accumulating and storing the character data file. The voice recognition unit 18 sequentially stores and stores the generated character data file in the character data DB 24 of the HDD 20. Thus, the voice recognition unit 18 corresponds to the voice recognition means and the character information recording means according to the present invention.

  Regarding the deletion of the compressed moving image file and the character data file stored and stored in the HDD 20, for example, when the HDD 20 is full, the reception start date and time indicated by the reception start date and time information set in the header is in order from the oldest information. It can be performed by any method such as erasing.

  Further, the HDD 20 is connected with a moving image playback unit 28 and a character data search unit 34. A display 30 for reproducing and displaying an image (video) and a speaker 32 for reproducing and outputting audio are connected to the moving image reproducing unit 28. As the display 30 and the speaker 32, for example, a display and a speaker built in the television receiver can be applied. When the information specifying the playback target compressed video file is input, the video playback unit 28 reads out the specified playback target compressed video file from the video file DB 22 of the HDD 20 and sequentially decodes the video obtained by the decoding. The video represented by the data is displayed on the display 30 and the audio represented by the audio data obtained by decoding is output from the speaker 32, thereby reproducing the moving image (video and audio) represented by the compressed moving image file to be reproduced.

  On the other hand, the character data search unit 34 includes a microcomputer or the like, and performs search / playback processing to be described later. The character data search unit 34 is connected to a designation unit 36 for the user to input various information. The designation unit 36 is configured to include information input means such as a keyboard, and the user inputs information such as the reception start time and reception end time of the TV tuner 14, the reception channel, and a search phrase in the search by the character data search unit 34. Is done.

  Next, as an operation of this embodiment, search / reproduction processing executed by the character data search unit 34 will be described with reference to the flowchart of FIG. In this search / playback process, for example, the user is interested in a specific matter, confirms the presence or absence of a TV program touching the matter of interest, and desires to view the TV program if there is a corresponding one. In such a case, a search for a TV program (compressed moving image file) is executed by an instruction from the user via the designation unit 36.

  In step 100, a message requesting input of a search term and a date and time range to be searched is displayed on the display 30 by the video playback unit 28, thereby requesting the user to input the search term. In the next step 102, it is determined whether or not a search term has been input, and the determination in step 102 is repeated until the determination is affirmed. The user who recognizes that the input of the search phrase and the search date / time range is requested by confirming the message displayed on the display 30, the search phrase (for example, he / she is interested) Enter words related to the matter). For example, when all the compressed moving image files stored and stored in the moving image file DB 22 are to be searched, it is possible to omit the specification of the date range to be searched.

  When the search phrase and the date / time range to be searched are input by the user, the determination in step 102 is affirmed and the process proceeds to step 104, a single character data file is extracted from the character data DB 24, and the header of the extracted character data file is retrieved. Based on the reception start date and time set in the above, it is determined whether the broadcast date and time range of the TV signal corresponding to the extracted character data file is within the specified search date and time range, and the broadcast date and time range is the search target date and time If the character data file is out of the range, the character data file corresponding to the program broadcast within the specified date and time range to be searched is searched by repeatedly extracting the next character data file, and the corresponding character data is retrieved. Import files. In step 106, all character data included in the captured character data file are compared with the search terms, and in the next step 108, character data including the search terms as character strings are included in the captured character data file. It is determined whether or not it existed.

If the determination in step 108 is negative, the process proceeds to step 112 without performing any processing. However, if the determination is affirmative, the process proceeds to step 110 and is previously captured in step 104 as reproduction candidate video information. Receiving channel information set in the header of the character data file and date and time information added to character data matching the search word (character data including the search word as a character string) (see FIG. 2B) ) Is displayed on the display 30 by the moving image reproduction unit 28, and then the process proceeds to step 112. In addition, you may make it display on the display 30 also the character data (For example, about several lines before and behind centering on a search word / phrase) including the search word / phrase as a character string.
In step 112, it is determined whether or not the search for the search term has been completed by determining whether or not the headers of all the character data files stored and stored in the character data DB 24 have been referred to in the previous step 104. . If the determination is negative, the process returns to step 104, and steps 104 to 112 are repeated until the determination of step 112 is affirmed. As a result, when a plurality of character data containing the search word / phrase as a character string is extracted, information of reproduction candidate moving images corresponding to each extracted character data is displayed in a list on the display 30. .

  If the determination in step 112 is affirmed, a message notifying the end of the search is displayed on the display 30 by the moving image reproduction unit 28, and then the process proceeds to step 114, and the search phrase is converted into a character string by the processing in steps 104 to 112 described above. It is determined whether or not the character data included as is extracted. If the determination is negative, the process proceeds to step 122, and the moving image playback unit 28 sends an error message notifying the user that there is no TV program (moving image) containing the voice that utters the designated search phrase. After displaying on the display 30, the search / playback process is terminated.

  On the other hand, when character data including a search phrase as a character string is extracted, the determination in step 114 is affirmed and the process proceeds to step 116, where a playback candidate video whose information is displayed on the display 30 is selected. It is then determined whether or not playback is instructed. If the determination is negative, the process proceeds to step 120, and it is determined whether or not the end of the search / playback process is instructed. If the determination is negative, the process returns to step 116, and steps 116 and 120 are repeated until either determination is positive. When the information on the playback candidate video is displayed on the display 30 when the message notifying the end of the search is displayed on the display 30, the user uses the designation unit 36 to display the information on the playback candidate video displayed on the display 30. Among them, information on a playback candidate video to be viewed is selected as a playback target, and playback of the selected playback target video is instructed. When a playback target video is selected and playback is instructed, the determination in step 116 is affirmed and the process proceeds to step 118, where information on the playback candidate video selected as the playback target (reception channel information and character data is added). The date / time information) is notified to the video playback unit 28 as information on the playback target video, and the video playback unit 28 is instructed to play back the playback target video, and then the process proceeds to step 120.

  Thereby, the moving image reproduction unit 28 first extracts a single compressed moving image file from the moving image file DB 22, and is notified from the character data search unit 34 based on the reception start date and time set in the header of the extracted compressed moving image file. The date and time represented by the date and time information (the date and time when the TV signal whose search phrase is uttered as audio when viewed) is included in the date and time range when the TV signal corresponding to the extracted compressed video file is broadcast, and is extracted It is determined whether the received channel set in the header of the compressed video file matches the notified reception channel. If the extracted compressed video file does not meet the above conditions, the next compressed video file is selected. By repeating the extraction, a compressed moving image file that meets the above conditions is searched. When a compressed moving image file to be played that satisfies the above conditions is extracted, the moving image playing unit 28 next reproduces a moving image from the compressed moving image file to be played based on the notified date and time information. To decide. For example, only the moving image for several minutes before and after is reproduced centering on the timing represented by the notified date and time information (timing that the search phrase is uttered as audio when the moving image represented by the compressed video file to be reproduced is reproduced). Can be determined.

  Subsequently, the video playback unit 28 sequentially refers to the time information inserted in the compressed video data and the compressed audio data included in the compressed video file to be played back, and the time represented by the referenced time information corresponds to the determined playback range. If it is the time, the extraction of the corresponding compressed video data or compressed audio data is repeated to extract only the compressed video data and compressed audio data corresponding to the determined reproduction range. Then, the moving image reproduction unit 28 arranges the extracted compressed video data and compressed audio data in time series and decodes them in order, displays the video represented by the video data obtained by the decoding on the display 30, and the audio data obtained by the decoding. Is output from the speaker 32, and a moving image (video and audio) corresponding to the determined reproduction range is reproduced. Thereby, the user can view only a part touching a matter of interest in the broadcast TV program as a moving image. As described above, the character data search unit 34 corresponds to the search unit according to the present invention, and the character data search unit 34 and the moving image playback unit 28 correspond to the presentation unit according to the present invention.

  If a plurality of playback candidate video information are displayed on the display 30, if the user who has finished viewing the above selects other playback candidate video information and indicates playback, the determination in step 116 is made. By affirming again and repeating the above-described processing for the selected playback candidate video, it is possible to view another portion of the broadcast TV program that touches an interesting matter as a moving image. .

  As described above, according to the present embodiment, even when the user suddenly becomes interested in a new matter, etc., if a phrase related to the matter of interest is designated as a search term, the designated search is performed. If a TV program including a voice that utters a phrase is broadcast, the user can easily and reliably view the TV program. Further, in the present embodiment, in the broadcast TV program, only the moving images for several minutes around the timing when the specified search word / phrase is uttered as voice are reproduced, so that the search word / phrase is uttered as voice. This saves the user from having to search for a location and saves the time required for viewing. Further, in the present embodiment, the specified search word is uttered as a voice by converting the voice signal into character data by voice recognition and performing a search for the specified search word with respect to the converted character data. Since a search for a moving image (TV program) is performed, it is possible to reliably extract and present a moving image (TV program) touching a matter that the user is interested in, as compared with the case of using a program guide or the like. it can.

  In the above description, an example in which only a moving image for several minutes before and after the timing at which the specified search phrase is uttered as a voice is reproduced has been described. However, the present invention is not limited to this, and the specified search is performed. The entire TV program in which the phrase is uttered as sound may be played, or the playback range of the moving image may be arbitrarily set by the user.

  In the above description, an example in which reception channel information and date / time information are displayed on the display 30 as information of a reproduction candidate video (a moving image in which a designated search phrase is uttered as sound) has been described. However, the present invention is not limited to this. For example, other information such as a program name may be acquired and displayed by referring to an electronic program guide published on the Internet.

  In addition, the moving image recording / reproducing apparatus 10 according to the present embodiment can be configured by, for example, an HDD recorder and a personal computer (PC), but is not limited to this. For example, a video signal or an audio signal being broadcast is received. If the PC has a receiving means for receiving (for example, a TV tuner connected to an antenna), the PC can also function as the moving picture recording / reproducing apparatus 10 according to the present embodiment by causing the PC to execute a predetermined program. It is. In this case, the predetermined program corresponds to the information presentation program according to the seventh aspect.

  Furthermore, in the above description, the configuration in which one TV tuner 14, one signal processing unit 16, and one voice recognition unit 18 are provided has been described. However, the present invention is not limited to this, and as shown in FIG. Are provided with a plurality of moving image file / character data generating / recording units 40 each including a TV tuner 14, a signal processing unit 16, and a voice recognizing unit 18. Alternatively, a configuration may be employed in which the generation of the received / compressed moving image file and the recording / recording of the character data file are performed in parallel for the recording / audio signal. In this case, the character data search unit 34 may be configured to search for the specified search word / phrase with respect to the character data files of all channels. This makes it possible to reliably extract and present each TV program even when TV programs broadcast in the same time zone on different channels are touching matters that the user is interested in.

  Further, the example in which the moving picture recording / reproducing apparatus 10 according to the present embodiment is installed at the user's home has been described above. However, the present invention is not limited to this, and the moving picture recording / reproducing apparatus 10 is connected to a computer network such as the Internet. When a search term is specified from a user via a computer network, either directly or via a server, the search result or moving image data instructed to be played is transmitted to the user via the computer network. A service may be provided. In particular, when the configuration of FIG. 4 is adopted, the apparatus may be large and expensive. However, by using the computer network as described above, a single moving image recording / reproducing apparatus 10 can be used by a plurality of users. This is preferable because it can be used.

  In the above description, the mode in which time information (time stamp) indicating the elapsed time when the compressed image file is reproduced from the beginning is sequentially inserted into the compressed video data and the compressed audio data of the compressed moving image file has been described. However, the present invention is not limited to this, and date / time information indicating the broadcast date / time (reception date / time) of the TV signal before being compressed into compressed video data and compressed audio data may be sequentially inserted. In this aspect, the date and time information corresponds to the date and time information described in claim 3.

  Further, in the above, after displaying the search result (information of the playback candidate video in which the designated search phrase is uttered as sound), when the playback candidate video is selected and playback is instructed, the selected moving image is played back. Although the example to perform was demonstrated, it is not limited to this, The aspect which displays only a search result (presentation) is also contained in this invention.

  In the above description, an example of receiving an analog TV signal transmitted by wireless broadcasting has been described. However, the present invention is not limited to this, and when receiving a TV signal of wired broadcasting, a digital TV signal is received. In the case of reception, it goes without saying that the present invention can also be applied to the case of receiving a radio broadcast signal instead of the TV broadcast (in this case, an AM / FM tuner or the like may be provided instead of the TV tuner 14).

It is a block diagram which shows schematic structure of the moving image recording / reproducing apparatus which concerns on this embodiment. (A) is a format of a compressed moving image file, and (B) is an image diagram showing an example of a format of a character data file. It is a flowchart which shows the content of the search / reproduction | regeneration process explaining the effect | action of a character data search part. It is a block diagram which shows the other example of schematic structure of a moving image recording / reproducing apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Movie recording / reproducing apparatus 12 Antenna 14 TV tuner 16 Signal processing part 18 Voice recognition part 20 HDD
28 Video playback unit 30 Display 32 Speaker 34 Character data search unit 38 Video playback unit 40 Video file / character data generation / recording unit

Claims (7)

Receiving means for receiving a video signal or audio signal being broadcast;
Recording means for recording the video signal or audio signal received by the receiving means on a recording medium;
An audio signal included in the received video signal or an audio recognition means for converting the received audio signal into character information by audio recognition;
Character information recording means for recording character information obtained by voice recognition by the voice recognition means together with information associated with a video signal or a voice signal recorded on the recording medium, on a recording medium;
Search means for searching for a search target phrase specified by a user for character information recorded on a recording medium by the character information recording means;
When character information including a search target phrase is extracted by the search by the search means, a video signal or an audio signal corresponding to the character information is read out from a recording medium and reproduced, or presented. Presenting means for presenting information capable of specifying a video signal or an audio signal corresponding to character information in which the target phrase exists;
An information presentation device.   The video signal being broadcast is an analog or digital television signal, and the recording means converts the television signal received by the receiving means into a compressed digital video signal and then records it on a recording medium. The information presenting apparatus according to claim 1, wherein: The information associating the character information with the video signal or the audio signal includes date and time information indicating the date and time when the audio signal before being converted into the character information was broadcast,
When the character information in which the search target word / phrase exists is extracted, the presenting means is based on the date / time information recorded together with the extracted character information, and the video signal or audio broadcast on the date / time indicated by the date / time information A signal is reproduced / presented, or information including date and time information recorded together with the extracted character information is presented as information that can identify the corresponding video signal or audio signal. Item 1. An information presentation device according to Item 1.   The reception means, the recording means, the voice recognition means, and the character information recording means are provided in the same number as the number of channels of the video signal or audio signal to be recorded, and the search means is provided by each character information recording means. 2. The information presentation apparatus according to claim 1, wherein each of the designated search target phrases is searched for the character information recorded on the recording medium.   The information presentation apparatus according to claim 1, wherein the search target word / phrase is specified by a user inputting through an input unit, or specified by a user uttering the search target word / phrase. Receiving the video signal or audio signal being broadcast, recording the received video signal or audio signal to the recording medium,
Information that converts the audio signal included in the received video signal or the received audio signal into character information by voice recognition, and associates the character information obtained by voice recognition with the video signal or audio signal recorded on the recording medium Along with a recording medium,
Search the search target words specified by the user against the character information recorded on the recording medium,
When character information including a search target word is extracted by the search, a video signal or an audio signal corresponding to the character information is read out from a recording medium and reproduced, or the search target word is displayed. An information presentation method for presenting information for specifying a video signal or an audio signal corresponding to character information in which there is a character. A computer comprising a receiving means and a recording medium for receiving a video signal or audio signal being broadcast,
Recording means for recording the video signal or audio signal received by the receiving means on a recording medium;
An audio signal included in the received video signal or an audio recognition means for converting the received audio signal into character information by audio recognition;
Character information recording means for recording character information obtained by voice recognition by the voice recognition means together with information associated with a video signal or a voice signal recorded on the recording medium, on a recording medium;
Search means for searching for a search target phrase specified by a user for character information recorded on a recording medium by the character information recording means;
And, when the character information in which the search target phrase exists is extracted by the search by the search means, the video signal or the audio signal corresponding to the character information is read out from the recording medium and reproduced, or presented, An information presentation program that functions as a presentation unit that presents information that can identify a video signal or an audio signal corresponding to character information in which the search target word is present.

Images