JP2006262057A - Information processing apparatus, information processing method, and program - Google Patents

Abstract

[PROBLEMS] To specify and replace commercials.
SOLUTION: In step S501, second metadata corresponding to a program ID of recorded data selected by a user is detected. In step S502, based on whether there is detected second metadata. It is determined whether or not there is a commercial replacement, and if it is determined that there is a commercial replacement, it is supplied from the matching processing unit based on the corresponding program ID and CMID of the second metadata in step S503. The time code of the commercial part to be replaced is detected from the first metadata. In step S503, based on the detected time code of the commercial part to be replaced, the video and audio data of the commercial part of the recording data supplied to the screen display control unit are included in the second metadata. Replaced with content data. The present invention can be applied to a recording apparatus.
[Selection] FIG.

Description

  The present invention relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device, an information processing method, and a program that can replace a commercial portion of recorded data.

  A technique for receiving and storing broadcast data, that is, recording video, is widely used. In particular, a technique capable of recording broadcast data on a large-capacity recording medium such as a hard disk is widely used, and a user can record a large amount of broadcast data. You can record it and watch it later later when you have time. In addition, there is a technique that allows a commercial (CM) inserted in the main part of a program to be skipped during playback of recorded broadcast data (for example, Patent Document 1).

JP 2003-319314 A

  When a broadcast program is recorded using an EPG (Electric Program Guide), an advertisement can be displayed on the EPG display screen.

  When the recorded broadcast data is played back, if the commercial part is skipped, it is disadvantageous for the program sponsor who cannot receive the commercial, and further, the value of the program commercial is reduced. Will also lead to a decrease in revenue.

  Since it is possible to record a large amount of broadcast data, the user may play back the recorded broadcast data several days or months after the broadcast date. However, program commercials include, for example, limited-time sale announcements and event advertisements that are held on a certain date, and can be viewed many days or months after the broadcast date. It is disadvantageous for the program sponsor, and further, the decline in the value of the program commercial leads to a decrease in the revenue of the broadcasting station. In addition, the user may lose the opportunity to purchase a product or service by viewing the commercial with a delay.

  The present invention has been made in view of such a situation. For example, new commercial data is acquired, and a commercial portion of recorded data can be replaced.

  The information processing apparatus according to the present invention includes a recording data storage unit that stores recording data associated with first time information, first discrimination information for distinguishing a program of the recording data, and a program main part of the recording data. The first text data relating to the second text data, the second text data relating to the commercial of the recorded data and made distinguishable by the second distinction information, and the first text data and the second text data First metadata storage means for storing first metadata including corresponding second time information, second data including content data corresponding to commercials, first distinction information, and second distinction information Of the recorded data stored in the recorded metadata stored in the second metadata storage means for storing the metadata of the recording data, the recording data desired by the user is stored. Display control means for controlling the display of the data, first metadata stored in the first metadata storage means, and second metadata stored in the second metadata storage means. In addition, among the recorded data whose display is controlled by the display control means, the first metadata included in the second metadata and the commercial specified by the second metadata are included in the second metadata. A replacement processing means for replacing the content data corresponding to the commercial is provided.

  The display control means extracts only the commercial part of the recorded data based on the second distinction information and the second time information included in the first metadata, controls the reproduction of the extracted commercial part, Thereafter, the reproduction of the recorded data other than the commercial can be controlled.

  The information processing method of the present invention includes a recording data storage control step for controlling storage of recording data associated with first time information, first discrimination information for distinguishing programs of recording data, and recording data Of these, the first text data relating to the main part of the program, the second text data relating to the commercial among the recorded data and made distinguishable by the second distinction information, and the first text data and the second text data A first metadata storage control step for controlling storage of the first metadata including second time information corresponding to the text data, content data corresponding to the commercial, first distinction information, and second Processing of second metadata storage control step for controlling storage of second metadata including discrimination information, and processing of first metadata storage control step Based on the first metadata whose storage is more controlled, the first distinction information included in the second metadata whose storage is controlled by the processing of the second metadata storage control step in the recorded data. A detection step for detecting a commercial specified by the second distinction information, a replacement processing step for replacing the commercial detected by the processing of the detection step with content data corresponding to the commercial included in the second metadata, The display includes a display control step for controlling the display of the recorded data in which the commercial is replaced with the content data corresponding to the commercial by the processing of the replacement processing step.

  The program of the present invention includes a recorded data storage control step for controlling storage of recorded data associated with first time information, first discrimination information for distinguishing a program of recorded data, and a program among recorded data. The first text data relating to the main part, the second text data relating to the commercial of the recorded data and made distinguishable by the second distinction information, and the first text data and the second text data A first metadata storage control step for controlling the storage of the first metadata including the second time information corresponding to the content data, the content data corresponding to the commercial, the first distinction information, and the second distinction information In the processing of the second metadata storage control step for controlling the storage of the second metadata including the first metadata storage control step First discriminating information included in the second metadata whose storage is controlled by the processing of the second metadata storage control step in the recorded data based on the first metadata whose storage is controlled. A detection step for detecting a commercial specified by the second distinction information, a replacement processing step for replacing the commercial detected by the processing of the detection step with content data corresponding to the commercial included in the second metadata, The computer causes the computer to execute a process including a display control step for controlling the display of the recorded data in which the commercial is replaced with the content data corresponding to the commercial by the process of the replacement process step.

  In the information processing apparatus, the information processing method, and the program of the present invention, recorded data associated with the first time information is stored, and the first discriminating information for discriminating the program of the recorded data, the recorded data First text data relating to the main part of the program, second text data relating to the commercial of the recorded data and made distinguishable by the second discrimination information, and the first text data and the second text data The first metadata including the second time information corresponding to the text data is stored, and the second metadata including the content data corresponding to the commercial, the first distinction information, and the second distinction information is stored. Based on the first metadata stored, the first discrimination information and the second discrimination information included in the second metadata of the recorded data. Thus commercial designated is detected, the detected commercials, recorded data is replaced with the content data corresponding to the commercial is displayed.

  According to the present invention, a recorded program can be reproduced and displayed, and in particular, a predetermined commercial can be replaced and displayed.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Therefore, even though there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

  The information processing apparatus according to claim 1 (for example, the recording apparatus 3 in FIG. 1) includes a recording data storage unit (for example, a recording data storage unit that stores recording data associated with first time information (for example, recording start time information) 2, the first discriminating information (for example, program ID information 168) for discriminating the program of the recorded data, the first text data related to the main program of the recorded data, and the recorded data Of the first text data and the second text data corresponding to the first text data and the second text data, which are related to the commercial and can be distinguished by the second discrimination information (for example, CMID). First metadata storage means for storing first metadata (for example, first metadata 165 in FIG. 3) including time information (for example, time code 167) For example, the first metadata storage unit 43 in FIG. 2 and the second metadata including the content data corresponding to the commercial, the first distinction information, and the second distinction information (for example, the first metadata in FIG. 4). Second metadata storage means (for example, the second metadata storage section 44 in FIG. 2) and recording data stored in the recording data storage means. Display control means (for example, the screen display control unit 48 in FIG. 2) that controls the display of the recording data desired by the user, first metadata stored in the first metadata storage means, and second Of the recorded data whose display is controlled by the display control means based on the second metadata stored in the metadata storage means, the first distinction information included in the second metadata and the second Of commercials that are specified by the identification information, the second content data and replacing replacement processing unit corresponding to the commercial included in the meta data (e.g., processing unit 46 replaces CM in FIG. 2), characterized in that it comprises a.

  The information processing method according to claim 3 is an information processing method of an information processing apparatus (for example, the recording apparatus 3 in FIG. 1) capable of controlling the display of stored recording data. A recording data storage control step (for example, processing in steps S3 and S4 in FIG. 8) that controls storage of recording data associated with time information (for example, recording start time information) is distinguished from a recording data program. 1st discriminating information (for example, program ID information 168), 1st text data relating to the main part of the program among recorded data, and about the commercial among the recorded data, and discriminating by second discriminating information (eg, CMID) Second text data that is made available, and second time information corresponding to the first text data and the second text data (for example, A first metadata storage control step (for example, the process of step S43 in FIG. 10) for controlling storage of the first metadata including the time code 167) (for example, the first metadata 165 in FIG. 3); The second data for controlling the storage of the second metadata (for example, the second metadata 169-1 in FIG. 4) including the content data corresponding to the commercial, the first distinction information, and the second distinction information. Based on the metadata storage control step (for example, the process of step S103 in FIG. 12) and the first metadata whose storage is controlled by the process of the first metadata storage control step, the second of the recorded data is recorded. Frames specified by the first distinction information and the second distinction information included in the second metadata whose storage is controlled by the processing of the metadata storage control step A detection step (for example, the processing of step S501 in FIG. 42) for detecting a commercial, and a replacement processing step for replacing the commercial detected by the processing of the detection step with content data corresponding to the commercial included in the second metadata ( For example, the display control step (for example, step S475 and step of FIG. 41) that controls the display of the recorded data in which the commercial is replaced with the content data corresponding to the commercial by the processing of the replacement processing step. The process of S476).

  In the program according to claim 4, the embodiment (however, an example) to which each step corresponds is the same as the information processing method according to claim 3.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a system diagram for explaining the configuration of an information processing system to which the present invention is applied.

  The broadcasting station 1 broadcasts a program using terrestrial waves or satellite waves. Broadcast program data includes video data and audio data.

  The television receiver 2 held by the user receives a broadcast signal broadcast from the broadcast station 1. When a search process using metadata, which will be described later, or program information by text is not provided, the broadcast signal selected by the tuner 11 is a video and audio signal processing unit without using the recording device 3. 12, the video signal is displayed on the display of the output unit 13 and the audio signal is output to the speaker of the output unit 13, so that the user can view the program.

  The recording device 3 receives an input of a broadcast signal selected by the tuner 11 of the television receiver 2 and processes the broadcast signal to obtain information indicating a recording start time (hereinafter referred to as recording start time information). The associated recording data can be generated and recorded (that is, recorded) on an internal recording medium. The recording data associated with the recording start time information is data that can be used to execute search processing or provision of program information by text using metadata to be described later. The metadata is acquired from the metadata supply server 6 via the Internet 5, and details thereof will be described later. The recording device 3 can output the recording data and the recording data whose reproduction position is designated by the search process to the output unit 13 for display and audio output.

  In addition, the recording device 3 receives supply of first metadata including text data related to a program and a time code corresponding to the text data from the metadata supply server 6 via the Internet 5. A thumbnail data file is generated using the first metadata and recorded on an internal recording medium. The thumbnail data constituting the thumbnail data file is obtained by associating the thumbnail image data with the text data and the time code included in the first metadata.

  The recording device 3 is also suitable for the second metadata, which is information related to commercials (hereinafter also referred to as CM), from the metadata supply server 6 via the Internet 5 and for the user to use for search processing. 3rd metadata including information indicating a list of keywords suitable for use in search, such as current information, is recorded and recorded on an internal recording medium. Then, the recording device 3 sends the thumbnail image and the text data related to the program to the output unit 13 based on the recording data, the first to third metadata, or the thumbnail data file corresponding to the program specified by the user. Alternatively, a display control process for displaying a display screen composed of moving image data, a GUI (Graphic User Interface) screen for assisting a user's operation input, or the like is executed.

  That is, the user can refer to various display screens displayed on the output unit 13 to understand the contents of the recorded program or to instruct a playback start position. Further, the user can preferentially receive a commercial corresponding to a keyword of interest by the processing of the recording device 3.

  Specifically, for example, the user inputs a search key for searching for desired recorded data recorded in the recording device 3 and information related to commercials stored in the recording device 3, and the search processing is performed. As a search result, a list of programs corresponding to the search key or a list of commercials is presented to the user. Then, when any of the presented search results is selected and instructed to be reproduced, the recording device 3 has a program ID corresponding to the program designated by the user and a time code corresponding to the reproduction start position, Alternatively, the second metadata corresponding to the commercial designated by the user is detected, and based on these, information relating to the recorded data or the commercial is retrieved and supplied to the output unit 13 for display. In addition to the search processing by the user, the recording apparatus 3 will be described later for instructing the display of a commercial that is assumed to be of interest to the user on the GUI screen for assisting the user's operation input. The banner button is controlled to be displayed.

  Here, the searched “program” is, for example, a whole program such as a two-hour drama, or a plurality of units even when each program is divided by a commercial or the like. Even a program may be included, or a commercial may be included or only a commercial may be indicated.

  Note that some or all of the functions that can be executed by the television receiver 2 and the recording device 3 may be executed using a mobile terminal such as a mobile phone or a PDA.

  The metadata supply server 6 publishes a web page for distributing the first metadata to the user via the Internet 5, for example, the recording device 3, a personal computer (not shown), a portable phone, In response to an access from a user using a PDA or the like, the first metadata used for searching for a program desired by the user is downloaded via the Internet 5.

  In addition to publishing the web page to the Internet 5, the method of distributing the first metadata to users includes, for example, connecting a plurality of information processing devices through a telephone line, centering on a host computer, for data communication It may be via any medium such as so-called personal computer communication, communication via a dedicated line, or distribution of data via a removable recording medium.

  The metadata supply server 6 distributes the second metadata and the third metadata to the recording device 3 via the Internet 5.

  Note that the second metadata or the third metadata can be distributed to users in addition to the exchange of information via the Internet 5, for example, a plurality of information processing devices centered on a host computer via a telephone line. It may be connected through any medium such as so-called personal computer communication for connecting and performing data communication, communication via a dedicated line, or distribution of data via a removable recording medium.

  FIG. 2 is a block diagram showing the configuration of the recording device 3.

  Of the broadcast signals selected by the tuner 11 of the television receiver 2, the video signal is supplied from the input terminal 21-1 to the video signal decoder 31, and the audio signal is input from the input terminal 21-2 to the audio signal decoder 32. Is input.

  The operation input unit 33 includes, for example, input devices such as buttons, keys, a touch panel, a touch pad, and a lever, and receives user operation inputs.

  When recording of the supplied video signal and audio signal is instructed by the user's operation input from the operation input unit 33, the recording control unit 34 controls the video signal decoder 31 and the audio signal decoder 32. , Decoding the supplied video signal and audio signal, and associating the recorded data with the program ID and recording start time information so that the acquired video signal and audio signal can be recorded as searchable information Control signal is generated and supplied to the recording data generation unit 35.

  The video signal decoder 31 decodes the supplied video signal based on the control of the recording control unit 34 and supplies the decoded video data to the memory 36. The memory 36 is a frame memory that temporarily holds the supplied video signal, and supplies the temporarily stored video signal to the recording data generation unit 35. The audio signal decoder 32 decodes the supplied audio signal based on the control of the recording control unit 34 and supplies the decoded audio data to the recording data generation unit 35.

  The recording data generation unit 35 controls the program ID information extraction unit 37 to extract the program ID included in the program management information from the video data held in the memory 36 based on the control of the recording control unit 34. . The program ID information extraction unit 37 indicates a unit to be searched from the program management information included in the video data decoded by the video signal decoder 31 (here, “program” indicates a unit to be searched, for example, a two-hour drama, etc. Even if it is the whole program, even if one program is divided by commercials, etc., each unit divided, or those that contain multiple programs, and those that contain commercials or only commercials The program ID information that can be uniquely distinguished is extracted and supplied to the recording data generation unit 35.

  When the program management information is not included in the video data, the program ID information extraction unit 37 acquires time information from the timer 38 via the recording data generation unit 35, and program ID information is obtained from the acquired time information. May be generated.

  The recorded data generation unit 35 refers to the timer 38 to acquire the time (absolute time) at which recording was started, and the video data supplied from the memory 36 or the audio data supplied from the audio signal decoder 32 At least one of them is associated with the recording start time information which is the acquired time information, and the video data and the audio data are associated with the program ID supplied from the program ID information extraction unit 37 to record the recorded data. Is supplied to the recording data storage unit 39. This recording start time information is used in a search process to be described later.

  That is, the recording start time information is associated with at least one of video data and audio data supplied to the recording data generation unit 35. Then, program ID information is associated with these data, and recording data is generated.

  The recording data storage unit 39 stores recording data, which is supplied from the recording data generation unit 35, and includes video data and audio data in which the program ID and the recording start time information are associated with each other. For example, the recorded data storage unit 39 may be configured by a large-capacity recording medium such as a hard disk, or may be configured by a removable recording medium such as a DVD (Digital Versatile Disc) or a video tape.

  When the user instructs the operation input unit 33 to set a chapter in the recorded data, the chapter setting unit 40 sets a chapter and a chapter name in the recorded data based on the user's operation input.

  The network interface 41 acquires information on a web page published on the Internet 5 and displays the information on the display unit 42, or based on an operation input to the operation input unit 33 by a user who refers to the display unit 42. Information necessary for requesting the transmission of the first to third metadata is transmitted to the metadata supply server 6, or the first metadata is downloaded from the metadata supply server 6, and the first metadata is downloaded. The metadata is output to the metadata storage unit 43 and stored, or the second metadata or the third metadata is acquired from the metadata supply server 6 as necessary, and the second metadata is stored in the second metadata. The third metadata is stored in the third metadata storage unit 45 in the data storage unit 44. In addition, the network interface 41 transmits the first to third metadata acquired by using a personal computer (not shown), a portable phone, or a PDA owned by the user by communication via wired or wireless communication. It can also be received from a personal computer (not shown), a portable telephone, or a PDA.

  The display unit 42 is configured by, for example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube), and information on a web page published on the Internet 5 acquired via the network interface 41 or an operation input unit 33 displays information input by the user.

  The first metadata storage unit 43 stores the first metadata downloaded by the network interface 41. The first metadata will be described later with reference to FIG.

  The second metadata storage unit 44 receives and stores the second metadata acquired by the network interface 41, and stores a CM replacement processing unit 46, a banner display control unit 47, a screen as necessary. The stored second metadata is supplied to the display control unit 48 or the matching processing unit 49. An example of the second metadata will be described later with reference to FIGS.

  The third metadata storage unit 45 receives and stores the third metadata acquired by the network interface 41, and stores the third metadata stored in the screen display control unit 48 as necessary. Supply metadata for The third metadata includes, for example, data suitable for searching for data recorded by the user, such as recommended word list data used for search processing, and display for assisting the user's operation input. Data necessary to display the displayed screen is included.

  When the user searches for a recorded program, the matching processing unit 49 receives input from the operation input unit 33 such as information for specifying the recorded data to be searched and text as a search key. The matching process is executed with reference to the first metadata stored in the first metadata storage unit 43, and the program ID and time code as the matching result are supplied to the recorded data search output unit 51. Further, the matching processing unit 49 supplies the first metadata corresponding to the program ID as a matching result to the CM replacement processing unit 46. Further, when a commercial search is executed by the user, the matching processing unit 49 receives an input of text serving as a search key from the operation input unit 33 and is stored in the second metadata storage unit 44. A matching process is executed with reference to the second metadata, and commercial content data as a matching result is supplied to the screen display control unit 48.

  The thumbnail generation unit 50 refers to the first metadata stored in the first metadata storage unit 43, and records one frame of the video signal from the recorded data stored in the recorded data storage unit 39. A plurality of thumbnail data composed of thumbnail image data that is the image data and text data corresponding to the thumbnail image data are generated, and a thumbnail data file generated from the thumbnail data for one program identified by the program ID is generated. And stored in the recorded data storage unit 39.

  Based on the program ID and time code that are the matching results supplied from the matching processing unit 49, the recorded data search output unit 51, for example, the entire recorded data corresponding to the program ID or the time indicated by the time code, Alternatively, recorded data reproduced from a position corresponding to a predetermined time such as before or after a predetermined time from the time code is retrieved from the recorded data storage unit 39 and supplied to the screen display control unit 48. Since the recording data stored in the recording data storage unit 39 is provided with the recording start time information, the recording data search output unit 51 uses the recording start time information as a reference and the playback start position corresponding to the time code. Can be detected.

  The CM replacement processing unit 46 reproduces the first metadata supplied from the matching processing unit 49 and the second metadata supplied from the second metadata storage unit 44 as necessary. A process of replacing the CM included in the recorded data is executed.

  The banner display control unit 47 displays in the display screen displayed when the user searches for or selects a desired program based on the second metadata supplied from the second metadata storage unit 44. The display of the advertisement banner to be displayed and the display of the commercial content when the displayed advertisement banner is selected by the user are controlled. A display example of the advertisement banner is shown in FIGS. An example of a commercial content display screen when the displayed advertisement banner is selected by the user will be described later with reference to FIG.

  The flag setting unit 52 includes the first metadata stored in the first metadata storage unit 43, the second metadata stored in the second metadata storage unit 44, or the third metadata. By referring to the third metadata stored in the data storage unit 45, various flags necessary for the screen display control unit 48 to determine screen transition are set.

  For example, when the first metadata of a predetermined program stored in the first metadata storage unit 43 includes text data corresponding to a CM, the flag setting unit 52 relates to reproduction of the program content. When the CM flag is in an active state, the second metadata storage unit 44 stores second metadata including CM content data that can be provided when providing information on a predetermined program by text. Assume that the CM flag dedicated to the program providing screen by text is in an active state, and the second metadata including CM content data that can be provided during the waiting time during the search process is stored in the second metadata storage unit 44. If it is, the search CM flag is in an active state. Details of determination of screen transition based on the presence or absence of a flag set by the flag setting unit 52 will be described later.

  The screen display control unit 48 controls display of a screen based on a user operation input supplied from the operation input unit 33. Specifically, the screen display control unit 48 refers to various flags set by the flag setting unit 52, for example, and reproduces the recorded data selected by the user from the beginning or from the position desired by the user. In addition to controlling the display of various display screens for prompting the user to input appropriate operations, an advertisement banner is displayed on the display screen based on the control of the banner display control unit 47, or the advertisement selected by the user Display image data for displaying a commercial corresponding to the banner is generated, and video data is supplied to the video output processing unit 53 and audio data is supplied to the audio output processing unit 54.

  Further, the screen display control unit 48 refers to various flags set by the flag setting unit 52, reads out, for example, a thumbnail data file of a program identified by the program ID from the recorded data storage unit 39, and operates the input unit 33. The video data is supplied to the video output processing unit 53 and the audio data is supplied to the audio output processing unit 54 in order to display in the display method selected by the user's operation input supplied. The screen display control unit 48 also includes text data included in the first metadata, thumbnail images included in the thumbnail data, or second metadata stored in the second metadata storage unit 44. Display data including information related to commercials included in the video is generated and supplied to the video output processing unit 53. When the display screen selected by the user includes a moving image, the screen display control unit 48 reads audio data corresponding to the displayed moving image from the recording data storage unit 39. This may be further used to control the display of the screen.

  Further, the screen display control unit 48, for example, the entire recording data corresponding to the program ID supplied from the recording data search output unit 51, or the time indicated by the time code, or a predetermined time from the time code. Using recorded data reproduced from a position corresponding to a predetermined time such as before or after, recorded data selected by the user can be reproduced from the beginning or from a desired position of the user.

  The video output processing unit 53 outputs the video data supplied from the screen display control unit 48 to the display of the output unit 13 of the television receiver 2 via the output terminal 22-1 for display.

  The audio output processing unit 54 outputs the audio data supplied from the screen display control unit 48 to the speaker of the output unit 13 of the television receiver 2 via the output terminal 22-2 and outputs the audio.

  The first metadata and the second metadata will be described with reference to FIGS.

  First, the first metadata will be described with reference to FIG.

  In the first metadata 165, the text data 166 is composed of a text group divided into appropriate lengths. The main part of the program that is not a CM part is text 1, text 2,. , CM1, CM2,... Such text data 166 is associated with a time code 167 describing the start time and end time of each text group. For example, if the text of ““ This is the news at 7 o'clock ”and“ Today's first topic is ... ”is divided as the text 1, the content indicated by this text in the main program broadcast The start time and end time corresponding to the time when the text is broadcast (for example, the content of this text is output as audio, the text is displayed as subtitles, or the video shown in this text is displayed) is the time code In addition, when the text of “XX car from ...” is divided as CM1, it corresponds to the time at which the content indicated by this text is broadcast in the CM broadcast. The start time and the end time are described in the time code 167. The first metadata 165 is further associated with program ID information 168 for uniquely distinguishing programs.

  Note that CM1, CM2,... Are CMIDs, and the text of the CM part can be uniquely distinguished by the program ID information 168 and the CMID.

  Next, the second metadata will be described with reference to FIGS.

  The second metadata 169-1 shown in FIG. 4 is generated by associating CM content data composed of video and audio with the program ID and CMID of the replacement destination. As the second metadata 169-1, the commercials included in the recording data stored in the recording device 3 and those specified as the replacement program ID and CMID are the second metadata 169-. 1 is used for replacement with the CM content data included in 1.

  Specifically, for example, among the commercials included in the recording data stored in the recording device 3, a commercial with a sense of season or a commercial that announces the sale or service content for a predetermined period is included in the content of the commercial. Watching after the matching time is not beneficial for both sponsors and viewers. Accordingly, commercials whose time has shifted are provided by supplying the recording device 3 with the second metadata 169-1 in which the replacement program ID and CMID are associated with the CM content data including video and audio. Can be replaced with a new commercial. Details of the commercial replacement process will be described later.

  Further, the second metadata 169-2 shown in FIG. 5 is generated by associating keywords and incidental data with CM content data composed of video and audio. The second metadata 169-2 is the second metadata associated with the keyword when a predetermined keyword is used when the user searches the recording data stored in the recording device 3. 169-2 is used to display preferentially the CM content data included in 169-2. Further, as the auxiliary data, for example, information such as display priority within the same keyword and the validity period of the second metadata 169-2 can be described.

  When the user searches the recorded data stored in the recording device 3, the keyword used by the user is a word related to a popular program at that time, a cast name or actor name of a drama with a high audience rating, or In many cases, it is a text line, represents a user's preference, or is interested in the user at that time. Accordingly, the second metadata 169-2 in which the keyword is associated with the CM content data including video and audio is supplied to the recording device 3, so that the optimum commercial associated with the keyword used by the user can be obtained. Can be provided. Corresponds to words related to programs that are popular at that time, cast names and actor names of dramas with high audience ratings, words of words, words expressing user preferences, or those in which the user is interested at that time Providing optimal commercials based on keywords is beneficial for both sponsors and viewers.

  In addition, commercials can be associated with words related to programs that are popular at the time, cast names and actor names of drama with high audience ratings, or text lines. The high audience rating of programs provided by (broadcast stations) and the widespread publicity of broadcasted programs also lead to the acquisition of sponsors. Details of the process for preferentially displaying the CM content data associated with the keyword will be described later.

  The second metadata 169-3 shown in FIG. 6 is generated by associating banner data and incidental data with CM content data composed of video and audio. The second metadata 169-3 includes an advertisement banner displayed on various display screens displayed when the user searches for recording data stored in the recording device 3, and the advertisement banner is selected. CM content data displayed in this case is included. For example, when the keyword is described as the incidental data, the second metadata 169-3 associated with the keyword used by the user to search the recording data stored in the recording device 3 is used. It is possible to preferentially display the advertisement banner included in. In addition to the keywords, for example, information related to display priority and information such as the validity period of the second metadata 169-3 can be described in the incidental data. Details of the display of the banner and details of the display of the commercial when the banner is selected will be described later.

  The second metadata 169-4 shown in FIG. 7 is generated by associating usage information and incidental data with CM content data composed of video and audio. The usage information is information indicating a usage in which the CM content data included in the second metadata 169-4 is displayed. For example, the CM content data included in the second metadata 169-4. Is the CM content data to be displayed during the waiting time during the search, etc., information indicating that “displayed during the search” is described as the usage information, and this second metadata 169-4 When the CM content data included in is CM content data to be displayed on the program information providing screen using text, information indicating that “display on the program information providing screen using text” is described as usage information. The For example, when the keyword is described as the incidental data, the CM content data included in the second metadata 169-4 in which the keyword used for the search is associated with the waiting time of the search process. , Can be preferentially displayed. Further, in addition to the keywords, for example, information related to display priority and information such as the validity period of the second metadata 169-4 can be described in the incidental data. Details of the commercial display using the usage information will be described later.

  Next, with reference to the flowchart of FIG. 8, the recording process which is the process executed by the recording apparatus 3 described with reference to FIG. 2 will be described.

  In step S <b> 1, the recording control unit 34 determines whether or not a program recording is instructed based on a user operation input supplied from the operation input unit 33. If it is determined in step S1 that recording of a program has not been instructed, the process ends.

  If it is determined in step S1 that the recording of the program has been instructed, in step S2, the video signal decoder 31 and the audio signal decoder 32 are programmed broadcast signals (video signal and audio signal) under the control of the recording control unit 34. ) To decode. The video signal decoder 31 supplies the decoded video data to the memory 36.

  In step S3, recorded data creation processing described later with reference to FIG. 9 is executed.

  In step S <b> 4, the recording data generation unit 35 supplies the recording data created by the process of step S <b> 3 to the recording data storage unit 39. The recording data storage unit 39 stores the supplied recording data, and the process is terminated.

  Through such processing, the recording apparatus 3 generates recording data that can be searched using text data corresponding to the first metadata, based on a user operation input, and records the recording data. Is possible.

  Next, the recording data creation process executed in step S3 of FIG. 8 will be described with reference to the flowchart of FIG.

  In step S21, the program ID information extraction unit 37 extracts program ID information capable of individually identifying the recorded program from the program management information included in the decoded video data held in the memory 36. This is supplied to the recording data generation unit 35.

  In step S <b> 22, the recording data generation unit 35 refers to the timer 38 and starts recording on at least one of the video data supplied from the memory 36 or the audio data supplied from the audio signal decoder 32. Associate time information.

  In step S23, the recording data generation unit 35 further associates a program ID with the video data or audio data associated with the recording start time information to generate recording data, and the processing is performed in step S3 of FIG. Return to step S4.

  By such processing, recording data in which the program ID and the recording start time information are associated with each other, which can use the text data corresponding to the first metadata for the search processing, is generated.

  When the program management information is not included in the video data, the program ID information extraction unit 37 acquires time information from the timer 38 via the recording data generation unit 35, and program ID information is obtained from the acquired time information. May be generated.

  Next, the first metadata storage process will be described with reference to the flowchart of FIG.

  In step S <b> 41, the network interface 41 accesses a web page published on the Internet 5 for a user to request the first metadata 165, and displays the web page on the display unit 42. Since the user refers to the web page displayed on the display unit 42 and uses the operation input unit 33 to designate a program for which the first metadata 165 is desired, the network interface 41 includes the operation input unit The program name or program ID corresponding to the program designated by the user's operation input supplied from 33 is supplied to the metadata supply server 6 via the Internet 5.

  In step S <b> 42, the network interface 41 determines whether or not the first metadata 165 has been received from the metadata supply server 6 via the Internet 5. If it is determined in step S42 that the first metadata 165 has not been received, the process returns to step S41, and the subsequent processes are repeated.

  If it is determined in step S42 that the first metadata 165 has been received, the network interface 41 supplies the received first metadata 165 to the first metadata storage unit 43 in step S43. The first metadata storage unit 43 stores the supplied first metadata 165, and the process ends.

  Through such processing, the first metadata 165 can be downloaded from the metadata supply server 6 and stored.

  In the process of FIG. 10, for example, it is assumed that the recording device 3 can acquire and store metadata by accessing a web page for requesting the first metadata 165 by the user. However, the recording apparatus 3 may be configured to automatically acquire the first metadata 165 corresponding to the recorded program.

  Next, with reference to the flowchart of FIG. 11, the thumbnail generation process executed in the recording device 3 owned by the user described with reference to FIG. 2 will be described.

  In step S <b> 71, the thumbnail generation unit 50 acquires the first metadata 165 stored in the first metadata storage unit 43.

  In step S <b> 72, the thumbnail generation unit 50 retrieves the recording data corresponding to the program ID information 168 of the first metadata 165 acquired in step S <b> 71 from the recording data storage unit 39 and acquires it.

  In step S <b> 73, the thumbnail generation unit 50 determines, for example, the time corresponding to the start time or the start time based on the start time of each text included in the time code 167 of the acquired first metadata 165. Thus, a video at a predetermined time before or after a predetermined time is extracted from the recorded data frame by frame to obtain a thumbnail image.

  In step S74, the thumbnail generation unit 50 associates the corresponding time code and text data described in the time code 167 and the text data 166 with the thumbnail image generated in step S73, and generates thumbnail data.

  In step S75, the thumbnail generation unit 50 generates a thumbnail data file that can be uniquely distinguished by the program ID information 168 based on the thumbnail data generated in step S74. That is, the thumbnail generation unit 50 configures the same number of thumbnail data as the text group constituting the time code 167 with thumbnail images, time codes, and text data, and assigns program ID information 168 to these thumbnail data. , A thumbnail data file.

  In step S76, the thumbnail generation unit 50 outputs and stores the generated thumbnail data file to the recorded data storage unit 39, and the process is terminated.

  By such processing, thumbnail data in which an image, text, and time code are associated is generated, and a thumbnail data file is generated from the thumbnail data group of the same program.

  Next, a recorded program viewing process executed in the recording apparatus 3 based on a user operation input will be described with reference to flowcharts of FIGS.

  In step S <b> 101, the operation input unit 33 of the recording device 3 determines whether or not a user has received a command for starting an application for searching or reproducing stored recording data. If it is determined in step S101 that an application activation instruction has not been received, the process of step S101 is executed until it is determined that an application activation instruction has been received.

  If it is determined in step S101 that an application activation command has been received, in step S102, the network interface 41 accesses the metadata supply server 6 to check the version of the application and the Metadata and third metadata are acquired.

  Here, when a version mismatch is detected, the network interface 41 downloads, for example, information necessary for version upgrade from the metadata supply server 6 or other predetermined server via the Internet 5. The process of installing in the recording device 3 may be executed.

  In step S103, the network interface 41 supplies the acquired second metadata to the second metadata storage unit 44 for storage, and also supplies the third metadata to the third metadata storage unit 45. To remember. The second metadata storage unit 44 stores the supplied second metadata, and the third metadata storage unit 45 stores the supplied third metadata.

  In step S104, the banner display control unit 47 determines the condition for displaying the banner based on the second metadata stored in the second metadata storage unit 44 and the function of the recording device 3 in step S103. It is determined whether or not Specifically, the banner display control unit 47 stores, for example, the second metadata storage unit 44 having the second metadata 169-3 having banner data described with reference to FIG. Further, when the recording apparatus 3 has a function necessary for executing the process of controlling the display of the second metadata 169-3 having banner data, the conditions for banner display are satisfied. It is determined that

  If it is determined in step S104 that the conditions for banner display are satisfied, in step S105, the banner display control unit 47 sets the second metadata stored in the second metadata storage unit 44. Among them, the second metadata 169-3 having the banner data is read, and various setting processes necessary for display are executed. Specifically, the banner display control unit 47 generates display image data of an advertisement banner to be displayed on the display screen based on the banner data included in the second metadata 169-3, or displays the display image data. In order to determine the order, for example, when information such as display priority and associated keywords is described as incidental data, these data are read.

  When it is determined in step S104 that the conditions for banner display are not satisfied, or after the processing in step S105 is completed, the screen display control unit 48 is stored in the recorded data storage unit 39 in step S106. For example, a recorded program list display screen 251 as shown in FIG. 17 is displayed based on the recorded data and thumbnail image data thereof. Specifically, the screen display control unit 48 generates display image data corresponding to the recorded program list display screen 251 and transmits it to the television receiver 2 via the video output processing unit 53 and the output terminal 22-1. Output and display. Hereinafter, since the display control of the various display screens by the screen display control unit 48 is executed in the same manner, the specific description will be omitted as appropriate, and it may be simply described that the display is controlled or displayed. is there.

  As shown in FIG. 17, the recorded program list display screen 251 includes recorded program information 271-1 to recorded programs each composed of a recorded program name and a thumbnail image corresponding to the recorded program. Information 271-8 is displayed. In FIG. 17, eight sets of recorded program information 271 composed of recorded program names and thumbnail images corresponding to the recorded programs can be displayed. It goes without saying that any number of sets can be displayed on one screen.

  For example, the user can use a manipulation input device such as a remote controller to move the cursor to any of the recorded program information 271 and highlight it. The recorded program list display screen 251 displays information such as the program name, broadcast channel, broadcast station name, or broadcast date and time corresponding to the recorded program information 271 in a highlighted state. Also good.

  If it is determined in step S104 that the conditions for banner display are satisfied, a plurality of advertisement banners 272 can be displayed on the recorded program list display screen 251. The advertisement banners 272-1 to 272-5 displayed in FIG. 17 are acquired in step S102, and the second metadata stored in the second metadata storage unit 44 in step S103. Based on the second metadata 169-3 having banner data described with reference to FIG. 6, the display is set in step S105. The screen display control unit 48 obtains a plurality of banner data of the second metadata 169-3 set as a display with high priority from the banner display control unit 47, and the predetermined display of the recorded program list display screen 251 is obtained. Controls the display at the position of.

  Further, the recorded program list display screen 251 includes a subtitle display button 273, a rearrangement button 274, a search button 275, a previous button 276, an up button 277, a next button 278, a down button 279, and an enter button. 280 is provided.

  The subtitle display button 273 is selected by the user when it is desired to receive provision of program information in text for the program corresponding to the recorded program information 271 with which the cursor is placed. The provision of program information by text will be described later. The rearrangement button 274 is selected by the user when it is desired to rearrange the display order of the recorded program information 271 in the recorded program list display screen 251. The search button 275 is instructed to execute processing for searching for a program desired by the user or a commercial desired by the user from the recorded program data using the first metadata 165 using text data as a keyword. Selected by the user.

  The forward button 276, the upward button 277, the next button 278, and the downward button 279 are buttons that are selected when the movement of the cursor position is instructed using a remote commander (not shown), for example. For example, when there is more recorded program data than the number of recorded program information 271 currently displayed and the cursor is positioned on the recorded program information 271-1, the previous button 276 or up When the up button 277 is selected and the cursor is instructed to move or when the cursor is set to the recorded program information 271-8, the next button 278 or the down button 279 is selected. When the movement of the cursor is instructed, the screen display control unit 48 may display recorded program information 271 other than the currently displayed recorded program information 271 on the recorded program list display screen 251.

  Some of these operation button selection operations are, for example, pressing buttons of four colors of red, yellow, blue, and green, which are used in remote commanders for BS tuners that are already widely used. You may make it respond | correspond to operation.

  The decision button 280 is a button that is selected when the user selects and decides information currently on the cursor. For example, in the recorded program list display screen 251 of FIG. 17, it is selected when the recorded data corresponding to the recorded program information 271 currently highlighted and highlighted is reproduced. The

  In step S107, the operation input unit 33 determines whether the search button 275 has been selected. If it is determined in step S107 that the search button 275 has been selected, the process proceeds to step S109 described later.

  If it is determined in step S107 that the search button 275 has not been selected, in step S108, the operation input unit 33 selects the caption display button 273, and has the user provided an instruction to provide program information in text? Judge whether or not. If it is determined in step S108 that provision of program information by text has been instructed, the process proceeds to step S135 described later. If it is determined in step S108 that provision of program information by text is not instructed, the process proceeds to step S148 described later.

  If it is determined in step S107 that the search button 275 has been selected, in step S109, the operation input unit 33 notifies the screen display control unit 48 that the search button 275 has been selected. The screen display control unit 48 displays an overall search screen 301 as shown in FIG.

  The overall search screen 301 displays keyword boxes 311-1 to 311-m in which search keywords input by the user, that is, search keys are displayed. The number of keyword boxes 311 displayed on the overall search screen 301 may be any number.

  The overall search screen 301 includes a return button 321, a search button 322 including all, a search button 323 including any one, a delete button 324, an up button 277, a down button 279, and a decision button 280. ing. The return button 321 is a button that is selected by the user when the display screen is changed to the previous screen or a predetermined screen that has been displayed before. In this case, the recording button described with reference to FIG. This button is selected by the user when changing the display screen to the completed program list display screen 251. The search button 322 including all is used to search recorded data or commercials including all keywords described in the keyword boxes 311-1 to 311-m, that is, to the keyword boxes 311-1 to 311-m. This button is selected by the user when performing a so-called AND search using all the keywords described. The search button 323 including any of them is used when searching for recorded data or commercials including at least one of the keywords described in the keyword boxes 311-1 to 311-m, that is, the keyword box 311. This button is selected by the user when performing a so-called or search using the keywords described in -1 to 311-m. The delete button 324 is a button selected by the user when deleting the keyword described in the keyword box 311 highlighted at the current cursor position among the keyword boxes 311-1 to 311-m. It is.

  The up button 277, the down button 279, and the decision button 280 are buttons that are selected by the user to execute basically the same processing as described above with reference to FIG. 17, and the decision button 280 is selected. In this case, among the keyword boxes 311-1 to 311-m, the cursor is currently placed, and text data input processing to the highlighted keyword box 311 can be executed.

  One or more advertisement banners 272 can also be displayed on the overall search screen 301.

  In step S110, the operation input unit 33 determines any keyword based on whether or not the determination button 280 is selected while the cursor is placed on any of the keyword boxes 311-1 to 311-m. It is determined whether or not the keyword input to the box 311 is instructed. If it is determined in step S110 that the keyword input to any one of the keyword boxes 311 is not instructed, the process proceeds to step S115 described later.

  If it is determined in step S110 that text input to any of the text boxes has been commanded, in step S111, the operation input unit 33 notifies the screen display control unit 48 that the enter button 280 has been selected. . The screen display control unit 48 displays a search method selection screen 341 as shown in FIG.

  In the search method selection screen 341, as shown in FIG. 19, a recommended word selection button 351 selected when a search keyword is input by selecting a recommended word, and a search keyword is input by inputting a free word. A free word input button 352 that is selected in this case is provided. The search method selection screen 341 further includes a return button 321, an up button 277, a down button 279, and an enter button 280. One or more advertisement banners 272 can also be displayed on the search method selection screen 341.

  In step S112, the operation input unit 33 determines whether or not the recommended word search is selected based on whether or not the decision button 280 is selected while the cursor is placed on the recommended word selection button 351. to decide.

  If it is determined in step S112 that the recommended word search has been selected, in step S113, a recommended word search process, which will be described later using the flowchart of FIG. 32, is executed, and the process returns to step S110. The subsequent processing is repeated.

  If it is determined in step S112 that the recommended word search has not been selected, the free word search is selected. Therefore, in step S114, a free word search process, which will be described later using the flowchart of FIG. 34, is executed. The process returns to step S110, and the subsequent processes are repeated.

  If it is determined in step S110 that the keyword input to any one of the keyword boxes 311 is not instructed, in step S115, the operation input unit 33 determines whether the return button 321 has been selected. It is determined whether or not it has been instructed to change the display screen to the recorded program list display screen 251 described with reference to FIG. If it is determined in step S115 that “return” is instructed, the process returns to step S106, and the subsequent processes are repeated.

  When it is determined in step S115 that “return” is not instructed, in step S116, the operation input unit 33 selects either the search button 322 including all or the search button 323 including any one. Whether or not search or or search based on the search keyword currently entered and displayed in the keyword boxes 311-1 to 311-m of the overall search screen 301 is instructed based on whether or not is selected. Judging.

  If it is determined in step S116 that the AND search or the or search is not instructed, in step S117, the operation input unit 33 determines whether an application termination is instructed. If it is determined in step S117 that the application has been commanded to end, the process ends. If it is determined in step S117 that the end of the application has not been commanded, the process returns to step S110, and the subsequent processes are repeated.

  If it is determined in step S116 that an AND search or or search has been commanded, in step S118, the operation input unit 33 notifies the screen display control unit 48 that the AND search or or search has been commanded, and the input. The keyword thus obtained is supplied to the matching processing unit 49 and the screen display control unit 48. The screen display control unit 48 displays a search result output method selection screen 381 as shown in FIG.

  On the search result output method selection screen 381, for example, as shown in FIG. 20, a program list button 391 for selecting a program list as a search result output method, and a commercial ( A CM list button 392 for selecting a (CM) list is provided. When another search result output method is prepared in the application, a button for appropriately selecting the prepared search result output method is displayed on the search result output method selection screen 381. The The search result output method selection screen 381 further includes a return button 321, an up button 277, a down button 279, and an enter button 280. One or more advertisement banners 272 can also be displayed on the search result output method selection screen 381.

  In step S119, the operation input unit 33 determines whether an output method has been selected based on whether the enter button 280 has been selected with the cursor placed on the program list button 391 or the CM list button 392. Judging. If it is determined in step S119 that the output method has not been selected, the process of step S119 is repeated until it is determined that the output method has been selected.

  If it is determined in step S119 that the output method has been selected, a search process, which will be described later, is executed using the flowchart of FIG. 36 in step S120.

  In step S121, the screen display control unit 48 determines whether a CM list has been selected as a search result output method based on the user operation input acquired by the operation input unit 33 in step S119.

  When it is determined in step S121 that the CM list has been selected as the search result output method, in step S122, the screen display control unit 48 displays a search result CM list display screen 421 as shown in FIG. Display.

  On the search result CM list display screen 421, as shown in FIG. 21, CM search result buttons 431-1 to CM search result buttons 431-6 indicating the contents of CMs corresponding to the search results are displayed. Further, the search result CM list display screen 421 is provided with a return button 321, a previous button 276, an up button 277, a next button 278, a down button 279, and an enter button 280. When the user selects and determines a desired one of the CM search result buttons 431-1 to 431-6, that is, the CM search result buttons 431-1 to 431-6. When the determination button 280 is selected in a state in which any of them is highlighted, the operation input unit 33 displays a signal indicating which one of the CM search result buttons 431 selected and determined by the user is a matching processing unit. 49. The matching processing unit 49 reads the corresponding commercial content data from the second metadata storage unit 44 based on the user's operation input and supplies it to the screen display control unit 48. The screen display control unit 48 supplies the supplied commercial content data to the output unit 13 via the video output processing unit 53 and the output terminal 22-1 and the audio output processing unit 54 and the output terminal 22-2. Therefore, the searched commercial is reproduced.

  Here, it is assumed that six search results have been output, but the search result CM list display screen 421 displays only search results of a predetermined number or less even if all search results are displayed at once. Search results that cannot be displayed at a time can be scrolled and displayed, for example, by selecting operations such as the forward button 276, the upward button 277, the next button 278, or the downward button 279. You may do it.

  One or more advertisement banners 272 can also be displayed on the search result CM list display screen 421. Furthermore, the second metadata 169-3 having banner data associated with the keyword used for the search (in which the keyword used for the search is described as incidental data) is displayed by the banner display control unit 47. If it is, the advertisement banner 272 corresponding to the second metadata 169-3 having banner data associated with the text used for the search is preferentially displayed on the search result CM list display screen 421. Can be.

  For example, if the keyword “Please marry” is included in the search keyword selected from the recommended words or entered by entering the free word, it will be used as ancillary data for the search. In addition, the display of the advertisement banner 272 corresponding to the second metadata 169-3 in which the keyword “please marry” is described is given priority. Accordingly, as shown in FIG. 21, for example, a diamond advertisement banner 272-15 and a wedding hall advertisement banner 272-16 that may be of interest to a user who wants to get married or who is planning to get married. In addition, since the advertisement information banner 272-17 of the marriage information magazine can be displayed on the search result CM list display screen 421, commercials useful for both the sponsor and the viewer are preferentially provided. It becomes possible.

  In step S123, the operation input unit 33 selects one of the search results, that is, the CM search result button 431-1 to the CM search result button 431-6 on the search result CM list display screen 421 described with reference to FIG. Whether or not an operation input for selecting and determining one of the buttons has been received, specifically, one of the CM search result buttons 431-1 to 431-6 is selected by being placed on the cursor. , It is determined whether or not the decision button 280 is selected.

  If it is determined in step S123 that an operation input for selecting and determining one of the search results has been received, in step S124, the screen display control unit 48 receives the user operation input supplied from the operation input unit 33. Based on the signal shown, the second metadata corresponding to the commercial selected by the user is read from the second metadata storage unit 44, and the display data is based on the commercial content data included in the second metadata. Is supplied to the output unit 13 via the video output processing unit 53 and the output terminal 22-1 and the audio data is supplied to the output unit 13 via the audio output processing unit 54 and the output terminal 22-2, respectively. It progresses to step S159 mentioned later.

  If it is determined in step S123 that an operation input for selecting and determining one of the search results has not been received, in step S125, the operation input unit 33 determines whether or not the return button 321 has been selected. If it is determined in step S125 that the return button 321 has been selected, the process returns to step S106, and the subsequent processes are repeated.

  If it is determined in step S125 that the return button 321 has not been selected, in step S126, the operation input unit 33 determines whether an application termination command has been issued. If it is determined in step S126 that an application termination has been commanded, the process is terminated. If it is determined in step S126 that the application termination is not instructed, the process returns to step S123, and the subsequent processes are repeated.

  If it is determined in step S121 that the CM list has not been selected as the search result output method, the program display is selected as the search result output method. Therefore, in step S127, the screen display control unit 48 A search result program list display screen 461 as shown in FIG. 22 is displayed.

  On the search result program list display screen 461, as shown in FIG. 22, a program search result button 471-1 to a program search result button 471- that are pairs of the program name corresponding to the search result and the corresponding thumbnail image data. 8 is displayed. Further, the search result program list display screen 461 includes a return button 321, a subtitle display button 273, a rearrangement button 274, a full screen playback button 434, a previous button 276, an up button 277, a next button 278, and a down button. 279 and a determination button 280 are provided. Here, it is assumed that eight search results have been output, but the search result program list display screen 461 displays only search results of a predetermined number or less even if all search results are displayed at once. Search results that cannot be displayed at a time can be scrolled and displayed, for example, by selecting operations such as the forward button 276, the upward button 277, the next button 278, or the downward button 279. You may do it.

  One or more advertisement banners 272 can also be displayed on the search result program list display screen 461. Furthermore, the second metadata 169-3 having banner data associated with the keyword used for the search (in which the keyword used for the search is described as incidental data) is displayed by the banner display control unit 47. If it is, the advertisement banner 272 corresponding to the second metadata 169-3 having the banner data associated with the keyword used for the search is also preferentially displayed on the search result program list display screen 461. Can be.

  For example, if the keyword “ramen” is included in the search keyword selected from the recommended words or entered by free word input, the “ramen” The display of the advertisement banner 272 corresponding to the second metadata in which the keyword “is described is prioritized. Therefore, as shown in FIG. 22, advertisement banners 272-18 to 272-20 that are considered to be of interest to users who like ramen are displayed on the search result program list display screen 461. Therefore, it is possible to preferentially provide commercials useful for both sponsors and viewers.

  After the process of step S127 is completed, in step S128, the operation input unit 33 selects one of the search results, that is, the program search result button 471-1 to the program on the search result program list display screen 461 shown in FIG. Whether or not an operation input for selecting any one of the search result buttons 471-6 has been received, specifically, the selection is made by placing the cursor on any one, but the decision button 280 is not selected. It is determined whether or not the state has not been determined. If it is determined in step S128 that an operation input for selecting one of the search results has been received, the process proceeds to step S131 described below.

  If it is determined in step S128 that an operation input for selecting one of the search results has not been received, in step S129, the operation input unit 33 determines whether the return button 321 has been selected. If it is determined in step S129 that the return button 321 has been selected, the process returns to step S106, and the subsequent processes are repeated.

  If it is determined in step S129 that the return button 321 has not been selected, in step S130, the operation input unit 33 determines whether an application termination command has been issued. If it is determined in step S130 that an application termination has been commanded, the process is terminated. If it is determined in step S130 that termination of the application is not instructed, the process returns to step S128, and the subsequent processes are repeated.

  If it is determined in step S128 that an operation input for selecting one of the search results has been received, in step S131, the operation input unit 33 uses text based on whether or not the caption display button 273 is selected. It is determined whether or not provision of program information is instructed. If it is determined in step S131 that provision of program information by text has been instructed, the process proceeds to step S135 described later.

  If it is determined in step S131 that provision of program information by text is not instructed, in step S132, the operation input unit 33 determines whether or not the full screen playback button 434 has been selected. It is determined whether or not reproduction is instructed. If it is determined in step S132 that reproduction on the full screen has been instructed, the process proceeds to step S149 described later.

  If it is determined in step S132 that full-screen playback has not been commanded, in step S133, the operation input unit 33 determines whether another playback method has been commanded based on the user's operation input. To do. If it is determined in step S133 that no other reproduction method is instructed, the process returns to step S128, and the subsequent processes are repeated.

  If it is determined in step S133 that another playback method has been commanded, in step S134, the operation input unit 33 notifies the screen display control unit 48 of information indicating the commanded playback method. 48 executes display control by the commanded reproduction method, and the process proceeds to step S159 described later.

  If it is determined in step S108 or step S131 that provision of program information by text is instructed, in step S135, program information provision processing by text, which will be described later, is executed using the flowchart of FIG.

  Display of the first subtitle information display screen 501 to the third subtitle information display screen 571 shown in FIGS. 23 to 26 is controlled by a program information providing process using text to be described later using the flowchart of FIG.

  First, a display example of the first caption information display screen 501 when no chapter is set is shown in FIG.

  The first caption information display screen 501 is provided with a caption information display area 511 and an image display area 512, as shown in FIG. The subtitle information display area 511 stores the recorded data stored in the first metadata storage unit 43, matched by the processing of the matching processing unit 49 and matched with the search condition input by the user, or selected by the user. A predetermined number of text data included in the text data 166 of the corresponding first metadata 165 is displayed in time series. In the image display area 512, thumbnail image data or moving image data corresponding to the recording data matched by the processing of the matching processing unit 49 and matched with the search condition input by the user or selected by the user is displayed. Can be made. Further, the first subtitle information display screen 501 is provided with a return button 321, a full screen playback button 434, an up button 277, a down button 279, and an enter button 280.

  Note that the thumbnail image data or moving image data displayed in the image display area 512 is displayed under the influence of the scroll operation only by scrolling the text data displayed in the subtitle information display area 511. It is not changed (the display is not changed unless any text data is selected and determined).

  Next, FIG. 24 shows a display example of the second subtitle information display screen 541 when chapters are set.

  In the second caption information display screen 541, a chapter name display area 551 is provided in addition to the caption information display area 511 and the image display area 512, as shown in FIG. In the chapter name display area 551, a part corresponding to the text data displayed in the subtitle information display area 511 among the chapter names of the chapters set by the processing of the chapter setting unit 40 based on the user's operation input. The chapter name is displayed. Also, thumbnail image data or moving image data can be displayed in the image display area 512. Further, the second subtitle information display screen 541 is provided with a return button 321, a full screen playback button 434, an up button 277, a down button 279, and an enter button 280.

  Next, FIG. 25 shows a display example of the third subtitle information display screen 571 when chapters are set.

  As shown in FIG. 25, the third subtitle information display screen 571 is provided with a subtitle information display area 511 and an image display area 512. In the subtitle information display area 511, the first metadata 165 is provided. The text data included in the text data 166 is not displayed in a chronological order, but instead, the chapter name of the chapter set by the processing of the chapter setting unit 40 based on the user's operation input Among them, a predetermined number of chapter names that match the search condition input by the user or that are set in the recording data selected by the user are displayed in time series. Also, thumbnail image data or moving image data can be displayed in the image display area 512. Further, the third subtitle information display screen 571 is provided with a return button 321, a full screen playback button 434, an up button 277, a down button 279, and an enter button 280.

  In addition to displaying thumbnail image data or moving image data in the image display area 512, CM content is displayed based on the second metadata stored in the second metadata storage unit 44. It can be displayed. As an example, FIG. 26 shows a third subtitle information display screen 571 in which CM content is displayed in the image display area 512. In the first subtitle information display screen 501 and the second subtitle information display screen 541, FIG. However, it goes without saying that the CM content may be displayed in the image display area 512 instead of the thumbnail image data or the moving image data.

  Here, in the image display area 512, CM content data included in the second metadata 169-2 corresponding to the search keyword input by the user may be preferentially displayed or searched. Alternatively, the commercials included in the recording data of the program selected by the user may be preferentially displayed.

  The first subtitle information display screen 501 to the third subtitle information display screen 571 can display one or a plurality of advertisement banners 272, and further correspond to the text used for the search. When the second metadata 169-3 having the attached banner data (in which the text used for the search is described as incidental data) is set by the banner display control unit 47, it is used for the search. The advertisement banner 272 corresponding to the second metadata 169-3 having the banner data associated with the text can be preferentially displayed.

  Returning to the description of the recorded program viewing process (FIG. 15).

  In step S136, the operation input unit 33 is displayed based on whether there is a selection operation such as the forward button 276, the upward button 277, the next button 278, or the downward button 279, for example. Determine if text scrolling has been commanded.

  If it is determined in step S136 that scrolling of the displayed text has been commanded, in step S137, the operation input unit 33 supplies a signal indicating the user's operation input to the screen display control unit 48. The display control unit 48 changes the display screen based on a user command so that the text is scrolled and displayed.

  If a display screen having an image display area 512 is displayed, thumbnail image data or moving image data is displayed even if it is determined in step S136 that scrolling of the displayed text has been commanded. The display of the existing image display area 512 is not changed. That is, when a thumbnail image is displayed in the image display area 512, even if a scroll of the displayed text is instructed, the thumbnail image displayed in the image display area 512 is not changed and is displayed in the image display area 512. When the moving image data is displayed, the playback position of the moving image data displayed in the image display area 512 is not jumped even if scrolling of the displayed text is instructed. In other words, the time code of the text displayed in the caption information display area 511 and the time code of the playback start position of the thumbnail image or moving image displayed in the image display area 512 are selected and determined for any text. As long as there is no operation, it will not be linked.

  In step S136, when it is determined that scrolling of the displayed text has not been commanded, or after the processing of step S137 is completed, in step S138, the operation input unit 33 is based on the supplied user operation input. Then, it is determined whether or not any of the displayed text has been selected and determined. If it is determined in step S138 that any of the displayed text has been selected and determined, the process proceeds to step S141 to be described later.

  If it is determined in step S138 that none of the displayed text has been selected and determined, in step S139, the operation input unit 33 determines whether or not the return button 321 has been selected. If it is determined in step S139 that the return button 321 has been selected, the process returns to step S106, and the subsequent processes are repeated.

  If it is determined in step S139 that the return button 321 has not been selected, in step S140, the operation input unit 33 determines whether an application termination command has been issued. If it is determined in step S140 that the application has been commanded to end, the process ends. If it is determined in step S140 that the application termination is not instructed, the process returns to step S136, and the subsequent processes are repeated.

  If it is determined in step S138 that any of the displayed text has been selected and determined, in step S141, the screen display control unit 48 displays a thumbnail image or a moving image corresponding to the selected and determined text. In addition, the thumbnail image data or the moving image corresponding to the time stamp associated with the selected and determined text from the recorded data storage unit 39 or corresponding to a time shifted by a predetermined time before and after the time stamp. Data is acquired and a thumbnail image or moving image corresponding to the selected text is displayed.

  In step S142, the operation input unit 33 determines whether or not reproduction on the full screen is instructed based on whether or not the full screen reproduction button 434 is selected. If it is determined in step S142 that reproduction on the full screen has been commanded, the process proceeds to step S149.

  If it is determined in step S142 that full-screen playback has not been commanded, in step S143, the operation input unit 33 determines whether or not a thumbnail or text display method change has been commanded based on the user's operation input. Determine whether.

  If it is determined in step S143 that no change in the thumbnail or text display method has been commanded, in step S144, the operation input unit 33 determines whether another playback method has been commanded based on the user's operation input. Determine whether. If it is determined in step S144 that no other reproduction method is instructed, the process returns to step S136, and the subsequent processes are repeated.

  If it is determined in step S144 that another playback method has been commanded, in step S145, the operation input unit 33 notifies the screen display control unit 48 of information indicating the commanded playback method. 48 executes display control by the commanded reproduction method, and the process proceeds to step S159 described later.

  If it is determined in step S143 that a change in the thumbnail or text display method has been commanded, in step S146, the operation input unit 33 notifies the screen display control unit 48 of information indicating the commanded playback method. The screen display control unit 48 uses the recording data stored in the recording data storage unit 39 or the thumbnail image data, and the first metadata 165 stored in the first metadata storage unit 43. The display image data of the commanded display method is generated. Specifically, the screen display control unit 48 uses the first subtitle information display screen 501 described with reference to FIGS. 23 to 26 based on the information indicating the commanded reproduction method supplied from the operation input unit 33. Through the third subtitle information display screen 571, display image data corresponding to the subtitle information display screen in one of the display formats is generated.

  In step S147, the screen display control unit 48 displays the caption information display screen using the display image data generated in step S146, the process returns to step S136, and the subsequent processes are repeated.

  If it is determined in step S108 that provision of program information by text is not instructed, in step S148, the operation input unit 33 determines whether or not an operation input for selecting and determining any program has been received. Whether or not the decision button 280 is selected when the cursor is moved to one of the recorded program information 271 displayed on the recorded program list display screen 251 and highlighted. Judging. If it is determined in step S148 that an operation input for selecting and determining any program has not been received, the process returns to step S106, and the subsequent processes are repeated.

  If it is determined in step S148 that an operation input for selecting and determining one of the programs has been received, if it is determined in step S132 that playback on the full screen has been commanded, or if in step S142, the full screen If it is determined that the reproduction is instructed, in step S149, the screen display control unit 48 refers to the flag setting unit 52 and determines whether or not the CM flag is in an active state. If it is determined in step S149 that the CM flag is not active, the process proceeds to step S157 described later.

  If it is determined in step S149 that the CM flag is active, in step S150, the screen display control unit 48 performs the viewing of either the CMs at the beginning or the CMs are not viewed. It is determined whether or not a CM viewing method selection function capable of selecting a method is provided. Whether or not the CM viewing method selection function is provided is determined by, for example, the function that the recording apparatus 3 has in advance, the version of the application, or the like. When it is determined in step S150 that the CM viewing method selection function is not provided, the process proceeds to step S153 described later.

  If it is determined in step S150 that the CM viewing method selection function is provided, in step S151, the screen display control unit 48 displays a CM viewing method selection screen 671 as shown in FIG.

  In the CM viewing method selection screen 671, as shown in FIG. 27, for example, “This program allows you to skip viewing of the CM if you wish. A message explaining that it is possible to skip the playback of the CM, such as charging conditions or privileges for the user when the CM is viewed and when the CM is not viewed. It can be displayed. Also, on the CM viewing method selection screen 671, a “view CM” button 681 for instructing the user to view the CM and a “do not see CM” button for the user to instruct not to view the CM 682. Further, the CM viewing method selection screen 671 is provided with a return button 321, an up button 277, a down button 279, and an enter button 280. One or more advertisement banners 272 can be displayed on the CM viewing method selection screen 671.

  In step S152, the operation input unit 33 determines whether or not CM viewing has been selected by the user based on whether or not the “view CM” button 681 on the CM viewing method selection screen 671 has been selected. If it is determined in step S152 that CM viewing has been selected, the process proceeds to step S154 described later. If it is determined that CM viewing has not been selected, the process proceeds to step S155 described later.

  If it is determined in step S150 that the CM viewing method selection function is not provided, in step S153, the screen display control unit 48 notifies the user that the CMs are to be collectively played back first. A notification screen 701 shown in FIG. 28 is displayed. On the notification screen 701, for example, a message such as “This program is played back together before the main part is played, but the CM being played back is skipped” is displayed.

  If it is determined in step S152 that CM viewing has been selected, or after the processing in step S153 is completed, CM batch viewing processing, which will be described later with reference to FIG. 41, is executed in step S154. The process proceeds to step S159.

  If it is determined in step S152 that viewing of the CM has not been selected, in step S155, the recorded data search output unit 51 searches and reads the recorded data selected by the user from the recorded data storage unit 39, and displays the screen. This is supplied to the control unit 48.

  In step S156, the screen display control unit 48 stores the portion corresponding to the CM in the first metadata 165 corresponding to the recording data selected by the user and stored in the first metadata storage unit 43. The CM part is deleted from the recorded data supplied from the recorded data search / output unit 51 with reference to the time code 167.

  If it is determined in step S149 that the CM flag is not active, in step S157, the recording data search output unit 51 searches and reads the recording data selected by the user from the recording data storage unit 39, and performs screen display control. Supplied to the unit 48.

  After the process of step S156 or step S157 is completed, in step S158, the screen display control unit 48 converts the recorded data including the CM portion or not including the CM portion into the video output processing unit 53 and the output terminal 22-1. In addition, the program is supplied to the output unit 13 of the television receiver 2 through the audio output processing unit 54 and the output terminal 22-2, and the selected program is normally reproduced on the full screen 711 as shown in FIG. 29, for example. Let

  After the processing of step S124, step S134, step S145, step S154, or step S158 is completed, in step S159, the operation input unit 33 or the screen display control unit 48 has finished reproducing the recorded data, or Then, it is determined whether or not the end of reproduction has been commanded.

  If it is determined in step S159 that the reproduction of the recorded data has been completed or the reproduction has been instructed, the process returns to step S106, and the subsequent processes are repeated.

  If it is determined in step S159 that the reproduction of the recorded data has not been completed and the reproduction end is not instructed, in step S160, the operation input unit 33 determines whether the application has been instructed to end. Judging. If it is determined in step S160 that the application is not instructed to end, the process returns to step S159, and the subsequent processes are repeated. If it is determined in step S160 that the application has been commanded to end, the process ends.

  By such processing, the user can view the program in various forms using the recorded data and the first to third metadata, and further, for the user and the sponsor, Commercial is provided to the user.

  Next, processing when a banner is selected, which is executed when any one of the advertisement banners 272 displayed on each display screen is selected, will be described with reference to the flowchart of FIG.

  In step S191, the operation input unit 33 determines whether or not the displayed advertisement banner 272 has been selected. If it is determined in step S191 that the advertisement banner 272 being displayed has not been selected, the process in step S191 is repeated until it is determined that the advertisement banner 272 has been selected.

  If it is determined in step S191 that the selected advertisement banner 272 has been selected, the banner display control unit 47 stores the second metadata 169-3 in the second metadata storage unit 44 in step S192. It is determined whether the commercial data corresponding to the selected advertisement banner 272, that is, the CM content data displayed when the advertisement banner 272 is selected, is stored in a reproducible state. For example, if part of the second metadata is broken or has passed the reproducible period, it is determined that it is not in a reproducible state. If it is determined in step S192 that the commercial data corresponding to the selected advertisement banner 272 is stored in a reproducible state, the process proceeds to step S196 described below.

  If it is determined in step S192 that the commercial data corresponding to the selected advertisement banner 272 is not stored in a playable state, the network interface 41 selects the selected advertisement via the Internet 5 in step S193. The metadata supply server 6 is accessed to obtain commercial data corresponding to the banner 272.

  In step S194, the network interface 41 sends the commercial data corresponding to the selected advertisement banner 272 or the second metadata 169-3 including the corresponding commercial data to the metadata supply server 6 via the Internet 5. Request delivery of. When the network interface 41 receives distribution of the commercial data corresponding to the selected advertisement banner 272 or the second metadata 169-3 including the corresponding commercial data, the network interface 41 converts the received data into the second metadata. The data is supplied to the storage unit 44.

  In step S195, the banner display control unit 47 searches the second metadata 169-3 stored in the second metadata storage unit 44, and acquires commercial data corresponding to the selected advertisement banner 272. Judge whether it was possible.

  When it is determined in step S192 that the commercial data corresponding to the selected advertisement banner 272 is stored in a reproducible state, or in step S195, the commercial data corresponding to the selected advertisement banner 272 is acquired. If it is determined that it has been possible, in step S196, the banner display control unit 47 and the screen display control unit 48, for example, a commercial display screen 731 corresponding to the selected advertisement banner 272 as shown in FIG. Is displayed, the process is terminated, and the screen display returns to the display screen before the advertisement banner 272 is selected.

  The commercial display screen 731 shown in FIG. 31 may be a moving image or a still image, and may be the same as or different from a commercial inserted in the middle of a normal program. Needless to say.

  If it is determined in step S195 that commercial data corresponding to the selected advertisement banner 272 could not be acquired, the banner display control unit 47 and the screen display control unit 48 correspond to the advertisement banner 272 in step S197. An error message for notifying the user that the commercial to be displayed cannot be displayed is displayed, the processing is terminated, and the screen display returns to the display screen before the advertisement banner 272 is selected.

  By such processing, it is possible to display a commercial corresponding to the advertisement banner 272 that the user is interested in. In particular, when the advertisement banner 272 is associated with a search keyword, the advertisement banner 272 displayed on each display screen may be one that the user is interested in or that is related to a recent fashion. Therefore, it is possible to present a commercial in a form that is beneficial to both the user and the sponsor.

  Next, the recommended word search process executed in step S113 of FIG. 13 will be described with reference to the flowchart of FIG.

  In step S231, the screen display control unit 48 refers to the third metadata stored in the third metadata storage unit 45, and whether or not the recommended word list data is held as the third metadata. Determine whether. If it is determined in step S231 that the recommended word list data is held as the third metadata, the process proceeds to step S236 described later.

  When it is determined in step S231 that the recommended word list data is not held as the third metadata, in step S232, the network interface 41 determines the recommended word list data or the corresponding third metadata. To obtain the metadata, the metadata supply server 6 is accessed via the Internet 5.

  In step S233, the network interface 41 requests the metadata supply server 6 to distribute the recommended word list data or the corresponding third metadata via the Internet 5. When the network interface 41 receives the recommended word list data or the corresponding third metadata from the metadata supply server 6 via the Internet 5, the received recommended word list data or the corresponding third word metadata is received. The third metadata is supplied to and stored in the third metadata storage unit 45.

  In step S234, the screen display control unit 48 searches the third metadata stored in the third metadata storage unit 45 to determine whether the recommended word list data has been acquired. to decide.

  When it is determined in step S234 that the recommended word list data could not be acquired, in step S235, the screen display control unit 48 notifies the user that the recommended word search cannot be performed. An error message is displayed, and the process returns to step S113 in FIG. 13 and proceeds to step S110.

  If it is determined in step S231 that the recommended word list data is held as the third metadata, or if it is determined in step S234 that the recommended word list data can be acquired, step In S236, the screen display control unit 48 displays a recommended word list display screen 751 as shown in FIG. 33, for example.

  In the recommended word list display screen 751 shown in FIG. 33, words related to the popular program at that time, the cast name and actor name of a drama with a high audience rating, the text line, the current trend, and news A keyword list display area 761 for displaying a list of suitable keywords used by the user for the search process is provided based on the events that are indicated. The recommended word list display screen 751 further includes a return button 321, an up button 277, a down button 279, and an enter button 280. Also, one or a plurality of advertisement banners 272 can be displayed on the recommended word list display screen 751.

  In step S237, the operation input unit 33 determines whether one of the keywords displayed in the keyword list display area 761 of the recommended word list display screen 751 has been selected.

  If it is determined in step S237 that no keyword has been selected, in step S238, the operation input unit 33 determines whether the return button 321 has been selected. If it is determined in step S238 that the return button 321 has been selected, the process returns to step S113 in FIG. 13 and proceeds to step S110. If it is determined in step S238 that the return button 321 has not been selected, the process returns to step S237, and the subsequent processes are repeated.

  When it is determined in step S237 that any keyword has been selected, in step S239, the operation input unit 33 notifies the screen display unit 87 and the matching processing unit 49 which keyword has been selected. The screen display unit 87 holds the selected keyword as a search keyword, and displays it on any of the keyword boxes 311-1 to 311-m on the overall search screen 301 in FIG. 18 described above. The matching processing unit 49 holds the selected keyword as a search keyword for use in the recording data search process.

  In step S240, the screen display control unit 48 determines whether or not the second metadata for displaying the CM or the advertisement banner corresponding to the selected keyword is stored in the second metadata storage unit 44. To do.

  If it is determined in step S240 that the second metadata for displaying the CM or advertisement banner corresponding to the selected keyword is stored, the screen display control unit 48 selects the selected metadata in step S241. The priority of display of the CM or banner corresponding to the keyword is changed to higher order, and the process returns to step S113 in FIG. 13 and proceeds to step S110.

  If it is determined in step S240 that the second metadata for displaying the CM or advertisement banner corresponding to the selected keyword is not stored, the process returns to step S113 in FIG. 13 and returns to step S110. move on.

  Through such processing, when a user selects and views a desired amount of recorded data from a huge amount of recorded data or acquired commercial content, the words related to the popular program at that time, and the audience rating is high. Based on the drama's cast name, actor name, text line, current trend, news events, etc., the user can present a list of suitable keywords to use for search processing, Furthermore, since the user can select a search keyword from keywords prepared in advance, the user can omit the operation of inputting the search keyword, and a commercial associated with the selected keyword is preferentially provided. You can make it.

  In addition, if the selected keyword is a keyword that corresponds to a word about a program that is popular at that time, a cast name or actor name of a drama with a high audience rating, or a word line, etc., an optimal commercial based on these keywords In other words, providing TV programs can lead to the acquisition of sponsors because of the high audience rating of programs provided by program producers (broadcast stations) and the wide publicity of broadcasted programs. .

  Next, the free word search process executed in step S114 of FIG. 13 will be described with reference to the flowchart of FIG.

  In step S301, the screen display control unit 48 displays a free word search screen 781 as shown in FIG. 35, for example.

  The free word search screen 781 is provided with a character selection area 791 for the user to input text data without a keyboard and a text display area 792 for displaying the character selected in the character selection area 791. Further, the free word search screen 781 includes a return button 321, an input completion button 793, an input switching button 794, a previous button 276, an up button 277, a next button 278, a down button 279, and an enter button 280. Is provided. Also, one or more advertisement banners 272 can be displayed on the free word search screen 781.

  The input completion button 793 is a button that is selected when the text data displayed in the text display area 792 configured by the character selected in the character selection area 791 is used as a search keyword, and the input switching button 794. In the same manner as when the “Hiragana”, “Katakana”, and “Alphabetic” tabs in the character selection area 791 are selected, the character type displayed in the character selection area 791 is changed to Hiragana, Katakana. This button is selected when switching sequentially in alphanumeric.

  In step S <b> 302, the operation input unit 33 determines whether or not the user has performed an operation input for selecting any one of the characters displayed in the character selection area 791.

  If it is determined in step S302 that there has been an operation input for selecting a character, in step S303, the screen display control unit 48 displays the selected character in the text display area 792 based on the user's operation input.

  If it is determined in step S302 that there is no operation input for selecting a character, or after the processing in step S303 is completed, the operation input unit 33 selects the input completion button 793 in step S304, and the input is completed. Determine whether commanded.

  If it is determined in step S304 that input completion is not instructed, in step S305, the operation input unit 33 determines whether the return button 321 is selected. If it is determined in step S305 that the return button 321 has not been selected, the process returns to step S302, and the subsequent processes are repeated. If it is determined in step S305 that the return button 321 has been selected, the process returns to step S114 in FIG. 13 and proceeds to step S110.

  If it is determined in step S304 that input completion has been commanded, in step S306, the operation input unit 33 notifies the input keyword to the screen display unit 87 and the matching processing unit 49. The screen display unit 87 holds the input keyword as a search keyword, and displays it on any of the keyword boxes 311-1 to 311-m on the overall search screen 301 in FIG. 18 described above. The matching processing unit 49 retains the input keyword as a search keyword for use in the recording data search process.

  In step S307, the screen display control unit 48 determines whether or not the second metadata for displaying the CM or the advertisement banner corresponding to the input keyword is stored in the second metadata storage unit 44. To do.

  If it is determined in step S307 that the second metadata for displaying the CM or advertisement banner corresponding to the input keyword is stored, the screen display control unit 48 inputs the input in step S308. The priority of display of the CM or banner corresponding to the keyword is changed to a higher rank, and the process returns to step S114 in FIG. 13 and proceeds to step S110.

  If it is determined in step S307 that the second metadata for displaying the CM or advertisement banner corresponding to the input keyword is not stored, the process returns to step S114 in FIG. 13 and returns to step S110. move on.

  Through such processing, a keyword for searching for a desired item can be freely input from the recorded data recorded by the user or the acquired commercial content, and the commercial associated with the input keyword is stored. It can be given priority.

  Also in this case, if the input keyword is a keyword corresponding to a word about a program that is popular at that time, a cast name or actor name of a drama with a high audience rating, or a text line, etc. In other words, providing the most suitable commercials means that the high audience rating of programs provided by program producers (broadcasting stations) and the wide publicity of broadcasted programs leads to the acquisition of sponsors. It will also be.

  Next, the search process executed in step S120 in FIG. 13 will be described with reference to the flowchart in FIG.

  In step S341, the screen display control unit 48 refers to the various flags set by the flag setting unit 52, and determines whether there is a search CM flag.

  If it is determined in step S341 that there is a search CM flag, in step S342, the screen display control unit 48 stores the second meta data corresponding to the CM displayed during the search in the second metadata storage unit 44. It is determined whether or not the data is stored in a reproducible state. For example, if part of the second metadata is broken or has passed the reproducible period, it is determined that it is not in a reproducible state.

  If it is determined in step S341 that there is no search CM flag, or in step S342, it is determined that the second metadata corresponding to the CM displayed during the search is not stored in a playable state. In step S343, the screen display control unit 48 displays a message or an image indicating that the search is being performed, and the process proceeds to step S346 described later.

  If it is determined in step S342 that the second metadata corresponding to the CM displayed during the search is stored in a reproducible state, in step S344, the screen display control unit 48 performs the search. Of the second metadata corresponding to the displayed CM, the second metadata having the highest priority is selected and acquired from the second metadata storage unit 44.

  In step S345, the screen display control unit 48 starts reproduction of the CM content data included in the selected second metadata, and displays a searching CM display screen 801 as shown in FIG. 37, for example. . In addition to the CM content data, for example, a message such as “Please wait while searching” may be displayed on the searching CM display screen 801.

  After the process of step S343 or step S345 is completed, in step S346, the matching processing unit 49 determines whether or not a CM list is selected as a search result output method in step S119 of FIG.

  If it is determined in step S346 that the CM list has been selected, in step S347, a CM search process to be described later is executed using the flowchart of FIG.

  If it is determined in step S346 that the CM list has not been selected, a program name search process, which will be described later, is executed using the flowchart of FIG. 39 in step S348.

  After the process of step S347 or step S348 is completed, in step S349, the screen display control unit 48 refers to various flags set by the flag setting unit 52 and determines whether there is a search CM flag. .

  If it is determined in step S349 that there is a search CM flag, that is, if the search CM display screen 801 described with reference to FIG. 37 is displayed, in step S350, the screen display control unit 48 It is determined whether or not the reproduction of the content data is finished. If it is determined in step S350 that the reproduction of the CM content data has not ended, the process of step S350 is executed until it is determined that the reproduction of the CM content data has ended.

  If it is determined in step S349 that there is no search CM flag, or if it is determined in step S350 that reproduction of the CM content data has been completed, in step S351, the screen display control unit 48 uses FIG. The search result in the process of step S347 or step S348 is displayed on the search result CM list display screen 421 described above or the search result program list display screen 461 described with reference to FIG. It returns to S120 and progresses to step S121 of FIG.

  By such processing, the search processing is executed, the search result is displayed, and the commercial can be displayed aiming at the search processing in which the user has no hand. Further, as described above, since the commercial corresponding to the search keyword has a higher display priority, it is the second metadata 169 corresponding to the commercial displayed during the search and matches the search keyword. When the second metadata 169 is distributed, a commercial having contents of interest to the user is provided, which is preferable for both the sponsor and the user. In addition, if the search keyword is a word about a popular program at that time, a cast name or actor name of a drama with a high audience rating, or a text line, etc., viewing of a program provided by a program producer (broadcast station) The fact that the rate is high and the broadcasted programs are widely known leads to the acquisition of sponsors.

  Next, the CM search process executed in step S347 of FIG. 36 will be described with reference to the flowchart of FIG.

  In step S381, the matching processing unit 49 refers to the second metadata 169 stored in the second metadata storage unit 44, and searches for the corresponding CM content data based on the search keyword.

  In step S382, the matching processing unit 49 determines whether corresponding CM content data has been searched.

  If it is determined in step S382 that the corresponding CM content data has not been searched, in step S383, the matching processing unit 49 supplies the screen display control unit 48 that the corresponding item is not applicable. 48, for example, by displaying a message such as “There is no match for the keyword. Please re-enter the keyword”, etc., to notify the user that it is not applicable. It returns to S347 and progresses to step S349.

  If it is determined in step S382 that the corresponding CM content data has been searched, in step S384, the screen display control unit 48 uses FIG. 21 based on the searched CM content data of the second metadata 169. Display screen data corresponding to the search result CM list display screen 421 described above is generated, and the process returns to step S347 in FIG. 36 and proceeds to step S349.

  By such processing, CM content data corresponding to the keyword is searched from the recorded CM content data, and display screen data corresponding to the search result CM list display screen 421 described with reference to FIG. 21 is generated. And displayed.

  Next, the program name search process executed in step S348 in FIG. 36 will be described with reference to the flowchart in FIG.

  In step S401, the matching processing unit 49 refers to the first metadata 165 stored in the first metadata storage unit 43, and searches for the corresponding text based on the search keyword.

  In step S402, the matching processing unit 49 determines whether the corresponding text has been searched.

  If it is determined in step S402 that the corresponding text has not been searched, in step S403, the matching processing unit 49 supplies the screen display control unit 48 that the corresponding text is not applicable. For example, by displaying a message such as “There is no program that matches the keyword. Please enter the keyword again” or the like, the user is notified that it is not applicable, and the process proceeds to step S348 in FIG. Return to step S349.

  If it is determined in step S402 that the corresponding text has been searched, the matching processing unit 49 extracts the program ID corresponding to the search result and supplies the program ID to the recorded data search output unit 51 in step S404.

  In step S <b> 405, the recorded data search output unit 51 reads thumbnail image data corresponding to the supplied program ID from the recorded data storage unit 39 and supplies it to the screen display control unit 48.

  In step S406, the screen display control unit 48 generates display screen data corresponding to the search result program list display screen 461 described with reference to FIG. 22 based on the program ID and the thumbnail image data. Returning to step S348 in FIG. 36, the process proceeds to step S349.

  Through such processing, all the recorded data having text data corresponding to the keyword is searched from the recorded video data, and the display screen corresponding to the search result program list display screen 461 described with reference to FIG. Data is generated.

  Next, with reference to the flowchart of FIG. 40, the program information providing process by text executed in step S135 of FIG. 15 will be described.

  In step S451, the screen display control unit 48 refers to various flags set by the flag setting unit 52, and determines whether or not there is a CM flag. If it is determined in step S451 that there is no CM flag, the process proceeds to step S455.

  If it is determined in step S451 that there is a CM flag, in step S452, the screen display control unit 48 refers to the various flags set by the flag setting unit 52, and is a CM flag dedicated to the program information providing screen using text. Judge whether there is. If it is determined in step S452 that there is no CM flag dedicated to the program information providing screen using text, the process proceeds to step S455 described later.

  If it is determined in step S452 that there is a CM flag dedicated to the program information providing screen using text, in step S453, the screen display control unit 48 uses the second metadata corresponding to the CM dedicated to the program information providing screen using text. 169-4 is extracted from the second metadata storage unit 44 and acquired.

  In step S454, the screen display control unit 48 selects, from the extracted second metadata 169-4, the one corresponding to a predetermined number or a predetermined time of CM in descending order of priority.

  If it is determined in step S451 that there is no CM flag, if it is determined in step S452 that there is no text-only CM flag dedicated to the program information providing screen, or after the processing in step S454 is completed, in step S455, The screen display control unit 48 extracts the first metadata 165 corresponding to the selected recording data from the first metadata storage unit 43 and acquires it.

  In step S456, the screen display control unit 48 sets the initial display screen format when program information is provided by text, specifically, the first subtitle information display screen 501 described with reference to FIGS. Through the third subtitle information display screen 571, information indicating which display screen is set to be displayed first is read.

  In step S457, the screen display control unit 48 determines that the recording data, the thumbnail image data, the first metadata 165, and the second metadata 169-4 selected in step S454 exist. Of the first subtitle information display screen 501 to the third subtitle information display screen 571 described with reference to FIGS. 23 to 26 using the second metadata 169-4, the display screen of the set display format Generate data.

  In step S458, the screen display control unit 48 displays the generated display image data, and the process returns to step S135 in FIG. 15 and proceeds to step S136.

  That is, when the second metadata 169-4 selected in step S454 exists, the first subtitle information display screen 501, the second subtitle information display screen 541 described with reference to FIGS. Alternatively, a search in which the selected commercial is reproduced for a predetermined number of times or for a predetermined time in the image display area 512 of the third subtitle information display screen 571 and then matched by the processing of the matching processing unit 49 and input by the user. The thumbnail image data or moving image data of the recording data that meets the conditions or selected by the user is displayed.

  By such processing, program information is provided by text, so that the user can understand the contents of the program quickly and easily. That is, the user can receive more information promptly by receiving program information provided by text, for example, compared with the case of performing fast-forward playback, so that the recorded data is not reproduced. The contents of the recorded program can be understood, and the desired reproduction start position can be easily selected. In addition, each user can read the text at a free speed. For example, a user who wants to know the contents of a program easily can refer to text information in a shorter time than reproducing the whole, while a user who wants to know the contents of a program sufficiently It is possible to scroll the text data at a speed that matches its own request and refer to the text information. In addition, since thumbnail images or moving images are displayed in association with the text data, for example, even a user such as a child who cannot read characters sufficiently can obtain program information. Further, by using the second metadata 169-4, it is possible to display a predetermined number or a commercial having a high display priority for a predetermined time.

  Next, the CM summary viewing process executed in step S154 of FIG. 16 will be described with reference to the flowchart of FIG.

  In step S <b> 471, the recording data search / output unit 51 searches the recording data storage unit 39 for the recording data selected by the user, reads it, and supplies it to the screen display control unit 48.

  In step S472, a CM replacement process to be described later with reference to FIG. 42 is executed.

  In step S473, the screen display control unit 48 reads the first metadata 165 corresponding to the recording data selected by the user from the first metadata storage unit 43, and stores the CM part of the first metadata 165. Detect time code.

  In step S474, the screen display control unit 48 detects the time code of the portion other than the CM of the first metadata 165, that is, the portion corresponding to the main program.

  In step S475, the screen display control unit 48 extracts and reproduces only the CM portion from the recorded data supplied from the recorded data search output unit 51.

  In step S476, the screen display control unit 48 reproduces the part other than the CM, that is, the part corresponding to the main part of the program, from the recording data supplied from the recording data search output unit 51, and the processing is as shown in FIG. It returns to step S154 and progresses to step S159.

  With this process, when recording data is played back, the CM part is played back together first. Therefore, for the sponsor, the CM is more reliably compared with the case where the CM is skipped during playback. It can be watched, and there is no contradiction to sponsor sponsoring funds for broadcast programs. In addition, while the main part of the program is being played, the main part of the program is continuously played without being played along the way, so that the user can watch the main part of the program without being interrupted by the CM. can do.

  In the present embodiment, it has been described that the CM part can be extracted and viewed together before the part corresponding to the main part of the program. However, the CM can be viewed together. Needless to say, the program can be executed in the same manner as described above, both in the middle of reproduction of the main part and after reproduction of the main part of the program.

  Next, the CM replacement process executed in step S472 of FIG. 41 will be described with reference to the flowchart of FIG.

  In step S501, the CM replacement processing unit 46 corresponds to the program ID of the recording data selected by the user among the second metadata stored in the second metadata storage unit 44, that is, FIG. 4, the second metadata 169-1 described with the program ID of the recording data selected by the user is detected.

  In step S502, the CM replacement processing unit 46 determines whether there is a commercial replacement based on whether there is the second metadata 169-1 detected in step S501. If it is determined in step S502 that there is no commercial replacement, the process returns to step S472 in FIG. 41 and proceeds to step S473.

  If it is determined in step S502 that there is a commercial replacement, in step S503, the CM replacement processing unit 46 determines from the matching processing unit 49 based on the corresponding program ID and CMID of the second metadata 169-1. The time code of the commercial part to be replaced is detected from the supplied first metadata 165.

  In step S503, the CM replacement processing unit 46 converts the video and audio data of the commercial portion of the recorded data supplied to the screen display control unit 48 based on the detected time code of the commercial portion to be replaced. The CM content data is replaced with the CM content data included in the second metadata 169-1, and the process returns to step S472 in FIG. 41 and proceeds to step S473.

  As a result of such processing, the second metadata 169-1 configured by associating the replacement program ID and CMID with the CM content data including video and audio has shifted the time. A commercial can be replaced with a new commercial. For example, among the commercials included in the recording data stored in the recording device 3, a seasoned commercial or a commercial that announces the contents of a sale or service for a predetermined period has passed the time when the commercial content is met. Although it is not beneficial for both sponsors and viewers, it is possible to provide users with the latest commercials that meet the timing by allowing the CM to be replaced in this way. it can.

  In addition, when this processing is performed, a new commercial can be provided, but the second meta is not provided by replacing the old commercial with the old commercial at random regardless of the sponsor of the recorded program. Since the commercial to be replaced is designated by the data 169-1, there is no contradiction with respect to the sponsor giving out funds for the broadcast program.

  Through the processing described above, using the first metadata, the second metadata including information related to commercials, and the third metadata including information on a suitable word used by the user for searching, etc. It is possible to provide information that allows the user to easily execute the search process or to intuitively understand the rough contents of the recorded broadcast program, and at the time of providing such information. Commercials can be displayed. Also, it is possible to provide a commercial while searching for a recorded program, or to display a commercial corresponding to a keyword preferentially when searching for a recorded program by a keyword. Can do. Further, the commercial part can be rearranged or the commercial part can be replaced when the recorded data is reproduced.

  The series of processes described above can also be executed by software. The software is a computer in which the program constituting the software is incorporated in dedicated hardware, or various functions can be executed by installing various programs, for example, a general-purpose personal computer For example, it is installed from a recording medium. In this case, for example, all or part of the recording apparatus described with reference to FIG. 2 is configured by a personal computer 901 as shown in FIG.

  43, a CPU (Central Processing Unit) 911 performs various processes according to a program stored in a ROM (Read Only Memory) 912 or a program loaded from a storage unit 918 to a RAM (Random Access Memory) 913. Execute. The RAM 913 also appropriately stores data necessary for the CPU 911 to execute various processes.

  The CPU 911, the ROM 912, and the RAM 913 are connected to each other via a bus 914. An input / output interface 915 is also connected to the bus 914.

  The input / output interface 915 includes an input unit 916 including a keyboard and a mouse, an output unit 917 including a display and a speaker, a storage unit 918 including a hard disk, and a communication unit 919 including a modem and a terminal adapter. It is connected. The communication unit 919 performs communication processing via a network including the Internet.

  A drive 920 is connected to the input / output interface 915 as necessary, and a magnetic disk 931, an optical disk 932, a magneto-optical disk 933, a semiconductor memory 934, or the like is appropriately mounted, and a computer program read from them is loaded. It is installed in the storage unit 918 as necessary.

  When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  As shown in FIG. 43, this recording medium is distributed to supply a program to a user separately from the apparatus main body, and a magnetic disk 931 (including a floppy disk) storing a program, an optical disk 932 (including a floppy disk). CD-ROM (including Compact Disk-Read Only Memory), DVD (including Digital Versatile Disk), magneto-optical disk 933 (including MD (Mini-Disk) (trademark)), or a semiconductor package such as a semiconductor memory 934 In addition to being configured, it is configured by a ROM 912 storing a program supplied to the user in a state of being pre-installed in the apparatus main body, a hard disk included in the storage unit 918, and the like.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  Further, in this specification, even when a process executed by a part or all of a system configured by a plurality of apparatuses is realized by the process of the same information processing apparatus, However, it goes without saying that the present invention is applicable even when processing executed by one device is realized by processing of a plurality of information processing devices.

It is a figure for demonstrating the structure of the information processing system to which this invention is applied. It is a block diagram for demonstrating the video recording apparatus of FIG. It is a figure for demonstrating the 1st metadata produced by the metadata supply server. It is a figure for demonstrating the 2nd metadata produced by a metadata supply server. It is a figure for demonstrating the 2nd metadata produced by a metadata supply server. It is a figure for demonstrating the 2nd metadata produced by a metadata supply server. It is a figure for demonstrating the 2nd metadata produced by a metadata supply server. It is a flowchart for demonstrating a video recording process. It is a flowchart for demonstrating recording data creation processing. It is a flowchart for demonstrating a 1st metadata storage process. It is a flowchart for demonstrating a thumbnail production | generation process. It is a flowchart for demonstrating a recorded program viewing process. It is a flowchart for demonstrating a recorded program viewing process. It is a flowchart for demonstrating a recorded program viewing process. It is a flowchart for demonstrating a recorded program viewing process. It is a flowchart for demonstrating a recorded program viewing process. It is a figure for demonstrating the recorded program list display screen. It is a figure for demonstrating the whole search screen. It is a figure for demonstrating the search method selection screen. It is a figure for demonstrating the selection screen of the output method of a search result. It is a figure for demonstrating the search result CM list display screen. It is a figure for demonstrating the search result program list display screen. It is a figure for demonstrating a 1st caption information display screen. It is a figure for demonstrating a 2nd caption information display screen. It is a figure for demonstrating the 3rd caption information display screen. It is a figure for demonstrating the 3rd caption information display screen. It is a figure for demonstrating CM viewing-and-listening system selection screen. It is a figure for demonstrating a notification screen. It is a figure for demonstrating reproduction | regeneration by a full screen. It is a flowchart for demonstrating a process when a banner is selected. It is a figure for demonstrating a commercial display screen. It is a flowchart for demonstrating a recommendation word search process. It is a figure for demonstrating the recommendation word list display screen. It is a flowchart for demonstrating a free word search process. It is a figure for demonstrating the free word search screen. It is a flowchart for demonstrating a search process. It is a figure for demonstrating the CM display screen during a search. It is a flowchart for demonstrating CM search processing. It is a flowchart for demonstrating a program name search process. It is a flowchart for demonstrating the provision process of the program information by a text. It is a flowchart for demonstrating CM summary viewing process. It is a flowchart for demonstrating CM replacement processing. It is a block diagram which shows the structure of a personal computer.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Broadcasting station 2 Television receiver 3 Recording apparatus 5 Internet 6 Metadata supply server 21 Input terminal 33 Operation input part 35 Recording data generation part 37 Program ID information extraction part 38 Timer 39 Recording data storage part 41 Network interface 43 1st Metadata storage unit 44 Second metadata storage unit 45 Third metadata storage unit 46 CM replacement processing unit 47 Banner display control unit 48 Screen display control unit 49 Matching processing unit 50 Thumbnail generation unit 51 Recording data search output unit 52 Flag setting section 95 Recording start time information 165 First metadata 166 Text data 167 Time code 168 Program ID
169 Second metadata

Claims (4)

Recording data storage means for storing recording data associated with the first time information;
The first distinction information for distinguishing the program of the recorded data, the first text data relating to the main part of the program among the recorded data, and the commercial among the recorded data, so that it can be distinguished by the second distinction information. And the first metadata storage means for storing the first text data including the second text data and the first metadata including the second text information and the second time information corresponding to the second text data. When,
Second metadata storage means for storing second metadata including content data corresponding to the commercial, the first distinction information, and the second distinction information;
Display control means for controlling display of the recording data desired by the user among the recording data stored by the recording data storage means;
Based on the first metadata stored in the first metadata storage means and the second metadata stored in the second metadata storage means, the display control means Of the recorded data whose display is controlled, the first metadata included in the second metadata and the commercial specified by the second metadata are included in the second metadata. An information processing apparatus comprising: replacement processing means for replacing the content data corresponding to the commercial. The display control means extracts only the commercial part of the recorded data based on the second distinction information and the second time information included in the first metadata, and the extracted commercial part The information processing apparatus according to claim 1, further comprising: controlling playback of a portion other than the commercial of the recorded data. In an information processing method of an information processing apparatus capable of controlling display of stored recording data,
A recorded data storage control step for controlling storage of the recorded data associated with the first time information;
The first distinction information for distinguishing the program of the recorded data, the first text data relating to the main part of the program among the recorded data, and the commercial among the recorded data and distinguishable by the second distinction information And the first meta data for controlling the storage of the first text data including the first text data and the second time information corresponding to the second text data. A data storage control step;
A second metadata storage control step for controlling storage of second metadata including the content data corresponding to the commercial, the first distinction information, and the second distinction information;
Based on the first metadata whose storage is controlled by the process of the first metadata storage control step, the storage is controlled by the process of the second metadata storage control step of the recorded data. A detection step of detecting the commercial specified by the first distinction information and the second distinction information included in the second metadata;
A replacement processing step of replacing the commercial detected by the processing of the detection step with content data corresponding to the commercial included in the second metadata;
A display control step of controlling display of the recorded data in which the commercial is replaced with content data corresponding to the commercial by the processing of the replacement processing step. A program for causing a computer to execute processing for controlling display of stored recording data,
A recorded data storage control step for controlling storage of the recorded data associated with the first time information;
The first distinction information for distinguishing the program of the recorded data, the first text data relating to the main part of the recorded data among the recorded data, and the commercial among the recorded data and distinguishable by the second distinction information And the first meta data for controlling the storage of the first text data including the first text data and the second time information corresponding to the second text data. A data storage control step;
A second metadata storage control step for controlling storage of second metadata including the content data corresponding to the commercial, the first distinction information, and the second distinction information;
Based on the first metadata whose storage is controlled by the process of the first metadata storage control step, the storage is controlled by the process of the second metadata storage control step of the recorded data. A detection step of detecting the commercial specified by the first distinction information and the second distinction information included in the second metadata;
A replacement processing step of replacing the commercial detected by the processing of the detection step with content data corresponding to the commercial included in the second metadata;
And a display control step for controlling display of the recorded data in which the commercial is replaced with content data corresponding to the commercial by the processing of the replacement processing step.

Images