JP4038081B2 - Music selection type content playback apparatus and program thereof - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention provides a music selection type content playback apparatus that, when playing back video / audio content, selects a music that suits the viewer's preference and plays it back as a BGM (BackGround Music)., ThatThe programToRelated.
[0002]
[Prior art]
Conventionally, BGM assigned to video / audio content such as TV programs and movies has been generated in advance as a single audio data stream by being synthesized with main audio data such as dialogue by the content creator of the video / audio content. It was.
In addition, there is a technology that plays back individually recorded audio data at an appropriate timing and synthesizes the reproduced audio data with main audio data in real time to generate a single audio data stream. To do.
Furthermore, there are various techniques for reorganizing video / audio contents according to the viewer's personal profile and providing them to the viewer by using metadata that is information about the data. For example, based on the personal profile, video and audio content in a state where video and audio are combined is rearranged on the time axis for individual fragments that are divided in time, or the individual fragments and text that are divided There is a technique for rearranging data, image data, and the like on a screen.
[0003]
[Problems to be solved by the invention]
However, in the conventional technology, since the content creator side generates BGM as a single audio data stream by synthesizing with main audio data such as dialogue, the viewer side converts the main audio and BGM into the main audio data. It was not possible to separate. Therefore, there is a problem that the viewer has no means for selecting music other than the music selected by the content creator as BGM, and there is a problem that even the music that does not meet the taste of the viewer must be passively viewed.
In addition, even on the content creator side, even if the content creator selects a plurality of BGMs for viewers with different hobbies and preferences, there is a problem that only one of them must be finally used.
[0004]
  The present invention has been made in view of the above problems, and music that can be used as BGM music that meets the taste and taste of the viewer when playing video and audio content consisting of video and audio. Music selection type content reproduction apparatus for reproducing selection type content, AndThe purpose of providing the program.
[0005]
[Means for Solving the Problems]
  In order to achieve the above object, a music selection type content playback apparatus according to the present invention selects video / audio content including video and audio, and music to be played back in conjunction with the video / audio content. Information andSet along the time axis of the video / audio contentControl information including playback time information of the music, and a music selection type content playback device that plays back the music selection type content including the selection information,Producer-recommended music pre-multiplexed with the video / audio content, orA music selection means for selecting a music linked to the video / audio content from a music storage means storing a plurality of the music;Music decoding means for decoding the music selected by the music selection means based on control information including reproduction time information of the music;Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal;The music selected by the music selection means and decrypted by the music decryption means,Based on the playback time information,Decoded by the video / audio content decoding meansVoice synthesis means for synthesizing with the voice signal,The control information includes a start time and start method of the music, and an end time and end method of the music, and the video / audio content decoding unit or the music decoding unit is configured to start and start the music. The music selected by the music selection means is decoded based on the method, the end time and the end method of the music.And
[0006]
  According to this music selection type content playback apparatus, music linked to video / audio content can be selected and decoded along with the video / audio content in accordance with the playback time information, and the favorite music of the viewer can be played. BGM can be synthesized with the main audio and played back together with the video.
  Further, according to the music selection type content playback apparatus, it is possible to play back content with a playback effect by using a music start method such as fade-in and cut-in and a music end method such as fade-out and cut-out. it can.
[0007]
Furthermore, the music selection type content playback apparatus further comprises personal profile storage means for storing a personal profile describing the preference information of the music of the viewer, wherein the music selection means is based on the selection information and the preference information. It was decided to select a song.
[0008]
According to this music selection type content playback apparatus, the music selection means can judge the viewer's preference, automatically select the viewer's favorite song, and play it as BGM along with the main audio and video.
[0009]
In the music selection type content playback apparatus, a viewing history storage unit that stores a viewer's viewing history, and a personal profile update unit that updates the personal profile based on the viewing history stored in the viewing history storage unit. It was decided to provide.
[0010]
According to this music selection type content reproduction apparatus, personal profile information is automatically created and updated from the music viewing history of the viewer, and music is selected by this personal profile information. According to the latest preference of the viewer, the music to be reproduced as BGM along with the main audio and video can be automatically selected.
[0011]
In the music selection type content reproducing apparatus, the music and music information having at least a unique identification number of the music are received from a music providing server that provides the music via a communication line. The music reception control means for storing in the storage means is provided.
[0012]
According to this music selection type content reproducing apparatus, music can be provided from the music providing server via the communication line, and the music can be reproduced together with the main audio and video. Can be used for
[0013]
Further, in the music selection type content playback device, the music information provided from the music providing server includes a valid period in which the music can be used, and the time elapse of the valid period is determined, An effective period determining means for prohibiting the reproduction of the music whose period has elapsed is provided.
[0014]
According to this, it is possible to limit the use period of the music provided from the music providing server and use the music provision for commercial purposes.
[0015]
In the music selection type content playback device, the selection information and the music information include music tone information that expresses the atmosphere and music tone of the music in a language, and the music selection means is configured based on the music tone information. It was configured to select music.
[0016]
According to the music selection type content playback apparatus, it is possible to select and play back the music that matches the atmosphere and tone intended by the creator as the BGM.
[0017]
  Further, the music selection type content playback apparatus includes video / audio content including video and audio, selection information for selecting music to be played back in conjunction with the video / audio content, andSet along the time axis of the video / audio contentControl information including reproduction time information of the music;Pre-multiplexed with the video / audio contentA music selection type content playback apparatus that plays back a music selection type content including a plurality of music pieces, and the music linked to the video / audio content based on the selection information included in the music selection type content TheFrom the plurality of music pieces pre-multiplexed with the video / audio contentMusic selection means to select;Music decoding means for decoding the music selected by the music selection means based on control information including reproduction time information of the music;Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal;The music selected by the music selection means and decrypted by the music decryption means,Based on the reproduction time information included in the music selection type contentBefore being decoded by the video / audio content decoding meansVoice synthesis means for synthesizing with the voice signal,The control information includes a start time and start method of the music, and an end time and end method of the music, and the video / audio content decoding unit or the music decoding unit is configured to start and start the music. The music selected by the music selection means is decoded based on the method, the end time and the end method of the musicIt was decided.
[0018]
According to this music selection type content playback apparatus, a music linked to video / audio content is selected from the music included in the content or from other music providers, and is matched with the playback time information together with the video / audio content. It can be decoded and played back, and the favorite music of the viewer can be synthesized as main music with BGM and played back together with the video.
[0021]
  Furthermore, the music selection type content playback program of the present invention includes video / audio content including video and audio, selection information for selecting music to be played back in conjunction with the video / audio content, andSet along the time axis of the video / audio contentControl information including playback time information of the music, andThe control information includes a start time and start method of the music, and an end time and end method of the music.In order to play the music selection type content, the computer is caused to function by the following means. That is, each means is based on the preference information described in the personal profile describing the preference information of the viewer's music and the selection information,Producer-recommended music pre-multiplexed with the video / audio content, orA music selection means for selecting a music suitable for the viewer from a music storage means for storing a plurality of music;A music decoding means for decoding the music selected by the music selection means based on control information including reproduction time information of the music;Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal;The music selected by the music selection means and decoded by the music decoding means,Based on the reproduction time information, voice synthesis means for synthesizing with the audio signal reproduced by the video / audio content reproduction means.
[0022]
According to this music selection type content playback program, a music piece linked to video / audio content can be selected on a computer and decoded along with the video / audio content in accordance with the playback time information. The music can be synthesized with the main voice as BGM and played with the video.
[0025]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0026]
(Configuration of music selection type content provision system)
FIG. 1 is a block diagram showing the configuration of a music selection type content providing system using the music selection type content reproduction apparatus of the present invention.
[0027]
In the music selection type content providing system 1 of FIG. 1, the music selection type content reproduction apparatus 100 has a reception function of receiving a digital broadcast broadcast from the broadcast station 400 and selects a music that is a broadcast wave stream input from an antenna. And a playback function for playing back the video and audio by sending the decoded video and audio to the video / audio output device 150. Furthermore, the music selection type content reproduction apparatus 100 is connected to the home network H-NET and has a communication function of performing communication via the home network H-NET. This home network H-NET is connected to the Internet NET via a telephone line, an optical fiber or the like.
[0028]
The home server 200 is a music storage means described in the claims, and stores music owned by the viewer. The home server 200 is connected to the home network H-NET and provided from the music providing server 300. Accumulate music. The home server 200 has a communication function. In addition to the music providing server 300, the home server 200 communicates with other devices connected to the home network H-NET, and uses the home network H-NET and the Internet NET. It is possible to communicate with a plurality of servers on the Internet NET.
[0029]
The music providing server 300 is a server that provides music provided on the Internet NET, provides a list of music that can be provided to the music selection type content playback apparatus 100 via the Internet NET, and selects music. When there is a music acquisition request from the type content playback apparatus 100, the music data itself is provided.
[0030]
The broadcast station 400 broadcasts a broadcast program as a data stream using a terrestrial wave directly from an antenna or via a BS / CS satellite.
In the music selection type content providing system 1, the music selection type content is not only provided by broadcast waves from the broadcast station 400, but can also be provided by a viewer purchasing it as a package media at a store. Further, it is also possible to receive provision from the content providing server 500 on the Internet NET by downloading.
[0031]
The content providing server 500 is a server that provides content including music selection type content provided on the Internet NET, and provides content to the music selection type content playback device 100 via the Internet NET. It is.
[0032]
  The billing management center 600 performs billing management of music provided from the music providing server 300 on the Internet NET. Billing management center600 also performs billing management of content received from the content providing server 500.
[0033]
For example, when the music selection type content playback apparatus 100 plays back the music selection type content, the music provided from the music providing server 300 and used as the BGM is stored in the home server 200 and the music selection type content is played back. After that, during the free use period preset for each song, the viewer can freely watch, and the viewer communicates with the billing management center 600 via the Internet NET and pays the specified amount. Alternatively, it may be possible to use the music freely beyond the free use period for the first time. In this way, the billing management center 600 is in charge of billing management between the viewer and the copyright holder of the music. Similarly, it is possible to perform billing management for the content itself.
[0034]
(Configuration of music selection type content playback device)
Next, referring to FIG. 2 (refer to FIG. 1 as appropriate), the configuration of the music selection type content playback apparatus 100 will be described. FIG. 2 is a block diagram showing the configuration of the music selection type content playback apparatus 100.
[0035]
As shown in FIG. 2, the music selection type content playback apparatus 100 includes a main control unit 101, a reception control unit 102, an input control unit 103, an output control unit 104, a program storage unit 105, and a BGM control code file. Storage means 106, usable music list storage means 107, personal profile storage means 108, viewing history storage means 109, content decryption means 110, music decryption means 111, speech synthesis means 112, and user operation control means 113 It was set as the structure provided with.
[0036]
The main control unit 101 controls each unit of the music selection type content reproduction apparatus 100 and transfers data between the units, and is composed of a CPU, a memory, and the like. The main control unit 101 includes a music reception control unit 1011, a music selection unit 1012, a personal profile update unit 1013, a music list generation unit 1014, an effective period determination unit 1015, and a viewing history update unit 1016.
Each unit of the main control unit 101 is stored in the program storage unit 105 as a program, and is read from the main control unit 101 and executed at the time of execution.
[0037]
Here, the music reception control means 1011 communicates with the music provision server 300 provided on the Internet NET, and matches the viewer's preference with the available music based on the contents of the BGM control code file storage means 106. A request for a music list is made to the music providing server 300 on the Internet NET, and the obtained available music list is stored in the available music list storage means 107, or a home server connected to the home network H-NET. It has a function of instructing to receive necessary music from a music providing server 300 provided on the Internet NET by communicating with the Internet 200.
[0038]
The music selection means 1012 has a function of selecting and acquiring a target music from music in the home server 200 on the home network H-NET, and providing the music selection means 111 for reproduction. ing.
[0039]
The personal profile update unit 1013 has a function of creating personal profile data that is a basis for determining the viewer's “preference” and storing the personal profile data in the personal profile storage unit 108. The personal profile can be formed by the viewing history update unit 1016 based on the viewing history stored in the viewing history storage unit 109, but the viewer himself / herself manually sets a favorite category and artist name. Can also be created.
[0040]
The music list generating unit 1014 creates a music list that spans a plurality of music providing servers 300 based on the available music list obtained by the music receiving control unit 1011 communicating with the music providing server 300 on the Internet NET. And has a function of storing in the available music list storage means 107.
[0041]
The validity period determination means 1015 determines the expiration of the validity period of the music based on the validity period of the music information stored in the available music list storage means 107, and prohibits the reproduction of the music after the validity period. To do. Furthermore, it has a function to display a song that has passed the free viewing period and ask the user to decide whether or not to purchase the song.
[0042]
The viewing history update means 1016 forms viewing history information including what kind of music the viewer has watched in the past and how many times it has been viewed, for example, the number of times of viewing by music and by artist. It has a function to memorize. At this time, it is also possible to reflect the latest “preference” of the viewer on the personal profile by adding a process such as weighting to the recently viewed song instead of focusing only on the past number of times of viewing. .
[0043]
The reception control means 102 receives the music selection type content (data stream) and separates it into encoded video (video), encoded audio (main audio), encoded music (BGM), and BGM control file (control information). To do.
Here, the configuration of the music selection type content (data stream) will be described with reference to FIG. FIG. 3A shows the configuration of a conventional data stream, and FIG. 3B shows the configuration of the data stream of the present invention.
As shown in FIG. 3A, the conventional audio is provided in a state where BGM corresponding to each cut (Cut1 to Cut6) of the video is synthesized with the main audio (main audio). For this reason, the main voice and the BGM cannot be separated, and it is physically impossible for the viewer to change the BGM to his favorite music.
[0044]
On the other hand, in the present invention, the music selection type content provided from the content provider is provided to the video / audio output device 150 in a state of being separated into main audio and BGM as shown in FIG. It can be done. Further, FIG. 3B shows that the music selection type content is provided with a plurality of BGMs at the same time of the same cut in addition to the main sound. Here, an example is shown in which three types of BGM music groups, a music group A recommended by the producer, a music group B consisting of classical music, and a music group C consisting of rock music, are provided as data streams from the broadcasting station. Furthermore, BGM1 to BGM5 can be used as BGM as BGM provided from the home server 200 or the music providing server 300 as well.
Although FIG. 3 does not describe a BGM control file (control information), this BGM control file is provided before the beginning of the music selection type content or before BGM is output as sound.
Returning to FIG. 2, the description will be continued.
[0045]
The input control means 103 and the output control means 104 are the home server 200 via the home network H-NET, the music providing server 300 on the Internet NET, and the content provision via the home network H-NET and the Internet NET. It communicates with the server 500 or the charge management center 600.
The program storage unit 105 is a storage unit for storing a program and is configured by a general storage unit such as a hard disk. The program stored in the program storage unit 105 is read and executed by the main control unit 101.
[0046]
The BGM control code file storage means 106 temporarily stores the BGM control file, and is configured by a general memory or the like.
Here, the contents of the BGM control file will be described with reference to FIG. FIG. 4 shows an example of the BGM control file.
As shown in FIG. 4, the BGM control file includes an identification number (BGM No.) for identifying the BGM, a BGM start time and a start method at the time of content reproduction, a BGM end time and a stop method, , Music tone information “expression” that expresses the atmosphere and tone of the BGM in language.
[0047]
For example, BGM No. 1 BGM starts playback with fade-in at the same time as the start of content playback (00:00:00), ends playback with fade-out after 4 minutes and 30 seconds (04:30:30), BGM No2 The BGM indicates that playback starts with a cut-in at 5:30 hours after content playback (05:30) and ends with a cut-out at 8:30:30 (08:30). ing. The BGM control file can also include detailed control information such as how much time it takes to fade out when reproduction is performed with a reproduction effect such as fade-out.
A method of using the music tone information “expression” will be described later.
Returning to FIG. 2, the description will be continued.
[0048]
The available music list storage unit 107 stores list information (music list) of available music (BGM), and is configured by a general memory or the like. The usable music list storage means 107 is a list of music that the music reception control means 1011 can use according to the content of the BGM control file and that matches the taste of the viewer. The request is made, and the available music list as a result is stored.
[0049]
The personal profile storage means 108 stores a personal profile in which preference information for the viewer's music is described, and includes a general memory or the like. This personal file describes, for example, a genre (category) preferred by the viewer, an artist, or a plurality of genres, artist rankings, and the like.
[0050]
The viewing history storage unit 109 stores the viewing history of music that the viewer has viewed in the past, and is configured by a general memory or the like. For example, the number of views of the music itself viewed by the viewer, the number of times of viewing by genre (category) of the music, the number of times of viewing by artist of the music, and the like are stored. The viewing history storage unit 109 is updated by the viewing history update unit 1016.
[0051]
The content decoding unit 110 (video / audio content decoding unit) receives the reception control unit 102 and decodes the separated encoded video, encoded audio (main audio), encoded music (BGM), and BGM control file. Is. The content decoding means 110 decodes the encoded video and outputs it to the video / audio output device 150 as a video signal. Also, the encoded voice (main voice) and the encoded music (BGM) are decoded and output to the voice synthesis unit 112 as a main voice signal and a music voice signal. The BGM control file received and separated by the reception control unit 102 is stored in the BGM control code file storage unit 106.
[0052]
The music decoding means 111 decodes the music (BGM) selected by the music selection means 1012 of the main control means 101 and acquired from the home server 200 to produce a music audio signal. The music voice signal decoded by the music decoding means 111 is output to the voice synthesis means 112.
[0053]
The voice synthesizing unit 112 synthesizes the main audio signal decoded by the content decoding unit 110 and the music audio signal decoded by the content decoding unit 110 or the music audio signal decoded by the music decoding unit 111 as an audio signal. This is output to the video / audio output device 150.
The voice synthesizing unit 112 is instructed by the music selection unit 1012 of the main control unit 101 as to which output of the content decoding unit 110 or the music decoding unit 111 is used as the music audio signal. In addition, voice synthesis is performed with an appropriate mixing amount in accordance with an instruction from the main control unit 101.
[0054]
The user operation control means 113 controls operations such as music selection mode change, volume switching, and sound balance adjustment between the main sound and BGM by the viewer. In this music selection mode, a normal mode in which the BGM provided from the content provider is reproduced as it is, a content music selection mode in which the BGM in the data stream provided from the content provider is selected, and a viewer's own BGM are selected. There is an automatic music selection mode to be given. Processing for these modes will be described later.
[0055]
The configuration of the music selection type content playback apparatus 100 has been described based on one embodiment, but the present invention is not limited to this. For example, a music storage unit that stores music provided from the music providing server 300 may be incorporated in the music selection type content playback apparatus 100.
In addition, the music selection type content reproduction apparatus 100 can also realize each unit as a function program in a computer, and can also operate the music selection type content reproduction program by combining the function programs.
[0056]
(Operation of music selection type content playback device)
Here, the operation of the music selection type content reproduction apparatus 100 will be described with reference to the flowchart of FIG.
In step S101, if the viewer has selected the normal mode for reproducing the BGM recommended by the producer provided by the content provider (YES), the music selection means 1012 automatically selects the music recommended by the producer in step 102. In the example of FIG. 3B, the music group A is selected as BGM. In this case, since the music playback procedure is set in advance, in step S103, the music synthesizer 112 synthesizes this music group with the main voice so as to match the playback of the video portion of the content. Audio is reproduced by the video / audio output device 150.
[0057]
In the example of FIGS. 3B and 4, BGM No. The first piece of music (BGM1A) starts to be played back by fade-in, and the playback of this music is finished by fade-out 4 minutes and 30 seconds after the start of content viewing. Subsequently, BGM No. 5 minutes 30 seconds after the start of content viewing. The second song (BGM2A) starts to be played with cut-in, and the playback ends with cut-out 8 minutes and 30 seconds after the start of content viewing. In this way, by presenting the content to the viewer while mixing the music of each BGM with the main voice in real time, the viewer can view the content in the normal mode as in the conventional case. Can do.
[0058]
In step S101, the viewer does not select the normal mode (No in S101), and in step S105, the viewer selects the content music selection mode for selecting one of the BGMs in the data stream provided from the content provider. In this case (YES in S105), or in step S105, the viewer selects the automatic music selection mode in which the viewer's own BGM is selected and given. However, in step S107, the music selection type content reproduction apparatus 100 is connected to the home network H-. If it is not possible to communicate with the home server 200 or the music providing server 300 via NET (No in S107), one of the songs in the data stream provided from the content provider is selected as BGM in step S106. In this case, if the viewer's personal profile indicates that the viewer likes classical music, for example, in FIG. 2 and FIG. A music group B consisting of music is selected as BGM, synthesized with the main voice and voice synthesizing means 112 in step S103, and video and audio are reproduced by the video and audio output device 150 in step S104.
[0059]
When the viewer selects the automatic music selection mode in which the viewer's own BGM is selected and given (No in S105), in step S107, the music reception control unit 1011 of the main control unit 101 displays the input control unit 103, It is confirmed whether or not communication with the home server 200 is possible via the output control means 104 and the home network H-NET. When communication with the home network H-NET is possible and there are no other restrictions (YES in S107), in step S108, the reception control means 102 once receives the music selection type content and decrypts the content. After being decoded by the means 110, the BGM control file is stored in the BGM control code file storage means 106. Furthermore, in step S109, it is confirmed whether or not communication with the music providing server 300 is possible via the Internet NET.
[0060]
If communication with the music providing server 300 is possible, in step S110, the music selection means 1012 of the main control means 101 is based on the BGM control file (see FIG. 4) stored in the BGM control code file storage means 106. The tune information “expression” of the tune to be used is referred to. Furthermore, the music selection means 1012 is stored in the BGM music provided together with the content from the content provider, the music stored in the home server 200, and the available music list storage means 107 provided from the music providing server 300. Among the songs in the available song list, the song that best matches the “viewer preference” according to the tone information is selected as the song to be used for BGM. Here, “viewer preference” means what kind of music the viewer listens to from the viewing history of the music that the personal profile updating means 1013 of the main control means 101 has viewed in the past. It is determined by the data stored in the personal profile storage means 108 as the latest personal profile of the viewer that the viewer is listening to the music of such an artist, and the selection of the music can be determined based on this data. Done.
[0061]
In step S110, when music that matches the taste of the viewer is selected from the music that can be used as the BGM provided from the music providing server 300 on the Internet NET, the music reception control means 1011 of the main control means 101 performs the step In S111, the communication is performed with the output control unit 104, the home network H-NET, and the home server 200 and the music providing server 300 via the Internet NET, and the music is provided via the Internet NET, the home network H-NET, and the input control unit 103. The music data sent from the server 300 is once taken into the home server 200 and stored.
In step S113, the start / end time of the music data is adjusted based on the information of the BGM control code file as shown in FIG. Then, processing is performed while adding a reproduction effect such as fade-out, the music decoding means 111 decodes it, the main voice and the voice synthesizing means 112 are synthesized in step S103 and output to the video / audio output device 150 as an audio signal, In step S104, the video / audio output device 150 plays the video.
[0062]
In step S110, a song that can be used as a BGM in accordance with the tone information of the BGM control code file and matches the viewer's preference is selected from the songs owned by the viewer stored in the home server 200. In the case of reproduction, in step S112, the music selection means 1012 of the main control means 101 communicates with the home server 200 via the home network H-NET via the output control means 104 to select music, and the home network The music data sent from the home server 200 is obtained via the input control means 103 via the H-NET. Then, the process proceeds to step S113, the start / end time is adjusted, the processing is performed while the reproduction effect is added, the music decoding means 111 decodes, the main voice and the voice synthesizing means 112 synthesize in step S103, and the video in step S104. Playback is performed by the audio output device 150.
[0063]
The viewer selects the automatic music selection mode in which the viewer's own BGM is selected and given. In step S107, the music reception control unit 1011 of the main control unit 101 for some reason is connected via the home network H-NET. If communication with the home server 200 is not possible (No in S107), the process proceeds to step S106, and thereafter, the same processing as in the in-contents music selection mode is performed. In step S110, when a music piece is selected from the music pieces in the content, the process proceeds to step S106 and the same process is performed.
If, for some reason, the music reception control means 1011 of the main control means 101 cannot communicate with the music providing server 300 via the home network H-NET and the Internet NET for some reason (No in S109), the process proceeds to step S112. After that, the same processing as in the case of selecting from the music stored in the home server 200 is performed.
[0064]
In step S110, when using the music provided from the music providing server 300 on the Internet NET, the music reception control means 1011 of the main control means 101 makes a request in advance to the music providing server 300 and sets the music data as BGM. Acquired and stored in the home server 200 before use. As a result of such processing, all the songs that can be used as BGM are temporarily stored in the music selection type content playback apparatus 100 and the home server 200, and can be played back at any time. As the content progresses, the main control means 101 reproduces the selected music piece in sequence based on the information in the BGM control code file shown in FIG. 4 while adding reproduction effects such as fade-in and fade-out according to circumstances. Thereby, it becomes possible to reproduce and present the content in which the favorite music of the viewer is used as the BGM to the viewer.
In addition, regarding what is provided from the music providing server 300, it has been described that the music data is acquired and stored in advance before using the music data. However, if it can be acquired immediately before the timing of playback as BGM, that may be sufficient. Usually, even if there is a slight delay in the reproduction of BGM, there is often no problem, so it is not impossible to reproduce the content while it is being reproduced.
[0065]
Next, a method for creating a personal profile that is a basis for determining the viewer's “preference” will be described. FIG. 6 shows an example of the past music viewing history of the viewer serving as a reference when the viewing history updating unit 1016 of the main control unit 101 creates personal profile data. In FIG. 6, “expression” in the second column indicates what kind of atmosphere each viewed music piece has. In this system, it is determined in what scene the music can be used for BGM based on the content shown in the item “expression”. The display contents of the “expression” item are presupposed to be provided by a music sales company that provides music or set by the viewer. Furthermore, it is assumed that information such as “category large” indicating a large classification of categories and “category small” indicating details of categories is also provided by a music sales company that provides music.
[0066]
As shown in FIG. 6, the music viewing history includes viewing history information indicating what kind of music the viewer has viewed in the past and how many times. This viewing history information is information in which the viewing history up to that point (for example, the number of times of viewing by music and by artist) is recorded for the music owned by the viewer. From this viewing history, a personal profile is created as shown in FIG. This personal profile is created with reference to a music viewing history or an artist viewing history. In addition to the past viewing history, the personal profile data can be adjusted by allowing the viewer to set his / her favorite category and artist name manually.
[0067]
Based on such personal profile data, the music selection means 1012 of the main control means 101 is selected by the viewer in the data stream provided by the content provider and the home server 200 in selecting the music. Among the music and music provided from the music providing server 300 on the Internet NET, “expression” that matches the viewer's “favorite” and is suitable as BGM for directing the atmosphere of each scene in the content Select a song that falls under. In selecting a song, the length for selecting each song must be taken into consideration, and a song having a song length sufficient as the BGM of the scene is selected according to the contents of the BGM control code file.
[0068]
Next, the contents of the available music list provided from the music providing server 300 on the Internet NET and the operation when purchasing music by the viewer will be described. FIG. 8 is an example of a list that is edited by the music list generation unit 1014 by the music list generation unit 1014 provided by the music providing server 300 on the Internet NET in response to a request from the music reception control unit 1011 of the main control unit 101. is there. In this example, the music selection unit 1012 of the main control unit 101 is a song having a “fun” atmosphere for a scene having a “fun” atmosphere, and a song belonging to a viewer's favorite category, or a viewer This is an example of a list of available music lists provided from the music providing server 300 as a result of requesting the music providing server 300 for a list of music by a favorite artist.
[0069]
At the time of selection of music, the music selection means 1012 of the main control means 101 selects, as BGM, music that most closely matches the viewer's “preference” from among music in the list and music owned by the viewer in the home server 200. select. Of the selected music pieces that are provided from the music providing server 300, the music receiving control means 1011 of the main control means 101 makes a request in advance to the music providing server 300 and reproduces the music data itself as BGM. Acquired and accumulated in advance before timing. The selected music is reproduced as BGM at an appropriate timing during content viewing.
[0070]
With respect to the music provided from the music providing server 300 and used as BGM, the viewer can freely watch and enjoy it as a single music during the free viewing period even after the content viewing ends. Then, after the free viewing period ends, the playback is automatically stopped by the action of the valid period determining means 1015. The valid period determining means 1015 plays a role of displaying a list of songs that are about to end the free viewing period or songs that are about to end the free viewing period and notifying the viewer. If the viewer likes the music reproduced as BGM and wants to purchase the right to view it, it can be purchased online via the Internet NET. At this time, the price of the music and the URL (Uniform Resource Locator: notation specifying the location on the web) of the billing management center to be contacted at the time of purchase are in the list of available music as shown in FIG. Is included as information. Thereby, this system has a music sales function as well as the provision of BGM.
[0071]
The music selection type content playback apparatus of the present invention has been mainly described above. However, the music selection granting method executed by the present apparatus and the music selection granting program for realizing the music selection granting method by the CPU are described.AlsoThe object of the present invention.In addition, the music selection type content playback apparatus can play back content with a playback effect by a music start method such as fade-in and cut-in and a music end method such as fade-out and cut-out.
[0072]
【The invention's effect】
As described above, in the music selection type content playback apparatus according to claim 1 of the present invention, the music linked to the video / audio content can be selected and decoded together with the video / audio content according to the playback time information and played back. It is possible to synthesize various music pieces as BGM with the main sound and reproduce it together with the video.
[0073]
In the music selection type content reproducing apparatus according to the second aspect of the present invention, the music selection means stores the viewer's personal preference information as a personal profile, and based on this, the viewer's preference is determined to determine the viewer's preference. It is possible to automatically select a favorite song and play it as a BGM along with the main audio and video.
[0074]
In the music selection type content reproduction apparatus according to claim 3 of the present invention, personal profile information is automatically created and updated from the music viewing history of the viewer, and the music is selected with this personal profile information. The selection means can automatically select the music to be reproduced as BGM along with the main audio and video according to the latest preference of the viewer.
[0075]
In the music selection type content reproducing apparatus according to claim 4 of the present invention, the music is provided from the music providing server via the communication line, and the music can be reproduced together with the main audio and video. Can be used for BGM from the many songs from the appropriate viewer's preference.
[0076]
In the music selection type content reproducing apparatus according to claim 5 of the present invention, by limiting the period in which music can be used free of charge, unlimited use can be suppressed and music distribution can be made commercially available.
[0077]
In the music selection type content reproduction apparatus according to claim 6 of the present invention, since information indicating the atmosphere and tone of the song is included in the selection information and song information, a song that matches the atmosphere and tone intended by the producer is selected, It can be used as BGM.
[0078]
In the music selection type content playback apparatus according to claim 7 of the present invention, a wide variety of music linked to video / audio content is selected from music included in the content or music from other music providers, and the video / audio content is selected. Along with the audio content, it can be decoded and reproduced in accordance with the reproduction time information, and the favorite music of the viewer can be synthesized with the main audio as BGM and reproduced together with the video. Even when there is a problem in the communication system, BGM can be selected from a plurality of music pieces.
[0080]
  Claims of the invention8According to the music selection type content playback program of the above, the computer selects the music linked to the video / audio content according to the preference of the viewer, and decodes and plays it along with the video / audio content according to the playback time information. The user's favorite music can be viewed together with the video as BGM.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a music selection / giving system in which a music selection type content playback apparatus of the present invention is used.
FIG. 2 is a block diagram showing a configuration of a music selection type content playback apparatus of the present invention.
FIG. 3 is a configuration diagram showing a configuration of a content data stream;
FIG. 4 is a table showing an example of information of a BGM control code file according to the present invention.
FIG. 5 is a flowchart showing the operation of the music selection type content reproduction apparatus of the present invention.
FIG. 6 is a chart showing an example of the contents of the past music viewing history of the viewer.
FIG. 7 is an explanatory diagram showing an example of a personal profile.
FIG. 8 is a chart showing an example of a usable music list provided from a music providing server.
[Explanation of symbols]
100 Music Selection Type Content Playback Device
101 Main control means
102 Reception control means
103 Input control means
104 Output control means
105 Program storage means
106 BGM control code file storage means
107 Available song list storage means
108 Personal profile storage means
109 Viewing history storage means
110 Content decryption means
111 Music decoding means
112 Speech synthesis means
113 User operation control means
150 Video / audio output device
200 Home server
300 Music providing server
400 broadcasting stations
500 Content providing server
600 Billing Management Center
1011 Music reception control means
1012 Music selection means
1013 Personal profile update means
1014 Music list generation means
1015 Validity period judging means
1016 Viewing history update means
NET internet
H-NET home network

Claims (8)

Video / audio content including video and audio, selection information for selecting music to be played back in conjunction with the video / audio content, and the music set along the time axis of the video / audio content A music selection type content playback apparatus for playing back music selection type content including control information including the playback time information of
Based on the selection information, a music piece that is pre-multiplexed with the video / audio content, or a music piece that selects music linked to the video / audio content from a music storage means that stores a plurality of the music pieces. A selection means;
Music decoding means for decoding the music selected by the music selection means based on control information including reproduction time information of the music;
Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal;
Audio synthesis means for synthesizing the music selected by the music selection means and decoded by the music decoding means with the audio signal decoded by the video / audio content decoding means based on the reproduction time information; Prepared,
The control information includes the start time and start method of the music, and the end time and end method of the music,
The video / audio content decoding means or the music decoding means decodes the music selected by the music selection means based on the start time and start method of the music and the end time and end method of the music. A music selection type content reproduction apparatus characterized by the above. A personal profile storage means for storing a personal profile describing the preference information of the viewer's music;
The music selection type content reproduction apparatus according to claim 1, wherein the music selection means selects the music based on the selection information and the preference information. Viewing history storage means for storing a viewer's viewing history;
Personal profile updating means for updating the personal profile based on the viewing history stored in the viewing history storage means;
The music selection type content reproduction apparatus according to claim 1, further comprising: Music reception control means for receiving the music and music information having at least a unique identification number of the music from a music providing server for providing the music, and storing the music in the music storage means;
The music selection content reproduction apparatus according to any one of claims 1 to 3, further comprising: The music information provided from the music providing server includes an effective period in which the music can be used,
Effective period determination means for determining the passage of time of the effective period and prohibiting the reproduction of the music that has passed the effective period;
The music selection type content reproduction apparatus according to claim 4, comprising: The selection information and the music information include music tone information that expresses the atmosphere and music tone of the music in language,
The music selection type content reproduction apparatus according to claim 4 or 5, wherein the music selection means selects the music based on the music tone information. Video / audio content including video and audio, selection information for selecting music to be played back in conjunction with the video / audio content, and the music set along the time axis of the video / audio content A music selection type content playback device that plays back music selection type content including control information including the playback time information and a plurality of songs pre-multiplexed with the video / audio content ,
Music selection means for selecting, based on the selection information included in the music selection type content, the music linked to the video / audio content from the plurality of music pre-multiplexed with the video / audio content ;
Music decoding means for decoding the music selected by the music selection means based on control information including reproduction time information of the music;
Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal;
Wherein selected by the song selection means, has been the music decoded by the music decode means, wherein on the basis of the reproduction time information contained in the music selective contents the video and audio content decryption before Symbol audio signal decoded by the means Voice synthesis means for synthesizing with
The control information includes the start time and start method of the music, and the end time and end method of the music,
The video / audio content decoding means or the music decoding means decodes the music selected by the music selection means based on the start time and start method of the music and the end time and end method of the music. A music selection type content reproduction apparatus characterized by the above. Video / audio content including video and audio, selection information for selecting music to be played back in conjunction with the video / audio content, and the music set along the time axis of the video / audio content Control information including the reproduction time information, and the control information to reproduce the music selection type content including the music start time and start method and the music end time and end method . Computer
Based on the preference information described in the personal profile describing the preference information of the viewer's music, and the selection information, the music recommended by the producer that has been multiplexed in advance on the video / audio content, or a plurality of music Music selection means for selecting music that suits the viewer from the music storage means
A music decoding means for decoding the music selected by the music selection means based on control information including reproduction time information of the music;
Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal;
Audio synthesis means for synthesizing the music selected by the music selection means and decoded by the music decoding means with the audio signal reproduced by the video / audio content reproduction means based on the reproduction time information;
A music selection type content reproduction program characterized in that it functions as a program.

Images