JP2004029324A - Music selection type content reproducing apparatus, its method and program, and music selection type content generation method - Google Patents

Abstract

An object of the present invention is to provide a music selection type content reproduction apparatus that can use, as BGM, music suitable for a viewer's hobbies and preferences when reproducing video / audio contents including video and audio.
A music selection type content including video / audio content and control information including selection information for selecting a music to be reproduced in conjunction with the video / audio content and reproduction time information of the music. A music selection means 1012 for selecting music linked to the video / audio content from a music storage means 200 storing a plurality of music pieces based on the selection information. A video / audio content decoding unit 110 that decodes the video / audio content into a video signal and an audio signal, and decodes the music selected by the music selection unit based on the reproduction time information; And a voice synthesizing unit 112 for synthesizing the voice signal.
[Selection] Fig. 2

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a music selection type content reproduction apparatus, a method and a program thereof, and a music selection type content, in which, when reproducing video / audio content, a music suitable for a viewer's preference is selected and reproduced as BGM (Background Music). Related to generation method.
[0002]
[Prior art]
Conventionally, BGM given to video / audio contents such as television programs and movies is previously synthesized with main audio data such as dialogue by a content creator of the video / audio contents to generate one audio data stream. Was.
Also, there is a technology that reproduces individually recorded audio data at an appropriate timing, synthesizes the reproduced audio data with main audio data in real time, and generates a single audio data stream. I do.
Furthermore, there are various techniques for using video data and metadata, which are information about data, to reorganize video / audio contents in accordance with a viewer's personal profile and to provide them to the viewer. For example, based on a personal profile, video and audio contents in which video and audio are combined are sorted on a time axis into individual fragments, and the individual fragments and text There is a technique for rearranging data, image data, and the like on a screen.
[0003]
[Problems to be solved by the invention]
However, according to the conventional technique, the content creator synthesizes the BGM with the main audio data such as dialogue to generate one audio data stream. I could not separate it. For this reason, there is no means for the viewer to select a music other than the music selected by the content creator as the BGM, and there is a problem that even if the music does not match the taste of the viewer, the music must be passively viewed.
Also, on the content creator side, there is a problem that even if the content creator selects a plurality of BGMs for viewers having different hobbies and tastes, it is necessary to finally use only one.
[0004]
SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems. A music that can be used as a BGM for a music that matches the interests and preferences of a viewer when reproducing video / audio contents including video and audio. It is an object of the present invention to provide a music selection type content reproducing apparatus for reproducing a selection type content, a method therefor, and a program therefor.
It is another object of the present invention to provide a music selection type content generation method for generating the music selection type content.
[0005]
[Means for Solving the Problems]
In order to achieve the above object, a music selection type content reproducing apparatus according to the present invention includes a video / audio content including video and audio, and a selection for selecting a music to be reproduced in conjunction with the video / audio content. A music selection type content reproducing apparatus that reproduces a music selection type content including information and control information including reproduction time information of the music, wherein the music accumulation storing a plurality of the music pieces based on the selection information A music selection means for selecting music linked to the video / audio content, a video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal, and And a voice synthesizing means for decoding the music selected by the music selecting means and synthesizing with the audio signal.
[0006]
According to this music selection type content reproducing device, it is possible to select a music linked to the video / audio content, decode and reproduce the video / audio content together with the reproduction time information, and reproduce the music desired by the viewer. BGM can be synthesized with the main audio and played back together with the video.
[0007]
Further, in the music selection type content reproducing apparatus, the music selection type content reproduction device further includes a personal profile storage unit that stores a personal profile describing preference information of the music of the viewer, wherein the music selection unit is configured to perform the music reproduction based on the selection information and the preference information. I decided to select a song.
[0008]
According to this music selection type content reproducing apparatus, the music selection means can judge the viewer's preference, automatically select the viewer's favorite music, and reproduce it as BGM together with the main audio and video.
[0009]
Further, in the music selection type content reproducing apparatus, a viewing history storing means for storing a viewing history of a viewer, and a personal profile updating means for updating the personal profile based on the viewing history stored in the viewing history storing means. , Is provided.
[0010]
According to the music selection type content reproducing device, personal profile information is automatically created and updated from the music viewing history of the viewer, and music is selected based on the personal profile information. According to the viewer's latest preference, music to be reproduced as BGM together with main audio and video can be automatically selected.
[0011]
Further, in the music selection type content reproducing device, the music and music information having at least a unique identification number of the music are received from a music providing server that provides the music via a communication line, and the music is received. Music receiving control means for storing in the storage means;
[0012]
According to this music selection type content reproducing apparatus, music can be provided from a music providing server via a communication line, and the music can be reproduced together with main audio and video. Can be used for
[0013]
Further, in the music selection type content reproducing device, the music information provided from the music providing server includes a valid period in which the music can be used, and the elapse of the valid period is determined. A valid period determining unit for prohibiting the reproduction of the music whose period has elapsed is provided.
[0014]
According to this, it is possible to use the music provision for commercial purposes by limiting the use period of the music provided from the music provision server.
[0015]
Then, in the music selection type content reproducing device, the selection information and the music information include tune information in which the ambience and tune of the music are expressed in language, and the music selection unit performs, based on the tune information, It was configured to select a song.
[0016]
According to this music selection type content reproducing apparatus, it is possible to select and reproduce, as the BGM, a music that has the mood and tune intended by the creator.
[0017]
Further, the music selection type content reproducing apparatus includes: a video / audio content including a video and an audio; selection information for selecting a music to be reproduced in conjunction with the video / audio content; and reproduction time information of the music. A music selection type content reproducing apparatus for reproducing a music selection type content including control information and a plurality of music pieces, wherein the video / audio content is selected based on the selection information included in the music selection type content. Music selection means for selecting the music linked to the video, audio and video content decoding means for decoding the video and audio content into a video signal and an audio signal, and the reproduction time information included in the music selection type content Speech synthesis means for decoding the music selected by the music selection means based on the sound signal and synthesizing with the audio signal. It was.
[0018]
According to this music selection type content reproducing device, a music linked to the video / audio content is selected from the music included in the content or from another music provider, and is adjusted together with the video / audio content to the reproduction time information. The music can be decoded and reproduced, and the music desired by the viewer can be synthesized as the BGM with the main sound and reproduced together with the video.
[0019]
Further, the music selection type content reproduction method includes a method of reproducing video / audio content including video and audio, selection information for selecting a music to be reproduced in conjunction with the video / audio content, and reproduction time information of the music. A music selection type content reproducing method for reproducing a music selection type content including control information including: decoding a video / audio content into a video signal and an audio signal by decoding the video / audio content; Music that selects a music that suits the viewer's preference from music storage means that stores a plurality of music, based on the preference information described in the personal profile that describes the preference information of the music of the viewer and the selection information. Selecting the music selected in the music selection step based on the reproduction time information, and decoding the video / audio content. It was decided to include a speech synthesis step of synthesizing said speech signal decoded by the reproducing step.
[0020]
According to this music selection type content reproduction method, a music linked to the video / audio content is automatically selected according to the viewer's preference, and decoded and reproduced as BGM together with the video / audio content in accordance with the reproduction time information. It is possible to synthesize the music desired by the viewer as BGM with the main sound and reproduce it together with the video.
[0021]
Further, the music selection type content reproduction program according to the present invention includes a video / audio content including video and audio, selection information for selecting a music to be reproduced in conjunction with the video / audio content, and reproduction of the music. In order to reproduce the music selection type content including the control information including the time information, the computer is caused to function by the following units. That is, based on the preference information described in the personal profile describing the preference information of the music of the viewer and the selection information, the respective means are adapted to the preference of the viewer from the music storage means storing a plurality of music. A music selection means for selecting a music that has been selected; a video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal; and the music selection means selected based on the reproduction time information. An audio synthesizing means for decoding the music and synthesizing the audio signal reproduced by the video / audio content reproducing means.
[0022]
According to this music selection type content reproduction program, it is possible for a computer to select music linked to video / audio content, decode the video / audio content together with the reproduction time information, and reproduce the video / audio content. The music can be synthesized as the BGM with the main audio and played back together with the video.
[0023]
Also, in the music selection type content generation method, in the video / audio content including video and audio, selection information for selecting a music to be reproduced in conjunction with the video / audio content, and reproduction time information of the music Was added.
[0024]
With this music selection type content generation method, it is possible to realize a content in which a music that suits the viewer's preference can be selected and used as BGM on the reproduction side.
[0025]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0026]
(Configuration of music selection type content providing system)
FIG. 1 is a block diagram showing a configuration of a music selection type content providing system using a music selection type content reproduction device of the present invention.
[0027]
In the music selection type content providing system 1 of FIG. 1, the music selection type content reproducing apparatus 100 has a receiving function of receiving a digital broadcast broadcast from the broadcast station 400, and selects a music selection which is a broadcast wave stream input from an antenna. It has a reproduction function of demultiplexing and decoding the type content and sending the decoded video and audio to the video and audio output device 150 to reproduce the video and audio. Furthermore, the music selection type content reproducing apparatus 100 is connected to the home network H-NET, and has a communication function of performing communication via the home network H-NET. The home network H-NET is connected to the Internet NET via a telephone line, an optical fiber, or the like.
[0028]
The home server 200 corresponds to the music storing means described in the claims, and stores the music owned by the viewer. The home server 200 is connected to the home network H-NET and provided from the music providing server 300. It stores music. The home server 200 has a communication function. The home server 200 communicates with other devices connected to the home network H-NET in addition to the music providing server 300, and connects to the home network H-NET and the Internet NET. It can communicate with a plurality of servers on the Internet NET via the Internet.
[0029]
The music providing server 300 is a server that provides music provided on the Internet NET. The music providing server 300 provides the music selection type content reproducing apparatus 100 with a list of available music via the Internet NET and selects a music. When a request to acquire a music is made from the type content reproducing apparatus 100, the data of the music itself is provided.
[0030]
The broadcasting station 400 broadcasts a broadcast program as a data stream using a terrestrial wave directly from an antenna or via a BS / CS satellite.
In the music selection type content providing system 1, the music selection type content can be provided not only by the broadcast wave from the broadcasting station 400 but also by the viewer purchasing the package media at the store. Furthermore, it is also possible to receive provision by download from the content provision server 500 on the Internet NET.
[0031]
The content providing server 500 is a server provided on the Internet NET for providing content including the music selection type content, and provides the content to the music selection type content reproducing apparatus 100 via the Internet NET. It is.
[0032]
The charging management center 600 performs charging management of the music provided from the music providing server 300 on the Internet NET. The charging management center 600 also performs charging management of the content provided from the content providing server 500.
[0033]
For example, when the music selection type content reproducing apparatus 100 reproduces the music selection type content, the music provided from the music providing server 300 and used as the BGM is stored in the home server 200, and the reproduction of the music selection type content is performed. After that, during the free usage period set in advance for each music, the viewer can freely watch and listen to the charge management center 600 via the Internet NET and pay the specified amount. Alternatively, the music may be freely used beyond the free usage period for the first time. As described above, the charge management center 600 is in charge of charge management between the viewer and the music copyright holder. It is also possible to perform charge management on the content itself.
[0034]
(Configuration of music selection type content playback device)
Next, the configuration of the music selection type content reproduction apparatus 100 will be described with reference to FIG. FIG. 2 is a block diagram showing the configuration of the music selection type content reproducing apparatus 100.
[0035]
As shown in FIG. 2, the music selection type content reproducing apparatus 100 includes a main control unit 101, a reception control unit 102, an input control unit 103, an output control unit 104, a program storage unit 105, and a BGM control code file. Storage means 106, available music list storage means 107, personal profile storage means 108, viewing history storage means 109, content decoding means 110, music decoding means 111, voice synthesis means 112, user operation control means 113 And a configuration including:
[0036]
The main control unit 101 controls each unit of the music selection type content reproducing apparatus 100 and transfers data between the units, and is configured by a CPU, a memory, and the like. The main control unit 101 includes a music reception control unit 1011, a music selection unit 1012, a personal profile update unit 1013, a music list generation unit 1014, a validity period determination unit 1015, and a viewing history update unit 1016.
Each unit of the main control unit 101 is stored as a program in the program storage unit 105, and is read out from the main control unit 101 and executed at the time of execution.
[0037]
Here, the music reception control means 1011 communicates with the music provision server 300 provided on the Internet NET, and matches the audience's preference with available music based on the contents of the BGM control code file storage means 106. A request for a music list is made to the music providing server 300 on the Internet NET, the obtained available music list is stored in the available music list storage means 107, or a home server connected to the home network H-NET It has a function of instructing to receive necessary music from a music providing server 300 provided on the Internet NET by communicating with the Internet 200.
[0038]
The music selection means 1012 has a function of selecting and acquiring a target music from the music stored in the home server 200 on the home network H-NET and providing the music to the music decoding means 111 for reproduction. ing.
[0039]
The personal profile updating unit 1013 has a function of creating personal profile data as a basis for determining a viewer's “liking” and storing the personal profile data in the personal profile storage unit 108. The personal profile can be formed by the viewing history updating unit 1016 based on the viewing history stored in the viewing history storage unit 109. However, the user is required to manually set his / her favorite category or artist name. Can also be created.
[0040]
The music list generation unit 1014 creates a music list that spans a plurality of music distribution servers 300 based on the available music list obtained by the music reception control unit 1011 communicating with the music distribution server 300 on the Internet NET. And has a function of storing in the available music list storage means 107.
[0041]
The validity period determining unit 1015 determines the lapse of the usable validity period of the music based on the validity period of the music information stored in the available music list storage unit 107, and prohibits the reproduction of the music after the validity period. I do. In addition, it has a function of displaying a song whose free viewing period has passed and asking the user whether to purchase the song.
[0042]
The viewing history update unit 1016 forms viewing history information including, for example, the number of times the viewer has viewed what kind of music and how many times in the past, for example, for each song and for each artist. It has the function of storing. At this time, instead of focusing only on the number of times of viewing in the past, it is possible to reflect the latest "liking" of the viewer in the personal profile by adding a process such as weighting the recently viewed song. .
[0043]
The reception control means 102 receives the music selection type content (data stream) and separates it into an encoded video (video), an encoded audio (main audio), an encoded music (BGM), and a BGM control file (control information). Is what you do.
Here, the configuration of the music selection type content (data stream) will be described with reference to FIG. FIG. 3A shows a configuration of a conventional data stream, and FIG. 3B shows a configuration of a data stream of the present invention.
As shown in FIG. 3A, the conventional audio is provided in a state where BGM corresponding to each cut (Cut1 to Cut6) of the video is synthesized with the main audio (main audio). For this reason, the main voice and the BGM cannot be separated, and it is physically impossible for the viewer to change the BGM to his favorite music.
[0044]
On the other hand, in the present invention, the music selection type content provided by the content provider is provided to the video / audio output device 150 in a state where the content is separated into main audio and BGM as shown in FIG. I can do it. Further, FIG. 3B shows that the music selection type content is provided with a plurality of BGMs at the same time of the same cut in addition to the main sound. Here, an example is shown in which three types of BGM music groups, a music group A composed of classical music and a music group C composed of rock music, are provided as a data stream from a broadcasting station, a music group A composed of classical music, and a music group C composed of rock music. Further, as BGM provided from the home server 200 or the music providing server 300, BGM1 to BGM5 can be similarly used as BGM.
Although FIG. 3 does not describe a BGM control file (control information), the BGM control file is provided at the beginning of the music selection type content or before the BGM is output as audio.
Returning to FIG. 2, the description will be continued.
[0045]
The input control means 103 and the output control means 104 are provided with the home server 200 via the home network H-NET, and the music providing server 300 on the Internet NET via the home network H-NET and the Internet NET, and the content provision. It communicates with the server 500 or the billing management center 600.
The program storage unit 105 is a storage unit for storing a program, and is configured by a general storage unit such as a hard disk. The program stored in the program storage unit 105 is read and executed by the main control unit 101.
[0046]
The BGM control code file storage means 106 temporarily stores a BGM control file, and is configured by a general memory or the like.
Here, the contents of the BGM control file will be described with reference to FIG. FIG. 4 shows an example of the BGM control file.
As shown in FIG. 4, the BGM control file includes an identification number (BGM No.) for identifying the BGM, a BGM start time and a start method thereof at the time of content reproduction, a BGM end time and a BGM end method. Tune information “expression” that expresses the atmosphere and tune of the BGM in language.
[0047]
For example, BGM No. BGM No. 1 starts reproduction with a fade-in at the same time as the start of the content reproduction (00: 00: 00: 00), ends reproduction with a fade-out after 4 minutes and 30 seconds (04:30:00), and BGM No. 2 BGM indicates that the reproduction starts with a cut-in 5 minutes and 30 seconds after the content reproduction (05:30:00), and ends with a cut-out at 8 minutes 30 seconds (08:30:00). ing. In addition, when performing playback with a playback effect such as fade-out, the BGM control file can include detailed control information such as how long the fade-out takes.
The method of using the tune information “expression” will be described later.
Returning to FIG. 2, the description will be continued.
[0048]
The available music list storage unit 107 stores list information (music list) of available music (BGM), and is configured by a general memory or the like. The available music list storage unit 107 allows the music reception control unit 1011 to transmit a list of available songs that match the viewer's preference to the music providing server 300 on the Internet NET based on the contents of the BGM control file. Request, and stores the available music list that is the result of the request.
[0049]
The personal profile storage unit 108 stores a personal profile describing preference information of a viewer for music, and is configured by a general memory or the like. This personal file describes, for example, a genre (category), an artist, or a plurality of genres, an artist's rank, and the like that the viewer likes.
[0050]
The viewing history storage unit 109 stores the viewing history of the music that the viewer has viewed in the past, and is configured by a general memory or the like. For example, it stores the number of times that the viewer has viewed the music itself, the number of times that the music has been viewed by genre (category), the number of times that the music has been viewed by each artist, and the like. The viewing history storage unit 109 is updated by the viewing history updating unit 1016.
[0051]
The content decoding unit 110 (video / audio content decoding unit) decodes the encoded video, encoded audio (main audio), encoded music (BGM), and BGM control file received by the reception control unit 102 and separated. Things. The content decoding unit 110 decodes the encoded video and outputs it to the video / audio output device 150 as a video signal. The coded voice (main voice) and the coded music (BGM) are decoded and output to the voice synthesis unit 112 as a main voice signal and a music voice signal. The BGM control file received and separated by the reception control means 102 is stored in the BGM control code file storage means 106.
[0052]
The music decoding means 111 decodes the music (BGM) selected by the music selection means 1012 of the main control means 101 and obtained from the home server 200 to generate a music sound signal. The music sound signal decoded by the music decoding means 111 is output to the sound synthesis means 112.
[0053]
The audio synthesizing unit 112 synthesizes the main audio signal decoded by the content decoding unit 110 and the music audio signal decoded by the content decoding unit 110 or the music audio signal decoded by the music decoding unit 111, and generates an audio signal. The output is to the video / audio output device 150.
The voice synthesizing unit 112 is instructed by the music selecting unit 1012 of the main control unit 101 to use the output of the content decoding unit 110 or the music decoding unit 111 as the music sound signal. In addition, voice synthesis is performed with an appropriate mixing amount in accordance with an instruction from the main control unit 101.
[0054]
The user operation control unit 113 controls operations such as a change of a music selection mode, a change in volume, and a sound balance adjustment between the main sound and the BGM by the viewer. The music selection mode includes a normal mode for directly reproducing the BGM provided by the content provider, a content music selection mode for selecting one of the BGMs in a data stream provided by the content provider, and selection of a viewer-specific BGM. There is a music automatic selection mode that is given by adding. The processing for these modes will be described later.
[0055]
As described above, the configuration of the music selection type content reproducing apparatus 100 has been described based on one embodiment, but the present invention is not limited to this. For example, the music selection type content reproduction device 100 may be configured to incorporate a music storage means for storing the music provided from the music providing server 300.
Further, in the music selection type content reproducing apparatus 100, each means in the computer can be realized as each function program, and each function program can be combined and operated as a music selection type content reproduction program.
[0056]
(Operation of the music selection type content playback device)
Here, the operation of the music selection type content reproducing apparatus 100 will be described with reference to the flowchart of FIG.
In step S101, if the viewer has selected the normal mode for playing back the BGM recommended by the maker provided by the content provider (YES), the music selection unit 1012 automatically selects the tune recommended by the creator in step 102. In the example of FIG. 3B, the music group A is selected as BGM. In this case, since the music reproduction procedure is set in advance, in step S103, this music group is synthesized with the main audio by the voice synthesizing means 112 so as to match the reproduction of the video portion of the content, and the video is reproduced in step S104. The audio is reproduced by the video / audio output device 150.
[0057]
In the example of FIG. 3B and FIG. 4, BGM No. The reproduction of the first tune (BGM1A) is started with fade-in, and the reproduction of this tune is ended with fade-out four and a half minutes after the start of content viewing. Subsequently, the BGM No. 5 minutes and 30 seconds after the content viewing start time. The second song (BGM2A) is started to be reproduced by cut-in, and the reproduction is ended by cut-out 8 minutes and 30 seconds after the content viewing start time. In this way, by presenting the content to the viewer while mixing the music of each BGM with the main voice in real time, the viewer can view the content in the normal mode in exactly the same manner as in the conventional case. Can be.
[0058]
In step S101, the viewer does not select the normal mode (No in S101), and in step S105, the viewer selects the content music selection mode for selecting any of the BGMs in the data stream provided by the content provider. In this case (YES in S105) or in step S105, the viewer has selected the automatic music selection mode in which the viewer's own BGM is selected, but in step S107, the music selection type content reproducing apparatus 100 sets the home network H- When it is not possible to communicate with the home server 200 or the music providing server 300 via the NET (No in S107), one of the music in the data stream provided from the content provider is selected as BGM in step S106. In this case, if it is known from the personal profile of the viewer that the viewer prefers classical music, for example, in FIG. 2 and FIG. A music group B composed of music is selected as BGM, the main sound is synthesized with the sound synthesizing means 112 in step S103, and the video / audio is reproduced by the video / audio output device 150 in step S104.
[0059]
When the viewer has selected the automatic music selection mode in which the viewer's own BGM is selected and assigned (No in S105), in step S107, the music reception control means 1011 of the main control means 101 sets the input control means 103, It is confirmed whether communication with the home server 200 is possible via the output control means 104 and the home network H-NET. Then, when communication with the home network H-NET is possible and there is no other restriction (YES in S107), in step S108, the reception control unit 102 once receives the music selection type content and decrypts the content. After decoding by the means 110, the BGM control file is stored in the BGM control code file storage means 106. Further, in step S109, it is confirmed whether or not communication with the music providing server 300 is possible via the Internet NET.
[0060]
If it is possible to communicate with the music providing server 300, in step S110, the music selecting means 1012 of the main control means 101 uses the BGM control file (see FIG. 4) stored in the BGM control code file storage means 106 as a basis. Then, the tune information “expression” of the tune to be used is referred to. Further, the music selection unit 1012 stores the BGM music provided together with the content from the content provider, the music stored in the home server 200, and the available music list storage unit 107 provided from the music providing server 300. From the available songs in the available song list, a song that matches the tune information and most closely matches "viewer preference" is selected as a song to be used for BGM. Here, the “viewer preference” is used by the personal profile updating unit 1013 of the main control unit 101 to determine which genre of music the viewer is listening to from the viewing history of the music that the viewer has viewed in the past. Whether or not the audience listens to music of various artists is determined by the data held in the personal profile storage unit 108 as the latest personal profile of the audience, and the selection of the music is determined based on this data. Done.
[0061]
In step S110, when selecting and using music that matches the viewer's preference from the music available as BGM provided from the music providing server 300 on the Internet NET, the music reception control means 1011 of the main control means 101 In step S111, communication with the home server 200 and the music providing server 300 is performed via the output control means 104, the home network H-NET, and the Internet NET, and music is provided via the Internet NET, the home network H-NET, and the input control means 103. The music data sent from the server 300 is once taken into the home server 200 and stored.
Then, in step S113, as the decoding and reproduction of the content by the content decoding means 110 progress, the start and end times of the music data are adjusted based on the information of the BGM control code file as shown in FIG. , Processing is performed while adding a reproduction effect such as fade-out and the like, decoded by the music decoding means 111, synthesized in step S103 by the main sound and the sound synthesis means 112, and output to the video / audio output device 150 as an audio signal. In S104, the video and audio output device 150 reproduces the data.
[0062]
In step S110, from the music pieces owned by the viewer stored in the home server 200, a music piece that matches the tune information of the BGM control code file and that can be used as BGM and matches the viewer's preference is selected. In the case of reproduction, in step S112, the music selection means 1012 of the main control means 101 communicates with the home server 200 via the home network H-NET via the output control means 104 to select a music, and The music data transmitted from the home server 200 via the input control means 103 via the H-NET is obtained. Then, the process proceeds to step S113, in which start and end times are adjusted, processing is performed while adding a reproduction effect, decoded by the music decoding unit 111, synthesized by the main voice and the voice synthesis unit 112 in step S103, and video is synthesized in step S104. The sound is reproduced by the audio output device 150.
[0063]
Although the viewer has selected the automatic music selection mode in which the viewer's own BGM is selected and selected, in step S107, the music reception control means 1011 of the main control means 101 for some reason via the home network H-NET. If communication with the home server 200 is not possible (No in S107), the process proceeds to step S106, and thereafter, the same processing as in the content music selection mode is performed. Also, in step S110, when a music piece is selected from the music pieces in the content, the process proceeds to step S106, and the same processing is performed.
In step S109, if the music reception control unit 1011 of the main control unit 101 cannot communicate with the music providing server 300 via the home network H-NET and the Internet NET for some reason (No in S109), the process proceeds to step S112. After that, the same processing as when selecting from the music pieces stored in the home server 200 is performed.
[0064]
In step S110, when using the music provided from the music providing server 300 on the Internet NET, the music receiving control means 1011 of the main control means 101 requests the music providing server 300 in advance and converts the music data into BGM. It is acquired before use and stored in the home server 200. As a result of such processing, all music pieces that can be used as BGM are temporarily stored in the music piece selection type content reproducing apparatus 100 and the home server 200, and can be reproduced at any time. The main control means 101 reproduces the selected music pieces sequentially, while adding a reproduction effect such as fade-in or fade-out as occasion demands, based on the information of the BGM control code file shown in FIG. As a result, it is possible to reproduce and present to the viewer the content in which the favorite music of the viewer is used as the BGM.
It should be noted that the music data provided by the music providing server 300 has been described as being acquired and stored in advance before using the music data, but may be obtained as long as it can be acquired immediately before the timing of playing back as BGM. Normally, even if there is some delay in the reproduction of BGM, there is often no problem, and it is not impossible to reproduce the content while acquiring it during reproduction.
[0065]
Next, a description will be given of a method of creating a personal profile serving as a basis for determining a viewer's “preference”. FIG. 6 shows an example of a viewer's past music viewing history as a reference for the viewing history updating means 1016 of the main control means 101 to create personal profile data. In FIG. 6, the “expression” in the second column indicates what kind of atmosphere each viewed music has. In this system, it is determined in which scene the music can be used for BGM based on the content indicated in the item of “expression”. It is assumed that the display contents of the "expression" item are provided by a music sales company that provides the music or set by the viewer himself. Further, information such as “category large” indicating a large category and “category small” indicating the details of a category is also assumed to be provided from a music sales company that provides music.
[0066]
As shown in FIG. 6, the music viewing history includes viewing history information indicating what kind of music the viewer has viewed in the past and how many times. This viewing history information is information in which the viewing history (for example, the number of times of viewing by music and by artist) of the music owned by the viewer is recorded up to that point. From this viewing history, a personal profile is created as shown in FIG. This personal profile is created with reference to a music viewing history, an artist viewing history, and the like. In addition to the past viewing history, it is also possible to adjust the personal profile data by manually setting a favorite category or artist name by the viewer himself.
[0067]
On the basis of such personal profile data, the music selection means 1012 of the main control means 101 selects a music piece, a music piece in a data stream provided by a content provider, and a viewer in the home server 200. From the music and the music provided from the music providing server 300 on the Internet NET, the “expression” that matches the “favoriteness” of the viewer and is appropriate as BGM in producing the atmosphere of each scene in the content Select a song that corresponds to. At the time of music selection, the length for selecting each music must also be considered, and a music having a sufficient music length as BGM of the scene is selected according to the contents of the BGM control code file.
[0068]
Next, the contents of the available music list provided from the music providing server 300 on the Internet NET and the operation when the viewer purchases music will be described. FIG. 8 is an example of a list obtained by editing the available music list provided from the music providing server 300 on the Internet NET by the music list generation means 1014 in response to a request from the music reception control means 1011 of the main control means 101. is there. In this example, the music selection means 1012 of the main control means 101 selects a music having a "fun" atmosphere and belonging to a favorite category of a viewer for a scene having a "fun" atmosphere. 13 is an example of a list of available songs provided by the song providing server 300 as a result of requesting the song providing server 300 for a song list by a favorite artist of the music artist.
[0069]
At the time of music selection, the music selection means 1012 of the main control means 101 selects, as the BGM, the music that best matches the viewer's “favorite” from the music in the list and the music owned by the viewer in the home server 200. select. Of the selected songs provided by the song providing server 300, the song receiving control unit 1011 of the main control unit 101 requests the song providing server 300 in advance and reproduces the song data itself as BGM. It is acquired and stored in advance before the timing. The selected music is reproduced as BGM at an appropriate timing while viewing the content.
[0070]
Regarding the music provided from the music providing server 300 and used as the BGM, the viewer can freely view and enjoy the music as a single music during the free viewing period even after the end of the content viewing. Then, after the free viewing period ends, the reproduction is automatically stopped by the operation of the validity period determining unit 1015. The valid period determination unit 1015 has a role of displaying a list of songs whose free viewing period is about to end or songs whose free viewing period has ended, to notify the viewer. If the viewer likes the music played as BGM and wants to purchase the right to view it, it is possible to make an online purchase via the Internet NET. At this time, as shown in FIG. 8, the price of the music and the URL (Uniform Resource Locator: notation for specifying a location on the web) of the charging management center to be contacted at the time of purchase are listed in the available music list as shown in FIG. Is included as information. As a result, the present system has a music selling function in addition to providing BGM.
[0071]
As described above, the music selection type content reproducing apparatus according to the present invention has been mainly described. However, the music selection providing method executed by the present apparatus, the music selection providing program for causing the CPU to realize the music selection providing method, and the music selecting type A content generation method is also an object of the present invention.
[0072]
【The invention's effect】
As described above, in the music selection type content reproducing apparatus according to the first aspect of the present invention, it is possible to select a music linked to the video / audio content, decode the video / audio content together with the reproduction time information, and reproduce the same. It is possible to synthesize various music as BGM with the main audio and play it together with the video.
[0073]
In the music selection type content reproducing apparatus according to the second aspect of the present invention, since the music selection means stores the personal preference information of the viewer as a personal profile, the preference of the viewer is determined based on the personal profile. Favorite music can be automatically selected and played as BGM along with main audio and video.
[0074]
In the music selection type content reproducing apparatus according to claim 3 of the present invention, personal profile information is automatically created and updated from the music viewing history of the viewer, and music is selected based on the personal profile information. The selecting means can automatically select the music to be reproduced as BGM together with the main audio and video according to the latest preference of the viewer.
[0075]
In the music selection type content reproducing apparatus according to a fourth aspect of the present invention, music is provided from a music providing server via a communication line, and the music can be reproduced together with main audio and video. From the many songs from the appropriate audience favorite songs can be used for BGM.
[0076]
In the music selection type content reproducing apparatus according to the fifth aspect of the present invention, by limiting the period during which music can be used free of charge, unlimited use can be suppressed and music distribution can be made commercially available.
[0077]
In the music selection type content reproducing apparatus according to claim 6 of the present invention, since the selection information and the music information include information indicating the mood and tune of the tune, the user selects a tune that matches the mood and tune intended by the creator. It can be used as BGM.
[0078]
In the music selection type content reproducing apparatus according to claim 7 of the present invention, music linked to video / audio content is selected widely from music included in the content or music from other music providers, and The content can be decoded and reproduced together with the audio content in accordance with the reproduction time information, and the music desired by the viewer can be synthesized as BGM with the main audio and reproduced together with the video. Even when there is a problem in the communication system, BGM can be selected from a plurality of music pieces.
[0079]
According to the music selection type content reproduction method according to the eighth aspect of the present invention, it is possible to automatically select the music to be reproduced in conjunction with the video and the main audio included in the content according to the viewer's preference. Therefore, the music selected according to the viewer's preference can be viewed together with the video as BGM.
[0080]
According to the tune selection type content reproduction program of the ninth aspect of the present invention, the computer selects a tune linked to the video / audio content according to the viewer's preference, and sets the tune along with the reproduction time information together with the video / audio content. The music can be decoded and played back, and the user's favorite music can be viewed together with the video as BGM.
[0081]
According to the music selection type content generation method of the tenth aspect of the present invention, since the content includes the selection information for selecting the music and the reproduction time information, the clue for viewing the music as BGM together with the video is provided. Obtained easily.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a music selection giving system using a music selection type content reproduction device of the present invention.
FIG. 2 is a block diagram showing a configuration of a music selection type content reproduction device of the present invention.
FIG. 3 is a configuration diagram showing a configuration of a content data stream.
FIG. 4 is a chart showing an example of information of a BGM control code file of the present invention.
FIG. 5 is a flowchart showing the operation of the music selection type content reproduction device of the present invention.
FIG. 6 is a table showing an example of the contents of a past music viewing history of a viewer.
FIG. 7 is an explanatory diagram showing an example of a personal profile.
FIG. 8 is a table showing an example of an available music list provided from a music providing server.
[Explanation of symbols]
100 Music selection type content reproducing apparatus
101 Main control means
102 Reception control means
103 input control means
104 output control means
105 Program storage means
106 BGM control code file storage means
107 Available music list storage means
108 Personal profile storage means
109 viewing history storage means
110 Content decryption means
111 Music decoding means
112 voice synthesis means
113 User operation control means
150 Video / audio output device
200 home server
300 music providing server
400 broadcasting stations
500 contents providing server
600 Billing Management Center
1011 Music reception control means
1012 Music selection means
1013 Personal profile updating means
1014 Music list generation means
1015 Validity period determination means
1016 Viewing history update means
NET Internet
H-NET home network

Claims (10)

Music selection including video / audio content including video and audio, and selection information for selecting a music to be reproduced in conjunction with the video / audio content, and control information including reproduction time information of the music. A music selection type content reproducing apparatus for reproducing type content,
Music selection means for selecting music linked to the video / audio content, from music storage means storing the plurality of music pieces based on the selection information;
Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal,
Based on the reproduction time information, decodes the music selected by the music selection means, and synthesizes the audio signal with the audio signal;
A music selection type content reproducing apparatus, comprising: Comprising personal profile storage means for storing a personal profile describing taste information of the music of the viewer,
The music selection type content reproducing apparatus according to claim 1, wherein the music selection unit selects the music based on the selection information and the preference information. Viewing history storage means for storing the viewing history of the viewer;
Personal profile update means for updating the personal profile based on the viewing history stored in the viewing history storage means;
3. The music selection type content reproducing apparatus according to claim 2, comprising: From a music providing server that provides the music, receives the music via a communication line and music information having at least a unique identification number of the music, music reception control means to accumulate in the music accumulation means,
The music selection content reproducing apparatus according to any one of claims 1 to 3, further comprising: The music information provided from the music providing server includes a valid period in which the music can be used,
Validity period determining means for determining the lapse of time of the validity period and prohibiting the reproduction of music having passed the validity period,
The music selection type content reproducing apparatus according to claim 4, comprising: The selection information and the music information include tune information in which the atmosphere and tune of the music are linguistically expressed,
The music selection type content reproduction apparatus according to claim 4, wherein the music selection unit selects the music based on the music information. Video / audio content including video and audio, control information including selection information for selecting a song to be reproduced in conjunction with the video / audio content and reproduction time information of the song, and a plurality of songs, A music selection type content reproducing apparatus for reproducing a music selection type content including
Music selection means for selecting the music linked to the video / audio content, based on the selection information included in the music selection type content,
Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal,
Based on the reproduction time information included in the music selection type content, decodes the music selected by the music selection means, and synthesizes the sound signal with the audio signal;
A music selection type content reproducing apparatus, comprising: Music selection including video / audio content including video and audio, and selection information for selecting a music to be reproduced in conjunction with the video / audio content, and control information including reproduction time information of the music. A music selection type content reproducing method for reproducing type content,
A video / audio content decoding step of decoding the video / audio content into a video signal and an audio signal,
Based on the preference information described in the personal profile describing the preference information of the music of the viewer and the selection information, select a music suitable for the viewer's preference from the music storage means storing a plurality of music. Song selection step,
An audio synthesizing step of decoding the music selected in the music selection step based on the reproduction time information and synthesizing with the audio signal decoded in the video / audio content reproduction step;
A music selection type content reproducing method characterized by including: Music selection including video / audio content including video and audio, and selection information for selecting a music to be reproduced in conjunction with the video / audio content, and control information including reproduction time information of the music. To play the type content, the computer
Based on the preference information described in the personal profile describing the preference information of the music of the viewer and the selection information, select a music suitable for the viewer's preference from the music storage means storing a plurality of music. Music selection means,
Video / audio content decoding means for decoding the video / audio content into a video signal and an audio signal,
Audio synthesis means for decoding the music selected by the music selection means based on the reproduction time information and synthesizing with the audio signal reproduced by the video / audio content reproduction means;
A music selection type content reproduction program characterized by functioning as a program. A piece of music, characterized by adding, to video / audio content including video and audio, selection information for selecting a piece of music to be played in conjunction with the video / audio content, and reproduction time information of the piece of music. Selective content generation method.

Images