HK1093800B - Content distributing server and content distributing method - Google Patents

Description

Content distribution server and content distribution method

Technical Field

The present invention relates to a content distribution server and a content distribution method for distributing musical composition content to a terminal apparatus such as a cellular mobile phone, the terminal apparatus, and a content distribution program executed by a computer.

Background

Conventionally, a server that distributes content (multimedia data) composed of a plurality of media data such as images, sounds, character strings, and the like that can be reproduced and output by sound emission, visual display, and the like to a terminal apparatus is known. Generally, multimedia data is only provided for the user of the terminal device to view, and thus, for example, the user cannot edit the multimedia data. In order to eliminate such difficulties, a technique of providing multimedia data as a template so that a user can edit the multimedia data to some extent has been proposed.

For example, the server disclosed in japanese unexamined patent publication (Kokai) No.2004-007407 distributes a multimedia template file, in which multimedia data is associated with editing operation setting data that specifies a manner of editing the multimedia data, to a terminal apparatus such as a cellular mobile phone. The individual user operates the terminal apparatus to perform editing in which the template file can be modified within a range allowed by the editing operation setting data. For example, the user may select an image to be reproduced at a predetermined timing from among a plurality of images and replace media data set to be reproduced at the predetermined timing with other media data.

However, with the server disclosed in japanese unexamined patent publication (Kokai) No.2004-007407, the user of the terminal device can select and replace the text and image of the template with other text and image, but cannot dynamically modify the template itself. Therefore, the distribution service provided by this server is not distinguished from the so-called congratulatory service. Further, it is common that musical composition data distributed to the user of the terminal device is restricted from being distributed and modified again, and thus musical compositions employed in the congratulatory service are restricted, and the user of the terminal device cannot always obtain a template including a desired musical composition.

Therefore, the problem is: in fact, it is difficult for the user to appropriately reproduce a desired moving video picture or the like in parallel and in correspondence with the reproduction of a desired musical piece. For example, there may be a case where if a musical piece or a moving video picture of the template is modified, the reproduction time length of the musical piece does not coincide with the reproduction time length of the moving video picture or the like. Also, there may be a case where the musical composition and the moving video picture or the like do not match in content, for example, the tune of the musical composition is fast, and the tone of the moving video picture or the like is dull or passive.

As described above, the conventional content distribution server has a problem that it is difficult for the user of the terminal device to display a desired moving video picture in conformity with reproduction of a desired musical piece.

Disclosure of Invention

An object of the present invention is to provide a content distribution server and a content distribution method that enable a terminal apparatus to reproduce desired display content in time in correspondence with reproduction of a desired musical piece, and a content distribution program executed by a computer.

In order to achieve the above object, in a first aspect of the present invention, there is provided a content distribution server including: a musical piece storage means that stores a plurality of musical piece contents each specifying a musical tune event sequence including musical tune event information; a template storage means that stores a plurality of template contents, each of which specifies a display control event sequence including display control event information; a communication device that communicates with at least one terminal device; musical piece identifying means for identifying one musical piece content from among the plurality of musical piece contents stored in the musical piece storing means in response to a request from a terminal apparatus through the communication means; template identification means for identifying one template content from among the plurality of template contents stored in the template storage means in response to a request from a terminal device through the communication means; time length adjusting means for adjusting the length of the reproduction time of the template content identified by the template identifying means, in accordance with the length of the reproduction time of the musical piece content identified by the musical piece identifying means; a synthesized content generating means for generating synthesized content by adding the template content, the reproduction time length of which has been adjusted by the time length adjusting means, to the musical piece content identified by the musical piece identifying means; and a content distribution means that distributes the composite content generated by the composite content generation means to a terminal apparatus through the communication means.

With the above-described structure, the terminal apparatus can reproduce desired display contents in time in correspondence with reproduction of a desired musical piece.

Preferably, the content distribution server includes: list providing means for creating a template list including at least one template content candidate that can be added to the identified musical piece content in response to a template content addition request from the terminal device through the communication means, and transmitting the created template list to the terminal device.

More preferably, the musical piece contents include lyrics tracks, and the list provision means extracts at least one word from the lyrics tracks of the musical piece contents recognized by the musical piece recognition means and selects at least one template content candidate based on the extracted word to create the template list.

Alternatively, the list provision means analyzes the musical tune characteristics of the musical piece contents identified by the musical piece identification means, and selects at least one template content candidate according to the analysis result to create a template list.

According to the preferred configuration, template contents suitable for the theme of music can be easily selected.

Preferably, each of the plurality of template contents includes a reproduction section including a first reproduction section in which a reproduction speed needs to be maintained at a constant speed and a second reproduction section in which the reproduction speed does not need to be maintained at the constant speed, and the time length adjustment means changes only a reproduction time length of the second reproduction section of the template content identified by the template identification means, thereby adjusting the entire reproduction time length of the identified template content.

More preferably, the reproduction section of each of the plurality of template contents is divided into a front section, an intermediate section and a rear section by time, the front section and the rear section being the first reproduction section and the intermediate section being the second reproduction section, and the time length adjustment means changes only the reproduction time length of the intermediate section of the template content recognized by the template recognition means, thereby adjusting the entire reproduction time length of the recognized template content.

More preferably, the reproduction time length of the intermediate section is changed by changing the reproduction time length of at least one piece of display control event information included at least partially in the intermediate section of the template content identified by the template identifying means among the display control event information constituting the display control event sequence specified by the identified template content so that the display end time of the display control event information matches the end time of the intermediate section.

Alternatively, the reproduction time length of the intermediate portion is changed by changing the display start time and the lifetime of at least one piece of display control event information included at least partially in the intermediate portion of the template content recognized by the template recognition means, among the display control event information constituting the display control event sequence specified by the recognized template content.

Alternatively, the reproduction time length of the intermediate section is changed by changing the display start time, the lifetime (lifetime), and the time parameter of at least one piece of display control event information included at least partially in the intermediate section of the template content recognized by the template recognition means, among the display control event information constituting the display control event sequence specified by the recognized template content.

Alternatively, the reproduction time length of the intermediate portion is changed by repeatedly displaying at least one piece of display control event information at least partially included in the intermediate portion of the template content recognized by the template recognition means among the display control event information constituting the display control event sequence specified by the recognized template content.

According to these preferred configurations, it is possible to prevent the influence on the display content corresponding to the introduction, termination, and the like of the musical piece content.

Preferably, the content distribution server includes: a musical composition distributing means for individually distributing the musical composition contents identified by the musical composition identifying means to a terminal apparatus; a distribution result management means that manages a distribution result of the musical piece distribution means and a distribution result of the content distribution means for each of at least one terminal apparatus; and a charging means that charges a fee in accordance with the distribution result managed by the distribution result management means, wherein the charging means charges a fee for distribution of the musical composition content in response to the musical composition distribution means distributing the musical composition content alone.

More preferably, in the case where the content distribution means distributes the synthesized content, a fee is charged for the distribution of the identified musical piece content and the distribution of the template content added to the identified musical piece content when the musical piece content identified by the musical piece identification means is not the musical piece content distributed in the past, and a fee is charged for only the distribution of the added template content when the musical piece content identified by the musical piece identification means is the musical piece content distributed in the past.

According to these preferred structures, musical piece content can be easily used in combination with existing services.

In order to achieve the above object, in a second aspect of the present invention, there is provided a content distribution method for a content distribution server including: a musical piece storage means that stores a plurality of musical piece contents each specifying a musical tune event sequence including musical tune event information; a template storage means that stores a plurality of template contents, each of which specifies a display control event sequence including display control event information; and a communication device that communicates with at least one terminal device, the content distribution method including: a musical piece identifying step of identifying one musical piece content from among a plurality of musical piece contents stored in the musical piece storing means in response to a request from a terminal apparatus through the communication means; a template identification step of identifying one template content from a plurality of template contents stored in the template storage means in response to a request from a terminal device through the communication means; a time length adjusting step of adjusting the reproduction time length of the template content identified in the template identifying step, in accordance with the reproduction time length of the musical piece content identified in the musical piece identifying step; a synthesized content producing step of producing synthesized content by adding the template content, the reproduction time length of which has been adjusted in the time length adjusting step, to the musical piece content identified in the musical piece identifying step; and a content distribution step of distributing the composite content generated in the composite content generation step to a terminal apparatus through the communication apparatus.

Preferably, the content distribution method includes: a list providing step of creating a template list including at least one template content candidate that can be added to the identified musical piece content in response to a template content addition request from the terminal apparatus through the communication apparatus, and transmitting the created template list to the terminal apparatus.

Preferably, each of the plurality of template contents includes a reproduction section including a first reproduction section in which a reproduction speed needs to be maintained at a constant speed and a second reproduction section in which the reproduction speed does not need to be maintained at the constant speed, and in the time length adjustment step, only a reproduction time length of the second reproduction section of the template content identified in the template identification step is changed, thereby adjusting the entire reproduction time length of the identified template content.

Preferably, the content distribution method includes: a musical composition distributing step of individually distributing the musical composition contents identified in the musical composition identifying step to a terminal apparatus; a distribution result management step of managing, for each of at least one terminal apparatus, a distribution result in the musical piece distribution step and a distribution result in the content distribution step; and a charging step of charging a fee in accordance with the distribution result managed in the distribution result managing step, wherein in the charging step, a fee is charged for distribution of the musical piece contents in response to the musical piece contents being distributed individually in the musical piece distributing step.

More preferably, in the case where the synthesized content is distributed in the content distribution step, a fee is charged for the distribution of the identified musical piece content and the distribution of the template content added to the identified musical piece content when the musical piece content identified in the musical piece identification step is not a musical piece content distributed in the past, and a fee is charged for only the distribution of the added template content when the musical piece content identified in the musical piece identification step is a musical piece content distributed in the past.

In order to achieve the above object, in a third aspect of the present invention, a content distribution program that causes a computer to execute the above content distribution method is proposed.

The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

Drawings

Fig. 1 is a block diagram showing the overall configuration of a content distribution system including a content distribution server according to an embodiment of the present invention;

fig. 2 is a conceptual diagram showing a data structure of a music file with animation;

fig. 3 is a diagram showing an example of a communication manner between the distribution server and the terminal apparatus;

fig. 4 is a flowchart showing a request reception process performed by the distribution server;

fig. 5 is a transition diagram showing a screen displayed in the display section of the terminal apparatus and processing performed by the distribution server as the request reception processing shown in fig. 4 proceeds;

FIG. 6A is a conceptual diagram showing keywords and a template table that are referred to when creating a template list;

fig. 6B is a conceptual diagram showing a music tune characteristic and a template table (map) referred to when creating the template list;

FIG. 7 is a timing chart showing a plurality of display event data in an animation track of a musical piece file and a template file in chronological order;

fig. 8 is a diagram showing an example of the first conversion mode of the time length adjustment;

fig. 9 is a diagram showing an example of the second conversion mode of the time length adjustment;

fig. 10 is a diagram showing an example of a third conversion mode of the time length adjustment; and

fig. 11 is a diagram showing an example of the fourth conversion mode of the time length adjustment.

Detailed Description

The present invention will now be described in detail with reference to the accompanying drawings, in which preferred embodiments of the invention are shown.

Fig. 1 is a block diagram showing the overall configuration of a content distribution system including a content distribution server according to an embodiment of the present invention.

This system is constituted by a content distribution server 10 and a plurality of communication terminal devices 30 (hereinafter, referred to as "distribution server" and "terminal device"). The terminal devices 30 are identical in structure and are connected to the distribution server 10 via the communication line 20 so as to communicate therewith.

The distribution server 10 stores various databases (hereinafter abbreviated as "DB"), i.e., a screen DB 11, a musical composition DB 12, a template DB 13, and a customer DB 14. The screen DB 11 stores a page description file, an icon image, and the like that can be displayed in the terminal device 30. The musical piece DB 12 (musical piece storage means) stores a plurality of music files mF (with or without lyrics) (hereinafter referred to as "musical piece files"), which can be reproduced by the terminal device 30 in response to an incoming call, for example.

The template DB 13 (template storage means) stores: a plurality of "template files tpF" described later, including animation, stop motion pictures, moving video pictures, and the like that can be displayed in the terminal device 30; and a "sample file" used as an example and corresponding to template file tpF. The customer DB14 stores, for each terminal apparatus 30, the distribution results (e.g., date of distribution, number of times of distribution, and point count consumption state) of the musical piece file mF and a music file amF with moving pictures (described later). Each terminal apparatus 30 is identified and managed by a telephone number.

The receiving section 16 (communication means) receives various requests transmitted from the terminal apparatus 30 through the communication line 20 and sends the received requests to the request analyzing section 15. The request analyzing section 15 analyzes the request from the receiving section 16 and accesses the requested DBs 11 to 14 according to the analysis result. The data of the analysis result is sent from the DB to the transmission section 17, the musical piece analysis engine 18, or the conversion engine 19. For example, screen data for screen display on the terminal device 30, a requested musical piece file mF, a list of various menus, and the like are transmitted to the transmission section 17.

As described later, the musical piece analyzing engine 18 analyzes the musical piece file mF selected by the user of the terminal apparatus 30, creates a template list in correspondence with the musical piece file mF, and sends the template list to the transmission section 17. As described later, the conversion engine 19 generates a music file amF with animation as a new file by adding the template file tpF to the musical piece file mF selected by the user of the terminal apparatus 30, and transmits the generated file amF to the transmission section 17. The transmission section 17 (communication means, content distribution means, and musical piece distribution means) transmits the received data to the terminal apparatus 30 via the communication line 20. Although the term "music file with animation amF" includes the word "animation" for convenience of explanation, the display data of the template file tpF is not necessarily animation, but may be a stop motion picture or a moving video picture.

Although not shown, the distribution server 10 has storage devices such as a large-capacity hard disk, a RAM, and a ROM, and a CPU. The ROM stores a control program executed by the CPU. The DBs 11 to 14 are stored in the hard disk. The CPU cooperates with the storage device to perform the functions of: a request analysis section 15 (musical piece recognition means and template recognition means), a musical piece analysis engine 18 (list provision means), a conversion engine 19 (time length adjustment means and synthesized content generation means), and the like.

Next, one terminal device 30, which is representative of the terminal devices 30, will be described. The terminal device 30 includes a CPU 31, a ROM 32, a storage section 33, a display section 34, a RAM 35, a communication interface (I/F)36, an input device 37, and a tune generator section 38, which are connected to the CPU 31 through a bus 40. The sound system 39 is connected to the tune generator section 38.

The terminal device 30 is implemented by a cellular mobile phone, for example. The CPU 31 controls the overall operation of the terminal device 30. The ROM 32 stores firmware and various data for overall control of the terminal device 30. The storage section 33 is implemented by a nonvolatile memory such as a flash memory, and stores various download data, control programs, and the like. The display portion 34 is constituted by a Liquid Crystal Display (LCD), for example, and displays various information such as images and characters. The RAM 35 temporarily stores marks and data.

The communication I/F36 is capable of establishing a link with the communication line 20, and may be wireless or wired. The input device 37 includes various operation elements such as a cursor key and a function key for inputting information. The tune generator section 38 converts the performance data stored in the storage section 33 or the RAM 35, such as the musical piece file mF, into a music tune signal, and converts the music tune signal into sound by the sound system 39.

Fig. 2 is a conceptual diagram showing a data structure of a music file amF with animation. The music file with animation amF includes a header 51, a music tune track 52, a lyrics track 53, and an animation track 54. A music file amF with animation is created by adding a template file tpF to the musical piece file mF (i.e., synthesizing these two files). The original musical piece file mF (before composition) stored in the musical piece DB 12 includes musical piece contents in which a musical tune event sequence composed of a plurality of pieces of musical tune event information is specified. The original musical piece file mF typically includes data in a known format distributed for use as an incoming musical composition. Specifically, the musical piece file mF is in the SMAF (synthetic music mobile application format) (registered trademark) format, and includes a music tune track 52 and a lyric track 53, and a header 51. Although not shown, the music tune track 52 is composed of a plurality of event data, strobe time data indicating the utterance duration of each event data, and the like.

The original template file tpF stored in the template DB 13 is template content that specifies a sequence of display control events, is similar in format to the musical piece file mF, and includes the animation track 54 and the header 51. The animation track 54 is composed of a plurality of display event data ev (described later with reference to fig. 7), gate time data indicating the utterance duration of each display event data, and the like. For example, the reproduction time length of the original template file tpF is set to about 10 to 30 seconds.

The header 51 of the music file amF with moving pictures is not identical to the header 51 of the original music file mF or the header 51 of the original template file tpF, but is a combination of the header 51 of the original music file mF and the original template file tpF. The header 51 of the music file with animation amF includes various information such as file size information and track information (title and genre of a musical piece, title of animation, author, and tempo data representing the performance tempo of the entire musical piece), and the like.

Fig. 3 is a diagram showing an example of how the distribution server 10 and the terminal device 30 perform communication. When purchasing a musical composition (musical composition file mF) from the distribution server 10 or purchasing a music file amF having a moving picture for reproducing a musical composition and displaying a moving picture or the like, the user of the terminal device 30 communicates with the distribution server 10 according to the following program.

First, when the terminal device 30 sets conditions such as a music genre and a new album and requests transmission of a musical piece list, the distribution server 10 responds and transmits the musical piece list to the terminal device 30. In response to the user's operation, the terminal apparatus 30 selects a desired musical composition from the musical composition list and passes the selection to the distribution server 10, whereby the selected musical composition can be previewed (listened to on trial). When only a musical piece is purchased (without creating a music file amF with animation from this musical piece), the selected musical piece is downloaded into the terminal apparatus 30 by sending a request for purchasing the musical piece to the distribution server 10. In this case, the distribution result indicating which musical piece has been purchased by the terminal apparatus 30 is recorded in the customer DB14 (see fig. 1; distribution result management means and charging means) of the distribution server 10, and a fee (e.g., two points) is charged for the purchase of the musical piece.

In the case of purchasing only musical pieces, communication and processing are performed in a conventional manner.

The remainder of the process will be briefly described with reference to fig. 3 and will be described in detail later with reference to fig. 4 to 11.

When the terminal apparatus 30 requests the distribution server 10 to add the template file tpF to a musical piece that the user currently wants to purchase or a musical piece that the user has purchased in the past (i.e., when an animation request is made), the distribution server 10 creates a template list suitable for the relevant musical piece and transmits it to the terminal apparatus 30. In the template list, one or more template files tpF (template content candidates) that can be added to the musical piece are shown.

The terminal device 30 selects a desired template file tpF from the received template list and previews it as necessary. For previews, data corresponding to the selected template file tpF may be downloaded from the distribution server 10 free of charge.

After selecting one desired template file tpF, the terminal apparatus 30 makes a motion picture change request, i.e., a request to adjust the length of reproduction time of the template file tpF and to actually add the adjusted template file tpF to the related musical piece. In this case, the distribution server 10 adjusts the reproduction time length of the template file tpF to coincide with the musical piece file mF (which will be described in detail later with reference to fig. 7 to 11). Then, the distribution server 10 generates a music file amF with moving pictures by adding the template file tpF of which the reproduction time has been adjusted to the musical piece file mF, and distributes the generated music file amF with moving pictures to the terminal apparatus 30 as the source of the request.

When the terminal apparatus 30 downloads the music file amF with moving picture, the customer DB14 of the distribution server 10 records the fact that the terminal apparatus 30 has purchased the music file amF with moving picture and the distribution result indicating which musical piece file mF and template file tpF constitute the music file amF with moving picture. The distribution server 10 collects a purchase fee (for example, three points). However, if the musical piece file mF constituting the music file amF with moving pictures has been downloaded in the past to the terminal apparatus 30, only the fee (for example, one point) of the template file tpF is collected.

For example, the distribution server 10 may provide a service in which each individual user pays a fixed monthly fee. In this service, a predetermined "point" is provided to each user, and the service is available within a payment range of points that the user has. When a file is downloaded (purchased), "points" are consumed. Upon receiving the download request, the distribution server 10 refers to the customer DB14 to check whether sufficient user points remain. If the remaining points are insufficient, a screen showing a message "service cannot be provided because the remaining points are insufficient" is transmitted to the terminal device 30.

Fig. 4 is a flowchart showing a request reception process performed by the distribution server 10. The distribution server 10 is always in a standby state, and executes processing each time a request from any terminal device 30 is received. Fig. 5 is a transition diagram showing a screen displayed in the display section 34 (see fig. 1) of the terminal device 30 and processing performed by the distribution server 10 as the request reception processing shown in fig. 4 proceeds.

It should be noted that the distribution server 10 can communicate with a plurality of terminal apparatuses 30 at the same time, but in the following description, a manner of processing from one terminal apparatus 30 and a corresponding screen display on the terminal apparatus 30 will be described.

First, as shown in fig. 4, when receiving a request from the terminal device 30, the request analysis section 15 analyzes the request to determine whether the request is an animation production request, a template preview request, an animation transition request, or any other type of request (step S101). If it is determined that it is another type of request, screen data suitable for the request is read out from the screen DB 11 or regenerated (step S111). Examples of such a request include a request to access the top screen, a request to transmit a list of musical compositions, a request to select a musical composition, a request to preview (listen on trial) a musical composition, and a request to purchase a musical composition (see fig. 3). The distribution server 10 transmits the read or generated screen data to the terminal device 30 that is the source of the request (step S112), and returns to the standby state.

As shown in fig. 5, for example, a list of musical pieces is selected on the top screen of the terminal apparatus 30. When a decision key (not shown) on the top screen is pressed (hereinafter referred to as "on") (step S201), a list of musical pieces is displayed on the screen (S202). When a desired musical piece is selected and turned on the screen, the process proceeds to step S203, and in step S203, a request for previewing, downloading, or animating the selected musical piece may be made. If "download" is turned on, it indicates a desire to purchase the selected musical piece. In this case, as described above, the distribution server 10 distributes the musical composition, records the distribution result, and collects two points to the terminal apparatus 30 for the purchase of the musical composition.

Referring again to fig. 4, if it is determined in step S101 that the request is an animation production request, the analysis engine 18 extracts information in a musical piece file mF (hereinafter referred to as "musical piece to be animated") that is currently an object of animation in order to analyze the musical piece to be animated (step S102).

Fig. 6A is a conceptual diagram showing keywords and a template table which are referred to when creating a template list. Fig. 6B is a conceptual diagram showing music tune characteristics and a template table (map) referred to when creating the template list. These tables are stored in the template DB 13 of the distribution server 10 or any of the above-described storage means, for example, not shown.

The keyword and template table in fig. 6A includes keywords such as "beach" and "lonely," each of which is associated with one or more template files tpF that conceptually match the keywords. For example, templates 1, 2, and 3 are associated with the keyword "beach". It should be noted that one template file tpF may be associated with a plurality of different keywords. On the other hand, the music tune characteristics and template table in fig. 6B includes a plurality of template files tpF two-dimensionally arranged in association with the key (minor key and major key) and the tempo of a music piece as indicated by circles in fig. 6B. For example, template file tpF is arranged so that it conceptually matches key and tempo; high-key animations are used for major keys, and animations with a sense of lightness are used for high beats.

Which of the above tables is to be used may be set by default or may be determined by the user of the terminal device 30. In the case where which form is to be used is determined by the user, for example, a screen for prompting the user to select "keyword" or "tune" may be displayed in response to an animation request.

In the case where the keywords and the template table in fig. 6A are used in creating the template list in step S102, text information is extracted from the lyric track 53 (see fig. 2) of the musical piece to be animated, and then, words appearing in the extracted text information are extracted from the text information. A predetermined number of top ranked words in descending order of frequency of occurrence are considered as keywords. It should be noted that the word extraction from the lyric track may be performed using a known method as described in japanese unexamined patent publication (Kokai) No. 2001-34275.

On the other hand, in the case where the music tune characteristics and the template table in fig. 6B are used in step S102, the music tune track 52 (see fig. 2) of the musical piece to be animated is analyzed to detect the key of the musical piece to be animated, and the tempo data is extracted from the header 51. It should be noted that the extraction of the key of the musical piece can be performed by a known method as described in japanese unexamined patent publication (Kokai) No. 2002-156969.

Next, in step S103 shown in fig. 4, a template list is made by listing one or more template files tpF that match the analysis result in step S102. Specifically, in the case of using a keyword and a template table, one or more template files tpF corresponding to the extracted keyword are identified with reference to the keyword and the template table. The number of template files tpF to be identified may be limited; for example, when the number of template files tpF exceeds a predetermined number (e.g., ten), template files tpF corresponding to the top-ranked keywords are preferentially identified, and the bottom-ranked keywords may be ignored.

On the other hand, in the case of using the music tune characteristics and the template table, one or more template files tpF arranged at positions near the intersection determined by the detected basis tones and the extracted tempo data are identified in the table. In this case, these template files near the intersection may be sequentially used as the identification template file tpF until the number of identification template files tpF exceeds predetermined data.

The identified template files tpF are then listed to make a template list. The distribution server 10 transmits the template list (screen data representing the template list) to the terminal apparatus 30 that is the source of the request (step S104), and returns to the standby state.

The processing in steps S102 to S105 shown in fig. 4 corresponds to the template animation production processing in step S204 shown in fig. 5. After turning on "add animation" on the display screen shown in step S203 shown in fig. 5 by the distribution server 10, the template animation production process is executed. When the terminal device 30 receives the template list, the process proceeds to step S205, where the template list is screen-displayed. On the screen, the user may preview or select any of the listed template files tpF. If "preview" is turned on, it is determined in step S101 shown in fig. 5 that the request is a template preview request, and sample data corresponding to the selected template file tpF to be previewed is read from the template DB 13 by the conversion engine 19 (see fig. 1) (step S105). Then, the distribution server 10 transmits the sample data to the terminal device 30 (step S106), and returns to the standby state.

When the template data is downloaded to the terminal device 30, it is automatically or manually reproduced in the terminal device 30. The sample data is constituted by the template file tpF and a predetermined musical piece file associated therewith. While the sample music tune is being produced, animation or the like is displayed in the display section 34.

On the other hand, when "select" is turned on the screen showing the template list displayed in step S05, a screen for requesting conversion of the selected template file tpF or previewing the converted music file amF with animation is displayed (step S206). On this screen, the user can input characters, images, and the like to the small screen 206a as needed. The content thus input is associated with the music file with animation amF, for example, used when the user identifies and manages a plurality of music files with animation amF.

When "conversion and DL (download)" or "preview" is turned on the screen displayed in step S206, it is determined in step S101 shown in fig. 4 that the request is a request to perform conversion of the selected template file tpF, and thus the process proceeds to step S107. In step S107, the conversion engine 19 reads the selected template file tpF and the musical piece to be animated (musical piece file mF) from the template DB 13 and the musical piece DB 12, respectively. Even in the case where it has been distributed to the same terminal apparatus 30 in the past, the musical piece file MF is still read out.

In next step S108, the conversion engine 19 performs the conversion process. Specifically, the conversion engine 19 adjusts the reproduction time length of the read template file tpF, and adds the adjusted template file tpF to the read musical piece file mF, thereby producing a music file amF with animation. This conversion process will be described later with reference to fig. 7 to 11. In step S108, when the conversion processing is executed in response to the turning on of "conversion and DL" on the screen displayed in step S206, "storable flag" is added to the generated music file amF with animation (step S207 in fig. 5). On the other hand, when the conversion processing is executed in response to the turning on of the "preview", the "memorable flag" is added to the produced music file amF with animation (step S208).

Next, the transmission section 17 transmits the generated music file amF with moving picture (with a storable flag or an unrecoverable flag) to the terminal apparatus 30 as the source of the request (step S109), and the distribution server 10 returns to the standby state. The terminal apparatus 30 that has downloaded the music file amF with moving pictures can store the music file amF with moving pictures in the storage section 33 (see fig. 1) only when a storable flag is attached thereto. Only the preview (music tune reproduction and display reproduction) of the music file amF with animation to which the non-storable flag is attached can be performed.

When distributing the music file with moving picture amF with the storable flag attached, the distribution server 10 updates the content of the customer DB14 (past distribution result) of the terminal device 30 as the destination of the music file with moving picture amF. At the same time, the distribution server 10 charges the terminal device 30 for the distribution service (step S209). In this case, if the template file tpF is added to the musical piece file mF purchased for the first time, all three points are charged, but if the template file tpF is added to the musical piece file mF distributed in the past, only one point is charged for the template file tpF. It should be noted that when the music file amF with animation to which the non-storable flag is attached is distributed, the customer DB14 is not updated, and the terminal device 30 is not charged.

Now, the conversion processing in step S108 will be described. Fig. 7 is a timing chart showing a plurality of display event data ev in the animation track 54 of the musical piece file mF and the template file tpF in chronological order. The duration of the display event data ev (including the display event data ev1 through ev7) from the display start time to the display end time is expressed in length.

The reproduction section of the template file tpF shown in fig. 7 is composed of a front part a including a subtitle display, a rear part b including a tail sound display, and a processing section SC1 between the parts a and b. The front a and the rear b (first reproduction sections) include a sequence display and a tail display, respectively, and thus in the sections a and b, the reproduction speed is maintained at a constant speed. On the other hand, in the processing section SC1 (second reproduction section), it is not necessary to maintain the reproduction speed at a constant speed.

The reproduction time length of the entire template file tpF before time adjustment is the sum of the time lengths of the following three parts (for example, about 10 to 30 seconds, as described above): a front portion a (from the reproduction start time to the processing section start time Gs), a processing section SC1 (a middle portion from the processing section start time Gs to the processing section end time Ge), and a rear portion b (from the processing section end time Ge to the reproduction end time). For example, the length of time of the front portion a is about 2 seconds, and the length of time of the rear portion b is about 10 seconds. The time lengths of these two portions vary according to the template file tpF.

On the other hand, as shown in the upper half of fig. 7, the reproduction time length of the musical piece file mF to which the template file tpF is to be added is "performance time MT" from the reproduction start time Ms to the reproduction end time Me. The performance time MT is obtained by accumulating the strobe time of the event data of the musical piece file mF or by referring to the reproduction time information included in the header 51. The length of the reproduction time of the template file tpF (a + SC1+ b) and the performance time MT do not necessarily coincide, and therefore the length of the reproduction time of the template file tpF is adjusted, i.e., extended or reduced, so as to coincide with the length of the performance time MT.

In this case, only the reproduction time length of the processing section SC1 is adjusted so that the reproduction time length of the entire template file tpF coincides with the performance time MT. The reproduction time lengths of the front a and the rear b are not adjusted because in the sections a and b, the reproduction speed must be maintained at a constant speed for the above-described reasons. Specifically, the display event data ev (display control event information) whose display is performed at least partially in the processing section SC1 is an adjustment object. In the illustrated example, the display event data ev1 through ev7 are adjustment objects.

In this example, the display event data ev1 through ev4 are all included in the processing section SC1 from the display start time to the display end time, and therefore the entirety of each of the display event data ev1 through ev4 is adjusted to be adapted to the adjustment of the reproduction time length of the template file tpF. On the other hand, the display event data ev5 through ev7 are not entirely included in the processing section SC1 from the display start time to the display end time position, but are partially included in the processing section SC 1. Specifically, only those parts of the display event data ev5 to ev7 included in the processing section SC1 are adjusted to be suitable for the adjustment of the reproduction time length of the template file tpF.

For example, in the case of extending the reproduction time length of the template file tpF, the display start time of the display event data ev5 is delayed, thereby increasing the duration of displaying the display event data ev 5. The duration of displaying the display event data ev6 is increased, but the display start time of the display event data ev6 is kept unchanged. The display start time of the display event data ev7 is not changed, but the duration of displaying the display event data ev7 is increased by an amount corresponding to the change in the time length of the processing section SC 1.

Each display event data ev is specified so that the display object is moving, and the scene, color, and pattern are changed on the screen. For example, each display event data ev specifies that a display object (such as a cloud in the sky) moves from a start position to an end position at a predetermined speed while changing its shape. In the following description, the duration of displaying each display event data ev will be referred to as "lifetime".

Fig. 8 to 11 are diagrams showing examples of transition patterns in the time length adjustment. In each figure, a musical piece file mF is shown in the upper part, a template file tpF before conversion is shown below the musical piece file mF, and a template file tpF after conversion is shown in the lower part. In the description of each conversion mode, it is assumed that the musical piece file mF is longer than the template file tpF before adjustment.

First, in the first conversion mode shown in fig. 8, the processing section SC1 having a time length of t1 is extended to the processing section SC2 having a time length of t2, so that MT becomes a + SC2(t2) + b. Then, for all the display event data ev1 to ev6 in the processing section SC1, the display end time is converted into a display end time (display event data ev11 to ev16) matching the processing section end time Ge of the processing section SC 2. As a result, the lifetime is increased, and the display of all the display event data ev11 to ev16 ends at the same time at the process section end time Ge.

Assuming that one display event data ev as a conversion object is data specifying "cloud in the sky moves from a start position to an end position at a predetermined speed while changing the shape", the template file tpF includes an operation time-related parameter specifying the change speed of the cloud shape and the movement speed of the cloud. However, in the first conversion mode, only the display end time is delayed, so the operation time-related parameter is kept unchanged, and thus the speed of change in the shape of the cloud and the speed of movement of the cloud are unchanged. Therefore, if the cloud moves from the start position to the end position throughout the lifetime according to the display event data ev before conversion, the display event data ev after conversion is such that the cloud reaches the end position before the end of the lifetime after extension and then stands still at the end position until the end of the lifetime. This is displayed in the terminal device 30.

In this case, the display event data ev whose display start time is not included in the processing section SC1 is displayed in the same manner and timing as the display template file tpF.

In the second switching pattern shown in fig. 9, as in the case of the first switching pattern, the processing section SC1 (time length t1) is extended to the processing section SC2 (time length t 2). Then, for all the display event data ev1 to ev4 in the processing section SC1, the length of time and lifetime from the processing section start time Gs to the display start time Gs is extended by a factor t2/t1 (display event data ev11 to ev 14). As a result, the length of time from the display end time to the processing section end time Ge is extended by the factor t2/t1 as well.

Also, in the second conversion mode, the operation time-dependent parameter is not changed, and thus in the example where the cloud moves in the sky, the change speed of the cloud shape and the movement speed of the cloud are not changed. Therefore, if the cloud moves from the start position to the end position throughout the lifetime before the data conversion, the converted display event data ev is that the cloud appears on the screen at a time delayed by a factor t2/t1, reaches the end position before the end of the extended lifetime, and stands still at the end position until the end of the lifetime.

In the third conversion mode shown in fig. 10, the processing in the second conversion mode shown in fig. 9 is performed, and further, the operation time-related parameters (display event data ev11 to ev14) are adjusted in the ratio of t1 to t 2. In this case, the operating speed is adjusted for a delay of a factor t1/t 2. The life is prolonged by a factor of t2/t 1.

In a third transition mode, in which the operation time-related parameter is also changed, in the example in which the cloud moves in the sky, the speed of change in the shape of the cloud and the speed of movement of the cloud are delayed by a factor of t1/t 2. Therefore, if the cloud moves from the start position to the end position throughout the lifetime before the data conversion, the display event data ev after the conversion is such that the cloud appears on the screen at a time delayed by a factor t2/t1 and moves from the start position to the end position (slower than before the data conversion) throughout the extended lifetime while changing the shape slower than before the conversion.

In the third conversion mode, for those display event data ev (display event data ev5 to ev7 shown in fig. 7) which are not included in the processing section SC1 in their entirety from the display start time to the display end time but are included in the processing section SC1 in part, the operation time-related parameter is adjusted only for the data section included in the processing section SC in accordance with the lifetime of each display event data ev after the time adjustment, as described with reference to fig. 7.

In the fourth switching pattern shown in fig. 11, as in the first switching pattern, processing section SC1 (time length t1) is extended to processing section SC2 (time length t 2). Then, all the display event data ev1 to ev3 in the display processing section SC1 are repeated in the processing section SC2 without changing the lifetime thereof (cycle).

Specifically, processing section SC2 is divided into a plurality of sections at time intervals of time length t1, which is the same as time length t1 of processing section SC1, from the beginning. In each section, the display event data ev1 to ev3 are displayed in the same manner as the display processing section SC 1. That is, the length of time from the start of each section to the display start time is equal to the length of time from the start of the processing section SC1 to the display start time. The display event data ev3 spans two adjacent sections and thus does not end at the termination point of the previous section, but continues to be displayed from the previous section to the next section to end its lifetime.

The last portion may be shorter than the length of time t 1. In the last section, only the display event data ev (ev1 and ev2 in the illustrated example) whose display start time has been reached are displayed, and the display event data ev (display event data ev3 in the illustrated example) whose display start time has not been reached yet is not displayed. Also, even after the processing section end time Ge, the display event data ev (ev1 and ev2) that have been displayed are displayed to complete the lifetime thereof. It should be noted that when the processing section end time Ge is reached, the display of the display event data ev (ev1 and ev2) may be terminated. Also, if the display start time thereof comes before the reproduction of the entire template file tpF is completed, the display event data ev3 may be displayed.

In step S108 shown in fig. 4, the conversion process is performed using any one of the above-described four conversion modes. The conversion mode to be employed may be set by default (for example, set to the third conversion mode). Alternatively, the switching mode to be employed may be determined by the user of the terminal device 30. In this case, for example, after "conversion and DL" or "preview" is turned on in step S206 shown in fig. 5, a screen prompting the user to select a conversion mode may be displayed immediately to accept the user' S selection.

It should be noted that when the musical piece file mF is shorter than the template file tpF before adjustment, various parameters of the display event data ev may be converted in a direction of shortening the time length of the processing section SC1 contrary to the examples shown in fig. 8 to 11.

According to the present embodiment, a music file amF with animation to be distributed is created by adding a template file tpF to a musical piece file mF to satisfy the preference of the user of the terminal apparatus 30, and the time length of displaying the template file tpF is adjusted to match the time length of reproducing the musical piece file mF. Therefore, the user of the terminal device 30 can match the time at which the display starts and ends with the time at which the reproduction of the musical piece starts and ends. Thus, desired display content can be reproduced so as to coincide in time with reproduction of a desired musical piece.

Further, since the template list is created in accordance with the keywords in the musical piece to be animated or the key and tempo of the musical piece to be animated, it is possible to easily select template contents suitable for the theme of music.

Also, since the musical piece file mF can be downloaded separately as in the related art and the download of the musical piece file mF and the download of the template file tpF are charged separately, the service for distributing the music file amF with animation can be used in combination with the existing service for distributing the musical piece file mF.

Further, the front a and rear b of template file tpF are not adjusted. Therefore, even if the template file tpF includes display sections (such as the caption display and the ending display corresponding to the introduction and the ending of the musical piece file mF) whose time lengths should not be extended or shortened, these display sections are not affected. It should be noted that if processing section SC1 can be lengthened or shortened to zero to an infinite value, the entire template file tpF can be lengthened or shortened.

It should be noted that the tables used for making the template list in steps S102 and S103 shown in fig. 4 are not limited to the tables shown in fig. 6A and 6B. For example, in the music tune characteristics and template table shown in fig. 6B, the template file tpF may be associated with a combination of various music tune characteristic parameters, such as tone colors (tone colors), volume, frequently occurring tones and chords, and musical piece categories in the header 51, instead of being associated with the key (major/minor) and tempo of a musical piece. Also, in the case where the musical piece file mF is constituted by waveform data (such as a song or the like), the template file tpF may be associated with parameters obtained by, for example, FFT (fast fourier transform) analysis.

Alternatively, a table in which one or more template files tpF are associated with each musical piece file mF in advance may be used. It should be noted that the tables and maps are not limited to the two-dimensional case, but may be three-dimensional.

Although in the present embodiment, the reproduction time lengths of the entire template file tpF are made to completely match the performance time MT of the musical piece file mF, they do not always have to completely match each other.

Although the data format of the musical piece file mF and the template file tpF is the SMAF in the present embodiment, it is not restrictive. For example, flash (macromedia flash) (registered trademark) may be used. The content of the music piece file mF is not limited to the incoming call melody, and may be "mobile phone song (registered trademark)" or the like.

It should be noted that the contents of the template file tpF are not limited to animation or moving video pictures, and may be, for example, data relating to sound effects (sound image localization control such as three-dimensional sound image generation) and vibration control.

Although in the present embodiment, the music file amF with animation is created by composition of the music piece file mF and the template file tpF, it is not necessarily integrated data. For example, a set of a musical piece file mF and a template file tpF may be distributed, to which information associating these files with each other and information for synchronous reproduction are added.

Although in the present embodiment, the terminal device 30 is implemented by a cellular mobile phone, it may be any other device as long as it has a communication function, a music reproduction function, and an image display function to receive the distribution service provided by the distribution server 10.

It should be understood that the invention may also be implemented in the following manner: providing the distribution server 10 having a storage medium in which program codes of software for realizing the functions of the above-described embodiments are stored; and causes a computer (or CPU or MPU) of the system or apparatus to read out and execute the program codes stored in the storage medium. In this case, the program code itself read out from the storage medium realizes the functions of the above-described embodiments, and therefore, the program code and the storage medium on which the program code is stored constitute the present invention.

Examples of the storage medium for supplying the program code include a floppy disk (registered trademark), a hard disk, a magneto-optical disk, an optical disk (e.g., CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, and the like), a magnetic tape, a nonvolatile memory card, and a ROM. Alternatively, the program code may be downloaded via a network.

Further, it is to be understood that the functions of the above-described embodiments may be realized not only by executing the program code read out by the computer, but also by causing an OS (operating system) or the like operating on the computer to perform a part or all of the actual operations according to the instructions of the program code.

Further, it is to be understood that the functions of the above-described embodiments may be implemented by writing the program code read out from the storage medium into a memory provided in an expansion board inserted into the computer or a memory provided in an expansion unit adjacent to the computer, and then causing a CPU or the like provided in the expansion board or the expansion unit to perform a part or all of the actual operations according to the instructions of the program code.

Claims (17)

1. A content distribution server comprising:

a musical piece storage means that stores a plurality of musical piece contents each specifying a musical tune event sequence including musical tune event information;

a template storage means that stores a plurality of template contents, each of which specifies a display control event sequence including display control event information;

a communication device that communicates with at least one terminal device;

musical piece identifying means for identifying one musical piece content from among the plurality of musical piece contents stored in the musical piece storing means in response to a request from a terminal apparatus through the communication means;

template identification means for identifying one template content from among the plurality of template contents stored in the template storage means in response to a request from a terminal device through the communication means;

time length adjusting means for adjusting the length of the reproduction time of the template content identified by the template identifying means, in accordance with the length of the reproduction time of the musical piece content identified by the musical piece identifying means;

a synthesized content generating means for generating synthesized content by adding the template content, the reproduction time length of which has been adjusted by the time length adjusting means, to the musical piece content identified by the musical piece identifying means; and

and a content distribution device that distributes the composite content generated by the composite content generation device to a terminal device via the communication device.

2. The content distribution server according to claim 1, comprising:

list providing means for creating a template list including at least one template content candidate capable of being added to the identified musical piece content in response to a template content addition request from the terminal device through the communication means, and transmitting the created template list to the terminal device.

3. The content distribution server according to claim 2, wherein:

the musical piece content includes a lyric track, an

The list provision means extracts at least one word from the lyrics track of the musical piece content identified by the musical piece identification means, and selects at least one template content candidate based on the extracted word to create a template list.

4. The content distribution server according to claim 2, wherein the list provision means analyzes a musical tune characteristic of the musical piece content identified by the musical piece identification means, and selects at least one template content candidate according to the analysis result to create the template list.

5. The content distribution server according to claim 1, wherein:

each of the plurality of template contents includes a reproduction section including a first reproduction section in which a reproduction speed needs to be maintained at a constant speed and a second reproduction section in which the reproduction speed does not need to be maintained at the constant speed, and

the time length adjusting means changes only the reproduction time length of the second reproduction section of the template content identified by the template identifying means, thereby adjusting the entire reproduction time length of the identified template content.

6. The content distribution server according to claim 5, wherein:

dividing a reproduction section of each of a plurality of template contents into a front section, an intermediate section, and a rear section by time, the front section and the rear section being a first reproduction section, and the intermediate section being a second reproduction section, an

The time length adjusting means changes only the reproduction time length of the intermediate portion of the template content recognized by the template recognizing means, thereby adjusting the entire reproduction time length of the recognized template content.

7. The content distribution server according to claim 6, wherein the reproduction time length of the intermediate section is changed by changing the reproduction time length of at least one piece of display control event information included at least partially in the intermediate section of the template content identified by the template identifying means, among the display control event information constituting the display control event sequence specified by the identified template content, so that the display end time of the display control event information matches the end time of the intermediate section.

8. The content distribution server according to claim 6, wherein the reproduction time length of the intermediate section is changed by changing a display start time and a lifetime of at least one display control event information included at least partially in the intermediate section of the template content identified by the template identifying means, from among the display control event information constituting the display control event sequence specified by the identified template content.

9. The content distribution server according to claim 6, wherein the reproduction time length of the intermediate portion is changed by changing display start time, lifetime, and time parameters of at least one display control event information included at least partially in the intermediate portion of the template content identified by the template identifying means, among the display control event information constituting the display control event sequence specified by the identified template content.

10. The content distribution server according to claim 6, wherein the length of the reproduction time of the intermediate portion is changed by repeatedly displaying at least one piece of display control event information at least partially included in the intermediate portion of the template content identified by the template identifying means, among the display control event information constituting the display control event sequence specified by the identified template content.

11. The content distribution server according to claim 1, comprising:

a musical composition distributing means for individually distributing the musical composition contents identified by the musical composition identifying means to a terminal apparatus;

a distribution result management means that manages a distribution result of the musical piece distribution means and a distribution result of the content distribution means for each of at least one terminal apparatus; and

a charging device for charging based on the distribution result managed by the distribution result management device,

wherein the charging means charges for the distribution of the musical composition contents in response to the distribution of the musical composition contents by the musical composition distributing means alone.

12. The content distribution server according to claim 11, wherein in a case where the content distribution means distributes the synthesized content, when the musical piece content identified by the musical piece identification means is not musical piece content distributed in the past, a fee is charged for the distribution of the identified musical piece content and the distribution of the template content added to the identified musical piece content, and when the musical piece content identified by the musical piece identification means is musical piece content distributed in the past, a fee is charged only for the distribution of the added template content.

13. A content distribution method for a content distribution server, the content distribution server comprising: a musical piece storage means that stores a plurality of musical piece contents each specifying a musical tune event sequence including musical tune event information; a template storage means that stores a plurality of template contents, each of which specifies a display control event sequence including display control event information; and a communication device that communicates with at least one terminal device, the content distribution method including:

a musical piece identifying step of identifying one musical piece content from among a plurality of musical piece contents stored in the musical piece storing means in response to a request from a terminal apparatus through the communication means;

a template identification step of identifying one template content from a plurality of template contents stored in the template storage means in response to a request from a terminal device through the communication means;

a time length adjusting step of adjusting the reproduction time length of the template content identified in the template identifying step, in accordance with the reproduction time length of the musical piece content identified in the musical piece identifying step;

a synthesized content producing step of producing synthesized content by adding the template content, the reproduction time length of which has been adjusted in the time length adjusting step, to the musical piece content identified in the musical piece identifying step; and

a content distribution step of distributing the composite content generated in the composite content generation step to a terminal apparatus via the communication apparatus.

14. The content distribution method according to claim 13, comprising:

a list providing step of creating a template list including at least one template content candidate that can be added to the identified musical piece content in response to a template content addition request from the terminal apparatus through the communication apparatus, and transmitting the created template list to the terminal apparatus.

15. The content distribution method according to claim 13, wherein:

each of the plurality of template contents includes a reproduction section including a first reproduction section in which a reproduction speed needs to be maintained at a constant speed and a second reproduction section in which the reproduction speed does not need to be maintained at the constant speed, and

in the time length adjusting step, only the reproduction time length of the second reproduction section of the template content identified in the template identifying step is changed, thereby adjusting the entire reproduction time length of the identified template content.

16. The content distribution method according to claim 13, comprising:

a musical composition distributing step of individually distributing the musical composition contents identified in the musical composition identifying step to a terminal apparatus;

a distribution result management step of managing, for each of at least one terminal apparatus, a distribution result in the musical piece distribution step and a distribution result in the content distribution step; and

a charging step of charging a fee based on the distribution result managed in the distribution result managing step,

wherein in the charging step, a fee is charged for distribution of the musical piece contents in response to the musical piece contents being distributed individually in the musical piece distribution step.

17. The content distribution method according to claim 16, wherein in a case where the synthesized content is distributed in the content distribution step, when the musical piece content identified in the musical piece identification step is not musical piece content distributed in the past, a fee is charged for distribution of the identified musical piece content and distribution of template content added to the identified musical piece content, and when the musical piece content identified in the musical piece identification step is musical piece content distributed in the past, a fee is charged only for distribution of the added template content.