JP2012198380A - Display control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide the technique capable of amusing not only a singing amateur singer but also users who do not sing, when a Karaoke device is used by a plurality of people.SOLUTION: An amateur singer sings along with recorded music using a Karaoke device 1. While the amateur singer is singing, other users not singing can decorate a video of the amateur singer by use of a touch screen 171. A video of the singing amateur singer and a lyric telop are displayed on a preview screen of the touch screen 171. When a decorating operation is performed by other users, a CPU 11 displays a combination of a decoration image and the video of the singing amateur singer according to a signal output from the touch screen 171 and the display content of the touch screen 171. At this time, the CPU 11 animates the decoration image in synchronization of the rhythm of a Karaoke accompaniment.

Description

  The present invention relates to a technique for displaying an image during karaoke accompaniment.

  In recent years, not only karaoke accompaniment but also karaoke apparatuses having various functions for making the user more enjoyable have become widespread. For example, Patent Document 1 discloses a karaoke apparatus having a function of shooting and recording a singing appearance with a video camera. According to this apparatus, the user can reproduce and enjoy the captured video later.

  In recent years, a service has been proposed in which characters and images are enjoyed by combining them with moving images. Specifically, for example, a service is provided in which a moving image uploaded to a server is enjoyed by adding comments using characters and symbols to other users. In addition, for example, a service is provided in which, when a moving image is uploaded, a server combines characters and images with the uploaded moving image.

JP-A-11-282479

  By the way, when photographing a singer in karaoke, it is preferable that not only the singer but also other users can be entertained. In the apparatus described in Patent Document 1, although the singer himself can be entertained by shooting the singing appearance, other users may not be able to enjoy the video.

  The present invention has been made under the background described above, and provides a technique that can entertain not only a singer but also a user who is not singing when a karaoke apparatus is used by a plurality of people. With the goal.

  In order to solve the above-described problems, the present invention shows music data storage means for storing music data indicating music, video data acquisition means for acquiring video data indicating video, and an image for decorating the video. Image data storage means for storing image data, a signal output from an operation display means for displaying an operation screen and operated by a user, and music data corresponding to display contents of the operation display means are stored in the music data storage A reproduction means for reading out and reproducing from the means, a signal output from the operation display means and image data corresponding to the display content of the operation display means from the image data storage means, and an image indicated by the read image data Display control means for combining with the video indicated by the video data acquired by the video data acquisition means and displaying on the display means Wherein identifying the tempo of the music data reproduced by the reproducing means, to provide a display control apparatus characterized by comprising display control means for changing the display mode of the image at a timing corresponding to the identified tempo.

  In a preferred aspect of the present invention, the video data may be data indicating a video shot by a shooting unit.

  Further, in a further preferred aspect of the present invention, when the image indicated by the read image data is a moving image, the display control means reproduces the image according to the tempo of music data reproduced by the reproduction means. You may display by speed.

  In a further preferred aspect of the present invention, the display control means changes the display mode of the image according to the signal when a signal indicating that the display mode of the image is changed is output from the operation display means. In addition, sequence data indicating at least one of the display start timing of the image indicated by the image data and the change timing of the display mode may be generated and output.

  Further, in a further preferred aspect of the present invention, the music data includes section data indicating a specific section of the music, and the display control means includes section data included in the music data reproduced by the reproducing means. The display mode of the image may be different between the section indicated by the section data and the other sections.

  In a preferred aspect of the present invention, the image data includes at least one of a display position, a display size, a display color, a transparency, and a relative switching speed with respect to a reproduction speed of the music data. The display control means may switch the display mode of the image indicated by the read image data according to the display mode data included in the image data.

  In a further preferred aspect of the present invention, the display control means may store the generated sequence data by adding it to the video data.

  In another preferred aspect of the present invention, the image data includes display mode data indicating a playback speed relative to the playback speed of the music data, and the display control means indicates the read image data. A moving image may be displayed at a reproduction speed indicated by display mode data included in the image data.

  In a further preferred aspect of the present invention, the display control means changes the display form of the image according to the output gain of the audio signal output from the sound collection means for collecting the singing voice of the singer. Also good.

  In a further preferred aspect of the present invention, the display control means outputs the image when the signal indicating that the image is displayed on the second display means is output from the operation display means. May be displayed on the display means.

  According to the present invention, when a karaoke apparatus is used by a plurality of people, not only singers but also users who are not singing can be entertained.

It is a block diagram which shows an example of the hardware constitutions of a karaoke apparatus. It is a figure which shows an example of the screen of a touch screen. It is a figure which shows an example of the screen of a touch screen. It is a figure which shows an example of the screen of a touch screen. It is a figure for demonstrating the content of the decoration process which a karaoke apparatus performs. It is a figure which shows an example of the content of decoration information. It is a figure for demonstrating the content of the decoration process which a karaoke apparatus performs.

<Configuration of karaoke equipment>
FIG. 1 is a block diagram showing an example of a hardware configuration of a karaoke apparatus 1 according to an embodiment of the present invention. In the figure, a CPU (Central Processing Unit) 11 reads a computer program stored in a ROM (Read Only Memory) 12, loads it into a RAM (Random Access Memory) 13, and executes it to execute the karaoke device 1 Control each part. The storage device 14 is a large-capacity storage unit such as a hard disk or an optical disk. The communication I / F 15 is an interface that exchanges data with other devices (for example, a server in a management room of a karaoke device) connected via a communication line.

  The display circuit 16 is a circuit for displaying an image on the main display device 22 such as a liquid crystal display. The input device 17 is an operation input device that outputs an operation signal corresponding to the operated content. The input device 17 includes an operator (not shown) attached to the apparatus main body and a touch screen 171. The touch screen 171 includes a display panel that displays an operation screen, and the user performs an operation by touching the display panel while viewing the screen displayed on the display panel. Here, the touch screen 171 can be operated by multi-touch. The user can perform various operations such as music selection using the touch screen 171.

  The singing microphone 18 is a sound collection device that collects the singing voice of the singer. The singing microphone 18 outputs an analog electric signal representing a waveform on the time axis of the singing voice. The sound processing unit 19 converts the electrical signal output from the singing microphone 18 into a digital signal. The audio processing unit 19 converts the digital signal into an analog signal under the control of the CPU 11 and outputs the analog signal to the speaker 20 via an amplifier (not shown). The speaker 20 is sound emitting means that emits sound with an intensity corresponding to the supplied audio signal. The video camera 21 is a photographing means for photographing and outputting a video signal representing the photographed video.

  When the karaoke device 1 reproduces the karaoke accompaniment, the video camera 21 captures the singer's singing image, combines the captured image and the lyrics telop, and displays them on the main display device 22, and also on the touch screen 171. indicate. Users other than the singer can use the touch screen 171 to decorate the singing video by adding characters and images to the singing video (hereinafter referred to as “decoration”).

  The storage device 14 is provided with a lyrics telop data storage area 141, an accompaniment sound data storage area 142, a material data storage area 143, and a decorated video file storage area 144. The lyrics telop data storage area 141 stores a plurality of lyrics data representing the lyrics of the music displayed as the lyrics telop. The accompaniment sound data storage area 142 stores a plurality of accompaniment sound data representing accompaniment sounds of music.

  In the material data storage area 143, a plurality of data (hereinafter referred to as “material data”) representing an image (hereinafter referred to as “material image”) used as a decoration material when the user performs a decoration operation using the touch screen 171. It is remembered. A material identifier is assigned to the material data. When the user performs an operation of selecting a material using the touch screen 171, the CPU 11 converts the signal output from the touch screen 171 and the display content of the touch screen 171. The corresponding material identifier is searched, and the searched material data is read from the material data storage area 143. Specific contents of the material data include, for example, frame material used as a frame for singing images such as “Sakura Fubuki” and “Soap bubble”, stamp material such as “Star” and “Heart”, and user-drawn freely There is a pen material to do. The material data may be data representing one still image, or may be data representing a moving image such as displaying a plurality of still images in order. The material data may be data configured by combining a plurality of image data (still image data or moving image data).

  When the material data is composed of a plurality of image data, the operation content of the user may be associated with each image data. Specifically, for example, “star” material data includes still image data of stars and moving image data representing moving images in which the stars glitter, and this moving image data is compatible with double-click operations. The attached structure may be sufficient. The material data may include various default values (display mode data) relating to the display mode of the image, such as the display position and display size of the image, display color, transparency, and reproduction speed. For example, the playback speed may indicate that the image is switched every beat of the music, or may indicate that the image is switched every two beats, for example.

  The decorated video file storage area 144 stores a decorated video file generated by the CPU 11 executing a decoration process described later. The details of the decoration process will be described later, and thus detailed description thereof is omitted here.

<Operation example 1 of karaoke equipment>
Next, an example of the operation of the karaoke apparatus 1 will be described. In this operation example, an operation in the case where another user performs a decoration operation on a singing video in real time when a singer is singing will be described. First, the singer operates the touch screen 171 to select a song to sing. The touch screen 171 outputs a signal corresponding to the operation content of the singer. The CPU 11 reads accompaniment sound data corresponding to the selected music from the accompaniment sound data storage area 142 based on the signal output from the touch screen 171 and the display content of the touch screen 171 and reproduces the karaoke accompaniment. Thereby, karaoke accompaniment is started. The video camera 21 shoots the singer over a period during which the karaoke accompaniment is being played, and outputs a video signal representing the shot video. Further, the CPU 11 reads out the lyrics telop data corresponding to the music selected by the singer from the lyrics telop data storage area 141, and synthesizes the lyrics telop indicated by the read out lyrics telop data and the video taken by the video camera 21. The composite image is displayed on the main display device 22 and the touch screen 171. That is, on the main display device 22 and the touch screen 171, the singer's singing video and the lyrics telop are displayed in real time.

  The singer sings along with the reproduced karaoke accompaniment while referring to the lyrics telop displayed on the main display device 22. When the user starts singing, the singing voice of the singer is picked up by the singing microphone 18 and supplied to the voice processing unit 19 as a voice signal. The audio processing unit 19 supplies an input audio signal to the speaker 20 and outputs it as a sound from the speaker 20 together with the accompaniment sound.

  While the singer is singing, other users who are not singing can decorate the singing video using the touch screen 171. 2 to 4 are diagrams showing examples of screens displayed on the touch screen 171. FIG. While reproducing the karaoke accompaniment, the CPU 11 displays a screen as illustrated in FIGS. 2 to 4 on the touch screen 171. In the figure, on the preview screen P1, as described above, the singing video photographed by the video camera 21 and the lyrics telop are combined and displayed. The frame tab T1 is for selecting a frame material. When the frame tab T1 is selected, as shown in FIG. 2, the frames such as “None”, “Sakurabuki”, “Soap bubble”,. Multiple materials are displayed. The stamp tab T2 is for selecting a stamp material. When the stamp tab T2 is selected, stamp materials such as “star”, “shooting star”, “heart”,... Multiple are displayed. The pen tab T3 is for selecting a pen material. When the pen tab T3 is selected, a plurality of pen materials are displayed as shown in FIG. The enter button B1, the cancel button B2, and the sync button B3 are for changing the display of the main display device 22. The speed change button B4 is for changing the speed of the material image animation.

  When the touch screen 171 is operated by the user, the CPU 11 executes a decoration process for the singing video based on the signal output from the touch screen 171 and the display content of the touch screen 171. Here, the contents of the decoration process executed by the CPU 11 will be described with reference to the drawings. FIG. 5 is a diagram for explaining the contents of the decoration process executed by the karaoke apparatus 1. In FIG. 5, the decoration editing unit 111 and the encoder 112 are realized by the CPU 11 reading and executing a computer program stored in the ROM 12 or the storage device 14. In FIG. 5, in order to prevent the drawing from becoming complicated, the configuration related to the decoration process is mainly illustrated, and the audio processing unit 19 and the display circuit 16 are not illustrated.

  In FIG. 5, the decoration editing unit 111 performs various processes related to the material image such as display and deletion of the material image and change of the display mode according to the signal output from the touch screen 171 and the display content of the touch screen 171. Execute. In addition, every time the processing related to the material image is executed, the decoration editing unit 111 generates decoration information (sequence data) indicating the content of the processing, and outputs the generated decoration information to the encoder 112. The encoder 112 outputs the video data output from the video camera 21, the lyrics telop data stored in the lyrics telop data storage area 141, the accompaniment sound data stored in the accompaniment sound data storage area 142, and the singing microphone 18. Then, the voice data obtained by synthesizing the singing voice data A / D converted by the voice processing unit 19 and the adder 114 is supplied. The encoder 112 encodes the video data, the lyrics telop data, the audio data, and the decoration information supplied from the decoration editing unit 111 so as to be synchronized to form one file (hereinafter, “decorated video file”). At that time, the encoder 112 may encode the video data and the audio data by a known technique.

  FIG. 6 is a diagram illustrating an example of the contents of the decoration information generated by the decoration editing unit 111. As illustrated, the decoration information includes items of “time stamp”, “material identifier”, “event”, and “argument”. The “time stamp” item stores information indicating the time (timing) when the time axis of karaoke accompaniment is used as a reference. In the item “material identifier”, an identifier for identifying material data is stored. The item “event” stores information (hereinafter “event identifier”) related to the display and operation of the decoration image. In the “argument” item, an argument corresponding to the type of event is stored. The number of arguments may be one, may be plural as shown in FIG. 6, or may be zero (that is, no argument may be set).

  In this embodiment, as event identifiers, “object creation”, “object deletion”, “object application”, “object cancellation”, “object movement”, “object expansion / contraction”, “object enhancement” , “Change object speed” is used. The event identifier is not limited to these, and other event identifiers may be used. “Generate object” indicates that an object related to the display of the decoration image is generated. “Delete object” indicates that the object is to be deleted. “Apply object” indicates that a decoration image is displayed on the main display device 22. In this case, display coordinates and display size are set as arguments. “Cancel object” indicates that the decoration image is deleted from the touch screen 171. “Move object” indicates that the display position of the decoration image is to be changed. In this case, display coordinates are set as an argument. “Object expansion / contraction” indicates that the display size of the decoration image is changed. In this case, the display size is set as an argument. “Object enhancement” indicates that a preset enhancement operation is performed on each decoration image. “Change object speed” indicates that the reproduction speed of the decoration image is changed. In this case, the playback speed is set as an argument.

  Each time the user performs an operation related to display of a decoration image (that is, every time a signal related to display of a decoration image is output from the touch screen 171), the decoration editing unit 111 sets the timing at which the operation is performed. Decoration information including the time stamp indicated and an event identifier indicating the event corresponding to the operation is generated, and the generated decoration information is output to the encoder 112.

  Next, an example of specific contents of the decoration process performed by the decoration editing unit 111 will be described. When the user performs an operation of selecting any of the material images using the touch screen 171, the decoration editing unit 111 generates material data corresponding to the signal output from the touch screen 171 and the display content of the touch screen 171. The material image is read from the material data storage area 143, and the material image indicated by the read material data is combined with the singing video and the lyrics telop and displayed on the touch screen 171. Specifically, for example, when any of the frame materials is selected by the user, the decoration editing unit 111 synthesizes the image of the selected frame material into the song video and the lyrics telop, and the preview screen P1. To display. For example, when the frame “Sakura Fubuki” is selected, the decoration editing unit 111 reads out material data representing “Sakura Fubuki” from the material data storage area 143, and displays a material image indicated by the read material data. It is combined with the singing video and the lyrics telop and displayed on the preview screen P1. When any of the stamp materials is selected by the user, the decoration editing unit 111 combines the image A1 of the selected stamp material into the song video and the lyrics telop as illustrated in FIG. It is displayed on the preview screen P1. For example, when any of the pen materials is selected by the user and a drag operation is performed on the preview screen P1, the decoration editing unit 111 displays a line drawn on the preview screen P1. In the following description, for convenience of explanation, a material image displayed on the touch screen 171 and a line drawn using a pen material will be referred to as a “decoration image”. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “object generation”.

  At this time, the decoration editing unit 111 specifies the tempo of the karaoke accompaniment being reproduced, and changes the display mode of the decoration image at a timing according to the specified tempo. Specifically, when the decoration image is a moving image composed of a plurality of still images, the decoration editing unit 111 reproduces and displays the decoration image at a reproduction speed corresponding to the tempo of the karaoke accompaniment being reproduced. That is, the decoration editing unit 111 refers to the accompaniment data, acquires information indicating the tempo of the karaoke accompaniment, and animates the decoration image in synchronization with the rhythm of the karaoke accompaniment. At this time, if a default value of the reproduction speed is set in advance for the decoration image, the decoration editing unit 111 reproduces and displays the decoration image at the reproduction speed. Specifically, for example, when it is set to switch the image for each beat, the decoration editing unit 111 switches and displays the image for each beat in accordance with the karaoke accompaniment tempo. Thus, by synchronizing the karaoke accompaniment and the image display, the display of the decoration image can be made more natural.

  Further, the decoration editing unit 111 changes the set change if the display image (display position, display size, transparency, color, reproduction speed, etc.) is changed in advance in the decoration image. According to the mode, the display mode of the decoration image is changed at a timing corresponding to the tempo of the karaoke accompaniment (in synchronization with the karaoke accompaniment). Specifically, for example, the decoration editing unit 111 sets the display position of the decoration image at every time interval (for example, left, right, left, right,...) According to the rhythm of the karaoke accompaniment. It may be moved every beat). Further, for example, the display size of the image may be switched at predetermined time intervals (for example, every beat) according to the rhythm of the karaoke accompaniment, such as large, small, large, small,.

  On the other hand, if the decoration image is composed of a single still image and does not include information indicating the display mode change mode, the decoration editing unit 111 does not change the display mode and displays the still image. Display as it is.

  Until the decision button B1 is selected, the decoration image is only displayed on the touch screen 171 and is not displayed on the main display device 22. That is, only the singing video and the lyrics telop are displayed on the main display device 22 until the determination button B1 is selected. However, when the sync button B3 is selected in advance by the user, the decoration editing unit 111 displays a screen similar to the preview screen P1 on the main display device 22. On the other hand, when the sync button B3 is not selected, the decoration editing unit 111 does not reflect the display content of the preview screen P1 on the screen of the main display device 22 until the determination button B1 is selected.

  When the determination button B1 is selected by the user while the decoration image is displayed on the touch screen 171, the decoration editing unit 111 reflects the display content of the preview screen P1 on the main display device 22. That is, when the user touches the enter button B1, the decoration editing unit 111 displays the decoration image displayed on the preview screen P1 also on the main display device 22. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “application of object”.

  When the user touches the cancel button B2 while touching the decoration image on the preview screen P1, the decoration editing unit 111 deletes the decoration image from the preview screen P1 and the display screen of the main display device 22. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “deletion of object”.

  When the user touches the speed change button B4 while touching the decoration image on the preview screen P1, the decoration editing unit 111 changes the animation speed of the decoration image. Specifically, when an operation for instructing to reduce the speed is performed, the decoration editing unit 111 decreases the reproduction speed of the decoration image. On the other hand, when an operation indicating increasing the speed is performed, the decoration editing unit 111 increases the reproduction speed of the decoration image. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “change in object speed”.

  When the user double-clicks the decoration image on the preview screen P1 in a state where the decoration image is displayed on the preview screen P1, the decoration editing unit 111 performs an emphasis operation specific to the decoration image. For example, when the material image is a star, an animation display in which the star is glittering may be performed. In this case, the decoration editing unit 111 displays an image associated with the double-click operation according to the signal output from the touch screen 171 and the display content of the touch screen 171. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “emphasis of object”.

  When the user drags a stamp on the preview screen P1, the decoration editing unit 111 changes the display position of the stamp. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “movement of the object”.

  When the user performs an operation of spreading the stamp with two fingers on the preview screen P1, the decoration editing unit 111 increases the display size of the stamp. Conversely, when the user performs an operation of narrowing the stamp with two fingers on the preview screen, the decoration editing unit 111 reduces the display size of the stamp according to the operated content. At this time, the decoration editing unit 111 generates and outputs decoration information indicating “object expansion / contraction”.

  As described above, the user of the karaoke apparatus 1 can display or edit the decoration image using the touch screen 171. The singing video having undergone the decoration process is stored as a decorated video file.

  The user of the karaoke apparatus 1 can enjoy the recorded singing video again by playing back the stored decorated video file later. At this time, since the decoration image by the user performing the decoration operation is synthesized with the reproduced singing image, the singing image can be made more entertaining, and Not only singers but also other users can enjoy the singing video.

<Operation example 2 of karaoke equipment>
The user of the karaoke apparatus 1 can perform a decoration operation while the singer is singing (see the operation example 1 of the karaoke apparatus), and even after the singing is finished, the singing video Can be decorated. Here, an example of operation when performing a decoration operation after singing will be described with reference to FIG. FIG. 7 is a diagram for explaining the contents of processing when performing a decoration operation after singing. In FIG. 7, the same components as those shown in FIG. In FIG. 7, the decoder 113 reads the decorated video file from the decorated video file storage area 144, and decodes the read decorated video file into video data, lyrics telop data, audio data, and decoration information. The decoder 113 outputs the video data and the lyrics telop data to the decoration editing unit 111 and the encoder 112, and outputs the decoration information to the decoration editing unit 111. The decoder 113 outputs audio data to the encoder 112 and supplies the audio data to the speaker 20 via the audio processing unit 19.

  The decoration editing unit 111 specifies the processing content for the decoration image according to the decoration information supplied from the decoder 113. When the decoration information indicates that a decoration image is to be displayed, the decoration editing unit 111 combines the decoration image with the video data and the lyrics telop data supplied from the decoder 113 and displays them on the touch screen 171. . Specifically, for example, when the event identifier included in the decoration information indicates “object generation”, the decoration editing unit 111 reads the material data from the material data storage area 143, and an image indicated by the read material data Is displayed on the touch screen 171. If the event identifier is “deletion of object”, the decoration editing unit 111 deletes the object. When the event identifier indicates “application of object”, the decoration editing unit 111 displays the decoration image displayed on the touch screen 171 on the main display device 22. When the event identifier is “cancel object”, the decoration editing unit 111 deletes the object from the preview screen. When the event identifier indicates “move object”, the decoration editing unit 111 changes the display position of the decoration image on the preview screen according to the decoration information. When the event identifier indicates “object expansion / contraction”, the decoration editing unit 111 changes the display size of the decoration image on the preview screen according to the decoration information. When the event identifier indicates “emphasis of object”, the decoration editing unit 111 performs an emphasis operation specific to the object on the preview screen. In this way, the decorated video is displayed on the touch screen 171 and the main display device 22.

  The user can further perform a decoration operation on the video while viewing the decorated video. The details of this decoration operation are the same as those described above (Operation example 1 of the karaoke apparatus), and thus detailed description thereof is omitted here. In other words, the user can add a decoration image, change the display position and display size of the decoration image that has already been added, or delete the decoration image that has been added while viewing the decorated video. And various other operations can be performed.

  In this way, the decoration can be edited not only while the singer is singing but also after the singing. As a result, the decorated video can be brought close to the video desired by the user.

  As described above, according to the present embodiment, when the karaoke apparatus 1 is used by a plurality of people, other users can decorate the singing video in real time while the singer is singing. Thus, not only singers but also users who are not singing can be entertained. At this time, since the decoration image is reproduced according to the tempo of the karaoke accompaniment, it is possible to perform a natural animation that is more suitable for the music, and to make the singing video more entertaining. . Moreover, according to this embodiment, it is also possible to decorate while reproducing the image | video which recorded the figure to sing.

<Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. An example is shown below. In addition, you may combine each following aspect suitably.
(1) In the above-mentioned embodiment, although the display control apparatus which is this invention demonstrated embodiment when applied as a karaoke apparatus which reproduces | regenerates a karaoke accompaniment, the display control apparatus which concerns on this invention is restricted to a karaoke apparatus. For example, a general-purpose computer such as a personal computer may be used. When the display control device is a general-purpose computer, the video card corresponds to the display circuit 16, and the keyboard and mouse correspond to the input device 17.

(2) In the above embodiment, the karaoke apparatus 1 encodes the decoration information together with the singing video data, the lyrics telop data, the singing voice data, and the accompaniment sound data to generate a decorated video file, and the generated decoration Although the video file is stored in the storage device 14, only the decoration information may be stored in the storage device 14 without being configured to generate a decorated video file. In the above-described embodiment, the material data is not included in the decorated file. However, the present invention is not limited to this, and the material data may be included in the decorated file.

(3) In the above-described embodiment, the decoration editing unit 111 and the encoder 112 illustrated in FIG. 3 are configured to be realized as software by the CPU 11 reading and executing a computer program stored in the ROM 12 or the storage device 14. However, the present invention is not limited to this, and the decoration editing unit 111 and the encoder 112 may be configured as hardware.

(4) In the above-described embodiment, the decoration processing is performed on the video data indicating the video shot by the video camera 21. However, the video data to be subjected to the decoration processing is the video shot by the video camera 21. The data is not limited to data indicating other data. For example, it may be data indicating an avatar or CG video, or may be video data or image data downloaded by a user from a predetermined server device or the like.
In the above-described embodiment, a line drawn by a frame material, a stamp material, or a pen material is used as a decoration image. However, the decoration image is not limited to this, and for example, a character (text) may be drawn. .

(5) In the above-described embodiment, the configuration in which the input device 17, the singing microphone 18, the speaker 20, the video camera 21, and the main display device 22 are externally attached to the karaoke device 1 is described. The microphone or the like may be built in the karaoke apparatus 1.

(6) In the above-described embodiment, the accompaniment data includes section data indicating a specific section of the music (for example, a chorus section), and the CPU 11 of the karaoke apparatus 1 refers to the section data and indicates the section data. You may make it vary the display mode of a decoration image by the area and the area other than that. Specifically, for example, when displaying a frame image of “cherry blossoms”, a display in which a lot of cherry blossoms dance in the rust section may be performed. In this case, the material data includes a plurality of pieces of image data (for example, moving image data displayed outside the chorus section and moving image data displayed in the chorus section), and correspondence between the moving image data and the chorus section. May be included in the material data. The CPU 11 displays the image data corresponding to the chorus section based on the correspondence indicated by the data included in the material data.

(7) In the above-described embodiment, the CPU 11 of the karaoke apparatus 1 may change the display mode of the decoration image according to the output gain of the singing sound collected by the singing microphone 18. Specifically, for example, the display size of the decoration image may be increased as the output gain is increased.

(8) In the above-described embodiment, accompaniment sound data representing karaoke accompaniment is used as music data indicating music, but the music data is not limited to accompaniment sound data, for example, guide melody data indicating the melody of music. The data may be any data as long as the tempo of the music can be specified by the data.

(9) In the above-described embodiment, the CPU 11 may change the display mode of the decoration image according to the pitch of the guide melody of the music. Specifically, for example, the CPU 11 may increase the display size of the decoration image as the pitch is higher. In the above-described embodiment, the CPU 11 may change the display mode of the decoration image according to the content of the lyrics of the music. Specifically, for example, when the CPU 11 analyzes the lyrics represented by the lyrics telop data and searches for a specific word (for example, “star”, “heart”), the animation image is reproduced at the reproduction timing of the word. You may make it enlarge the display size of. In the above-described embodiment, the CPU 11 may perform image analysis on the movement of the singer and synchronize the analyzed movement with the animation operation of the decoration image.

(10) In the above-described embodiment, when the user operates the touch screen 171 to change the display mode of the decoration image, the CPU 11 of the karaoke apparatus 1 synchronizes the reproduction of the karaoke accompaniment and the reproduction of the decoration image. As described above, the time stamp of the decoration information may be corrected. A specific example in this case will be described below. For example, the user of the karaoke apparatus 1 uses the touch screen 171 to move the decoration image representing “star” on the preview screen such as right, left, right, left,... According to the rhythm of the karaoke accompaniment. Suppose that In this case, there may be a slight difference between the rhythm of the user's operation and the karaoke accompaniment rhythm. In such a case, the CPU 11 of the karaoke apparatus 1 may correct the time stamp of the decoration information so as to correct this deviation. In this case, more specifically, the CPU 11 specifies the rhythm by referring to the accompaniment data, and when the difference between the beat start timing and the time stamp of the decoration information is within a predetermined threshold, the time stamp May be changed to the same value as the beat start timing. In this way, the animation operation of the decoration image can be made more in line with the karaoke accompaniment rhythm.

(11) The program executed by the CPU 11 of the karaoke apparatus 1 in the above-described embodiment is a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, a semiconductor memory, etc. It can be provided in a state where it is recorded on a computer-readable recording medium. It is also possible to download to the karaoke apparatus 1 via a network such as the Internet.

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Memory | storage device, 15 ... Communication I / F, 17 ... Input device, 18 ... Singing microphone, 19 ... Audio | voice processing part, 20 ... Speaker, 21 ... Video camera, 22 ... Main display device, 111 ... Decoration editing unit, 112 ... Encoder, 113 ... Decoder, 114 ... Adder, 141 ... Lyric telop data storage area, 142 ... Accompaniment sound data storage area, 143 ... Material data storage Area 144: Decorated video file storage area 171 Touch screen.

Claims (6)

Music data storage means for storing music data indicating the music;
Video data acquisition means for acquiring video data indicating video;
Image data storage means for storing image data indicating an image for decorating the video;
A reproducing means for displaying the operation screen and reading out the music data corresponding to the signal output from the operation display means operated by the user and the display content of the operation display means from the music data storage means;
The signal output from the operation display means and the image data corresponding to the display contents of the operation display means are read from the image data storage means, the image indicated by the read image data and the video data acquired by the video data acquisition means Is a display control unit that synthesizes and displays on the display unit the video data indicated by And a display control means. The display control apparatus according to claim 1, wherein the video data is data indicating a video shot by a shooting unit. The display control means, when the image indicated by the read image data is a moving image, displays the image at a reproduction speed corresponding to the tempo of music data reproduced by the reproduction means. Item 3. The display control device according to Item 1 or 2. When the signal indicating that the display mode of the image is changed is output from the operation display unit, the display control unit changes the display mode of the image according to the signal,
The display according to any one of claims 1 to 3, wherein sequence data indicating at least one of display start timing and display mode change timing of the image indicated by the image data is generated and output. Control device. The music data includes section data indicating a specific section of the music,
The display control means refers to the section data included in the music data reproduced by the reproducing means, and makes the display mode of the image different between the section indicated by the section data and the other sections. The display control apparatus of any one of Claims 1 thru | or 4. The image data includes a plurality of display mode data indicating at least one of a display position, a display size, a display color, transparency, and a relative switching speed with respect to a reproduction speed of the music data,
The display control according to claim 1, wherein the display control unit switches a display mode of an image indicated by the read image data according to display mode data included in the image data. apparatus.