TWI683691B - Method for generating customized hit-timing list of music game automatically, non-transitory computer readable medium, computer program product and system of music game - Google Patents

Abstract

A method for generating a customized hit-timing list of a music game automatically, a non-transitory computer readable medium, a computer program product and a system of the music game are disclosed. The method includes the steps of receiving and parsing a user’s selection in a user interface for game setting and operating, activating or applying a first generation rule for classifying the types such as the lyrics, the human voices, the string instruments and the percussive instruments of each section or frame of a user-specific or a system-preset audio source and detecting the corresponding onsets to generate at least one first raw hit-timing list and activating or applying a second generation rule for generating a hit-timing list derived from the first raw hit-timing list.

Description

Automatic generation method for customized beat spectrum of music games, non-transitory computer readable media, computer Program products and music game system

The invention relates to a method for generating game data, non-transitory computer readable media, computer program products and systems, in particular to a method for automatically generating music game customized beat spectrum, non-transitory computer readable media, computer Program products and music game systems.

Beat-type or percussive music games built on large game consoles, video game consoles, computer games, handheld electronic audio-visual devices or mobile phones are still quite popular types of games. However, the beat spectrum used by this type of beat-type or percussion-type music game is often pre-set by the game developer and must be manually marked by the developer to generate it. Or the interactiveness and customization of the players.

In addition, in order to increase the convenience and portability of this type of game bearing device or system for user operation, lightweight or miniaturized design often limits the user's operable interface The size and position, in turn, affect the user's control accuracy of the preset operating interface or buttons and other input modules, user experience or entertainment effects.

In addition, based on increasing computing speed, accelerating game response time and reducing power consumption of handheld electronic audio-visual devices or mobile phones, centralized or decentralized processing of some modules and computing tasks also depends on the type of application. In view of this, it is necessary to provide technical inventions that can meet the interaction needs of users in customized audio sources and user-defined interface operation modes, as well as provide automatic judgment and generation of beat spectrum planes based on the type of audio source composition fragments. Inventions related to synthetic music games.

One of the main objects of the present invention is to provide a method for automatically generating customized music scores for music games to effectively improve the problems of inability to customize and automatically generate music scores, limited manipulation, lack of interactivity, and low portability.

Another main object of the present invention is to provide a non-transitory computer-readable memory medium with a stored program, which is effective for the execution of a computer system and improves the inability to customize and automatically generate beat spectrum, limited control, and lack of interaction Issues of low sex and portability.

Another main object of the present invention is to provide a computer program product with a stored program, which is effective in the execution of a computer system and improves the inability to customize and automatically generate beat spectrum, limited control, lack of interactivity and low portability And other issues.

Another main object of the present invention is to provide a music game system to effectively improve the inability to customize and automatically generate beat spectrum, limited control, lack of interactivity and The problem of low portability.

To achieve the above purpose, the method for automatically generating customized music scores for music games provided by the present invention includes the following steps: receiving and analyzing at least one operation option selected by a user in a game setting and operation interface, and according to the operation The analysis result corresponding to one of the options corresponds to a program parameter or instruction. A beat spectrum generation program is executed on a user-created audio or a user non-created audio to generate a beat spectrum surface. The beat spectrum surface generation program further includes: Activate a first beat spectrum generation rule according to the program parameters or instructions to distinguish one type of each component segment of the user-created audio or the user's non-created audio, and respectively detect one utterance corresponding to each type Starting point to generate at least a first basic beat surface, where the type includes lyrics, vocals, stringed instruments or percussion instruments; and a second beat surface generation rule is activated based on the program parameters or instructions and the types, by which At least one first basic beat spectrum surface further generates the beat spectrum surface.

In an embodiment of the invention, the step of further generating the beat spectrum surface from the at least one first basic beat spectrum surface further includes: generating a second basic beat spectrum surface and a third basic sound from the at least one first basic beat spectrum surface A beat spectrum surface or a fourth basic beat spectrum surface; and using the second basic beat spectrum surface, the third basic beat spectrum surface or the fourth basic beat spectrum surface as the beat spectrum surface.

In another embodiment of the present invention, the second basic beat spectrum surface is selected and combined from part or all of the at least one first basic beat spectrum surface. The generation of the fourth basic beat spectrum surface further includes: increasing or decreasing the utterance starting point of the at least one first basic beat spectrum surface, generating a third basic beat spectrum surface; and selecting and combining part or all of the third basic beat spectrum surface , The fourth basic beat spectrum surface is generated.

In other embodiments of the present invention, in the method for automatically generating customized music scores for music games, the at least one operation option is selected from a set difficulty level, a specified system default audio, or uploading a self-made audio content, and a recorded audio content , At least one of a group that displays historical scores or continues the game with historical records, one starts a new game, one shares games and scores, and one sets a game mode; the game setting and operation interface are set on a mobile phone And/or a near-end, remote, or cloud computer system with network communication capabilities and combinations thereof, and the game setting and operation interface are further available for the user to select or operate the displayed beat spectrum.

In other embodiments of the present invention, the game setting and operation interface and the beat spectrum are set and displayed on a mobile phone, and the at least one operation option is received and parsed and the beat spectrum is executed according to the program parameters or instructions The step of generating a program to generate the beat spectrum is performed on the mobile phone, a near-end, remote or cloud computer system with network communication capabilities and combinations thereof; if the user creates audio or the user does not create When the genre to which each audio component segment belongs has lyrics, it further includes: performing a lyrics segmentation procedure first, and then detecting the utterance starting point corresponding to the genre.

In order to achieve the above purpose, the non-transitory computer with a stored program provided by the present invention can read a memory medium. After the computer loads the program and executes it, it can complete the aforementioned automatic generation method of customized music scores for music games.

In order to achieve the above purpose, the computer program product with built-in program provided by the present invention can complete the aforementioned automatic generation method of customized music score surface of the music game after the computer loads the program and executes it.

To achieve the above purpose, the music game system provided by the present invention includes: a game setting and display interface with at least one operation option for a user to select; an audio storage module for storing a user-generated Audio, a user's non-self-generated audio, a beat spectrum surface generated and a beat-type music game synthesized; a beat spectrum surface generation program storage module for storing a beat spectrum surface generation program; and an audio processing module To receive and parse the at least one operation option selected by the user to access the audio storage module, load and execute the beat spectrum surface generation program to generate and output the beat spectrum surface and the beat spectrum surface and the user Self-made audio or the user's non-self-made audio synthesis beat music game.

In an embodiment of the present invention, the at least one operation option of the music game system is selected from a set difficulty level, a specified system default audio or uploading a homemade audio content, a recorded audio content, a historical score display or a The historical record is at least one of a group consisting of continuing a game, starting a new game, sharing a game and scores, and setting a game mode. Setting a game mode further includes an actual interface operation mode and a user-defined interface operation mode. The beat-type music game system further includes: a training program storage module for storing a user-created audio recognition and training program And/or a user-defined instrument sound recognition and training program, wherein if the user selects the user-defined interface operation mode, the audio processing module is further used to perform the user-defined instrument sound recognition and training program.

In another embodiment of the present invention, the audio processing module further executes a first beat spectrum surface generation rule of one of the beat spectrum surface generation programs according to a program parameter or instruction corresponding to the analysis result of the operation option to distinguish Each type segment of the user-generated audio or the user-ungenerated audio belongs to a type, and a utterance starting point corresponding to each type is detected to Integrate and generate at least one first basic beat spectrum, where the type includes lyrics, vocals, stringed instruments or percussion instruments. If the user-generated audio or the user's non-generated audio is composed of lyrics of the genre, the audio processing module first executes the user-generated audio or the user's non-generated audio A lyrics segmentation program, and then detect the utterance starting point corresponding to the type.

In other embodiments of the present invention, the audio processing module further executes any one of the beat spectrum surface generation process and any one of the beat spectrum surface generation rules and procedures A to D according to the program parameters or instructions and the types to determine the Beat spectrum: Program A: Use the at least one first basic beat spectrum as the beat spectrum; Program B: Select and combine some or all of the at least one first basic beat spectrum to generate a second basic beat spectrum. The second basic beat spectrum surface is used as the beat spectrum surface; program C: increasing or decreasing the utterance starting point of the at least one first basic beat spectrum surface to generate a third basic beat spectrum surface, and using the third basic beat spectrum surface as the beat spectrum surface; And program D: Select and combine part or all of the third basic beat spectrum surface to generate the fourth basic beat spectrum surface.

In addition, in other embodiments of the present invention, the music game system is a mobile phone and/or a near-end, remote or cloud computer system with network communication capabilities and combinations thereof. In other embodiments of the present invention, the music game system further includes: a video processing module for displaying the beat spectrum on the game setting and display interface when the beat-type music game is executed. The game setting and operation interface, the beat spectrum and the beat-type music game are set or displayed on a mobile phone, and the audio processing module and the video processing module are set on the mobile phone or have a network One of the communication capabilities of near-end, far-end or cloud computer systems and their combinations.

In summary, the method for automatically generating customized music scores for music games, non-transitory computer-readable media, computer program products, and music game systems provided by the present invention can be effective for computer systems to execute programmatic methods, from From the data obtained by detecting the sound start time, select available and relatively important time points, and classify the audio content, generate types and difficulty, integrate these results, and automatically generate beat spectrum. Music games created by this method, the music score is generated through an automated process, which greatly improves production capacity; users can instantly convert the music they hold into the music score, which can increase game richness and customization, and can also obtain centralized or decentralized The system configuration is flexible in the multiple choice of computing and energy consumption.

S11~S15, S21~S25 ‧‧‧ steps

U‧‧‧ user

3‧‧‧Music game system

31‧‧‧Game settings and display interface

P‧‧‧Operation options

P1‧‧‧ Set difficulty level

P2‧‧‧Specify the system default audio or upload your own audio content

P3‧‧‧Record audio content

P4‧‧‧ Display historical scores or continue the game with historical records

P5‧‧‧Start new game

P6‧‧‧Share game and score

P7‧‧‧Set a game mode

P71‧‧‧ Actual interface operation mode

P72‧‧‧User-defined interface operation mode

32‧‧‧Audio storage module

321‧‧‧User-created audio

322‧‧‧User non-created audio

323‧‧‧ Beat Spectrum

324‧‧‧music game

33‧‧‧ Beat spectrum generation program storage module

331‧‧‧ Beat spectrum generation program

34‧‧‧Audio processing module

35‧‧‧Training program storage module

351‧‧‧User-created audio recognition and training program

352‧‧‧User-defined instrument sound recognition and training program

36‧‧‧Video processing module

FIG. 1 is a flowchart of an embodiment of a method for automatically generating customized beat scores for a music game according to the present invention.

FIG. 2 is a flowchart of another embodiment of a method for automatically generating customized beat scores for a music game according to the present invention.

3 is a block diagram of a system architecture according to an embodiment of a beat-type music game system of the present invention.

Please refer to FIG. 1, which is a flowchart of an embodiment of a method for automatically generating customized music scores for music games according to the present invention. As shown in FIG. 1, in this embodiment, in step S11, the operation options selected by the user in the game settings and operation interface are received and analyzed, and the analysis result is generated. Corresponding program parameters or instructions, and in step S12, the first beat spectrum generation rule is activated according to the corresponding program parameters or instructions to distinguish the type of each user-created or non-created audio segment. For example, if the operation option selected by the user in the game settings and operation interface is to specify the system default audio or upload the homemade audio content, then in the step of enabling the first beat spectrum generation rule according to the corresponding program parameters or instructions, because Game developers are based on entertainment effects. The system's default audio may be a song that contains at least vocals or songs and background or accompaniment music, or it may contain lyrics. Therefore, you need to first determine the type of audio components, if it contains vocals or songs Singing Voice Separation needs to be processed first with the background or accompaniment music. Therefore, the first beat spectrum generation rule can be, for example, a sound separation algorithm, used to separate the vocals or singing voices in the music from the background or accompaniment music . In addition, if the operation option is to specify the system default audio or upload the homemade audio content, and it is determined that the user is to upload the homemade audio content to be used to generate the beat spectrum, it may contain monotone or mixed sounds, any user objects Percussion or sounds or beats, user-created music, vocals or lyrics with speech/spoken voices, a cappella or animal sounds without accompaniment or background music, etc. Therefore, the rule for generating the first beat spectrum can be, for example, An algorithm for separating sounds or distinguishing or identifying sound types.

According to the above embodiment, for example, when the operation option selected by the user in the game setting and operation interface is to set the difficulty level, the second beat spectrum generation rule may be to select and combine part or all of the number according to the user's difficulty requirements for the music game At least one first basic beat spectrum surface, that is, when the user receives or judges that the user hopes that the game difficulty may be higher, repeating or combining the entire number of utterance starting points to make the beat spectrum surface denser, and when the difficulty is lower, The collection of repeated or combined parts of the starting point of the sound makes the beat spectrum surface sparse or Loose, so users can beat or tap the beat during the game. It is mentioned here that in another embodiment, the first beat spectrum surface generation rule and the second beat spectrum surface generation rule may also be in response to the pitch of the music, beat, tonality/genre, violent change degree, multiple starting points The proximity and density in time may be determined by the K-means clustering method to distinguish or specify the number of channels or the user-selected set game mode (such as a user-defined interface operation mode) to determine, Increase or decrease the content and quantity of the utterance starting point of at least one first basic beat spectrum surface, so as to remove or increase the number from the intensive utterance starting point.

Then, according to the above embodiment, in step S13, if the genre contains lyrics, a lyrics segmentation procedure is performed first to detect the corresponding vocalization start point, and the genre is detected as a vocal, stringed instrument, or percussion instrument, respectively. The corresponding sound starting point is integrated to generate at least a first basic beat spectrum. In step S14, the second beat spectrum surface generation rule is enabled according to the program parameters or instructions and the type to which it belongs, and in step S15, a second basic beat spectrum surface is generated by selecting and combining at least one first basic beat spectrum surface from part or all of the number, using the The second basic beat spectrum is used as the beat spectrum.

Please also refer to FIG. 1 and FIG. 2. FIG. 2 is a flowchart of another embodiment of the method for automatically generating a customized music score for a music game according to the present invention. In this embodiment, steps S21 to S24 are the same as steps S11 to S14, so they are not repeated here. After step S24, step S25 is executed to increase or decrease the utterance starting point of at least one first basic beat spectrum surface to generate a third basic beat spectrum surface, using the third basic beat spectrum surface as the beat spectrum surface, or select and combine a part or all of the third number The basic beat spectrum surface generates a fourth basic beat spectrum surface, and the fourth basic beat spectrum surface is used as the beat spectrum surface.

Please refer to FIG. 3, which is a block diagram of a system architecture according to an embodiment of the music game system of the present invention. In this embodiment, the music game system 3 includes: a game setting and display interface 31. At least one operation option P can be selected by a user U; an audio storage module 32 is used to store user-generated audio 321, user-ungenerated audio 322, generated beat spectrum 323 and synthesized A music game 324; a beat score generation program storage module 33 for storing a beat score generation program 331; and an audio processing module 34 for receiving and analyzing the at least one operation option P selected by the user U to Access the audio storage module 32, load and execute the beat spectrum surface generation program 331 to generate and output the beat spectrum surface 323 and the beat spectrum surface 323 and the user-created audio 321 or the user non-created audio 322 A music game 324 is synthesized. The music game 324 may be, for example, a beat-type, percussion-type, or strike-type music game.

In an embodiment of the invention, at least one operation option P is selected from a set difficulty level P1, a specified system default audio or uploading a self-made audio content P2, a recorded audio content P3, a display of historical scores or historical records At least one of the continuation game P4, a new game start P5, a shared game and score P6, and a game mode P7 is set. A setting a game mode P7 further includes an actual interface operation mode P71 and a user-defined interface operation mode P72. The beat-type music game system 3 further includes: a training program storage module 35 for storing a user-generated The audio recognition and training program 351 and/or a user-defined instrument sound recognition and training program 352, wherein if the user U selects the user-defined interface operation mode P72, the audio processing module 34 is further used to execute the user-defined Define the instrument sound recognition and training program 352.

In another embodiment of the present invention, the audio processing module 34 further executes a first beat spectrum surface generation rule of one of the beat spectrum surface generation programs 331 according to a program parameter or instruction corresponding to an analysis result of an operation option P to distinguish The user-generated audio 321 or the user's non-generated audio 322 constitutes a type of each segment, and respectively detects a starting point corresponding to each type Integrate and generate at least one first basic beat spectrum, where the type includes lyrics, vocals, stringed instruments or percussion instruments. If the user-generated audio 321 or the user's non-autonomous audio 322 has lyrics in the type of each component segment, the audio processing module 34 first executes a lyrics to the user-generated audio 321 or the user's non-generated audio 322 Segmented program, and then detect the starting point of utterance corresponding to the type.

In other embodiments of the present invention, the audio processing module 34 further executes one of the second beat spectrum surface generation program 331 and any one of the programs A to D according to the program parameters, instructions, and types to determine the beat spectrum surface 323. Program A uses the at least one first basic beat spectrum surface as the beat spectrum surface 323; Program B selects and combines at least one first basic beat spectrum surface from part or all of the number to generate a second basic beat spectrum surface. The two basic beat spectrum planes serve as the beat spectrum plane 323; program C is to increase or decrease the utterance starting point of at least one first basic beat spectrum plane to generate a third basic beat spectrum plane, using the third basic beat spectrum plane as the beat spectrum plane 323; and program D, It is to select and combine part or all of the third basic beat spectrum surface to generate the fourth basic beat spectrum surface. It is mentioned here that the first beat spectrum surface generation rule may be, for example, an algorithm for sound separation or a sound type distinction or recognition, and the second beat spectrum surface generation rule may be selected and combined according to the user's difficulty in the music game. The total number of at least one first basic beat spectrum surface to control the intensity of the beat points of the beat spectrum surface, and the first beat spectrum surface generation rule and the second beat spectrum surface generation rule can also be in accordance with the pitch, beat, tonality/song of the music The wind, the degree of change, the proximity and density of multiple utterance starting times or the K-means clustering method can be used to distinguish or specify the number of channels or the user-selected set game mode (for example, a user User-defined interface operation mode) to determine, increase or decrease at least a first basic section The content and number of vocalization starting points on the beat surface are removed or increased from the denser vocalization starting points.

In addition, in other embodiments of the present invention, the music game system 3 is a mobile phone and/or a near-end, remote or cloud computer system with network communication capabilities and combinations thereof. In other embodiments of the present invention, the music game system 3 further includes a video processing module 36 for displaying the beat spectrum surface 323 on the game setting and display interface 31 when the music game 324 is executed. The game setting and operation interface 31, the beat spectrum surface 323 and the music game 324 are set or displayed on a mobile phone, and the audio processing module 34 and the video processing module 36 are set on the mobile phone or One of the near-end, far-end or cloud computer systems with network communication capabilities and their combinations.

The above-mentioned embodiments are only examples, and are not intended to limit the scope of implementation of the present invention; any simple or equivalent changes and modifications made without departing from the spirit and scope of the present invention shall still fall within the scope of the patent of the present invention. .

S11~S15‧‧‧Step

Claims (17)

A method for automatically generating customized music scores for music games, comprising: receiving and parsing at least one operation option selected by a user in a game setting and an operation interface, and corresponding to a program parameter or a program parameter corresponding to the analysis result of one of the operation options Command to execute a beat spectrum surface generation program for a user-created audio or a user non-created audio to generate a beat spectrum surface. The beat spectrum surface generation program further includes: enabling a first beat spectrum surface generation according to the program parameters or instructions Rules to distinguish a type of each user-generated audio or non-user-generated audio, and detect an onset corresponding to each type to integrate and generate at least a first basic Beat spectrum surface, where the type includes lyrics, vocals, stringed instruments or percussion instruments; and a second beat spectrum surface generation rule is enabled according to the program parameters or instructions and the types, further from the at least a first basic beat spectrum surface Generate the beat spectrum. For example, the method for automatically generating a customized music score surface for a music game according to item 1 of the patent scope, wherein the step of generating the beat spectrum surface from the at least one first basic beat spectrum surface further includes: generating from the at least one first basic beat spectrum surface A second basic beat spectrum surface, a third basic beat spectrum surface or a fourth basic beat spectrum surface; and using the second basic beat spectrum surface, the third basic beat spectrum surface or the fourth basic beat spectrum surface as the beat spectrum surface. For example, the method for automatically generating customized music scores for music games in item 2 of the patent scope, wherein the second basic beat spectrum is selected and combined from part or all of the at least one first basic beat spectrum, and the third basic beat The spectrum surface is generated by adding or subtracting the utterance starting point of the at least one first basic beat spectrum surface, and the fourth basic beat spectrum surface is selected and combined from partial or full The number of the third basic beat spectrum. For example, in the first patent application, a method for automatically generating customized music scores for music games, wherein the at least one operation option is selected from a set difficulty level, a specified system default audio, or uploading a self-made audio content, and a recorded audio content . At least one of a group that displays historical scores or continues the game with historical records, starts a new game, shares a game and scores, and sets a game mode. For example, the automatic generation method of customized music scores for music games in item 1 of the patent scope, where the game settings and operation interface are set on a mobile phone and/or one of the near end, remote end or cloud with network communication capabilities A computer system and its combination, and the game setting and operation interface are further available for the user to select or operate the displayed beat spectrum. For example, a method for automatically generating customized music scores for music games in item 1 of the patent scope, wherein the game setting and operation interface and the music scores are set and displayed on a mobile phone, and the at least one operation is received and parsed The step of generating the beat spectrum surface by selecting and executing the beat spectrum surface generation program according to the program parameters or instructions is performed on the mobile phone, a near-end, remote or cloud computer system with network communication capabilities and combinations thereof. For example, the method for automatically generating customized music scores for music games according to item 1 of the patent scope, where if the user-generated audio or the user's non-generated audio belongs to the genre of the genre, it includes: Perform a lyrics segmentation procedure first, and then detect the starting point of the utterance corresponding to the type. A non-transitory computer with a stored program that can read the memory media. After the computer loads the program and executes it, it can complete the customized beat spectrum of the music game as described in any of items 1 to 7 of the patent application. Automatic generation method. A computer program product with a stored program. After the computer loads the program and executes it, it can complete the automatic generation method of the customized music score surface of the music game as described in any one of the items 1 to 7 of the patent application. A music game system includes: a game setting and display interface with at least one operation option for a user to select; an audio storage module for storing a user-created audio, a user non-created audio, A beat spectrum surface generated and a music game synthesized; a beat spectrum surface generation program storage module for storing a beat spectrum surface generation program; and an audio processing module for receiving and analyzing the user selected At least one operation option to access the audio storage module, load and execute the beat spectrum generation program to generate and output the beat spectrum, and the beat spectrum with the user-created audio or the user's non-created audio Synthesize the music game. For example, the music game system of claim 10, wherein the at least one operation option is selected from a set difficulty level, a specified system default audio or uploading homemade audio content, a recorded audio content, a historical score display or The historical record is at least one of a group consisting of continuing a game, starting a new game, sharing a game and scores, and setting a game mode. For example, the music game system of claim 11 of the patent scope, wherein the setting of a game mode further includes an actual interface operation mode and a user-defined interface operation mode, the music game system further includes: a training program storage module, used To store a user-created audio recognition and training program and/or a user-defined instrument sound recognition and training program, where the audio processing module is more useful if the user selects the user-defined interface operation mode To execute Define musical instrument sound recognition and training procedures. For example, the music game system of claim 10, wherein the audio processing module further executes one of the beat spectrum surface generation procedures according to a program parameter or instruction corresponding to the analysis result of the operation option. Rules to distinguish a type to which each component segment of the user-created audio or the user-non-created audio belongs, and respectively detect a utterance starting point corresponding to each type to integrate and generate at least a first basic beat spectrum surface, The type includes lyrics, vocals, stringed instruments or percussion instruments. For example, the music game system of claim 13 of the patent scope, in which if the user-generated audio or the user's non-generated audio belongs to the genre of the genre, the audio processing module first addresses the user The self-created audio or the user's non-created audio executes a lyrics segmentation process, and then detects the utterance starting point corresponding to the type. For example, the music game system according to item 14 of the patent application, wherein the audio processing module further executes one of the beat spectrum surface generation procedures and the second beat spectrum surface generation rules and procedures A to D according to the program parameters or instructions and the types One item to determine the beat spectrum surface: Program A: use the at least one first basic beat spectrum surface as the beat spectrum surface; Program B: select and combine some or all of the at least one first basic beat spectrum surface to generate a second The basic beat spectrum surface, using the second basic beat spectrum surface as the beat spectrum surface; program C: increasing or decreasing the utterance starting point of the at least one first basic beat spectrum surface to generate a third basic beat spectrum surface, and using the third basic beat spectrum surface As the beat spectrum surface; and program D: select and combine part or all of the third basic beat spectrum surface to generate the fourth basic beat spectrum surface. For example, the music game system in the 10th scope of the patent application is a mobile phone and/or a near-end, remote or cloud computer system with network communication capabilities and combinations thereof, and further includes: A video processing module is used to display the beat spectrum surface in the game setting and display interface when the music game is executed. For example, the music game system of claim 16, wherein the game setting and operation interface, the beat spectrum and the music game are set or displayed on a mobile phone, and the audio processing module and the video processing module It is installed on the mobile phone or a near-end, remote or cloud computer system with network communication capabilities and combinations thereof.

Images