WO2018184249A1

WO2018184249A1 - Music generation method and terminal

Info

Publication number: WO2018184249A1
Application number: PCT/CN2017/079829
Authority: WO
Inventors: 陈崇震
Original assignee: 格兰比圣（深圳）科技有限公司
Priority date: 2017-04-08
Filing date: 2017-04-08
Publication date: 2018-10-11

Abstract

A music generation method and a terminal. The method comprises the following steps: recognizing an image to acquire element information in the image and parameter information of elements; and generating music according to the acquired element information and the parameter information of the elements. The terminal comprises: an image recognition module, for recognizing an image to acquire element information in the image and parameter information of elements; and a music generation module, for generating music according to the acquired element information and the parameter information of the elements. The music generated by using the technical solution can directly reflect the elements in the image, with a good matching effect, and achieving a visual to auditory conversion.

Description

Instruction title: A music generation method and terminal

Technical field

[0001] The present invention relates to the field of mobile terminals, and in particular, to a music generating method and a terminal.

Background technique

[0002] In order to increase the interest of browsing pictures, the music associated with the picture can also be played at the same time as the picture is displayed on the terminal. At present, the conventional method is that the terminal first searches for a matching music on the network or a pre-established music library according to, for example, a location and a time of the captured picture, and then plays the same picture through the player while browsing the picture. Match the music.

[0003] The existing method of providing music matching the picture, because the existing music library is searched for music matching the picture, it is often found that the searched music does not respond well to each of the pictures recorded in the picture. In the case of elements, the matching effect is poor, and the searched music does not reflect the content in the picture well.

technical problem

[0004] The technical problem to be solved by the present invention lies in the existing way of providing music matching the picture, the matching effect of the searched music and the picture is poor, and the searched music cannot reflect the defect of the content in the picture well. .

Problem solution

Technical solution

[0005] The technical solution adopted by the present invention to solve the technical problem thereof is: Providing a music generating method, comprising the following steps:

[0006] identifying a picture, acquiring element information in the picture and parameter information of the element;

[0007] Music is generated based on the acquired element information and parameter information of the element.

[0008] Preferably, the step of generating music according to the acquired element information and parameter information of the element includes:

[0009] Based on the acquired element information and the parameter information of the element, the sound of the element is generated using a sound simulation method.

[0010] Preferably, the step of generating music according to the acquired element information and the parameter information of the element comprises: [0011] determining a note type corresponding to the element information; [0012] acquiring a note in a corresponding note category according to parameter information of the element;

[0013] The music of the element is generated according to the acquired note.

[0014] Further preferably, the step of generating music according to the acquired element information and parameter information of the element further comprises:

[0015] The music of each element of the picture is superimposed and/or arranged in order to generate music that matches the picture.

[0016] Preferably, the music generating method of the present invention further includes:

[0017] associating the generated music with the picture.

[0018] Preferably, the music generating method of the present invention further includes:

[0019] When a play command is received, the generated music is played.

[0020] Further preferably, when the picture is browsed, a play instruction is received.

[0021] A music generating terminal is provided, including:

[0022] an image recognition module, configured to identify a picture, obtain element information in the picture, and parameter information of the element;

[0023] The music generating module is configured to generate music according to the acquired element information and parameter information of the element.

[0024] Preferably, the music generating terminal of the present invention further includes:

[0025] an association module, configured to associate the generated music with the picture.

[0026] Preferably, the music generating terminal of the present invention further includes:

[0027] a playing module, configured to play the generated music after receiving the play instruction.

Advantageous effects of the invention

Beneficial effect

[0028] Implementing the technical solution of the present invention, the generated music can directly reflect the elements in the picture, and the matching effect is good, and the visual to auditory conversion is realized.

Brief description of the drawing

DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below, and obviously, in the following description The drawings are only some of the embodiments of the present invention, and those of ordinary skill in the art will not On the premise of creative labor, other drawings can also be obtained from these drawings.

1 is a schematic flow chart of a first embodiment of a music generating method provided by the present invention.

2 is a schematic flowchart of step S12 in the first embodiment of the music generating method provided by the present invention;

3 is a schematic flowchart of step S22 in the second embodiment of the present invention. [0033] FIG. 4 is a flowchart of a third embodiment of the music generating method provided by the present invention. Schematic diagram

5 is a schematic flow chart of a fourth embodiment of a music generating method provided by the present invention;

6 is a schematic structural diagram of a first embodiment of a music generating terminal provided by the present invention;

7 is a structural diagram of a music generation module in another embodiment of a music generation terminal provided by the present invention.

Embodiments of the invention

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. example. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Referring to FIG. 1, FIG. 1 is a music generating method according to the present invention. The operating method of the embodiment includes the following steps:

[0039] Step S11: Identify a picture, obtain element information in the picture, and parameter information of the element.

[0040] Step S12: Generate music according to the acquired element information and the parameter information of the element.

[0041] In step S11, the picture can be acquired in various ways, such as by network downloading, camera shooting, and the like. After obtaining the picture, the element information in the picture and the parameter information of the element may be automatically identified and acquired, or the element information of the corresponding picture and the parameter information of the element may be identified and obtained after receiving the control instruction. The user can input control commands by interacting with the terminal.

[0042] The element is the content recorded in the photo that can be simulated, such as a picture of a frog on a pond in a rainy day, which can be both an elementary rain and a frog. The parameter information of an element includes information reflecting the characteristics of the element, such as the number of elements, radians, length, and the like.

[0043] The elements in the picture and their parameters can be identified by various image recognition technologies, preferably, The image edge detection algorithm (PattemRecognition) is used to identify various elements contained in the image, as well as various parameter information of each element.

[0044] In this embodiment, as shown in FIG. 2, step S12 includes the following sub-steps:

[0045] Sub-step S121: generating music of the element by using a sound simulation method according to the acquired element information and the parameter information of the element;

[0046] Sub-step S122: superimposing and/or arranging the music of each element of the picture to generate music that matches the picture.

[0047] In sub-step S121, music can be generated by various sound simulation calculation methods. Specifically, the subject that needs to perform the sound simulation is determined according to the element information, and the feature that the theme is finally simulated into the sound is determined according to the parameter information. For example, the element is rain, and the parameter information of the element includes a large number of raindrops and a large length, and the sound of the downpour is simulated by a sound simulation calculation method. The element is a frog, and the parameter information of the element is a plurality of numbers, and the sound of the frog is simulated by a sound simulation calculation method.

[0048] In sub-step S122, if there is only one element in the picture, the music of the element acts as music that matches the picture. If the image contains multiple elements, the music of each element can be superimposed and/or arranged in order. For example, the sound of a downpour is superimposed on the frog's screams, and then the sound of a torrential rain and then the frog's cry. Again, the sound of the downpour and the sound of the frog's screams, and then the sound of the trees swaying in the wind.

[0049] In the first embodiment of the music generating method of the present invention, the music generated by performing sound simulation by using the element information in the picture and the parameter information of the element can directly reflect the content in the picture, and the degree of matching with the picture is high. , the realization of the transition from visual to auditory.

[0050] In a second embodiment of the music generating method of the present invention, the music generating method includes the following steps:

[0051] Step S20: Identify a picture, obtain element information in the picture, and parameter information of the element.

[0052] Step S21: Generate music according to the acquired element information and the parameter information of the element.

[0053] The difference between this embodiment and the first embodiment is that, as shown in FIG. 3, step S21 includes the following sub-steps:

[0054] Sub-step S211: determining a note category corresponding to the element information;

[0055] Sub-step S212: Acquire notes in corresponding note categories according to parameter information of the element;

[0056] Sub-step S213: generating music of the element according to the acquired note; [0057] Sub-step S214: superimposing and/or arranging the music of each element of the picture to generate music that matches the picture.

[0058] In the present embodiment, the notes for simulating the generation of various elements are classified in advance, one element corresponds to one note type, and one note category includes a plurality of notes for expressing the element features.

[0059] In the sub-step S211, the corresponding note type is obtained according to the acquired element information, and in the sub-step S212, all the notes for embodying the feature of the element are found from the note type according to the feature information of the element. The music of the element is generated using all of the acquired notes in sub-step S213. If there is only one element in the picture, the music of the element is used as the music matching the picture. If the picture contains multiple elements, in sub-step S214, the music of each element is superimposed and/or pressed. The order of the lines produces music that matches the picture.

[0060] In the second embodiment of the music generating method of the present invention, the light and heavy fluctuations of the music generated by using the element information in the picture and the note corresponding to the parameter information of the element can directly reflect the content in the picture and match the picture. High degree, achieving a transition from visual to auditory.

[0061] In the third embodiment of the music generating method of the present invention, as shown in FIG. 4, the music generating method includes the following steps:

[0062] Step S40: Identify a picture, obtain element information in the picture, and parameter information of the element.

[0063] Step S41: generating music according to the acquired element information and parameter information of the element;

[0064] Step S42: Associating the generated music with the picture.

The difference between this embodiment and the first or second embodiment is that, in step S42, the music generated in step S41 is associated with the corresponding picture, and the music and the association relationship are saved. There are several ways to associate music with a picture, for example, setting up a relationship table, and recording the generated music and pictures in the table.

[0066] In the third embodiment of the music generating method of the present invention, by associating the music with the picture, the user can be allowed to know or use the corresponding picture when playing the music, or when browsing the picture. Get or play the corresponding music.

[0067] In the fourth embodiment of the music generating method of the present invention, as shown in FIG. 5, the music generating method includes the following steps: [0068] Step S50: identifying a picture, acquiring element information in the picture and parameter information of the element

[0069] Step S51: generating music according to the acquired element information and parameter information of the element;

[0070] Step S52: associate the generated music with the picture;

[0071] Step S53: When the play command is received, the generated music is played.

[0072] The difference between this embodiment and the third embodiment is that when the terminal receives the play command, the generated music will be played. Specifically, when the user browses the picture with the matching music, the terminal receives the play instruction, and automatically plays the music that matches the picture. In other embodiments, a play command can also be input through interaction with other means of the terminal device to play music that matches the picture. For example, after browsing the picture, the user double-clicks the picture, and the terminal receives the play command, and then plays the music that matches the picture.

[0073] In this embodiment, when the user browses to the picture where the matching music exists, the terminal can automatically play the matched music, thereby improving the user experience.

[0074] In other embodiments of the music generating method of the present invention, it is also possible to automatically set the matching music of the picture as the incoming call of the user after detecting that the user uses the picture as the caller ID image of a contact of the mobile phone. ring.

[0075] As shown in FIG. 6, a music generating terminal 600 according to the present invention includes:

[0076] an image recognition module 610, configured to identify a picture, obtain element information in the picture, and parameter information of the element;

[0077] a music generating module 620, configured to generate music according to the acquired element information and parameter information of the element;

[0078] an association module 630, configured to associate the generated music with a picture;

[0079] The playing module 640 is configured to play the generated music after receiving the play instruction.

[0080] In this embodiment, the music generating module 620 includes:

[0081] a first element music sub-module 621, configured to generate music of the element by using a sound simulation method according to the acquired element information and parameter information of the element;

[0082] The music synthesis sub-module 622 is configured to superimpose and/or sequentially arrange the music of each element of the picture to generate music that matches the picture.

[0083] In other embodiments, as shown in FIG. 7, the music generating module may further include: [0084] a category determining submodule 710, configured to determine a note category corresponding to the element information;

[0085] a note acquisition sub-module 720, configured to obtain a note in a corresponding note category according to the parameter information of the element;

[0086] a second element music sub-module 730, configured to generate music of the element according to the acquired note;

[0087] The music synthesis sub-module 740 is configured to superimpose and/or arrange the music of each element of the picture to generate music that matches the picture.

[0088] In the first embodiment of the music generating terminal of the present invention, the music generated by performing sound simulation by using the element information in the picture and the parameter information of the element can directly reflect the content in the picture, and the degree of matching with the picture is high. , the realization of the transition from visual to auditory.

[0089] The steps in the method of the embodiment of the present invention may be sequentially adjusted, merged, and deleted according to actual needs.

Modules or units or subunits in the apparatus of the embodiments of the present invention may be combined, divided, and deleted according to actual needs. A person skilled in the art can understand that all or part of the steps of the foregoing embodiments can be completed by a program to instruct terminal device related hardware, and the program can be stored in a computer readable storage medium, and the storage medium can be Including: flash drive, read-only memory (ROM), random access memory (Random Access Memory, RAM), disk or CD, etc.

The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto. Those skilled in the art can understand all or part of the process of implementing the above embodiments, and Equivalent variations of the claims of the invention are still within the scope of the invention.

Claims

Claim

[Claim 1] A music generating method, comprising the steps of:

Identifying a picture, obtaining element information in the picture and parameter information of the element; generating music according to the acquired element information and parameter information of the element.

[Claim 2] The music generating method according to claim 1, wherein the step of generating music based on the acquired element information and parameter information of the element comprises: using sound simulation based on the acquired element information and parameter information of the element The method generates music for this element.

[Claim 3] The music generating method according to claim 1, wherein the step of generating music based on the acquired element information and the parameter information of the element comprises: determining a note type corresponding to the element information;

Acquiring a note in the corresponding note class according to the parameter information of the element; generating music of the element according to the acquired note.

[Claim 4] The music generating method according to claim 2 or 3, wherein the step of generating music based on the acquired element information and the parameter information of the element further comprises:

The music of each element of the picture is superimposed and/or arranged in order to generate music that matches the picture.

[Claim 5] The music generating method according to claim 1, further comprising:

The generated music is associated with the picture.

[Claim 6] The music generating method according to claim 1, further comprising:

When the play command is received, the generated music is played.

[Claim 7] The music generating method according to claim 6, wherein when the picture is browsed, a play instruction is received.

[Claim 8] A music generating terminal, comprising:

An image recognition module, configured to identify a picture, obtain element information in the picture, and parameter information of the element;

a music generating module, configured to generate music according to the acquired element information and parameter information of the element.

[Claim 9] The music generating terminal according to claim 8, further comprising: an association module, configured to associate the generated music with the picture.

[Claim 10] The music generating terminal according to claim 8, further comprising:

The play module is configured to play the generated music after receiving the play command.