CN111400518A - Method, device, terminal, server and system for generating and editing works - Google Patents

Abstract

The present application proposes a method, device, terminal, server and system for generating and editing a work. The method for generating a work includes: sending a work creation request to the cloud, where the work creation request includes creation parameters, so that the cloud requests the work creation module according to the Create a creation work corresponding to the creation parameters; receive the creation task ID corresponding to the creation request of the work returned by the cloud; send a first query request to the cloud, where the first query request includes the creation task ID, so that the The cloud queries the creation work corresponding to the creation task ID; receives and displays the creation work corresponding to the creation task ID at the vehicle end. The embodiments of the present application provide users with a work creation service at the vehicle terminal through the communication between the vehicle terminal and the cloud, and can use the photos, videos, music and other creative materials captured by the camera at the vehicle terminal to provide users with poems, paintings, music, videos, etc. Editing, etc.

Description

Work generation and editing method, device, terminal, server and system

technical field

The present application relates to artificial intelligence technology, and in particular, to a work generation and editing method, device, terminal, server and system.

Background technique

In-vehicle terminal refers to the abbreviation of in-vehicle infotainment products installed in vehicles, which can realize information communication between people and vehicles, vehicles and the outside world (such as vehicles and vehicles). At present, most of the car and machine terminals provide users with multimedia services and navigation services, and the service forms are relatively simple. However, with the gradual popularization of vehicles, users expect that the vehicle terminal can provide diversified services.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a method, device, terminal, server and system for generating and editing works, so as to solve the problems existing in the related art, and the technical solutions are as follows:

In a first aspect, an embodiment of the present application provides a method for generating a work, including:

Send a work creation request to the cloud, where the work creation request includes creation parameters, so that the cloud request work creation module creates a corresponding creation work according to the creation parameters;

Receive the creation task ID corresponding to the work creation request returned by the cloud;

Send a first query request to the cloud, where the first query request includes the creative task ID, so that the cloud queries the creative work corresponding to the creative task ID;

Receive and display the creation work corresponding to the creation task ID returned by the cloud on the vehicle end.

In the second aspect, the embodiments of the present application provide a method for generating works, which is applied to the cloud, including:

Receive a work creation request sent by the vehicle terminal, and the work creation request includes the creation parameters;

Generate a creation task ID corresponding to the work creation request;

Send the creation task ID to the vehicle terminal;

Request the work creation module to create a corresponding creation work according to the creation parameter;

receiving a first query request sent by the vehicle terminal, where the first query request includes the creation task ID;

Query the creation work corresponding to the creation task ID;

Send the creation work corresponding to the creation task ID to the vehicle terminal.

In a third aspect, an embodiment of the present application provides a method for generating a work, which is applied to a vehicle terminal, including:

Perform semantic recognition on the voice command to obtain a first recognition result;

The vehicle terminal is triggered to execute the work generation method according to any one of the above-mentioned aspects according to the target recognition result, where the target recognition result includes the first recognition result.

In one embodiment, the method further includes:

sending the voice command to the cloud, so that the cloud generates a second recognition result according to the voice command;

receiving the second identification result returned by the cloud;

According to a preset arbitration rule, the target recognition result is determined from the first recognition result and the second recognition result.

In a fourth aspect, an embodiment of the present application provides a work editing method, which is applied to a mobile terminal, and the method includes:

Identify the editing logo of the works displayed on the vehicle end;

Determine the address of the creative work in the cloud according to the work editing identifier, and the creative work is generated according to any of the above work generation methods;

Obtain creative works from the cloud according to the address;

Display creative works on mobile terminals.

In a fifth aspect, an embodiment of the present application provides an apparatus for generating a work, including:

A work creation request sending module is used to send a work creation request to the cloud, where the work creation request includes creation parameters, so that the cloud request work creation module creates a corresponding creation work according to the creation parameters;

The creation task ID receiving module is used to receive the creation task ID corresponding to the creation request of the work returned by the cloud;

a first query request sending module, configured to send a first query request to the cloud, where the first query request includes the creation task ID, so that the cloud can query the creation work corresponding to the creation task ID;

The work display module is used to receive and display the creation work corresponding to the creation task ID returned by the cloud on the vehicle end.

In a sixth aspect, an embodiment of the present application provides an apparatus for generating a work, including:

The work creation request receiving module is used to receive the work creation request sent by the vehicle terminal, and the work creation request includes the creation parameters;

The creation task ID generation and sending module is used to generate the creation task ID corresponding to the creation request of the work, and send the creation task ID to the vehicle terminal;

A request module, used to request the work creation module to create a corresponding creation work according to the creation parameter;

a first query request receiving module, configured to receive a first query request sent by the vehicle terminal, where the first query request includes the creation task ID;

The work query module is used to query the creation work corresponding to the creation task ID;

The work sending module is used to send the creation work corresponding to the creation task ID to the vehicle terminal.

In a seventh aspect, an embodiment of the present application provides an apparatus for generating a work, including:

The semantic recognition module is used to perform semantic recognition on the voice command to obtain the first recognition result;

The trigger execution module is configured to trigger the vehicle terminal to execute the work generation method according to any one of the above aspects according to the target recognition result, where the target recognition result includes the first recognition result.

In one embodiment, the apparatus further includes:

a voice command sending module, configured to send the voice command to the cloud, so that the cloud generates a second recognition result according to the voice command;

an identification result receiving module, used for receiving the second identification result returned by the cloud;

The arbitration module is configured to determine the target recognition result from the first recognition result and the second recognition result according to a preset arbitration rule.

In an eighth aspect, an embodiment of the present application provides a work editing device, including:

The logo identification module is used to identify the editing logo of the works displayed on the vehicle end;

The address determination module is used to determine the address of the creative work in the cloud according to the work editing identifier, and the creative work is generated according to any of the above work generation methods;

The work acquisition and display module is used to acquire the creative work from the cloud according to the address and display it on the mobile terminal.

In a ninth aspect, an embodiment of the present application provides an on-board terminal, including:

at least one first processor; and

a first memory in communication with the at least one first processor; wherein,

The first memory stores instructions executable by the at least one first processor, the instructions are executed by the at least one first processor, so that the at least one first processor can execute any of the above works on the vehicle side Generate method.

In a tenth aspect, an embodiment of the present application provides a server, including:

at least one second processor; and

a second memory in communication with the at least one second processor; wherein,

The second memory stores instructions executable by the at least one second processor, the instructions being executed by the at least one second processor to enable the at least one second processor to perform the work generation method of any of the above aspects .

In an eleventh aspect, an embodiment of the present application provides a mobile terminal, including:

at least one second processor; and

a second memory in communication with the at least one second processor; wherein,

The second memory stores instructions executable by the at least one second processor, the instructions being executed by the at least one second processor to enable the at least one second processor to perform the work editing method of any of the above-mentioned aspects .

In a twelfth aspect, an embodiment of the present application provides a work generation system, including the vehicle terminal described in any of the above aspects and the cloud server described in any of the above aspects.

In a thirteenth aspect, an embodiment of the present application provides a system for generating works, including a vehicle terminal and a cloud, where the vehicle terminal includes a work generation module, and the cloud includes a creation service module, a work creation module, and an API gateway; the work generation module includes: A creation interface for sending a work creation request to the cloud; a display interface for sending a first query request to the cloud; wherein, the work creation request includes creation parameters, and the first query request includes the creation returned by the cloud and corresponding to the work creation request task ID; the creation service module includes: a creation interface for requesting the work creation module to create a corresponding creation work according to the creation parameters; a display interface for querying and returning the creation work corresponding to the creation task ID to the vehicle terminal; wherein, the cloud The work creation request is parsed through the API gateway to call the authoring interface of the authoring service module, and the cloud parses the first query request through the API gateway to call the authoring interface of the authoring service module.

In a tenth aspect, an embodiment of the present application provides a computer-readable storage medium, where computer instructions are stored in the computer-readable storage medium, and when the computer instructions are executed by a processor, the method for generating a work in any of the foregoing aspects is implemented.

The advantages or beneficial effects of the above technical solutions include at least: through the communication between the vehicle terminal and the cloud, the user is provided with a work creation service on the vehicle terminal, and the photos, videos, music and other creative materials captured by the camera at the vehicle terminal can be used for the user. Provide poetry, paintings, music, video clips and other creative works.

The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present application will become apparent by reference to the drawings and the following detailed description.

Description of drawings

In the drawings, unless stated otherwise, the same reference numbers refer to the same or like parts or elements throughout the several figures. The drawings are not necessarily to scale. It should be understood that these drawings depict only some embodiments disclosed in accordance with the present application and should not be considered as limiting the scope of the present application.

1 is a schematic diagram of a work generation method according to an embodiment of an embodiment of the present application;

FIG. 2 is a schematic diagram of a work generation method according to another implementation of an embodiment of the present application;

3 is a schematic diagram of a work generation method according to yet another implementation of an embodiment of the present application;

4 is a schematic diagram of a work generation method according to yet another implementation of an embodiment of the present application;

FIG. 5 is a schematic diagram of communication between the vehicle terminal and the cloud according to an implementation manner of an embodiment of the present application;

6 is a schematic diagram of a work generation method according to an embodiment of an embodiment of the present application;

FIG. 7 is a schematic diagram of communication between the vehicle terminal and the cloud according to another implementation manner of an embodiment of the present application;

FIG. 8 is a schematic diagram of a work generation method according to an embodiment of an embodiment of the present application;

FIG. 9 is a schematic diagram of communication between the vehicle terminal and the cloud according to another implementation manner of an embodiment of the present application;

Figure 10, Figures 11-1 to 11-4 are different examples of the work creation system according to the embodiment of the application;

12 is a schematic diagram of a work generation method according to an embodiment of the embodiment of the application;

FIG. 13 is a schematic diagram of a work generation method according to another implementation manner of an embodiment of the present application;

14 is an example of a work creation system according to an embodiment of the application;

15 is a schematic diagram of an apparatus for generating works on the vehicle side according to an embodiment of the present application;

16 is a schematic diagram of an apparatus for generating works in the cloud according to an embodiment of the present application;

FIG. 17 is a schematic diagram of a work generating device on the vehicle side according to another embodiment of the present application

FIG. 18 is a block diagram of a terminal or a server that can implement an embodiment of the present application.

Detailed ways

In the following, only certain exemplary embodiments are briefly described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present application. Accordingly, the drawings and description are to be regarded as illustrative in nature and not restrictive.

The embodiments of the present application provide a work generation system, including a vehicle terminal and a cloud, and artificial intelligence creation of works can be realized through communication between the vehicle terminal and the cloud. In an example, the vehicle terminal may provide a work generation module, such as an artificial intelligence creation (Artificial Intelligence Creation, AIC) application (Application, APP), and the AIC APP is used to implement the work generation method on the vehicle terminal.

Example 1

FIG. 1 shows a flowchart of a work generation method according to Embodiment 1 of the present application. The work generation method can be applied to the vehicle end, that is, it can be realized by the vehicle end.

As shown in Figure 1, the work generation method can include:

Step S101: Send a work creation request to the cloud, where the work creation request includes creation parameters, so that the cloud requests the work creation module to create a corresponding work according to the creation parameters.

For example, the user can use the input creation instructions provided by the vehicle terminal, and select appropriate creation materials, such as pictures, videos, audios, etc. The car terminal sends a work creation request to the cloud according to the creation instruction. The creative material may be multimedia resources collected by the vehicle-mounted multimedia component, such as audio collected by the vehicle-mounted microphone multimedia component, image data collected by the vehicle-mounted camera multimedia component, etc. The image data includes pictures and videos.

In one example, the authoring asset file is small, such as a picture. The creative material can be sent to the cloud along with the work creation request. However, if the creative material is large, if it is sent directly, it will affect the communication efficiency. Therefore, the creative material can be sent (uploaded, uploaded) to the cloud. After the cloud receives the creative material, it can be saved to the cloud, and the address of the creative material can be returned to the vehicle end. In one example, the creative material uploaded by the user can be saved to a network disk, such as an On-line Business Systems (OBS) in the cloud. Furthermore, the address of the authoring material may be a Uniform Resource Locator (Uniform Resource Locator, URL) address. The car terminal can receive the address corresponding to the creative material returned by the cloud, and use the address as a creative parameter, and send it to the cloud together with the work creation request.

In one example, the authoring parameters may include user expectations, such as theme, style, rhythm, etc., and the user may input user expectations through the AIC APP.

Step S102: Receive a creation task ID (IdentityDocument, identity number) returned by the cloud and corresponding to the work creation request.

After receiving the work creation request sent by the vehicle terminal, the cloud can request the work creation module to create the corresponding work according to the creation parameters. In one example, the work creation module may include an intelligent (AI) creation model, and the AI creation model may be obtained by training a deep learning neural network through a large amount of sample data. There can be multiple AI creation models, such as AI poetry creation model, AI painting creation model, AI music creation model, AI video editing model, etc., and the work creation module can select the corresponding model according to the different creation materials.

In one embodiment, the authoring parameter is an address of the authoring material in the cloud, such as a URL address. The work creation module can download the corresponding creation material from the network disk according to the address.

In one example, the creation parameters may include the above-mentioned user expectation, and the user expectation is input into the corresponding AI creation model by the work creation module as an input parameter, so that the final created work meets the user expectation.

Further, because the creation of works is time-consuming, the cloud is unlikely to return the works to the vehicle terminal immediately. Therefore, the cloud can generate a creation task ID corresponding to the work creation request, and send the creation task ID to the vehicle terminal. .

Step S103: Send a first query request to the cloud, where the first query request includes the creation task ID, so that the cloud can query the work corresponding to the creation task ID.

After receiving the creation task ID, the car-machine terminal can query whether the corresponding work has been completed from the cloud according to the creation task ID. After receiving the first query request, the cloud queries the corresponding work according to the creation task ID. In an example, when a work is created, it will be stored in a work database (Data Base, DB) in the cloud. The cloud can search for the corresponding work from the work database according to the creation task ID, and send the found work to the car. machine side.

In an implementation manner, step S103 may include: sending the first query request to the cloud according to a first preset time interval. That is to say, the car terminal will poll the cloud multiple times to check whether the creation has been completed. Each time the cloud queries the work database according to the first query request to see if there is a corresponding creative work. If there is, it means that the creative work has been completed, and then the cloud can send the creative work to the vehicle terminal.

Step S104, receiving and displaying the creation work corresponding to the creation task ID returned by the cloud on the vehicle end.

After receiving the creative works returned by the cloud, the car-machine terminal can display it through the in-vehicle multimedia components.

According to the work generation method of the embodiment of the present application, intelligent creation can be performed according to the creation material provided by the user, and displayed for the user at the vehicle end. For example, using the photos and videos taken by the car camera as creative materials, create personalized AI poems, AI paintings, AI music, AI videos and other creative works for users.

In one embodiment, the creation material includes multimedia resources collected by the vehicle-mounted multimedia component, and step S101 may include: detecting the scene conditions where the vehicle-mounted terminal is located; controlling the corresponding vehicle-mounted multimedia components to collect the corresponding multimedia resources according to the scene conditions, A work creation request is sent to the cloud, and the creation request includes creation parameters corresponding to the multimedia resources.

That is to say, the work creation request sent by the vehicle terminal to the cloud can be initiated by the user, or automatically initiated according to the scene conditions where the vehicle terminal (vehicle) is located. When it is detected that the scene conditions of the vehicle terminal meet the preset conditions, the vehicle terminal automatically triggers the corresponding vehicle-to-media component to collect the corresponding multimedia resources, and sends a work creation request to the cloud.

In an example, multimedia resources can be uploaded to the cloud in advance as creative materials, so as to receive the address returned by the cloud (such as the address of the network disk of the multimedia resources in the cloud), and the creation parameters can include this address, which is sent to the cloud together with the work creation request. cloud. When the creation service module on the cloud requests the work creation module to create a work, the corresponding multimedia resource can be downloaded from the network disk through this address.

In one embodiment, the scene conditions include positioning information, and controlling the corresponding vehicle-mounted multimedia components to collect corresponding multimedia resources according to the scene conditions includes: controlling the vehicle-mounted multimedia components to collect multimedia resources under the condition that the positioning information corresponds to the target journey information .

For example: the target journey information is a certain scenic spot. If the current positioning information of the vehicle is detected to match the scenic spot, the vehicle terminal will automatically trigger the in-vehicle multimedia components, such as the camera multimedia component or the microphone multimedia component to collect the corresponding audio, image or Video, so that users can record what they see and hear during the journey, and generate corresponding AI creation works based on what they see and hear, and display them on the car side.

In one embodiment, the scene conditions include environmental audio, and controlling the corresponding vehicle-mounted multimedia components to collect corresponding multimedia resources according to the scene conditions includes: controlling the microphone multimedia component to collect environmental audio; controlling the camera multimedia component to collect image data; the multimedia resources include environmental audio and image data.

For example, the car terminal can automatically trigger the microphone multimedia component to collect ambient audio, and trigger the camera multimedia component to collect image data, so that the corresponding AI creation works can be generated based on these environmental audio and image data, and displayed on the car terminal. The ambient audio may be the audio inside or around the vehicle.

In an example, the vehicle terminal detects whether the environmental audio includes a preset trigger word, for example, can perform semantic recognition on the environmental audio to obtain a corresponding recognition result, and detect whether the recognition result matches the preset secondary trigger word. If it matches, the microphone multimedia component is triggered to continue to collect ambient audio, and the camera multimedia component is triggered to collect image data.

In one embodiment, the scene conditions include a facial image of the target user, and controlling the corresponding vehicle-mounted multimedia components to collect corresponding multimedia resources according to the scene conditions includes: determining the emotional state of the target user according to the facial image of the target user; When the emotional state corresponds to the preset emotional state, the vehicle-mounted multimedia component is controlled to collect multimedia resources.

The facial image of the user includes the facial features of the user, and the emotional state of the user can be identified according to the facial features. For example, facial features can be input into a trained emotion recognition model to obtain the user's emotional state. If it is recognized that the user's emotional state conforms to the preset emotional state (such as happy), multimedia resources can be automatically triggered to record the user's audio, image or video in the emotional state, and based on these multimedia resources, the corresponding AI creation works can be generated. and displayed on the car side.

According to the method of this embodiment, the user can automatically trigger the vehicle-mounted multimedia component to collect multimedia resources according to the scene conditions of the vehicle during the use of the vehicle, such as during the journey, to record user behaviors, what they have seen and heard, etc., and generate data based on these materials. The corresponding AI creation works are displayed on the car side.

In an implementation manner, as shown in FIG. 2 , the method for generating works on the vehicle terminal according to the embodiment of the present application may further include: step S201 , sending a second query request to the cloud, so that the cloud can query a plurality of works from the work database , the work includes the above-mentioned creation works; step S202 , receiving multiple works returned by the cloud; and step S203 , displaying the multiple works returned by the cloud at the vehicle end.

Based on this, users can query the full amount of AI-created works through the AICAPP on the car terminal. For example, the car terminal sends a second query request to the cloud, and after receiving the second query request, the cloud queries a plurality of works from the work database in the cloud, and returns them to the car terminal. After receiving multiple works, the car terminal can display it on the car terminal.

For example: use the multimedia components on the vehicle side to display multiple works in the form of waterfalls. Display form is not limited in the embodiment of the present application, and can be arbitrarily set according to user requirements. The works in the work database may be generated by the work creation module, that is, obtained by the work generation method of any of the above embodiments, or may be pre-stored.

In one embodiment, as shown in FIG. 3 , the method for generating works at the vehicle terminal according to the embodiment of the present application may further include: step S301 , sending a sharing request to the cloud, and the sharing request includes the work ID of the created work, so that the cloud According to the work ID, query the address of the creative work in the work database; step S302, receive the address of the creative work returned by the cloud; step S303, generate a corresponding work sharing identifier according to the address of the creative work; step S304, display it on the vehicle end Work sharing logo.

Based on this, users can share their creations on social media such as WeChat and Weibo. For example, the user can trigger the sharing command of the created work through the sharing portal provided by the AIC APP on the car terminal. After receiving the sharing instruction, the car terminal sends a sharing request to the cloud. After the cloud receives the sharing request, it searches the cloud's work database for the address of the created work, such as the URL address, according to the work ID of the created work, and sends the address to the cloud. To the car side. The car terminal generates a corresponding work sharing logo, such as a QR code, from this address, and displays it on the car terminal. Users can scan QR codes with mobile terminals such as mobile phones and share work cards to social media. Wherein, each work stored in the work database corresponds to a work ID, and the work ID can be associated with the creation task ID in the work creation stage.

In one embodiment, the step S104 may include: editing the creation work according to the user's editing instruction; and displaying the edited creation work at the vehicle end.

That is to say, after the cloud returns the AI creation work, it can be used to edit the work on the vehicle side, such as adding some text or expressions, etc., to realize the secondary creation on the vehicle side, and display the editing (secondary) on the vehicle side. Creation) after the creation.

In one embodiment, the method for generating a work in this embodiment may further include: sending the edited creative work to the cloud; sending a sharing request to the cloud, where the sharing request includes the work ID of the edited creative work, so that the cloud can According to the work ID, query the address of the edited creative work in the cloud; receive the address of the edited creative work returned by the cloud; generate the corresponding work sharing logo according to the edited creative work address; display the work sharing on the car terminal logo.

That is to say, the edited creative work can be shared on the vehicle end, and the sharing method can refer to steps S301 to S304. Specifically, the edited creative work can be uploaded to the cloud from the vehicle terminal first, and the cloud can save the edited creative work on the vehicle terminal in the work database, and the edited creative work also corresponds to a work ID. When sharing the edited creative work on the car terminal, the sharing request sent by the car terminal to the cloud includes the work ID of the edited creative work, so that the cloud can query from the cloud (such as the work database) according to the work ID. The corresponding edited creative work is to obtain the address of the edited creative work, and the address is returned to the vehicle terminal. After the vehicle end receives the address, it generates a corresponding sharing identifier.

In an implementation manner, the method of the embodiment of the present application may include: generating a work editing identifier according to the address of the creation work in the cloud; displaying the work editing identifier on the vehicle end, so that the mobile terminal determines that the creation work is in The address of the cloud, and according to the address, the creation works are obtained from the cloud and displayed on the mobile terminal.

The vehicle terminal can generate a work editing ID, such as a QR code, which corresponds to the cloud address of the creation to be edited. The user can scan the two-dimensional code on the vehicle terminal through the mobile terminal, display the creative work on the mobile terminal, and provide a corresponding editing page on the mobile terminal for the user to re-create the creative work. The mobile terminal may be a smart device such as a mobile phone and a tablet computer. Further, the mobile terminal can obtain corresponding editing materials according to the user's editing instructions, and edit the creation work according to the editing materials, so as to realize the secondary creation of the mobile terminal. The user can share the edited (secondary creation) creation to social media on the mobile terminal.

FIG. 4 shows a flow chart of a work generation method according to an embodiment of the present application. This work generation method can be applied to the cloud. As shown in Figure 4, the method may include:

Step S401, receiving a work creation request sent by the vehicle terminal, where the work creation request includes creation parameters;

Step S402, generating a creation task ID corresponding to the work creation request;

Step S403, sending the creation task ID to the vehicle terminal;

Step S404, requesting the work creation module to create a corresponding creation work according to the creation parameters;

Step S405, receiving the first query request sent by the vehicle terminal, where the first query request includes the creation task ID;

Step S406, query the creation work corresponding to the creation task ID;

Step S407, sending the creation work corresponding to the creation task ID to the vehicle terminal.

Some specific implementation manners of the cloud work generation method implemented in the present application can be referred to the corresponding descriptions in the foregoing embodiments with reference to FIG. 5 , which will not be repeated here.

In one embodiment, as shown in FIG. 6 , the method for generating works on the cloud may include: step S601 , receiving a second query request sent by the vehicle terminal; step S602 , querying a plurality of works from the works database according to the second query request A work, the work includes the above-mentioned creation work; Step S603 , sending a plurality of works to the vehicle terminal. Specifically, reference may be made to the corresponding description in the foregoing embodiment in conjunction with FIG. 7 , and details are not repeated here.

In one embodiment, as shown in FIG. 8 , the method for generating works in the cloud may include: step S801, receiving a sharing request sent by the vehicle terminal, where the sharing request includes the work ID of the created work; step S802, according to the work ID, Query the address of the creative work in the work database; step S803, send the address of the creative work to the vehicle terminal. Specifically, referring to FIG. 9 and the corresponding descriptions in the foregoing embodiments, details are not repeated here.

The embodiment of the present application also provides a method for editing a work on a mobile terminal, including: recognizing a work editing identifier displayed on the vehicle terminal; determining an address of the creation work in the cloud according to the work editing identifier, wherein the creation work can be based on any of the above embodiments. The works are generated by the method of generating works in ; obtain the creative works from the cloud according to the address; display the creative works on the mobile terminal.

In one embodiment, the work editing method may further include: acquiring corresponding editing materials according to an editing instruction of a user; editing the creative work according to the editing materials; and sharing the edited creative work.

For a specific implementation manner, please refer to the corresponding description of the above-mentioned work editing method at the vehicle end, which will not be repeated here.

Embodiment 2

FIG. 10 shows an architecture diagram of a work generation system in an embodiment of the present application. It should be noted that this architecture is only an example of an implementation. Among them, the car terminal includes a work generation module (AIC APP), and the cloud may include a creation service module, a work creation module, and an API (Application Programming Interface, application programming interface) gateway. Further, both the work generation module and the creation service module respectively include a creation (create) interface and a display (pull) interface.

In one embodiment, according to the architecture of the second embodiment, step S101 may include: sending a work creation request to the cloud by invoking the creation interface of the vehicle terminal, so that the cloud can call the creation interface of the creation service module through the API gateway. The step S103 may include: sending a first query request to the cloud by invoking the display interface of the vehicle terminal. Correspondingly, the step S401 may include: the step of receiving the work creation request sent by the vehicle terminal may include: parsing the work creation request through the API gateway to call the creation interface of the creation service module. Steps S405 and S406 may include: parsing the first query request through the API gateway to invoke the presentation interface of the authoring service module.

In one embodiment, the vehicle terminal calls the display interface of the work generation module according to the first preset time interval, and the cloud calls the display interface of the creation service module according to the second preset time interval, so as to realize the creation between the vehicle terminal and the cloud. Works for asynchronous queries.

In one embodiment, the creation parameters include the address of the creation material in the cloud, the car terminal further includes an upload interface, the cloud includes a network disk, the car terminal sends the creation material to the network disk by calling the upload interface, and the address is the creation material in the network address on the disk. Further, the cloud includes a work database, and a plurality of works are stored in the work database.

In one embodiment, the authoring service module includes a data processing (DataProcessing) sub-module. The data processing sub-module can perform data processing on the data received from the vehicle terminal (such as the creation material corresponding to the creation parameters), such as establishing a matching relationship between the vehicle terminal or the user's account information, or filtering some sensitive words. The data processing module can also process the AI creation works and store them in the works database. The data processing module may be a sub-module of the authoring service module. Authoring service modules can be managed through the operations center.

In one embodiment, both the work generation module and the authoring service module may include a list interface and a share interface, respectively.

The step S201 may include: sending a second query request to the cloud by invoking a list interface on the vehicle terminal, so that the cloud can call the list interface of the authoring service module through the API gateway. The step S301 may include: sending a sharing request to the cloud by invoking a share interface of the vehicle terminal, so that the cloud can call the sharing interface of the authoring service module through the API gateway.

Correspondingly, step S601 may include: parsing the second query request through the API gateway, so as to call the list interface of the authoring service module to query a plurality of works from the work database. Step S801 may include: parsing the sharing request through the API gateway to call the sharing interface of the authoring service module.

Specifically, after the user selects creation through the AIC APP, the AIC APP calls the creation interface, thereby sending a work creation request to the cloud. The cloud calls the creation interface of the creation service module through the API gateway, and the interface calls the corresponding creation model in the work creation module to create AI creation works. Because the authoring process is long, the authoring service module generates the authoring task ID and returns it to AICAPP.

After receiving the creation task ID, AICAPP calls the display interface according to the creation task ID, thereby sending a first query request to the cloud, and the first query request carries the creation task ID. Correspondingly, the cloud invokes the display interface of the creation service module asynchronously through the API gateway. The display interface queries the work database corresponding to the creation task ID, and returns the work to the AIC APP when the work is found to exist. .

In one example, the user can query the full amount of works through the AIC APP, including the works obtained by the work generation method in any of the above embodiments, that is, the AI creation results. Specifically, the user inputs a full query instruction through the AIC APP, and the AIC APP calls the list interface, thereby sending a second query request to the cloud, where the second query request is used to request to query multiple works. Correspondingly, the cloud calls the list interface of the creation service module through the API gateway, queries multiple works from the works database, and returns the results to the AIC APP. After receiving multiple works, AIC APP can display multiple works in the form of waterfall.

In one example, the user can scan the QR code with the mobile phone through the sharing portal of the AIC APP, and share the card of the creation to social media. Wherein, the creation work may be a work obtained by the work generation method of any of the above embodiments, that is, an AI creation result. Specifically, the AIC APP sends a sharing request to the cloud by calling the sharing interface, and the sharing request carries the ID of the creative work. Correspondingly, the cloud calls the sharing interface of the creation service module through the API gateway, so as to query the address of the creation work in the work database according to the work ID, and send the address to the vehicle terminal. After receiving the address, AIC APP generates a corresponding work sharing logo, such as a QR code, and displays it on the AIC APP.

Through the work generation method of this embodiment, the creation of corresponding AI creation works, such as AI poetry, AI painting, AI music, and AI video, can be realized based on the creation materials on the vehicle side, such as the camera side album (which can be captured by a camera). and so on, and display and share AI creations on the car side.

Embodiment 3

In this embodiment, the method for generating works in the cloud may further include: receiving a result query ID returned by the work creation module according to the creation parameters; and according to a second preset time interval, inquiring from the work creation module whether the work corresponding to the result query ID has been Completed; in the case of completion, obtain the work corresponding to the result query ID from the work creation module.

Since it is time-consuming for the work creation module to create works, the work creation module can first return a result query ID to the creation service module. The result query ID is associated with the creation parameters provided by the vehicle terminal, that is, associated with the creation task ID returned by the cloud to the vehicle terminal. The creation service module may use the result query ID to continuously poll the work creation module according to the second preset time interval, until a work corresponding to the result query ID is obtained. That is to say, the polling of the work results in the cloud and the polling of the work results in the cloud are performed asynchronously.

In an example, as shown in Figure 11-1, the work generation method of the embodiment of the present application can be applied to AI poetry creation. Specifically, the method of this example may include:

(1) Train the AI poetry creation model based on the sample data.

(2) The user selects the material from the album through the poetry creation application of the AIC APP on the car terminal. Among them, the picture material is uploaded to the network disk through the upload interface, and the URL address of the material is obtained. The user selects creation and calls the creation interface, which is implemented by calling the poetry creation interface of the creation service module through the API gateway, and the implementation calls the AI poetry creation model of the work creation module. Due to the time-consuming AI poetry creation, the creation service module generates the creation task ID and returns it to the AIC APP on the vehicle end.

(3) The poetry creation application of the AIC APP on the vehicle side obtains the creation task ID, calls the display interface according to the creation task ID, asynchronously calls the display interface of the creation service module through the API gateway, and polls the AI poetry creation result from the work creation module. ). After multiple polls, the AI poetry creation results (works) are returned to the AIC APP on the car side to display the AI poetry creation results (works).

(4) Users can query the full amount of AI poetry creation results (works) through the poetry creation application of the AIC APP on the car terminal. The AIC APP on the vehicle side calls the list interface, which is implemented by calling the list interface of the creation service module through the API gateway. This implementation queries multiple AI poetry creation results (works) from the works database, and returns them to the vehicle side AIC APP for waterfalls Stream display.

(5) The user can scan the QR code with the mobile device through the sharing portal provided by the poetry creation application of the AIC APP on the car terminal, and share the card of the AI poetry creation result (work) to social media.

In one example, as shown in FIG. 11-2 , the work generation method of the embodiment of the present application can be applied to AI painting creation. Specifically, the difference from the AI poetry creation method is that the AI painting creation uses the creation materials to create the painting, the AIC APP on the car terminal calls the painting creation application, and the AI creation model based on it is the painting creation model.

In one example, as shown in FIG. 11-3 , the composition generation method of the embodiment of the present application can be applied to AI music creation. Specifically, the difference from the AI poetry creation method is that the AI painting creation uses the creative materials, such as music materials, such as the style of the music, whether to generate singing, etc. Therefore, the creative materials do not need to be uploaded to the network disk in advance. In addition, the AIC APP on the car side calls the music creation application, and the AI creation model based on it is the music creation model.

Through the work generation method of this embodiment, the creation of corresponding AI poetry works, AI paintings, and AI music can be realized based on the creation materials on the vehicle terminal, and the AI creation works can be displayed and shared on the vehicle terminal.

Embodiment 4

In this embodiment, the creation material is a video, and the cloud-based work generation method may further include: when the work creation module completes the work corresponding to the creation parameters, the work creation module invokes the callback of the creation service module through the API gateway interface to save the works corresponding to the creation parameters to the work database.

In one example, as shown in FIG. 11-4 , the work generation method of the embodiment of the present application can be applied to AI video clips. Specifically, the method of this example may include:

(1) Train an AI video creation model based on sample data.

(2) The user selects the video material from the album through the video editing application of the AIC APP on the vehicle end, uploads it to the network disk through the upload interface, and obtains the address of the video material, such as the URL address.

(3) When the user chooses to create, the AIC APP on the vehicle end calls the creation interface, thereby sending the creation request carrying the video material address list to the cloud. Through the API gateway, the cloud calls the video clip creation interface of the creation service module, which carries a list of video material URL addresses, and requests the video clip service of the work creation module. The video authoring model initiates a video editing task. Because the video editing service is time-consuming, the creation service module will return the creation task ID to the video editing application of the AIC APP on the vehicle end.

(4) After the video editing task is completed, that is, after the AI video is created, the work creation module calls the callback interface of the creation service module through the API gateway, and stores the video editing result (work) in the work database.

(5) After the video editing application of the AIC APP on the vehicle side obtains the creation task ID, it calls the display interface according to the creation task ID. The cloud calls the display interface of the creation service module through the API gateway, and polls the video editing results corresponding to the creation task ID. (work). Repeat training in rotation until you get the video editing result (work), and return it to the video editing application display of the AIC APP on the vehicle end.

(6) Users can query the full video editing results (works) through the video editing application of the AIC APP on the vehicle end. The video clip application of the AIC APP on the vehicle side calls the list interface. This interface is implemented by calling the list interface of the creation service module through the API gateway. This implementation can query multiple video editing results (works) from the work data and return them to the vehicle side. The video editing application of the AIC APP is a waterfall display.

(7) The user can scan the QR code with the mobile device through the sharing portal of the video editing application of the AIC APP on the vehicle end, and share the card of the video editing result (work) to social media.

Through the work generation method of this embodiment, the creation of corresponding AI video editing works can be realized based on the video creation material (which can be captured by a camera) at the vehicle end, and the AI video editing work can be displayed and shared at the vehicle end.

Embodiment 5

As shown in FIG. 12 , an embodiment of the present application provides a method for generating works at the vehicle end, which may include:

Step S1201, performing semantic recognition on the voice command to obtain a first recognition result;

Step S1202 , triggering the vehicle terminal to execute the work generation method of any of the above embodiments according to the target recognition result, where the target recognition result includes the first recognition result.

The in-vehicle terminal can provide an in-vehicle voice assistant. For example: used to input voice commands: "help me write a poem", "draw me a painting with the theme of sunset", etc. The in-vehicle voice assistant obtains the audio file of the voice command and performs local semantic recognition to obtain the first recognition result. And according to the first recognition result, call the AIP APP on the vehicle terminal to create, display and share the corresponding AI creation works.

In one embodiment, as shown in FIG. 13 , step S1201 may include:

Step S1301, sending the voice command to the cloud, so that the cloud generates a second recognition result according to the voice command;

Step S1302, receiving the second identification result returned by the cloud;

Step S1303: Determine the target recognition result from the first recognition result and the second recognition result according to the preset arbitration rule.

After the in-vehicle voice assistant gets the audio of the voice command, it will send the audio to the cloud. Through the voice gateway, the cloud transmits audio to the voice service module for ASR (Automatic Speech Recognition, automatic speech recognition technology) and NLU (Natural Language Processing, natural language processing) recognition. The voice gateway gets the recognition result, and the arbitration module in the cloud routes the NLU result to the dialog management module to generate the second recognition result according to the input. The voice gateway obtains the second recognition result and returns it to the in-vehicle voice assistant. The in-vehicle voice assistant obtains the second recognition result from the cloud and the first recognition result returned locally, and decides to use one of them as the target recognition result based on the preset arbitration rules.

The arbitration rules can be set according to different scenarios. For example: if the application scenario is a local session scenario, the first recognition result is used first; if the application scenario is a cloud session scenario, the second recognition result is used first; if the application scenario is a hybrid scenario, the order of arrival of the recognition results is determined Either the first recognition result or the second recognition result is used.

Through the work generation method of this embodiment, the creation of the corresponding AI creation works can be realized based on the voice dialogue between the user and the vehicle terminal and the creation materials at the vehicle terminal, and the AI creation works can be displayed and shared on the vehicle terminal.

In an example, as shown in FIG. 14 , the vehicle-machine terminal further includes a first dialogue management module (vehicle voice assistant), which is used to perform semantic recognition on the voice command to obtain a first recognition result; the cloud includes a second dialogue management module, It is used to receive the voice command from the first dialogue management module, and generate the second recognition result according to the voice command; the first dialogue management module is also used to determine from the first recognition result and the second recognition result according to the preset arbitration rule. Target recognition results, and trigger the work generation module according to the target recognition results.

In one embodiment, the first dialogue management module includes a first protocol encoder, a first protocol decoder and a first dialogue engine; the first protocol encoder is used to encode a voice command and send it to the second dialogue management module; the first The protocol decoder is used to call the first recognition result callback interface (ASR callback and NLU callback), and send the decoded first recognition result to the first dialogue engine; the first protocol decoder is also used to call the second recognition result callback interface, Send the decoded second recognition result to the first dialogue engine; the first dialogue engine is used to determine the target recognition result from the first recognition result and the second recognition result according to the preset arbitration rules, and trigger the work generation module .

In one embodiment, the second dialogue management module includes a second protocol encoder, a second protocol encoder, a voice gateway, a voice service module and a second dialogue engine; the voice gateway receives the voice command and passes the second protocol decoder After decoding the voice command, it is sent to the second protocol encoder; the second protocol encoder is used to encode the voice command output by the second protocol decoder; the voice service module performs semantic recognition on the voice command output by the second protocol encoder to obtain an initial recognition result the second dialogue engine generates the second recognition result according to the initial recognition result; the voice gateway encodes the second recognition result through the second protocol encoder and sends it to the first dialogue management module.

In an example, as shown in FIG. 14 , the work generation method of this embodiment may include:

(1) The user enters voice commands through the on-board voice assistant, such as: "help me write a poem", "draw me a painting with the theme of sunset", etc. The in-vehicle voice assistant obtains the audio of the voice command and performs local recognition, that is, accesses the SDK (software development kit) through the voice capability to perform semantic recognition, and generates the first recognition result. At the same time, the in-vehicle voice assistant uploads the audio to the cloud-based voice gateway.

(2) The voice gateway decodes the audio through the second protocol decoder, encodes the audio into the format expected by the voice service module through the second protocol encoder, and transmits the encoded audio to the voice service module for ASR recognition and NLU recognition. The voice gateway obtains the results of ASR recognition and NLU recognition from the voice service module in a streaming manner.

(3) The arbitration module of the voice gateway routes the result of the NLU recognition to the second dialogue management module, so that the second dialogue management module generates the second recognition result based on the result of the NLU recognition. The voice gateway obtains the second recognition result, encodes it through the second protocol encoder, and returns it to the vehicle-mounted voice assistant.

(4) The in-vehicle voice assistant receives the second recognition result returned by the voice gateway through the second recognition result callback interface, and selects one of the second recognition result and the first recognition result as the target recognition result according to the preset arbitration strategy.

(5) The in-vehicle voice assistant uses the first dialogue engine (legA) to call the AICAPP on the vehicle-end to realize the corresponding service according to the target recognition result. At the same time, through the TTS (TextToSpeech, text-to-speech) engine, the target recognition result is broadcast on the vehicle end.

(6) The car-end AIC APP can open a click-to-talk interface for the car voice assistant, and reuse the AI in any of the above embodiments through the atomic operation (target recognition result) output by the first dialogue engine (legA). Methods of poetry creation, AI painting creation, AI music creation and AI video creation.

It should be noted that, although the work generation method of the work generation system of the embodiment of the present application is described with the above examples, those skilled in the art can understand that the present application should not be limited thereto. In fact, the user can flexibly set the implementation method of each module or each step according to personal preferences and/or actual application scenarios.

Embodiment 6

FIG. 15 shows a structural block diagram of an apparatus for generating works on the vehicle side according to an embodiment of the present application. As shown in Figure 15, the apparatus may include:

A work creation request sending module 1501, configured to send a work creation request to the cloud, where the work creation request includes creation parameters, so that the cloud requests the work creation module to create a corresponding creation work according to the creation parameters;

The creation task ID receiving module 1502 is used for receiving the creation task ID corresponding to the work creation request returned by the cloud;

The first query request sending module 1503 is configured to send a first query request to the cloud, where the first query request includes the creation task ID, so that the cloud can query the creation work corresponding to the creation task ID;

The work display module 1504 is configured to receive and display the creation work corresponding to the creation task ID returned by the cloud on the vehicle end.

In one embodiment, the first query request sending module 1503 is configured to send the first query request to the cloud according to a first preset time interval.

In one embodiment, the creation parameter is the address of the creation material in the cloud, and the work generation device further includes:

A creative material sending module, used to send the creative material to the cloud;

The creation material receiving module is used for receiving the address corresponding to the creation material returned by the cloud.

In one embodiment, the work creation request sending module includes:

The detection unit is used to detect the scene conditions where the vehicle end is located;

The control unit is configured to control the corresponding vehicle-mounted multimedia components to collect corresponding multimedia resources according to the scene conditions, and send a work creation request to the cloud, where the creation request includes creation parameters corresponding to the multimedia resources.

In an embodiment, the scene condition includes positioning information, and the control unit is further configured to: control the vehicle-mounted multimedia component to collect multimedia resources under the condition that the positioning information corresponds to the target journey information.

In one embodiment, the scene conditions include ambient audio, and the control unit is further configured to: control the microphone multimedia component to collect ambient audio; control the camera multimedia component to collect image data; and the multimedia resources include ambient audio and image data.

In one embodiment, the scene condition includes a facial image of the target user, and the control unit is further configured to: determine the emotional state of the target user according to the facial image of the target user; when the emotional state of the target user corresponds to a preset emotional state , control the vehicle multimedia components to collect multimedia resources.

In one embodiment, the work generating device further includes:

A second query request sending module, configured to send a second query request to the cloud, so that the cloud can query a plurality of works from the work database;

The work receiving module 1504 is further configured to receive the plurality of works returned by the cloud;

The work display module is used to display the plurality of works on the vehicle end.

In one embodiment, the work generating device further includes:

The sharing request sending module is used to send a sharing request to the cloud, where the sharing request includes the work ID of the creation work, so that the cloud can query the address of the creation work in the work database according to the work ID;

The address receiving module is used to receive the address of the creative work returned by the cloud;

An identification generation module, which is used to generate a corresponding work sharing identification according to the address of the created work;

The logo display module is used to display the work sharing logo on the vehicle end.

In an embodiment, the work generating apparatus further includes: a creative work uploading module, configured to send the edited creative work to the cloud. Further, the sharing request sending module is used to send a sharing request to the cloud, and the sharing request includes the work ID of the edited creative work, so that the cloud can query the edited creative work in the works database according to the work ID. The address receiving module is also used to receive the address of the edited creative work returned by the cloud; the identifier generation module is also used to generate a corresponding work sharing identifier according to the edited address of the creative work.

In one embodiment, the work creation request sending module 1501 sends the work creation request to the cloud by calling the creation interface of the vehicle terminal, so that the cloud can call the creation interface of the creation service module through the API gateway.

In one embodiment, the first query request sending module 1503 sends the first query request to the cloud by calling the display interface of the vehicle terminal.

In one embodiment, the second query request sending module sends the second query request to the cloud by calling the list interface of the vehicle terminal, so that the cloud can call the list interface of the authoring service module through the API gateway.

In one embodiment, the sharing request sending module sends the sharing request to the cloud by calling the sharing interface of the vehicle terminal, so that the cloud can call the sharing interface of the authoring service module through the API gateway.

In one embodiment, the work generating apparatus may further include:

an editing identification generating module, configured to generate an editing identification for the work according to the address of the creative work in the cloud;

The editing identification display module is used to display the editing identification of the work on the vehicle end, so that the mobile terminal can determine the address of the creation in the cloud according to the editing identification of the work, and The cloud acquires the creative work and displays it on the mobile terminal.

In one embodiment, the editing logo display module may include:

an editing unit for editing the creative work according to the user's editing instructions;

In the display unit, it is used for displaying the edited creation work at the vehicle-machine end.

FIG. 16 shows a structural block diagram of an apparatus for generating works in the cloud according to an embodiment of the present application. As shown in Figure 16, the apparatus may include:

The work creation request receiving module 1601 is used to receive the work creation request sent by the vehicle terminal, and the work creation request includes creation parameters;

The creation task ID generation and sending module 1602 is used to generate the creation task ID corresponding to the work creation request, and send the creation task ID to the vehicle terminal;

A requesting module 1603, configured to request the work creation module to create a corresponding creation work according to the creation parameters;

The first query request receiving module 1604 is configured to receive the first query request sent by the vehicle terminal, where the first query request includes the creation task ID;

Work query module 1605, used to query the creation work corresponding to the creation task ID;

The work sending module 1606 is configured to send the work corresponding to the creation task ID to the vehicle terminal.

In one embodiment, the work generating device further includes:

The result query ID receiving module is used to receive the result query ID returned by the work creation module according to the creation parameter;

A work status query module, configured to query from the work creation module whether the creation work corresponding to the result query ID has been completed according to the second preset time interval;

The work acquisition module is used to acquire the work creation corresponding to the result query ID from the work creation module when the work is completed.

In one embodiment, the creation material corresponding to the creation parameter is a video, and the work generating device further includes:

A work saving module, used for when the work creation module completes the work corresponding to the creation parameter, the work creation module calls the callback interface of the creation service module through the API gateway to save the work corresponding to the creation parameter to the work database.

In one embodiment, the creation parameter is the address of the creation material in the cloud, and the work generation device further includes:

The creative material receiving module is used to receive and save the creative materials sent by the vehicle terminal;

The creation material sending module is used for sending the address corresponding to the creation material to the vehicle terminal.

In one embodiment, the work generating device further includes:

The second query request receiving module is configured to receive the second query request sent by the vehicle terminal;

The work query module is further configured to query a plurality of works from the work database according to the second query request;

The work sending module is further configured to send the plurality of works to the vehicle terminal.

In one embodiment, the work generating device further includes:

The sharing request receiving module is used to receive the sharing request sent by the vehicle terminal, and the sharing request includes the work ID of the created work;

The address query module is used to query the address of the creative work in the work database according to the work ID;

The address sending module is used to send the address of the created work to the vehicle terminal.

In one embodiment, the work generating device further includes a creative work receiving module, configured to receive and save the edited creative work at the vehicle terminal, and the edited creative work corresponds to a work ID. Further, a sharing request receiving module is used to receive a sharing request sent by the vehicle terminal, and the sharing request includes the work ID, so that the cloud can query the edited address of the creative work in the cloud according to the work ID; The address query module is used to query the address of the creative work in the work database according to the work ID; the address sending module is used to send the edited cloud address of the creative work to the vehicle terminal.

In one embodiment, the work creation request receiving module 1601 parses the work creation request through the API gateway to call the creation interface of the creation service module.

In one embodiment, the first query request receiving module 1604 parses the first query request through the API gateway to asynchronously invoke the presentation interface of the authoring service module.

In one embodiment, the second query request receiving module parses the second query request through the API gateway, so as to call the list interface of the authoring service module to query the plurality of works from the work database.

In one embodiment, the sharing request receiving module parses the sharing request through the API gateway to call the sharing interface of the authoring service module.

FIG. 17 shows a structural block diagram of an apparatus for generating works on the vehicle side according to an embodiment of the present application. As shown in Figure 17, the apparatus may include:

A semantic recognition module 1701, configured to perform semantic recognition on the voice command to obtain a first recognition result;

The trigger execution module 1702 is configured to trigger the vehicle terminal to execute the method of any one of claims 1 to 9 according to the target recognition result, where the target recognition result includes the first recognition result.

In one embodiment, as shown in FIG. 17 , the semantic recognition module 1701 may include:

a voice command sending module 1703, configured to send the voice command to the cloud, so that the cloud can generate a second recognition result according to the voice command;

The identification result receiving module 1704 is used for receiving the second identification result returned by the cloud;

The arbitration module 1705 is configured to determine the target recognition result from the first recognition result and the second recognition result according to a preset arbitration rule.

For the functions of each module in each device in this embodiment of the present application, reference may be made to the corresponding description in the foregoing method, and details are not described herein again.

The embodiment of the present application provides a work editing device, including:

The logo identification module is used to identify the editing logo of the works displayed on the vehicle end;

The address determination module is used to determine the address of the creative work in the cloud according to the work editing identifier, and the creative work is generated according to any of the above work generation methods;

The work acquisition and display module is used to acquire the creative work from the cloud according to the address and display it on the mobile terminal.

In one embodiment, the work editing device further includes:

The editing material obtaining module is used to obtain the corresponding editing material according to the user's editing instruction;

The editing module is used to edit and create works based on editing materials;

The sharing module is used to share edited creations.

FIG. 18 shows a structural block diagram of a terminal or a server according to an embodiment of the present application. As shown in FIG. 18 , the terminal or server includes: a memory 1801 and a processor 1802 , and instructions that can be executed on the processor 1802 are stored in the memory 1801 . When the processor 1802 executes the instruction, any one of the work generation methods in the above-mentioned embodiments is implemented. The number of the memory 1801 and the processor 1802 may be one or more. The terminal or server is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. A terminal or server may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the application described and/or claimed herein.

The terminal or server may further include a communication interface 1803 for communicating with external devices to perform data interactive transmission. The various devices are interconnected using different buses and can be mounted on a common motherboard or otherwise as desired. Processor 1802 may process instructions for execution within the terminal or server, including instructions stored in or on memory to display graphical information of the GUI on external input/output devices, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used with multiple memories and multiple memories, if desired. Likewise, multiple terminals or servers can be connected, with each device providing some of the necessary operations (eg, as an array of servers, a group of blade servers, or a multiprocessor system). The bus can be divided into address bus, data bus, control bus and so on. For ease of presentation, only one thick line is shown in FIG. 18, but it does not mean that there is only one bus or one type of bus.

Optionally, in specific implementation, if the memory 1801, the processor 1802 and the communication interface 1803 are integrated on one chip, the memory 1801, the processor 1802 and the communication interface 1803 can communicate with each other through the internal interface.

It should be understood that, the above-mentioned processor may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Sntegrated Circuit, ASIC), Field Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or any conventional processor or the like. It should be noted that the processor may be a processor supporting an advanced RISC machines (ARM) architecture.

Embodiments of the present application provide a computer-readable storage medium (such as the above-mentioned memory 1801 ), which stores computer instructions, and when the program is executed by a processor, implements the methods provided in the embodiments of the present application.

Optionally, the memory 1801 may include a stored program area and a stored data area, wherein the stored program area may store an operating system and an application program required by at least one function; the stored data area may store data created according to the use of the terminal or server Wait. Additionally, memory 1801 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory 1801 may optionally include memory located remotely from the processor 1802, and these remote memories may be connected to a terminal or server through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The processor 1802 may be the first processor, the second processor or the third processor; the memory 1801 may be the first memory, the second memory or the third memory.

In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present application. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine the different embodiments or examples described in this specification, as well as the features of the different embodiments or examples, without conflicting each other.

In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present application, "plurality" means two or more, unless otherwise expressly and specifically defined.

Any description of a process or method in a flowchart or otherwise described herein may be understood to represent a representation of executable instructions comprising one or more (two or more) steps for implementing a specified logical function or process. A module, fragment or section of code. Also, the scope of the preferred embodiments of the present application includes alternative implementations in which the functions may be performed out of the order shown or discussed, including performing the functions substantially concurrently or in the reverse order depending upon the functions involved.

The logic and/or steps represented in flowcharts or otherwise described herein, for example, may be considered an ordered listing of executable instructions for implementing the logical functions, may be embodied in any computer-readable medium, For use with, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch instructions from and execute instructions from an instruction execution system, apparatus, or apparatus) or equipment.

It should be understood that various parts of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. All or part of the steps of the method in the above-mentioned embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one of the steps of the method embodiment or its combination.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the above-mentioned integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium. The storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the technical field disclosed in the present application can easily think of various changes or Replacement, these should be covered within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (53)

1. A work generation method is applied to a vehicle end and is characterized by comprising the following steps:

sending a work creation request to a cloud end, wherein the work creation request comprises creation parameters, so that the cloud end requests a work creation module to create corresponding created works according to the creation parameters;

receiving an authoring task ID corresponding to the work authoring request returned by the cloud;

sending a first query request to the cloud, wherein the first query request comprises the creation task ID, so that the cloud queries the creation work corresponding to the creation task ID;

and receiving and displaying the creative work corresponding to the creative task ID at the vehicle end.

2. The method of claim 1, wherein sending a first query request to the cloud comprises:

and sending the first query request to the cloud according to a first preset time interval.

3. The method of claim 1, wherein the authoring parameters include an address of authoring material at the cloud, and wherein sending a request to the cloud for authoring a work further comprises:

sending the creation material to the cloud;

and receiving an address which is returned by the cloud and corresponds to the creation material.

4. The method of claim 1, wherein sending a work creation request to a cloud comprises:

detecting a scene condition of the vehicle end;

and controlling a corresponding vehicle-mounted multimedia assembly to collect corresponding multimedia resources according to the scene conditions, and sending the work creation request to the cloud, wherein the creation request comprises creation parameters corresponding to the multimedia resources.

5. The method according to claim 4, wherein the scene condition includes positioning information, and controlling the corresponding vehicle-mounted multimedia component to acquire the corresponding multimedia resource according to the scene condition comprises:

and controlling the vehicle-mounted multimedia assembly to acquire multimedia resources under the condition that the positioning information corresponds to the target journey information.

6. The method of claim 4, wherein the scene condition comprises an environmental audio, and controlling the corresponding in-vehicle multimedia component to acquire the corresponding multimedia resource according to the scene condition comprises:

controlling a microphone multimedia component to collect the environmental audio;

controlling a camera multimedia assembly to acquire image data; the multimedia asset includes the ambient audio and the image data.

7. The method of claim 4, wherein the scene condition comprises a facial image of a target user, and wherein controlling the corresponding in-vehicle multimedia component to acquire the corresponding multimedia resource according to the scene condition comprises:

determining an emotional state of the target user according to the facial image of the target user;

and controlling the vehicle-mounted multimedia assembly to acquire multimedia resources under the condition that the emotional state of the target user corresponds to a preset emotional state.

8. The method of claim 1, further comprising:

sending a sharing request to the cloud end, wherein the sharing request comprises a work ID of the creative work, so that the cloud end queries the address of the creative work in a work database according to the work ID;

receiving the address of the creative work returned by the cloud end;

generating a corresponding work sharing identification according to the address of the creative work;

and displaying the work sharing identification at the vehicle end.

9. The method of claim 1, further comprising:

generating a work editing identifier according to the address of the creative work at the cloud end;

and displaying the work editing identification at the vehicle end so that the mobile terminal can determine the address of the creative work at the cloud end according to the work editing identification, and acquire the creative work from the cloud end according to the address and display the creative work at the mobile terminal.

10. The method of claim 1, wherein presenting the creative work corresponding to the creative task ID at the vehicle end comprises:

editing the creative work according to an editing instruction of a user;

and displaying the edited creative work at the vehicle end.

11. The method of claim 10, further comprising:

sending the edited creative work to the cloud end;

sending a sharing request to the cloud end, wherein the sharing request comprises a work ID of the edited creative work, so that the cloud end inquires the address of the edited creative work at the cloud end according to the work ID;

receiving an address of the edited creative work returned by the cloud;

generating a corresponding work sharing identification according to the edited address of the creative work;

and displaying the work sharing identification at the vehicle end.

12. The method of claim 8 or 11, wherein sending the sharing request to the cloud comprises:

and sending the sharing request to the cloud end by calling a sharing interface at the vehicle end so that the cloud end calls the sharing interface of the creation service module through the API gateway.

13. The method of claim 1, wherein sending a work creation request to a cloud comprises:

and sending the work creation request to the cloud end by calling the creation interface at the vehicle end so as to enable the cloud end to call the creation interface of the creation service module through the API gateway.

14. The method of claim 1, wherein sending the first query request to the cloud comprises:

and sending the first query request to the cloud terminal by calling a display interface at the vehicle terminal.

15. The method of claim 1, further comprising:

sending a second query request to the cloud end so as to enable the cloud end to query a plurality of works from a work database, wherein the works comprise the creative works;

receiving a plurality of works returned by the cloud;

and displaying the plurality of works returned by the cloud end at the vehicle end.

16. The method of claim 15, wherein sending a second query request to the cloud comprises:

and sending the second query request to the cloud end by calling a list interface of the vehicle end so that the cloud end calls the list interface of the creation service module through the API gateway.

17. A work generation method is applied to a cloud end and is characterized by comprising the following steps:

receiving a work creation request sent by a vehicle end, wherein the work creation request comprises creation parameters;

generating an authoring task ID corresponding to the work authoring request;

sending the authoring task ID to the vehicle end;

requesting a work creation module to create a corresponding created work according to the creation parameters;

receiving a first query request sent by the vehicle end, wherein the first query request comprises the creation task ID;

inquiring the creative work corresponding to the creative task ID;

and sending the creative work corresponding to the creative task ID to the vehicle end.

18. The method of claim 17, further comprising:

receiving a result inquiry ID returned by the composition creation module according to the creation parameters;

inquiring whether the creative work corresponding to the result inquiry ID is finished from the work creative module according to a second preset time interval;

in the completed case, a creative work corresponding to the result query ID is obtained from the work creative module.

19. The method of claim 17, wherein the authoring material corresponding to the authoring parameters is a video, the method further comprising:

under the condition that the work creation module completes the work creation corresponding to the creation parameters, the work creation module calls a callback interface of the creation service module through an API gateway so as to store the work creation corresponding to the creation parameters to a work database.

20. The method of claim 17, wherein the authoring parameter is an address of authoring material at the cloud, the method further comprising:

receiving and storing the creation material sent by the vehicle end;

and sending the address corresponding to the creation material to the automobile terminal.

21. The method of claim 17, further comprising:

receiving a second query request sent by the vehicle end;

querying a plurality of works from a work database according to the second query request, the works including the creative works;

and sending the plurality of inquired works to the vehicle end.

22. The method of claim 17, further comprising:

receiving a sharing request sent by the vehicle end, wherein the sharing request comprises a work ID of the creative work;

inquiring the address of the creative work in a work database according to the ID of the work;

and sending the address of the creative work to the vehicle end.

23. The method of claim 17, further comprising:

receiving and storing the edited creative work at the vehicle end, wherein the edited creative work corresponds to a work ID;

receiving a sharing request sent by the vehicle end, wherein the sharing request comprises the work ID, so that the cloud end queries the address of the edited creative work at the cloud end according to the work ID;

and sending the edited creative work to the vehicle end at the address of the cloud end.

24. The method of claim 17, wherein receiving a work composition request from a vehicle end comprises:

and analyzing the work creation request through the API gateway so as to call an creation interface of the creation service module.

25. The method of claim 17, wherein receiving a first query request from the vehicle end comprises:

and analyzing the first query request through the API gateway so as to call a display interface of the authoring service module.

26. The method of claim 21, wherein receiving a second query request from the vehicle end to query a plurality of works from a database of works, comprises:

and analyzing the second query request through an API gateway to call a list interface of an authoring service module to query a plurality of works from the work database.

27. The method according to claim 22 or 23, wherein receiving the sharing request sent by the vehicle end comprises:

and analyzing the sharing request through the API gateway so as to call a sharing interface of the authoring service module.

28. A work generation method is applied to a vehicle end and is characterized by comprising the following steps:

performing semantic recognition on the voice command to obtain a first recognition result;

triggering the vehicle end to perform the method of any one of claims 1 to 16 according to a target recognition result, the target recognition result including the first recognition result.

29. The method of claim 28, further comprising:

sending the voice instruction to a cloud end so that the cloud end generates a second recognition result according to the voice instruction;

receiving the second recognition result returned by the cloud end;

and determining the target recognition result from the first recognition result and the second recognition result according to a preset arbitration rule.

30. A method for editing works is applied to a mobile terminal and is characterized by comprising the following steps:

identifying a work editing identifier displayed at a vehicle end;

determining an address of a creative work at a cloud according to the work editing identifier, the creative work being generated according to the method of any one of claims 1-29;

acquiring the creative work from the cloud according to the address;

and displaying the creative work at the mobile terminal.

31. The method of claim 30, further comprising:

acquiring a corresponding editing material according to an editing instruction of a user;

editing the creative work according to the editing materials;

and sharing the edited creative work.

32. A work generation apparatus, comprising:

the work creation request sending module is used for sending a work creation request to a cloud end, wherein the work creation request comprises creation parameters, so that the cloud end requests the work creation module to create corresponding created works according to the creation parameters;

the creation task ID receiving module is used for receiving a creation task ID which is returned by the cloud end and corresponds to the creation request of the work;

the first query request sending module is used for sending a first query request to the cloud, wherein the first query request comprises the creation task ID, so that the cloud queries the creation works corresponding to the creation task ID;

and the work display module is used for receiving and displaying the creative work which is returned by the cloud end and corresponds to the creative task ID at the vehicle end.

33. A work generation apparatus, comprising:

the system comprises a work creation request receiving module, a work creation request processing module and a work creation request processing module, wherein the work creation request receiving module is used for receiving a work creation request sent by a vehicle end, and the work creation request comprises creation parameters;

the creation task ID generating and sending module is used for generating a creation task ID corresponding to the creation request of the work and sending the creation task ID to the vehicle end;

the request module is used for requesting the work creation module to create the corresponding created work according to the creation parameters;

a first query request receiving module, configured to receive a first query request sent by the vehicle end, where the first query request includes the creation task ID;

the work inquiry module is used for inquiring the creative work corresponding to the creative task ID;

and the work sending module is used for sending the creative work corresponding to the creative task ID to the vehicle end.

34. A work generation apparatus, comprising:

the semantic recognition module is used for performing semantic recognition on the voice command to obtain a first recognition result;

a trigger execution module, configured to trigger the vehicle end to execute the method according to a target recognition result, where the target recognition result includes the first recognition result.

35. The apparatus of claim 34, further comprising:

the voice instruction sending module is used for sending the voice instruction to a cloud end so that the cloud end can generate a second recognition result according to the voice instruction;

the identification result receiving module is used for receiving the second identification result returned by the cloud end;

and the arbitration module is used for determining the target recognition result from the first recognition result and the second recognition result according to a preset arbitration rule.

36. A work editing apparatus, comprising:

the identification recognition module is used for recognizing the editing identification of the works displayed at the vehicle end;

an address determination module, configured to determine, according to the work editing identifier, an address of a creative work at a cloud, where the creative work is generated according to the method of any one of claims 1 to 29;

and the work acquisition and display module is used for acquiring the creative work from the cloud end according to the address and displaying the creative work on the mobile terminal.

37. A vehicle end terminal, comprising:

at least one first processor; and

a first memory communicatively coupled to the at least one first processor; wherein,

the first memory stores instructions executable by the at least one first processor to enable the at least one first processor to perform the method of any one of claims 1 to 16, claim 28 and claim 29.

38. A server, comprising:

at least one second processor; and

a second memory communicatively coupled to the at least one second processor; wherein,

the second memory stores instructions executable by the at least one second processor to enable the at least one second processor to perform the method of any one of claims 17 to 27.

39. A mobile terminal, comprising:

at least one third processor; and

a third memory communicatively coupled to the at least one third processor; wherein,

the third memory stores instructions executable by the at least one third processor to enable the at least one third processor to perform the method of claim 30 or 31.

40. A work generation system comprising the vehicle-end terminal of claim 37 and the server of claim 38.

41. The system according to claim 40, further comprising the mobile terminal according to claim 39.

42. A work generation system is characterized by comprising a vehicle end and a cloud end, wherein the vehicle end comprises a work generation module, and the cloud end comprises an authoring service module, a work authoring module and an API gateway;

the work generation module includes: an authoring interface for sending a work authoring request to the cloud; the display interface is used for sending a first query request to the cloud end; the work creation request comprises creation parameters, and the first query request comprises an creation task ID (identity) which is returned by the cloud and corresponds to the work creation request;

the authoring service module comprises: an authoring interface for requesting the work authoring module to author a corresponding authored work according to the authoring parameters; the display interface is used for inquiring and returning the creative work corresponding to the creative task ID to the vehicle end;

the cloud end analyzes the work creation request through the API gateway to call a creation interface of the creation service module, and the cloud end analyzes the first query request through the API gateway to call the creation interface of the creation service module.

43. The system of claim 42, wherein the vehicle end invokes the presentation interface of the production generation module at a first predetermined time interval, and the cloud end invokes the presentation interface of the production service module at a second predetermined time interval.

44. The system of claim 42, wherein the authoring parameters comprise an address of the authoring material in the cloud, the vehicle end further comprises an uploading interface, the cloud end comprises a web disk, the vehicle end sends the authoring material to the web disk by calling the uploading interface, and the address is the address of the authoring material in the web disk.

45. The system of claim 42, wherein the cloud comprises a work database having a plurality of works stored therein, the works including the work of creation.

46. The system of claim 45, wherein the composition generation module comprises a listing interface for sending a second query request to the cloud, and wherein the authoring service module comprises a listing interface for querying the plurality of compositions from the composition database, wherein the authoring service module parses the second query request through the API gateway to invoke the listing interface of the authoring service module.

47. The system of claim 45, wherein the composition generation module comprises a sharing interface for sending a sharing request to the cloud, the sharing request comprises a composition ID of the composition, the composition service module comprises a sharing interface for querying an address of the composition in the composition database returned to the vehicle end according to the composition ID, and the composition service module parses the sharing request through the API gateway to call the sharing interface of the composition service module.

48. The system of claim 45, wherein the authoring material corresponding to the authoring parameter is a video, wherein the authoring service module further comprises a callback interface, and wherein the composition authoring module calls the callback interface of the authoring service module via the API gateway to save the composition corresponding to the authoring parameter to the composition database when the composition authoring module completes the composition corresponding to the authoring parameter.

49. The system of claim 42, wherein the authoring service module further comprises a data processing sub-module for performing data processing on authoring material corresponding to the authoring parameters, the data processing including sensitive word filtering.

50. The system according to any one of claims 42 to 49, wherein the vehicle end further comprises a first dialogue management module, configured to perform semantic recognition on the voice command to obtain a first recognition result; the cloud end comprises a second dialogue management module which is used for receiving the voice command from the first dialogue management module and generating a second recognition result according to the voice command; the first dialogue management module is further used for determining a target recognition result from the first recognition result and the second recognition result according to a preset arbitration rule, and triggering the work generation module according to the target recognition result.

51. The system according to claim 50, wherein said first session management module comprises a first protocol encoder, a first protocol decoder, and a first session engine;

the first protocol encoder is used for encoding the voice command and then sending the voice command to the second dialogue management module;

the first protocol decoder is used for calling a first recognition result callback interface and sending a decoded first recognition result to the first dialogue engine; the first protocol decoder is further used for calling a second recognition result callback interface and sending the decoded second recognition result to the first dialogue engine;

the first dialogue engine is used for determining the target recognition result from the first recognition result and the second recognition result according to a preset arbitration rule and triggering the work generation module.

52. The system according to claim 50, wherein said second session management module comprises a second protocol encoder, a voice gateway, a voice services module, and a second session engine;

the voice gateway receives the voice command, decodes the voice command through the second protocol decoder and then sends the voice command to the second protocol encoder;

the second protocol encoder is used for encoding the voice instruction output by the second protocol decoder;

the voice service module carries out semantic recognition on the voice command output by the second protocol encoder to obtain an initial recognition result;

the second dialogue engine generates a second recognition result according to the initial recognition result;

and the voice gateway encodes the second identification result through the second protocol encoder and then sends the second identification result to the first dialogue management module.

53. A computer readable storage medium having stored therein computer instructions which, when executed by a processor, implement the method of any one of claims 1 to 31.

Images