CN118796335A - Cloud application interaction method, device, equipment and storage medium based on smart device - Google Patents

Abstract

The present invention provides a cloud application interaction method, apparatus, device and storage medium based on smart devices, and relates to the technical field of smart devices. The method includes: receiving a cloud application startup instruction, determining a first target cloud application to be started based on the cloud application startup instruction, and generating a cloud application startup request for starting the first target cloud application; sending the cloud application startup request to a server, so that the server obtains cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request, the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application; receiving the interaction data returned by the server in response to the cloud application startup request, and outputting the interaction data. The present invention can ensure that the number of applications that can be used on smart devices is not limited, and ensure the consistency of experience between cloud applications and local applications.

Description

Cloud application interaction method, device, equipment and storage medium based on smart device

Technical Field

The present invention relates to the field of smart device technology, and in particular to a cloud application interaction method, device, equipment and storage medium based on a smart device.

Background Art

With the rapid development of science and technology, the application scope of smart devices is becoming more and more extensive. For example, smart home devices are becoming more and more common in family life, and they also have more and more functions. In order to realize the intelligence of smart devices, applications need to be installed on smart devices.

At present, all applications of smart devices are installed locally on the devices. However, most smart devices have low hardware configuration, limited storage space, and limited computing power, which results in a small number of applications that can be installed on smart devices, and the inability to install applications with high configuration requirements, which in turn results in a small number of applications that can be used on smart devices, and the applications that can be used are limited, which ultimately limits the intelligent realization of smart devices.

Summary of the invention

The present invention provides a cloud application interaction method, apparatus, device and storage medium based on smart devices, which are used to solve the defects in the prior art that the number of applications that can be used on smart devices is small and the applications that can be used are limited.

The present invention provides a cloud application interaction method based on a smart device, which is applied to the smart device. The method comprises:

receiving a cloud application startup instruction, determining a first target cloud application to be started based on the cloud application startup instruction, and generating a cloud application startup request for starting the first target cloud application;

Sending the cloud application startup request to the server, so that the server obtains the cloud application information of the first target cloud application and the device information of the smart device based on the cloud application startup request, the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application;

Receive interaction data returned by the server in response to the cloud application startup request, and output the interaction data, where the interaction data is data that the first target cloud application needs to present to the user when it is started.

The present invention also provides a cloud application interaction method based on a smart device, which is applied to a server, and the method comprises:

Receiving a cloud application start request for starting a first target cloud application sent by a smart device;

Based on the cloud application start request, obtaining cloud application information of the first target cloud application and device information of the smart device;

Send the device information and the cloud application information of the first target cloud application to a cloud application center node, so that the cloud application center node allocates and starts a first cloud application service node for the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, where the cloud application information of the first target cloud application is used to allocate and start a first target virtual machine for the first target cloud application;

Receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device, where the interaction data is the data that the first target cloud application needs to present to the user when starting.

The present invention also provides a cloud application interaction method based on a smart device, which is applied to a cloud application service node. The method comprises:

Receive cloud application information of a first target cloud application sent by a cloud application center node;

Based on the cloud application information of the first target cloud application, allocating and starting a first target virtual machine of the first target cloud application;

The interactive data required to be presented to the user when the first target cloud application is started is obtained, and the interactive data is sent to the server so that the server forwards the interactive data to the smart device.

The present invention also provides a cloud application interaction method based on a smart device, which is applied to a cloud application center node, and the method includes:

Receive cloud application information of the first target cloud application and device information of the smart device sent by the server;

Based on the device information, allocating and starting a first cloud application service node for the first target cloud application;

The cloud application information of the first target cloud application is sent to the first cloud application service node, so that the first cloud application service node allocates and starts the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application.

The present invention also provides a cloud application interaction device based on a smart device, which is deployed on the smart device, and the device includes:

A first receiving module is used to receive a cloud application startup instruction, determine a first target cloud application to be started based on the cloud application startup instruction, and generate a cloud application startup request for starting the first target cloud application;

A first sending module, used to send the cloud application startup request to the server, so that the server obtains the cloud application information of the first target cloud application and the device information of the smart device based on the cloud application startup request, the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application;

The second receiving module is used to receive the interaction data returned by the server in response to the cloud application startup request, and output the interaction data, where the interaction data is the data that the first target cloud application needs to present to the user when it is started.

The present invention also provides a cloud application interaction device based on a smart device, which is deployed on a server, and the device includes:

A third receiving module, configured to receive a cloud application startup request sent by a smart device to start a first target cloud application;

A first acquisition module, configured to acquire cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request;

A second sending module is used to send the device information and the cloud application information of the first target cloud application to a cloud application central node, so that the cloud application central node allocates and starts a first cloud application service node for the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, and the cloud application information of the first target cloud application is used to allocate and start a first target virtual machine for the first target cloud application;

The fourth receiving module is used to receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device, where the interaction data is the data that the first target cloud application needs to present to the user when it is started.

The present invention also provides a cloud application interaction device based on a smart device, which is deployed in a cloud application service node, and the device includes:

A fifth receiving module, used to receive cloud application information of the first target cloud application sent by the cloud application center node;

A first allocation module, configured to allocate and start a first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application;

The second acquisition module is used to acquire the interaction data that needs to be presented to the user when the first target cloud application is started, and send the interaction data to the server so that the server forwards the interaction data to the smart device.

The present invention also provides a cloud application interaction device based on a smart device, which is deployed in a cloud application center node, and the device includes:

A sixth receiving module, configured to receive the cloud application information of the first target cloud application and the device information of the smart device sent by the server;

A second allocation module, configured to allocate and start a first cloud application service node for the first target cloud application based on the device information;

The third sending module is used to send the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node can allocate and start the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application.

The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the cloud application interaction method based on smart devices as described above is implemented.

The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the cloud application interaction methods based on smart devices as described above.

The cloud application interaction method, apparatus, device and storage medium based on smart devices provided by the present invention receive a cloud application startup instruction, determine a first target cloud application to be started based on the cloud application startup instruction, and generate a cloud application startup request for starting the first target cloud application, so as to send the cloud application startup request to a server, so that the server can obtain cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request, and the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application, so that the first target cloud application can be installed and started on the first cloud application service node without installing the first target cloud application on the smart device, thereby ensuring that the number of applications available on the smart device is not limited and ensuring The size of the application that can be used is also not limited, thereby ensuring that the intelligent realization of the smart device is not limited; at the same time, the first cloud application service node for starting the first target cloud application is reasonably allocated based on the device information, and the first target virtual machine for starting the first target cloud application is reasonably allocated based on the cloud application information, ensuring the normal startup and operation of the first target cloud application, thereby ensuring that the smart device can use the first target cloud application normally; in addition, the interaction data returned by the server in response to the cloud application startup request is received, and the interaction data is output, and the interaction data is the data that the first target cloud application needs to present to the user when it is started, thereby ensuring that the interaction data presented by the first target cloud application on the first target virtual machine is consistent with the interaction data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

FIG1 is a flow chart of a cloud application interaction method based on a smart device provided by the present invention;

FIG. 2 is a second flow chart of the cloud application interaction method based on smart devices provided by the present invention;

FIG3 is a third flow chart of the cloud application interaction method based on smart devices provided by the present invention;

FIG4 is a fourth flow chart of the cloud application interaction method based on smart devices provided by the present invention;

FIG5 is a schematic diagram of the structure of a cloud application interaction system based on smart devices provided by the present invention;

FIG6 is a fifth flow chart of the cloud application interaction method based on smart devices provided by the present invention;

FIG7 is a sixth flow chart of the cloud application interaction method based on smart devices provided by the present invention;

FIG8 is a seventh flow chart of the cloud application interaction method based on smart devices provided by the present invention;

FIG9 is a flowchart of the eighth method for interacting with cloud applications based on smart devices provided by the present invention;

FIG10 is a schematic diagram of a structure of a cloud application interaction device based on a smart device provided by the present invention;

FIG11 is a second structural diagram of the cloud application interaction device based on smart devices provided by the present invention;

FIG12 is a third structural diagram of the cloud application interaction device based on smart devices provided by the present invention;

FIG13 is a fourth structural diagram of the cloud application interaction device based on smart devices provided by the present invention;

FIG. 14 is a schematic diagram of the structure of an electronic device provided by the present invention.

DETAILED DESCRIPTION

In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

With the rapid development of science and technology, the application scope of smart devices is becoming more and more extensive. For example, smart home devices are becoming more and more common in family life, and they also have more and more functions. In order to realize the intelligence of smart devices, applications need to be installed on smart devices.

At present, all applications of smart devices are installed locally on the devices. However, most smart devices have low hardware configuration, limited storage space, and limited computing power, which results in a small number of applications that can be installed on smart devices, and the inability to install applications with high configuration requirements, which in turn results in a small number of applications that can be used on smart devices, and the applications that can be used are limited, which ultimately limits the intelligent realization of smart devices.

For example, smart speakers play an increasingly important role in people's lives. However, existing smart speakers have low hardware configuration, limited storage space, and limited computing power, which results in applications being installed locally on the smart speakers, a small number of applications that can be installed, and applications with high configuration requirements cannot be installed.

In view of the above problems, the present invention proposes the following embodiments.

The present invention proposes a cloud application interaction method based on a smart device, and the method is applied to a smart device. FIG1 is one of the flow diagrams of the cloud application interaction method based on a smart device provided by the present invention. As shown in FIG1 , the cloud application interaction method based on a smart device applied to a smart device includes:

Step 110: Receive a cloud application startup instruction, determine a first target cloud application to be started based on the cloud application startup instruction, and generate a cloud application startup request for starting the first target cloud application.

In the embodiment of the present invention, for ease of understanding, the smart device is taken as an example of a smart speaker. It should be understood that the smart device is provided with a cloud application market for selecting more cloud applications, that is, cloud applications with no limit on quantity and hardware configuration.

In one embodiment, the smart device includes a local application management module, a cloud application management module, an acoustic module and a communication module. The local application management module is responsible for the management of applications installed locally on the smart device, which mainly manages some applications that rely on hardware functions or need to run in the background. The cloud application management module is responsible for the management of cloud applications, which specifically includes application list display, application startup, application voice control, application gesture control and application display, etc. The acoustic module is responsible for acoustic echo cancellation, noise reduction and sound pickup, etc. The communication module is responsible for communicating with the server, including transmitting voice streams and receiving control information, etc.

Here, the cloud application startup instruction is used to instruct to start (open) a cloud application, and the cloud application startup instruction may indicate the first target cloud application to be started. The cloud application startup instruction may be triggered by a user based on a smart device, and its triggering method may include but is not limited to at least one of the following: touch control (such as click operation), voice control, gesture control, posture control, expression control, etc.

Here, the first target cloud application is an application installed in the cloud application service node. The first target cloud application determined based on the cloud application startup instruction can be characterized by the cloud application unique identification information.

Here, the cloud application start request is used to request the server to start the first target cloud application. It should be understood that the first target cloud application is actually started at the cloud application service node.

In one embodiment, a cloud application startup request corresponding to the first target cloud application and the smart device is generated, so that the cloud application startup request can be used to indicate the first target cloud application and the smart device. More specifically, based on the cloud application unique identification information corresponding to the first target cloud application and the device unique identification information corresponding to the smart device, the cloud application startup request is generated, so that the cloud application startup request can be used to indicate the unique identification information and the device unique identification information.

In another embodiment, cloud application information of a first target cloud application and device information of a smart device are obtained, and a cloud application startup request is generated based on the cloud application information of the first target cloud application and the device information of the smart device, so that the cloud application startup request indicates the cloud application information and the device information.

In another embodiment, cloud application information of a first target cloud application is obtained, and based on the cloud application information of the first target cloud application, a cloud application startup request corresponding to the smart device is generated, so that the cloud application startup request indicates the cloud application information and indicates the smart device. More specifically, based on the cloud application information and the device unique identification information corresponding to the smart device, a cloud application startup request is generated, so that the cloud application startup request can be used to indicate the cloud application information and the device unique identification information.

In another embodiment, the device information of the smart device is obtained, and based on the device information, a cloud application startup request corresponding to the first target cloud application is generated, so that the cloud application startup request indicates the device information and indicates the first target cloud application. More specifically, based on the device information and the cloud application unique identification information corresponding to the first target cloud application, the cloud application startup request is generated, so that the cloud application startup request can be used to indicate the device information and the cloud application unique identification information.

Step 120: Send the cloud application start request to the server, so that the server can obtain the cloud application information of the first target cloud application and the device information of the smart device based on the cloud application start request.

The device information is used to allocate a first cloud application service node for starting a first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting a first target cloud application.

Here, the server is the cloud (cloud service node) corresponding to the smart device. For the server, the server receives the cloud application startup request sent by the smart device; based on the cloud application startup request, obtains the cloud application information of the first target cloud application and the device information of the smart device; sends the device information and the cloud application information of the first target cloud application to the cloud application center node, so that the cloud application center node can allocate the first cloud application service node to start the first target cloud application based on the device information, and send the cloud application information of the first target cloud application to the first cloud application service node. For the first cloud application service node, the first cloud application service node receives the cloud application information of the first target cloud application sent by the cloud application center node; based on the cloud application information, allocates and starts the first target virtual machine of the first target cloud application.

Considering that cloud applications are fixed to run on a certain cloud application service node and a certain virtual machine, the running resources cannot be reasonably allocated, and the cloud application needs to temporarily use the running resources all the time, thus wasting server resources; based on this, the running resources of the first target cloud application should be reasonably allocated.

Here, the device information is used to characterize the configuration information of the smart device, so that its needs can be determined based on the device information, and then the cloud application service node (edge node) that meets its needs can be determined, and then the first cloud application service node that starts the first target cloud application can be allocated based on the device information. The device information may include but is not limited to at least one of the following: external network IP address, bandwidth, display resolution, whether soft decoding is supported and whether hard decoding is supported, etc.

Here, the cloud application information is used to characterize the configuration requirement information of the cloud application, so that the requirements of the cloud application can be determined based on the cloud application information, and then the virtual machine that meets the requirements can be determined, and then the first target virtual machine for starting the first target cloud application can be allocated based on the cloud application information. The cloud application information may include but is not limited to at least one of the following: the running memory (RAM) required by the cloud application, the package volume corresponding to the cloud application (i.e., the storage space ROM required by the cloud application), the CPU configuration required by the cloud application (such as the number of CPU cores), the bandwidth required by the cloud application, and other running configurations required by the cloud application, etc. For example, the package volume corresponding to the cloud application can be the volume of APK (Android Application Package).

Step 130, receiving the interaction data returned by the server in response to the cloud application startup request, and outputting the interaction data, where the interaction data is the data that the first target cloud application needs to present to the user when it is started.

Here, the interaction data refers to human-computer interaction data, that is, the interaction data that the first target cloud application needs to interact with the user when it is started.

In one embodiment, the interactive data is transmitted to the smart device via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the first target cloud application, and thus improve user experience.

In one embodiment, the interaction data is data in a preset format, that is, the first target virtual machine processes the interaction data to obtain interaction data in a preset format. Exemplarily, the first target virtual machine compresses the application page information of the first target cloud application into an h256 format audio and video stream and transmits it to the smart device.

In a specific embodiment, the interaction data includes audio data and/or video data, so that the page of the first target cloud application when it is started is also displayed on the smart device, and the sound of the first target cloud application when it is started is also output on the smart device to ensure the consistency of the cloud application and local application experience. The video data can be output on the display screen of the smart device, and the audio data can be output on the audio output device of the smart device. Exemplarily, when the smart device obtains the first frame information of the video data, it starts to display the application page of the first target cloud application to present it to the user.

For the first cloud application service node, when the first target cloud application is started (opened), the first cloud application service node obtains the interaction data required to be presented to the user when the first target cloud application is started, and sends the interaction data to the server. For the server, the server receives the interaction data returned by the first cloud application service node and forwards the interaction data to the smart device.

It is understandable that smart devices are only used for human-computer interaction with users, while cloud applications are installed on cloud application service nodes, and the data processing process of applications is also executed by cloud application service nodes. Smart devices only need to interact with their corresponding servers, thereby reducing the storage pressure of smart devices and will not be limited by the computing power of smart devices. Based on this, the size and weight of smart devices can be further reduced, thereby reducing the cost of smart devices, improving their portability, and ultimately improving user experience.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention receives a cloud application startup instruction, determines a first target cloud application to be started based on the cloud application startup instruction, and generates a cloud application startup request for starting the first target cloud application, so as to send the cloud application startup request to a server, so that the server can obtain cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request, and the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application, so that the first target cloud application can be installed and started on the first cloud application service node, without installing the first target cloud application on the smart device, thereby ensuring that the number of applications available on the smart device is not limited, and ensuring that the first target cloud application can be used The application size is also not limited, thereby ensuring that the intelligent realization of smart devices is not limited; at the same time, the first cloud application service node for starting the first target cloud application is reasonably allocated based on the device information, and the first target virtual machine for starting the first target cloud application is reasonably allocated based on the cloud application information, ensuring the normal startup and operation of the first target cloud application, thereby ensuring that the smart device can use the first target cloud application normally; in addition, the interaction data returned by the receiving server in response to the cloud application startup request is output, and the interaction data is the data that the first target cloud application needs to present to the user when it is started, thereby ensuring that the interaction data presented by the first target cloud application on the first target virtual machine is consistent with the interaction data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, the method further includes:

Obtain user control instructions;

Determining that the user control instruction is an instruction to control the second target cloud application, and sending the user control instruction to the server, so that the server determines whether the second target cloud application has been started based on the user control instruction;

The first response data returned by the receiving server in response to the user's control instruction.

Here, the user control instruction can be triggered by the user based on the smart device, and the triggering method may include but is not limited to at least one of the following: touch control (such as click operation), voice control, gesture control, posture control and expression control, etc.

It should be understood that the user control instruction can be an instruction to control the cloud application, or it can be other control instructions, for example, it is an instruction to control the local application, or it is an instruction to adjust the volume, etc. Based on this, it is necessary to determine whether the user control instruction is an instruction to control the second target cloud application. Exemplarily, when a user manually clicks or voice orders a content, the party to which the content belongs is obtained. When the party to which the content belongs is a cloud application, the user control instruction is sent to the server.

If the user manipulation instruction is an instruction to manipulate the second target cloud application, the user manipulation instruction may indicate the second target cloud application to be manipulated. Furthermore, the second target cloud application indicated by the user manipulation instruction may be characterized by the cloud application unique identification information. Furthermore, the user manipulation instruction also indicates the manipulation content data, so that the second target cloud application can perform corresponding steps based on the manipulation content data, thereby ensuring the consistency of the experience of the cloud application and the local application, thereby improving the user experience.

It should be understood that the second target cloud application may be the same cloud application as the first target cloud application, or may be a different cloud application.

Among them, when the second target cloud application is not started, the user control instruction is used to allocate the second cloud application service node and the second target virtual machine for starting the second target cloud application, and to control the second target cloud application on the second target virtual machine; when the second target cloud application is already started, the user control instruction is used to control the second target cloud application on the second target virtual machine.

It should be noted that if the second target cloud application is not started, it is necessary to start the second target cloud application first, that is, it is necessary to allocate cloud application service nodes and virtual machine resources to the second target cloud application first, and then operate the second target cloud application; if the second target cloud application is already started, the second target cloud application can be directly operated.

For the server, the server receives the user control instruction sent by the smart device, determines the second target cloud application to be controlled based on the user control instruction; determines that the second target cloud application is not started, obtains the cloud application information of the second target cloud application and the device information of the smart device based on the user control instruction, allocates the second cloud application service node and the second target virtual machine to the second target cloud application based on the cloud application information of the second target cloud application and the device information of the smart device, so as to start the second target cloud application; determines that the second target cloud application is started, and directly sends the user control instruction to the second cloud application service node that starts the second target cloud application. For the second cloud application service node, the second cloud application service node receives the user control instruction sent by the server.

Here, the first response data is the response data returned by the second target cloud application in response to the user's manipulation instruction.

In one embodiment, the first response data is transmitted to the smart device via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the second target cloud application, and thus improve user experience.

In one embodiment, the first response data is data in a preset format, that is, the second target virtual machine processes the first response data to obtain interactive data in a preset format. Exemplarily, the second target virtual machine compresses the application page information of the second target cloud application into an h256 format audio and video stream and transmits it to the smart device.

In a specific embodiment, the first response data includes audio data and/or video data and/or text data and/or control information to ensure consistency in experience between the cloud application and the local application.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention obtains a user control instruction, determines that the user control instruction is an instruction to control a second target cloud application, and sends the user control instruction to a server, so that the server can determine whether the second target cloud application has been started based on the user control instruction, and the user control instruction is used to control the second target cloud application on the second target virtual machine, so that the second target cloud application can be controlled on the second cloud application service node, thereby ensuring that the control of the second target cloud application on the smart device can also be executed on the second target virtual machine, thereby ensuring the consistency of experience between the cloud application and the local application, thereby improving the user experience; in addition, the first response data returned by the server in response to the user control instruction is received, thereby ensuring that the response data presented by the second target cloud application on the second target virtual machine is consistent with the response data presented on the smart device, thereby ensuring the consistency of experience between the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, after the above step 130, the method further includes:

Collecting voice data for controlling the first target cloud application;

Sending the voice data to the server so that the server can perform intent recognition on the voice data and obtain a control intention to control the first target cloud application;

The receiving server returns second response data in response to the voice data.

It should be noted that the user can control the cloud application through voice on the smart device. Based on this, the smart device can collect voice data for controlling the first target cloud application. For example, the voice data is the data corresponding to the cloud application wake-up word spoken by the user.

For the server, the server receives the voice data sent by the smart device; performs intent recognition on the voice data to obtain the control intention of controlling the first target cloud application; sends the control intention to the first cloud application service node, so that the first cloud application service node can control the first target cloud application based on the control intention; receives the second response data returned by the first cloud application service node in response to the control intention, and sends the second response data to the smart device. For the first cloud application service node, the first cloud application service node receives the control intention sent by the server; controls the first target cloud application based on the control intention to obtain the second response data; and sends the second response data to the server.

Here, the second response data is the response data returned by the first target cloud application in response to the manipulation intention.

In one embodiment, the second response data is transmitted to the smart device via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the first target cloud application, and thus improve user experience.

In one embodiment, the second response data is data in a preset format, that is, the first target virtual machine processes the second response data to obtain interactive data in a preset format. Exemplarily, the first target virtual machine compresses the application page information of the first target cloud application into an h256 format audio and video stream and transmits it to the smart device.

In a specific embodiment, the second response data includes audio data and/or video data and/or text data and/or control information (such as detail page play, fast forward, pause, previous/next episode, etc.) to ensure consistency in experience between the cloud application and the local application.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention collects voice data for controlling a first target cloud application; sends the voice data to a server so that the server can perform intent recognition on the voice data to obtain the control intention for controlling the first target cloud application, so that the cloud application can be controlled by voice control on the smart device, thereby improving the user experience, and the first target cloud application can be controlled on the first cloud application service node, thereby ensuring that the control of the first target cloud application on the smart device can also be executed on the first target virtual machine, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience; in addition, the second response data returned by the server in response to the voice data is received, thereby ensuring that the response data presented by the first target cloud application on the first target virtual machine is consistent with the response data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, the present invention further provides a cloud application interaction method based on a smart device, which is applied to a server. FIG2 is a second flow chart of a cloud application interaction method based on a smart device provided by the present invention. As shown in FIG2 , the cloud application interaction method based on a smart device applied to a server includes:

Step 210: Receive a cloud application start request for starting a first target cloud application sent by a smart device.

Here, the server is the cloud (cloud service node) corresponding to the smart device. The cloud application startup request is used to request the server to start the first target cloud application. It should be understood that the first target cloud application is actually started at the cloud application service node.

Step 220: Based on the cloud application start request, obtain cloud application information of the first target cloud application and device information of the smart device.

In one embodiment, the cloud application startup request can be used to indicate the first target cloud application and the smart device, based on which, based on the cloud application startup request, the first target cloud application and the smart device can be determined, and then the cloud application information of the first target cloud application and the device information of the smart device are obtained. More specifically, the cloud application startup request can be used to indicate the unique identification information of the first target cloud application and the device unique identification information of the smart device, based on which, based on the cloud application startup request, the first target cloud application and the smart device can be determined, and then the cloud application information of the first target cloud application and the device information of the smart device are obtained. The cloud application information and the device information may be pre-stored on the server side, or may not be stored on the server side.

In another embodiment, the cloud application start request indicates the cloud application information and the device information. Based on this, based on the cloud application start request, the cloud application information of the first target cloud application and the device information of the smart device can be directly parsed and obtained.

In another embodiment, the cloud application startup request indicates the cloud application information and the smart device, based on which, based on the cloud application startup request, the cloud application information of the first target cloud application can be directly parsed and the smart device can be determined, and then the device information of the smart device can be obtained. The device information can be pre-stored on the server side or not.

In another embodiment, the cloud application startup request indicates the device information and the first target cloud application, based on which, based on the cloud application startup request, the device information of the smart device can be directly parsed and the first target cloud application can be determined, and then the cloud application information of the first target cloud application can be obtained. The cloud application information can be pre-stored on the server side or not.

Step 230, sends the device information and the cloud application information of the first target cloud application to the cloud application center node, so that the cloud application center node can allocate and start the first cloud application service node of the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node.

The cloud application information of the first target cloud application is used to allocate and start the first target virtual machine of the first target cloud application.

Here, the device information is used to characterize the configuration information of the smart device, so that its needs can be determined based on the device information, and then the cloud application service node that meets its needs can be determined, and then the first cloud application service node for starting the first target cloud application can be allocated based on the device information. The device information may include but is not limited to at least one of the following: external network IP address, bandwidth, display resolution, whether soft decoding is supported, whether hard decoding is supported, etc.

Here, the cloud application information is used to characterize the configuration requirement information of the cloud application, so that the requirements of the cloud application can be determined based on the cloud application information, and then the virtual machine that meets the requirements can be determined, and then the first target virtual machine for starting the first target cloud application can be allocated based on the cloud application information. The cloud application information may include but is not limited to at least one of the following: the running memory (RAM) required by the cloud application, the package volume corresponding to the cloud application (i.e., the storage space ROM required by the cloud application), the CPU configuration required by the cloud application (such as the number of CPU cores), the bandwidth required by the cloud application, and other running configurations required by the cloud application, etc. For example, the package volume corresponding to the cloud application can be the volume of the APK.

Here, the cloud application center node (cloud application service center) is used to allocate cloud application service nodes for starting cloud applications. One cloud application center node corresponds to multiple cloud application service nodes, that is, the cloud application center node is the control center of multiple cloud application service nodes.

For the cloud application center node, it receives the cloud application information of the first target cloud application and the device information of the smart device sent by the server; based on the device information, it allocates and starts the first cloud application service node of the first target cloud application; and sends the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node allocates and starts the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application.

Furthermore, after the above step 230, a mapping relationship between the first target cloud application and the smart device is established and stored. For example, when the first target cloud application is started (opened), the mapping relationship is established and saved.

Step 240: Receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device. The interaction data is the data that the first target cloud application needs to present to the user when starting.

Here, the interaction data refers to human-computer interaction data, that is, the interaction data that the first target cloud application needs to interact with the user when it is started.

In one embodiment, the interactive data is transmitted to the server via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the first target cloud application, and thus improve user experience.

In one embodiment, the interaction data is data in a preset format, that is, the first target virtual machine processes the interaction data to obtain interaction data in a preset format. Exemplarily, the first target virtual machine compresses the application page information of the first target cloud application into an h256 format audio and video stream and transmits it to the server.

In a specific embodiment, the interaction data includes audio data and/or video data, so that the page of the first target cloud application when it is started is also displayed on the smart device, and the sound of the first target cloud application when it is started is also output on the smart device, so as to ensure the consistency of the cloud application and local application experience.

For the first cloud application service node, when the first target cloud application is started (opened), the first cloud application service node obtains the interaction data required to be presented to the user when the first target cloud application is started, and sends the interaction data to the server.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention receives a cloud application startup request sent by a smart device for starting a first target cloud application, obtains cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request, and sends the device information and the cloud application information of the first target cloud application to a cloud application center node, so that the cloud application center node can allocate a first cloud application service node for starting the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, and the cloud application information of the first target cloud application is used to allocate a first target virtual machine for starting the first target cloud application, so that the first target cloud application can be installed and started on the first cloud application service node without installing the first target cloud application on the smart device, thereby ensuring that the number of applications available on the smart device is The amount is not limited, and the size of the available applications is not limited, thereby ensuring that the intelligent realization of the smart device is not limited; at the same time, the first cloud application service node for starting the first target cloud application is reasonably allocated based on the device information, and the first target virtual machine for starting the first target cloud application is reasonably allocated based on the cloud application information, ensuring the normal startup and operation of the first target cloud application, thereby ensuring that the smart device can use the first target cloud application normally; in addition, the interaction data returned by the first cloud application service node is received, and the interaction data is sent to the smart device, and the interaction data is the data that the first target cloud application needs to present to the user when it is started, thereby ensuring that the interaction data presented by the first target cloud application on the first target virtual machine is consistent with the interaction data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, the method further includes:

Receiving a user control instruction sent by the smart device, and determining a second target cloud application to be controlled based on the user control instruction;

Determine that the second target cloud application is not started, and based on the user control instruction, obtain the cloud application information of the second target cloud application and the device information of the smart device; send the device information and the cloud application information of the second target cloud application to the cloud application center node, so that the cloud application center node can allocate a second cloud application service node for starting the second target cloud application based on the device information, and send the cloud application information of the second target cloud application to the second cloud application service node, and the cloud application information of the second target cloud application is used to allocate and start the second target virtual machine of the second target cloud application; send the user control instruction to the second cloud application service node;

Determining that the second target cloud application has been started, and sending the user control instruction to the second cloud application service node that starts the second target cloud application;

Receiving first response data returned by the second cloud application service node in response to the user manipulation instruction, and sending the first response data to the smart device;

The user control instruction is used to control the second target cloud application on the second target virtual machine.

Here, the user manipulation instruction can indicate the second target cloud application that needs to be manipulated. Furthermore, the second target cloud application indicated by the user manipulation instruction can be characterized by the cloud application unique identification information. Furthermore, the user manipulation instruction also indicates the manipulation content data, so that after the user manipulation instruction is sent to the second cloud application service node, the second target cloud application can execute corresponding steps based on the manipulation content data to ensure the experience consistency between the cloud application and the local application, thereby improving the user experience; for example, when the second target cloud application has been started, the manipulation content data is passed to the second target cloud application for display by the second target cloud application.

In a specific embodiment, it is queried whether there is a mapping relationship between the second target cloud application and the smart device. If so, it is determined that the second target cloud application has been started; if not, it is determined that the second target cloud application has not been started.

It should be noted that if the second target cloud application is not started, it is necessary to start the second target cloud application first, that is, it is necessary to allocate cloud application service nodes and virtual machine resources to the second target cloud application first, and then operate the second target cloud application; if the second target cloud application is already started, the second target cloud application can be directly operated.

Here, the specific steps of allocating and starting the second cloud application service node of the second target cloud application are basically the same as those of allocating and starting the first cloud application service node of the first target cloud application. The specific steps of allocating and starting the second target virtual machine of the second target cloud application are basically the same as those of allocating and starting the first target virtual machine of the first target cloud application, and they will not be repeated here one by one.

Here, the first response data is the response data returned by the second target cloud application in response to the user's manipulation instruction.

In one embodiment, the first response data is transmitted to the server via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the second target cloud application, and thus improve user experience.

In one embodiment, the first response data is data in a preset format, that is, the second target virtual machine processes the first response data to obtain interactive data in a preset format. Exemplarily, the second target virtual machine compresses the application page information of the second target cloud application into an h256 format audio and video stream and transmits it to the server.

In a specific embodiment, the first response data includes audio data and/or video data and/or text data and/or control information to ensure consistency in experience between the cloud application and the local application.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention can manipulate the second target cloud application on the second cloud application service node through the above-mentioned method, thereby ensuring that the manipulation of the second target cloud application on the smart device can also be executed on the second target virtual machine, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience; in addition, receiving the first response data returned by the second cloud application service node in response to the user manipulation instruction, and sending the first response data to the smart device, thereby ensuring that the response data presented by the second target cloud application on the second target virtual machine is consistent with the response data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, after the above step 230, the method further includes:

Receiving an information query request sent by the first cloud application service node;

Based on the information query request, obtain device identification information of the smart device and/or account information of the smart device;

The device identification information and/or account information is sent to the first cloud application service node, and the device identification information and/or account information is used to log in to the first target cloud application.

Here, the information query request is used by the first cloud application service node to request the server to return the device identification information of the smart device and/or the account information of the smart device. For the first cloud application service node, the first cloud application service node will perform authentication when the first target cloud application is started (opened). Based on this, the first cloud application service node sends an information query request to the server to receive the device identification information and/or account information sent by the server, and sends the device identification information and/or account information to the cloud platform of the first target cloud application to log in to the first target cloud application. Further, the information query request indicates that there is a smart device.

Here, the device identification information may include but is not limited to at least one of the following: SN, MAC address, device model, device manufacturer information, etc. The account information is user information of the user corresponding to the smart device.

If the device identification information has been stored in the server, the device identification information of the smart device is directly obtained. If the device identification information is not stored in the server, an information query request is sent to the smart device, so that the smart device can obtain the device identification information of the smart device based on the information query request, and send the device identification information to the server; further, based on the mapping relationship pre-stored by the server, the smart device corresponding to the information query request is determined, and the information query request is sent to the smart device.

If the account information has been stored in the server, the account information of the smart device is directly obtained. If the account information is not stored in the server, an information query request is sent to the smart device, so that the smart device can obtain the account information of the smart device based on the information query request and send the account information to the server; further, based on the mapping relationship pre-stored by the server, the smart device corresponding to the information query request is determined, and the information query request is sent to the smart device.

It should be understood that both the device identification information and the account information can be used to log in to the first target cloud application to perform rights and interests query and account binding, thereby realizing the unification of user accounts, and the cloud application can be login-free (ready-to-use), and some personal data from the last use can be queried (such as collection information, playback records, rights and interests information, application personalization settings information, and account rights and interests validity period, etc.).

The cloud application interaction method based on smart devices provided by the embodiment of the present invention can realize the cloud application login-free through the above method, that is, the user does not need to log in to the first target cloud application, but logs in through the above interaction method, thereby improving the user experience. And through the above method, account binding can be performed, and personal data can be queried, ensuring the consistency of experience between cloud applications and local applications, thereby improving the user experience.

Based on any of the above embodiments, after the above step 240, the method further includes:

receiving voice data sent by the smart device, where the voice data is data for controlling the first target cloud application;

Performing intent recognition on the voice data to obtain a control intention for controlling the first target cloud application;

Sending the manipulation intention to the first cloud application service node, so that the first cloud application service node can manipulate the first target cloud application based on the manipulation intention;

Receive second response data returned by the first cloud application service node in response to the manipulation intention, and send the second response data to the smart device.

Specifically, speech recognition is performed on the speech data to obtain text data; semantic understanding and intent recognition are performed on the text data to obtain the control intention of controlling the first target cloud application. The specific execution steps can refer to various algorithms of NLP (Natural Language Processing), which will not be described in detail here.

In one embodiment, the second response data is transmitted to the server via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the first target cloud application, and thus improve user experience.

In one embodiment, the second response data is data in a preset format, that is, the first target virtual machine processes the second response data to obtain interactive data in a preset format. Exemplarily, the first target virtual machine compresses the application page information of the first target cloud application into an h256 format audio and video stream and transmits it to the server.

In a specific embodiment, the second response data includes audio data and/or video data and/or text data and/or control information (such as detail page play, fast forward, pause, previous/next episode, etc.) to ensure consistency in experience between the cloud application and the local application.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention can control the cloud application through voice control on the smart device through the above-mentioned method, thereby improving the user experience, and can control the first target cloud application on the first cloud application service node, thereby ensuring that the control of the first target cloud application on the smart device can also be executed on the first target virtual machine, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience; in addition, the second response data returned by the first cloud application service node in response to the control intention is received, and the second response data is sent to the smart device, thereby ensuring that the response data presented by the first target cloud application on the first target virtual machine is consistent with the response data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, in the method, performing intent recognition on the voice data to obtain a control intention for controlling the first target cloud application includes:

Sending a page information acquisition request to the first cloud application service node;

Receiving page information returned by the first cloud application service node in response to the page information acquisition request, where the page information includes a plurality of controllable information corresponding to the current page of the first target cloud application;

Obtain a hot word set corresponding to the page information, the hot word set including multiple hot words with weights;

Perform speech recognition on the speech data to obtain text data;

Based on the hot word set, the text data is corrected;

Intent recognition is performed on the corrected text data to obtain the control intention for controlling the first target cloud application.

Here, the page information acquisition request is used to request the first cloud application service node to return the page information of the first target cloud application. For the first cloud application service node, the first cloud application service node responds to the page information acquisition request, obtains a number of controllable information corresponding to the current page of the first target cloud application, and encapsulates the several controllable information to obtain the page information, so as to send the page information to the server.

In a specific embodiment, when the first packet of voice data from the smart device is received, a page information acquisition request is sent to the first cloud application service node. Further, when the first packet of voice data from the smart device is received, the corresponding first cloud application service node is determined based on the pre-stored mapping relationship, and a page information acquisition request is sent to the first cloud application service node.

In one embodiment, the plurality of controllable information is page information that can be controlled by voice. Exemplarily, the controllable information is predefined instructions, such as play, page jump, etc.

In a specific embodiment, based on the information-set mapping relationship, the hot word set corresponding to the page information is obtained. The information-set mapping relationship can be pre-stored, which is used to represent the corresponding relationship between multiple page information and each hot word set.

Specifically, the target hot word corresponding to the text data is matched from the hot word set, and the text data is updated to the target hot word. For example, if the hot word set includes the hot word "third page", and the recognized text data is "third night", the third night is forcibly converted to the third page. If the target hot word corresponding to the text data cannot be matched from the hot word set, there is no need to correct the text data.

In a specific embodiment, the corrected text data is segmented into word slots to perform intent recognition on the segmented text data. Further, the manipulation intent corresponding to the segmented text data can be determined based on the hot word set, that is, the hot word set includes hot words corresponding to the manipulation intent. If the manipulation intent corresponding to the text data cannot be matched from the hot word set, the text data is directly subjected to intent recognition.

Exemplarily, the hot word set includes "movie name", page switching instructions, broadcast control instructions, etc. Speech recognition is performed on the voice data to obtain text data, and the text data will be corrected during the recognition process, and the hot words with relatively large weights in the hot word set will be forcibly converted, and the text data (such as I want to watch xxx movie) will be segmented into word slots to convert into actions (such as watch) and hot word names (xxx movie), and after the segmentation is completed, the broadcast control instruction intent corresponding to the hot word will be bound to obtain the control intent.

The cloud application interaction method based on smart devices provided in the embodiment of the present invention can improve the accuracy of intent recognition, thereby improving the accuracy of voice control and ultimately improving the user experience through the above-mentioned method.

Based on any of the above embodiments, the present invention further provides a cloud application interaction method based on smart devices, which is applied to a cloud application service node. FIG3 is a flow chart of a cloud application interaction method based on smart devices provided by the present invention. As shown in FIG3 , the cloud application interaction method based on smart devices applied to a cloud application service node includes:

Step 310: Receive cloud application information of the first target cloud application sent by the cloud application center node.

Here, the cloud application information is used to characterize the configuration requirement information of the cloud application, so that the requirements of the cloud application can be determined based on the cloud application information, and then the virtual machine that meets the requirements can be determined, and then the first target virtual machine for starting the first target cloud application can be allocated based on the cloud application information. The cloud application information may include but is not limited to at least one of the following: the running memory (RAM) required by the cloud application, the package volume corresponding to the cloud application (i.e., the storage space ROM required by the cloud application), the CPU configuration required by the cloud application (such as the number of CPU cores), the bandwidth required by the cloud application, and other running configurations required by the cloud application, etc. For example, the package volume corresponding to the cloud application can be the volume of the APK.

Step 320: Based on the cloud application information of the first target cloud application, allocate and start a first target virtual machine of the first target cloud application.

In a specific embodiment, it is determined that a first target virtual machine corresponding to the cloud application information of the first target cloud application exists in the virtual machine pool, and the first target virtual machine is allocated as a virtual machine for starting the first target cloud application; it is determined that a virtual machine corresponding to the cloud application information of the first target cloud application does not exist in the virtual machine pool, a first target virtual machine corresponding to the cloud application information of the first target cloud application is created, and the first target virtual machine is allocated as a virtual machine for starting the first target cloud application.

It is understandable that the cloud application service node has a virtual machine pool, and no virtual machine will be created when there is an available virtual machine to improve the response speed of opening the cloud application, thereby improving the user experience.

It should be understood that after the first target virtual machine for starting the first target cloud application is allocated, the first target virtual machine will start running the first target cloud application. In addition, when the first target virtual machine is created, the preset first target cloud application can be set in the first target virtual machine.

Step 330, obtaining the interaction data required to be presented to the user when the first target cloud application is started, and sending the interaction data to the server, so that the server forwards the interaction data to the smart device.

When the first target cloud application is started (opened), the cloud application service node will establish a communication connection with the server.

Here, the interaction data refers to human-computer interaction data, that is, the interaction data that the first target cloud application needs to interact with the user when it is started.

In one embodiment, the interactive data is transmitted to the server via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the first target cloud application, and thus improve user experience.

In one embodiment, the interaction data is data in a preset format, that is, the first target virtual machine processes the interaction data to obtain interaction data in a preset format. Exemplarily, the first target virtual machine compresses the application page information of the first target cloud application into an h256 format audio and video stream and transmits it to the server.

In a specific embodiment, the interaction data includes audio data and/or video data, so that the page of the first target cloud application when it is started is also displayed on the smart device, and the sound of the first target cloud application when it is started is also output on the smart device, so as to ensure the consistency of the cloud application and local application experience.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention receives cloud application information of a first target cloud application sent by a cloud application center node, and allocates a first target virtual machine for starting the first target cloud application based on the cloud application information of the first target cloud application, so that the first target cloud application can be installed and started on the cloud application service node without installing the first target cloud application on the smart device, thereby ensuring that the number of applications that can be used on the smart device is not limited, and ensuring that the size of the applications that can be used is also not limited, thereby ensuring that the intelligentization of the smart device is not limited; at the same time, based on the cloud application information of the first target cloud application, allocates a first target virtual machine for starting the first target cloud application, ensuring the normal startup and operation of the first target cloud application, thereby ensuring that the smart device can use the first target cloud application normally; in addition, the interaction data required to be presented to the user when the first target cloud application is started is obtained, and the interaction data is sent to the server end, so that the server end forwards the interaction data to the smart device, thereby ensuring that the interaction data presented by the first target cloud application on the first target virtual machine is consistent with the interaction data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, the method further includes:

When the second target cloud application is not started, receiving cloud application information of the second target cloud application sent by the cloud application center node;

Based on the cloud application information of the second target cloud application, allocating and starting a second target virtual machine of the second target cloud application;

Receiving a user control instruction sent by the server to control the second target cloud application;

When the second target cloud application has been started, receiving a user control instruction sent by the server to control the second target cloud application;

In response to the user's control instruction, first response data is obtained, and the first response data is sent to the server, so that the server forwards the first response data to the smart device.

Here, the user manipulation instruction can indicate the second target cloud application that needs to be manipulated. Furthermore, the second target cloud application indicated by the user manipulation instruction can be characterized by the cloud application unique identification information. Furthermore, the user manipulation instruction also indicates the manipulation content data, so that the second target cloud application can perform corresponding steps based on the manipulation content data, ensuring the experience consistency between the cloud application and the local application, thereby improving the user experience; for example, when the second target cloud application has been started, the manipulation content data is passed to the second target cloud application for display by the second target cloud application.

Here, the specific steps of allocating and starting the second target virtual machine of the second target cloud application and allocating and starting the first target virtual machine of the first target cloud application are basically the same, and will not be repeated here.

Here, the first response data is the response data returned by the second target cloud application in response to the user's manipulation instruction.

In one embodiment, the first response data is transmitted to the server via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the second target cloud application, and thus improve user experience.

In one embodiment, the first response data is data in a preset format, that is, the second target virtual machine processes the first response data to obtain interactive data in a preset format. Exemplarily, the second target virtual machine compresses the application page information of the second target cloud application into an h256 format audio and video stream and transmits it to the server.

In a specific embodiment, the first response data includes audio data and/or video data and/or text data and/or control information to ensure consistency in experience between the cloud application and the local application.

Furthermore, before obtaining the first response data in response to the user manipulation instruction, the user manipulation instruction is converted to obtain a manipulation instruction corresponding to the second target cloud application, and then the first response data is obtained in response to the manipulation instruction.

Exemplarily, if the user manipulation instruction is triggered based on a manual click, the user manipulation instruction records a touch event, which includes the click coordinates and resolution information of the smart device. Based on this, the cloud application service node maps the touch event to the coordinate system coordinates that need to simulate the touch event on the second target virtual machine, and performs click display on the second target cloud application to achieve synchronous display, thereby ensuring the consistency of experience between the cloud application and the local application, and thereby improving the user experience.

Exemplarily, if the user control instruction is triggered by voice, the corresponding page of the second target cloud application is opened through the deeplink protocol based on the user control instruction, that is, the user control instruction is parsed according to the deeplink protocol to search for data and display pages, etc.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention can manipulate the second target cloud application on the cloud application service node through the above-mentioned method, thereby ensuring that the manipulation of the second target cloud application on the smart device can also be executed on the second target virtual machine, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience; in addition, in response to the user manipulation instruction, first response data is obtained, and the first response data is sent to the server, so that the server forwards the first response data to the smart device, thereby ensuring that the response data presented by the second target cloud application on the second target virtual machine is consistent with the response data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, after the above step 320, the method further includes:

Sending an information query request to the server, so that the server can obtain device identification information and/or account information of the smart device based on the information query request;

Receive device identification information and/or account information sent by the server;

The device identification information and/or account information is sent to the cloud platform of the first target cloud application to log in to the first target cloud application.

Here, the information query request is used to request the server to return the device identification information of the smart device and/or the account information of the smart device. Further, the information query request indicates that there is a smart device.

Specifically, when the first target cloud application is started (opened), authentication is performed, based on which an information query request is sent to the server.

Here, the device identification information may include but is not limited to at least one of the following: SN, MAC address, device model, device manufacturer information, etc. The account information is the user information of the user corresponding to the smart device.

It should be understood that both the device identification information and the account information can be used to log in to the first target cloud application to perform rights and interests query and account binding, thereby realizing the unification of user accounts, and the cloud application can be login-free (ready-to-use), and some personal data from the last use can be queried (such as collection information, playback records, rights and interests information, application personalization settings information, and account rights and interests validity period, etc.).

Further, after sending the device identification information and/or account information to the cloud platform of the first target cloud application, the personal data returned by the cloud platform is received. Still further, the personal data can be sent to the server so that the server forwards the personal data to the smart device.

The cloud application interaction method based on smart devices provided by the embodiment of the present invention can realize the cloud application login-free through the above method, that is, the user does not need to log in to the first target cloud application, but logs in through the above interaction method, thereby improving the user experience. And through the above method, account binding can be performed, and personal data can be queried, ensuring the consistency of experience between cloud applications and local applications, thereby improving the user experience.

Based on any of the above embodiments, after the above step 330, the method further includes:

receiving a control intention for controlling the first target cloud application sent by the server, where the control intention is obtained by the server performing intent recognition on the voice data sent by the smart device;

Manipulate the first target cloud application based on the manipulation intention to obtain second response data;

The second response data is sent to the server, so that the server forwards the second response data to the smart device.

In one embodiment, the second response data is transmitted to the server via the webRTC protocol to reduce data transmission delay, ensure real-time synchronous display of the first target cloud application, and thus improve user experience.

In one embodiment, the second response data is data in a preset format, that is, the first target virtual machine processes the second response data to obtain interactive data in a preset format. Exemplarily, the first target virtual machine compresses the application page information of the first target cloud application into an h256 format audio and video stream and transmits it to the server.

In a specific embodiment, the second response data includes audio data and/or video data and/or text data and/or control information (such as detail page play, fast forward, pause, previous/next episode, etc.) to ensure consistency in experience between the cloud application and the local application.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention can control the cloud application through voice control on the smart device through the above-mentioned method, thereby improving the user experience, and can control the first target cloud application on the cloud application service node, thereby ensuring that the control of the first target cloud application on the smart device can also be executed on the first target virtual machine, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience; in addition, the second response data is sent to the server so that the server forwards the second response data to the smart device, thereby ensuring that the response data presented by the first target cloud application on the first target virtual machine is consistent with the response data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

Based on any of the above embodiments, before receiving the control intention sent by the server to control the first target cloud application, the method further includes:

Receive the page information acquisition request sent by the server;

In response to the page information acquisition request, obtain a number of controllable information corresponding to the current page of the first target cloud application;

Encapsulate several controllable information to obtain page information, and send the page information to the server.

In one embodiment, the plurality of controllable information is page information that can be controlled by voice. Exemplarily, the controllable information is predefined instructions, such as play, page jump, etc.

For example, the data that can be controlled by the current page of the first target cloud application is assembled to obtain page information, which is then sent to the server after assembly is completed. Further, the page information is data in JSON format.

The cloud application interaction method based on smart devices provided in an embodiment of the present invention sends page information to the server in the above manner, which can improve the accuracy of intent recognition by the server, thereby improving the accuracy of voice control and ultimately improving the user experience.

Based on any of the above embodiments, the present invention further provides a cloud application interaction method based on smart devices, which is applied to a cloud application center node. FIG4 is a fourth flow chart of a cloud application interaction method based on smart devices provided by the present invention. As shown in FIG4 , the cloud application interaction method based on smart devices applied to a cloud application center node includes:

Step 410: Receive cloud application information of the first target cloud application and device information of the smart device sent by the server.

Here, the cloud application center node (cloud application service center) is used to allocate cloud application service nodes for starting cloud applications. One cloud application center node corresponds to multiple cloud application service nodes, that is, the cloud application center node is the control center of multiple cloud application service nodes.

Step 420: Based on the device information, allocate and start a first cloud application service node for the first target cloud application.

Here, the device information is used to characterize the configuration information of the smart device, so that its needs can be determined based on the device information, and then the cloud application service node that meets its needs can be determined, and then the first cloud application service node for starting the first target cloud application can be allocated based on the device information. The device information may include but is not limited to at least one of the following: external network IP address, bandwidth, display resolution, whether soft decoding is supported, whether hard decoding is supported, etc.

Step 430: Send the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node can allocate and start the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application.

Here, the cloud application information is used to characterize the configuration requirement information of the cloud application, so that the requirements of the cloud application can be determined based on the cloud application information, and then the virtual machine that meets the requirements can be determined, and then the first target virtual machine for starting the first target cloud application can be allocated based on the cloud application information. The cloud application information may include but is not limited to at least one of the following: the running memory (RAM) required by the cloud application, the package volume corresponding to the cloud application (i.e., the storage space ROM required by the cloud application), the CPU configuration required by the cloud application (such as the number of CPU cores), the bandwidth required by the cloud application, and other running configurations required by the cloud application, etc. For example, the package volume corresponding to the cloud application can be the volume of the APK.

The cloud application interaction method based on smart devices provided in the embodiment of the present invention receives cloud application information of a first target cloud application and device information of a smart device sent by a server, allocates a first cloud application service node for starting the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node allocates a first target virtual machine for starting the first target cloud application based on the cloud application information of the first target cloud application, so that the first target cloud application can be installed and started on the first cloud application service node without installing the first target cloud application on the smart device, thereby ensuring that the number of applications that can be used on the smart device is not limited, and ensuring that the size of the applications that can be used is also not limited, thereby ensuring that the smart device The energy-saving implementation is not restricted; at the same time, the first cloud application service node for starting the first target cloud application is reasonably allocated based on the device information, and the first target virtual machine for starting the first target cloud application is reasonably allocated based on the cloud application information, ensuring the normal startup and operation of the first target cloud application, thereby ensuring that the smart device can use the first target cloud application normally; in addition, the server can receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device, and the interaction data is the data that the first target cloud application needs to present to the user when it is started, thereby ensuring that the interaction data presented by the first target cloud application on the first target virtual machine is consistent with the interaction data presented on the smart device, thereby ensuring the experience consistency of the cloud application and the local application, thereby improving the user experience.

The cloud application interaction system based on smart devices provided by the present invention is described below. The cloud application interaction system based on smart devices described below and the cloud application interaction method based on smart devices described above can be referenced to each other.

FIG5 is a schematic diagram of the structure of the cloud application interaction system based on smart devices provided by the present invention. As shown in FIG5 , the cloud application interaction system based on smart devices includes: smart devices, a server, a cloud application service node and a cloud application center node.

Among them, smart devices, servers, cloud application service nodes and cloud application center nodes can communicate and connect through the Internet.

Exemplarily, the smart device communicates with the server through the network to transmit voice streams, receive skill information and TTS (Text To Speech) audio streams. The server and the cloud application service node communicate through the network to transmit information related to the cloud application. The cloud application center node and the cloud application service node communicate through the network. The cloud application service node communicates with the server through the network.

To facilitate understanding of the above embodiments, a specific embodiment is used for illustration. As shown in FIG6 , the interactive steps for starting a cloud application include:

S101, the smart device sends a cloud application startup request to the server. Specifically, the smart device receives a cloud application startup instruction, determines a first target cloud application to be started based on the cloud application startup instruction, and generates a cloud application startup request for starting the first target cloud application; sends the cloud application startup request to the server, so that the server obtains cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request;

S102, the server sends the device information and cloud application information to the cloud application center node. Specifically, the server receives a cloud application startup request sent by the smart device for starting the first target cloud application; based on the cloud application startup request, obtains the cloud application information of the first target cloud application and the device information of the smart device; sends the device information and the cloud application information of the first target cloud application to the cloud application center node, so that the cloud application center node allocates a cloud application service node for starting the first target cloud application based on the device information;

S103, the cloud application center node sends the cloud application information to the cloud application service node. Specifically, the cloud application center node receives the cloud application information of the first target cloud application and the device information of the smart device sent by the server; based on the device information, allocates and starts the first cloud application service node of the first target cloud application; sends the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node allocates and starts the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application;

S104, the cloud application service node returns the interaction data to the server. Specifically, the cloud application service node receives the cloud application information of the first target cloud application sent by the cloud application center node; based on the cloud application information of the first target cloud application, allocates a first target virtual machine to start the first target cloud application; obtains the interaction data required to be presented to the user when the first target cloud application is started, and sends the interaction data to the server;

S105, the server returns the interaction data to the smart device. Specifically, the server receives the interaction data returned by the first cloud application service node, sends the interaction data to the smart device, so that the smart device receives the interaction data returned by the server in response to the cloud application startup request, and outputs the interaction data.

To facilitate understanding of the above embodiments, a specific embodiment is used for explanation. As shown in FIG. 7 (the interactive steps of starting the cloud application are not shown), the interactive steps of controlling the cloud application include:

S201, the smart device sends a user control instruction to the server. Specifically, the smart device obtains the user control instruction; determines that the user control instruction is an instruction to control the second target cloud application, and sends the user control instruction to the server, so that the server determines whether the second target cloud application has been started based on the user control instruction;

S202, the server sends the user control instruction to the cloud application service node. Specifically, the server receives the user control instruction sent by the smart device, and determines the second target cloud application to be controlled based on the user control instruction; determines that the second target cloud application is not started, obtains the cloud application information of the second target cloud application and the device information of the smart device based on the user control instruction, sends the device information and the cloud application information of the second target cloud application to the cloud application center node, sends the user control instruction to the cloud application service node, and sends the user control instruction to the cloud application service node that starts the second target cloud application; determines that the second target cloud application is started, and sends the user control instruction to the cloud application service node that starts the second target cloud application;

S203, the cloud application service node returns the first response data to the server. Specifically, when the second target cloud application is not started, the cloud application service node receives the cloud application information of the second target cloud application sent by the cloud application center node, allocates a second target virtual machine to start the second target cloud application based on the cloud application information of the second target cloud application, receives the user control instruction sent by the server to control the second target cloud application; when the second target cloud application is started, receives the user control instruction sent by the server to control the second target cloud application; obtains the first response data in response to the user control instruction, and sends the first response data to the server.

S204, the server returns the first response data to the smart device. Specifically, the server receives the first response data returned by the cloud application service node in response to the user control instruction, and sends the first response data to the smart device.

To facilitate understanding of the above embodiments, a specific embodiment is used for illustration. As shown in FIG8 , the interaction steps of voice-controlled cloud applications include:

S301, the smart device sends voice data to the server. Specifically, the smart device collects voice data for controlling the first target cloud application and sends the voice data to the server;

S302, the server sends a page information acquisition request to the cloud application service node. Specifically, the server receives the voice data sent by the smart device and sends a page information acquisition request to the cloud application service node;

S303, the cloud application service node returns the page information to the server. Specifically, the cloud application service node receives the page information acquisition request sent by the server; responds to the page information acquisition request, obtains a number of controllable information corresponding to the current page of the first target cloud application; encapsulates the several controllable information to obtain the page information, and sends the page information to the server;

S304, the server sends the manipulation intention to the cloud application service node. Specifically, the server receives the page information returned by the first cloud application service node in response to the page information acquisition request; obtains the hot word set corresponding to the page information; performs speech recognition on the speech data to obtain text data; performs correction processing on the text data based on the hot word set; performs intent recognition on the corrected text data to obtain the manipulation intention of manipulating the first target cloud application; and sends the manipulation intention to the cloud application service node;

S305, the cloud application service node returns the second response data to the server. Specifically, the cloud application service node receives the control intention sent by the server to control the first target cloud application; controls the first target cloud application based on the control intention, obtains the second response data; and sends the second response data to the server;

S306, the server returns the second response data to the smart device. Specifically, the server receives the second response data returned by the cloud application service node in response to the manipulation intention, and sends the second response data to the smart device.

To facilitate understanding of the above embodiments, a specific embodiment is used for illustration. As shown in FIG9 , the interactive steps for logging into a cloud application include:

S401, the cloud application service node sends an information query request to the server;

S402, the server returns the device identification information and/or account information to the cloud application service node. Specifically, the server receives the information query request sent by the first cloud application service node; based on the information query request, obtains the device identification information and/or account information of the smart device; sends the device identification information and/or account information to the first cloud application service node;

S403, the cloud application service node sends the device identification information and/or account information to the cloud platform. Specifically, the cloud application service node receives the device identification information and/or account information sent by the server; and sends the device identification information and/or account information to the cloud platform of the first target cloud application to log in to the first target cloud application.

Based on the above embodiments, the present invention can reduce the hardware cost of smart devices, improve the application richness and playability of smart devices, and increase user stickiness.

The cloud application interaction device based on a smart device provided by the present invention is described below. The cloud application interaction device based on a smart device described below and the cloud application interaction method based on a smart device described above can be referenced to each other.

FIG. 10 is one of the structural schematic diagrams of the cloud application interaction device based on the smart device provided by the present invention. As shown in FIG. 10 , the cloud application interaction device based on the smart device deployed on the smart device includes:

The first receiving module 1010 is used to receive a cloud application startup instruction, determine a first target cloud application to be started based on the cloud application startup instruction, and generate a cloud application startup request for starting the first target cloud application;

The first sending module 1020 is used to send a cloud application startup request to the server, so that the server can obtain cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request, the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application;

The second receiving module 1030 is used to receive the interaction data returned by the server in response to the cloud application startup request, and output the interaction data, where the interaction data is the data that the first target cloud application needs to present to the user when it is started.

FIG. 11 is a second structural diagram of the cloud application interaction device based on smart devices provided by the present invention. As shown in FIG. 11 , the cloud application interaction device based on smart devices deployed on the server side includes:

The third receiving module 1110 is used to receive a cloud application startup request sent by a smart device to start a first target cloud application;

A first acquisition module 1120 is used to acquire cloud application information of a first target cloud application and device information of a smart device based on a cloud application startup request;

The second sending module 1130 is used to send the device information and the cloud application information of the first target cloud application to the cloud application center node, so that the cloud application center node allocates and starts the first cloud application service node of the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, and the cloud application information of the first target cloud application is used to allocate and start the first target virtual machine of the first target cloud application;

The fourth receiving module 1140 is used to receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device. The interaction data is the data that the first target cloud application needs to present to the user when starting.

FIG. 12 is a third structural schematic diagram of the cloud application interaction device based on smart devices provided by the present invention. As shown in FIG. 12 , the cloud application interaction device based on smart devices deployed in the cloud application service node includes:

The fifth receiving module 1210 is used to receive the cloud application information of the first target cloud application sent by the cloud application center node;

The first allocation module 1220 is used to allocate and start a first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application;

The second acquisition module 1230 is used to acquire the interaction data that needs to be presented to the user when the first target cloud application is started, and send the interaction data to the server so that the server forwards the interaction data to the smart device.

FIG. 13 is a fourth structural diagram of the cloud application interaction device based on smart devices provided by the present invention. As shown in FIG. 13 , the cloud application interaction device based on smart devices deployed in the cloud application center node includes:

The sixth receiving module 1310 is used to receive the cloud application information of the first target cloud application and the device information of the smart device sent by the server;

The second allocation module 1320 is used to allocate a first cloud application service node for starting a first target cloud application based on the device information;

The third sending module 1330 is used to send the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node can allocate and start the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application.

FIG14 illustrates a schematic diagram of the physical structure of an electronic device. As shown in FIG14 , the electronic device may include: a processor 1410, a communication interface 1420, a memory 1430, and a communication bus 1440, wherein the processor 1410, the communication interface 1420, and the memory 1430 communicate with each other through the communication bus 1440. The processor 1410 may call the logic instructions in the memory 1430 to execute the cloud application interaction method based on the smart device described in the above embodiments.

In addition, the logic instructions in the above-mentioned memory 1430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the cloud application interaction method based on smart devices of the above-mentioned embodiments.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (20)

1. A cloud application interaction method based on a smart device, characterized in that it is applied to a smart device and comprises: receiving a cloud application startup instruction, determining a first target cloud application to be started based on the cloud application startup instruction, and generating a cloud application startup request for starting the first target cloud application; Sending the cloud application startup request to the server, so that the server obtains the cloud application information of the first target cloud application and the device information of the smart device based on the cloud application startup request, the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application; Receive interaction data returned by the server in response to the cloud application startup request, and output the interaction data, where the interaction data is data that the first target cloud application needs to present to the user when it is started. 2. The cloud application interaction method based on smart devices according to claim 1, characterized in that it also includes: Obtain user control instructions; Determining that the user control instruction is an instruction for controlling the second target cloud application, and sending the user control instruction to the server, so that the server determines whether the second target cloud application has been started based on the user control instruction; Receiving first response data returned by the server in response to the user control instruction; Among them, when the second target cloud application is not started, the user control instruction is used to allocate the second cloud application service node and the second target virtual machine for starting the second target cloud application, and is used to control the second target cloud application on the second target virtual machine; when the second target cloud application is already started, the user control instruction is used to control the second target cloud application on the second target virtual machine. 3. The cloud application interaction method based on smart devices according to claim 1, characterized in that the step of outputting the interaction data further comprises: Collecting voice data for controlling the first target cloud application; Sending the voice data to the server, so that the server can perform intent recognition on the voice data and obtain a control intention for controlling the first target cloud application; Receive second response data returned by the server in response to the voice data. 4. A cloud application interaction method based on smart devices, characterized in that it is applied to a server, and the method includes: Receiving a cloud application start request for starting a first target cloud application sent by a smart device; Based on the cloud application start request, obtaining cloud application information of the first target cloud application and device information of the smart device; Send the device information and the cloud application information of the first target cloud application to a cloud application center node, so that the cloud application center node allocates and starts a first cloud application service node for the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, where the cloud application information of the first target cloud application is used to allocate and start a first target virtual machine for the first target cloud application; Receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device, where the interaction data is the data that the first target cloud application needs to present to the user when starting. 5. The cloud application interaction method based on smart devices according to claim 4, characterized in that it also includes: receiving a user control instruction sent by the smart device, and determining a second target cloud application to be controlled based on the user control instruction; Determining that the second target cloud application is not started, and acquiring cloud application information of the second target cloud application and device information of the smart device based on the user control instruction; Send the device information and the cloud application information of the second target cloud application to the cloud application center node, so that the cloud application center node allocates and starts the second cloud application service node of the second target cloud application based on the device information, and sends the cloud application information of the second target cloud application to the second cloud application service node, and the cloud application information of the second target cloud application is used to allocate and start the second target virtual machine of the second target cloud application; Sending the user control instruction to the second cloud application service node; Determining that the second target cloud application has been started, and sending the user control instruction to a second cloud application service node that starts the second target cloud application; receiving first response data returned by the second cloud application service node in response to the user manipulation instruction, and sending the first response data to the smart device; The user control instruction is used to control the second target cloud application on the second target virtual machine. 6. The cloud application interaction method based on smart devices according to claim 4, characterized in that the sending of the device information and the cloud application information of the first target cloud application to a cloud application center node further comprises: Receiving an information query request sent by the first cloud application service node; Based on the information query request, obtaining device identification information of the smart device and/or account information of the smart device; The device identification information and/or the account information is sent to the first cloud application service node, and the device identification information and/or the account information is used to log in to the first target cloud application. 7. The cloud application interaction method based on smart devices according to claim 4, characterized in that the step of sending the interaction data to the smart device further comprises: receiving voice data sent by the smart device, where the voice data is data for controlling the first target cloud application; Performing intent recognition on the voice data to obtain a control intention for controlling the first target cloud application; Sending the manipulation intention to the first cloud application service node, so that the first cloud application service node can manipulate the first target cloud application based on the manipulation intention; Receive second response data returned by the first cloud application service node in response to the manipulation intention, and send the second response data to the smart device. 8. The cloud application interaction method based on smart devices according to claim 7, characterized in that the performing intention recognition on the voice data to obtain the control intention of controlling the first target cloud application includes: Sending a page information acquisition request to the first cloud application service node; Receiving page information returned by the first cloud application service node in response to the page information acquisition request, the page information including a plurality of controllable information corresponding to the current page of the first target cloud application; Obtaining a hot word set corresponding to the page information, the hot word set including a plurality of hot words with weights; Performing speech recognition on the speech data to obtain text data; Based on the hot word set, correcting the text data; Intent recognition is performed on the corrected text data to obtain the control intention for controlling the first target cloud application. 9. A cloud application interaction method based on smart devices, characterized in that it is applied to a cloud application service node, and the method comprises: Receive cloud application information of a first target cloud application sent by a cloud application center node; Based on the cloud application information of the first target cloud application, allocating and starting a first target virtual machine of the first target cloud application; The interactive data required to be presented to the user when the first target cloud application is started is obtained, and the interactive data is sent to the server so that the server forwards the interactive data to the smart device. 10. The cloud application interaction method based on smart devices according to claim 9, characterized in that it also includes: When the second target cloud application is not started, receiving cloud application information of the second target cloud application sent by the cloud application center node; Based on the cloud application information of the second target cloud application, allocating and starting a second target virtual machine of the second target cloud application; Receiving a user control instruction sent by the server to control the second target cloud application; When the second target cloud application has been started, receiving a user control instruction sent by the server to control the second target cloud application; In response to the user manipulation instruction, first response data is obtained, and the first response data is sent to a server, so that the server forwards the first response data to the smart device. 11. The cloud application interaction method based on smart devices according to claim 9, characterized in that the cloud application information based on the first target cloud application allocates and starts the first target virtual machine of the first target cloud application, and then further comprises: Sending an information query request to the server, so that the server can obtain the device identification information of the smart device and/or the account information of the smart device based on the information query request; Receiving the device identification information and/or the account information sent by the server; The device identification information and/or the account information is sent to the cloud platform of the first target cloud application to log in to the first target cloud application. 12. The cloud application interaction method based on smart devices according to claim 9, characterized in that the step of sending the interaction data to the server further comprises: receiving a control intention sent by the server to control the first target cloud application, wherein the control intention is obtained by the server performing intent recognition on the voice data sent by the smart device; Manipulate the first target cloud application based on the manipulation intention to obtain second response data; The second response data is sent to the server, so that the server forwards the second response data to the smart device. 13. The cloud application interaction method based on smart devices according to claim 12, characterized in that the receiving of the control intention sent by the server to control the first target cloud application also includes: Receiving a page information acquisition request sent by the server; In response to the page information acquisition request, obtain a number of controllable information corresponding to the current page of the first target cloud application; The plurality of controllable information are encapsulated to obtain page information, and the page information is sent to the server. 14. A cloud application interaction method based on smart devices, characterized in that it is applied to a cloud application center node, and the method includes: Receive cloud application information of the first target cloud application and device information of the smart device sent by the server; Based on the device information, allocating and starting a first cloud application service node for the first target cloud application; The cloud application information of the first target cloud application is sent to the first cloud application service node, so that the first cloud application service node allocates and starts the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application. 15. A cloud application interaction device based on a smart device, characterized in that it is deployed on a smart device and comprises: A first receiving module is used to receive a cloud application startup instruction, determine a first target cloud application to be started based on the cloud application startup instruction, and generate a cloud application startup request for starting the first target cloud application; A first sending module, used to send the cloud application startup request to the server, so that the server obtains the cloud application information of the first target cloud application and the device information of the smart device based on the cloud application startup request, the device information is used to allocate a first cloud application service node for starting the first target cloud application, and the cloud application information is used to allocate a first target virtual machine for starting the first target cloud application; The second receiving module is used to receive the interaction data returned by the server in response to the cloud application startup request, and output the interaction data, where the interaction data is the data that the first target cloud application needs to present to the user when it is started. 16. A cloud application interaction device based on a smart device, characterized in that it is deployed on a server, and the device comprises: A third receiving module, configured to receive a cloud application startup request sent by a smart device to start a first target cloud application; A first acquisition module, configured to acquire cloud application information of the first target cloud application and device information of the smart device based on the cloud application startup request; A second sending module is used to send the device information and the cloud application information of the first target cloud application to a cloud application central node, so that the cloud application central node allocates and starts a first cloud application service node for the first target cloud application based on the device information, and sends the cloud application information of the first target cloud application to the first cloud application service node, and the cloud application information of the first target cloud application is used to allocate and start a first target virtual machine for the first target cloud application; The fourth receiving module is used to receive the interaction data returned by the first cloud application service node, and send the interaction data to the smart device. The interaction data is the data that the first target cloud application needs to present to the user when it is started. 17. A cloud application interaction device based on a smart device, characterized in that it is deployed in a cloud application service node, and the device comprises: A fifth receiving module, configured to receive cloud application information of a first target cloud application sent by a cloud application center node; A first allocation module, configured to allocate and start a first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application; The second acquisition module is used to acquire the interaction data that needs to be presented to the user when the first target cloud application is started, and send the interaction data to the server so that the server forwards the interaction data to the smart device. 18. A cloud application interaction device based on smart devices, characterized in that it is deployed in a cloud application center node, and the device comprises: A sixth receiving module, configured to receive the cloud application information of the first target cloud application and the device information of the smart device sent by the server; A second allocation module, configured to allocate and start a first cloud application service node for the first target cloud application based on the device information; The third sending module is used to send the cloud application information of the first target cloud application to the first cloud application service node, so that the first cloud application service node can allocate and start the first target virtual machine of the first target cloud application based on the cloud application information of the first target cloud application. 19. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for cloud application interaction based on a smart device as described in any one of claims 1 to 3 is implemented, or the method for cloud application interaction based on a smart device as described in any one of claims 4 to 8 is implemented, or the method for cloud application interaction based on a smart device as described in any one of claims 9 to 13 is implemented, or the method for cloud application interaction based on a smart device as described in claim 14 is implemented. 20. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that when the computer program is executed by a processor, it implements the cloud application interaction method based on a smart device as described in any one of claims 1 to 3, or implements the cloud application interaction method based on a smart device as described in any one of claims 4 to 8, or implements the cloud application interaction method based on a smart device as described in any one of claims 9 to 13, or implements the cloud application interaction method based on a smart device as described in claim 14.