CN110444209A - Voice interactive method, the apparatus and system of web page are embedded towards intelligent vehicle device - Google Patents

Abstract

The invention discloses a voice interaction method for embedded web pages in an intelligent vehicle, comprising the following steps: configuring response message instructions for each embedded web page; acquiring user voice instructions; The response message instruction of the web page determines the key instruction message; the key message instruction is output to the corresponding embedded web page. According to another aspect of the present invention, there is also provided a voice interaction device and system for embedded web pages in a smart car. According to the method, device and system disclosed in the present invention, operations involving web pages during driving can be realized. Realized by voice interaction, the user experience and driving safety are improved, and it has certain scalability.

Description

Voice interaction method, device and system for embedded web page in smart car

technical field

The invention relates to the technical field of in-vehicle systems, in particular to a voice interaction method, device and system for embedded web pages in intelligent vehicles.

Background technique

At present, with the rapid development of my country's economy, the sales of automobiles continue to rise, and the income of households continues to increase. More and more people can buy private cars, so more and more people will drive. Sales are getting more and more popular.

The existing in-vehicle intelligent system integrates various devices in the car to form a system, which is convenient for the control of each device. Although there are some existing in-vehicle intelligent systems that can be controlled by voice, for some such as control the WEB terminal that pops up from the in-vehicle system. Relevant operations still require manual operation, which is inconvenient for the driver to control while driving.

SUMMARY OF THE INVENTION

In order to solve the above problem, the inventor conceives of monitoring the voice information sent by the user through the vehicle client, and then sending the voice information to the web page through the defined communication protocol, and the web page will make a message according to the message sent by the vehicle client. The corresponding page elements are operated, and some key content messages of the current page are notified to the vehicle client. In this way, as long as the response to the command is added on the corresponding in-vehicle system page, the operation can be completed, which can greatly improve the scalability of the in-vehicle client in terms of content and operation, and improve the experience of human-computer interaction.

According to a first aspect of the present invention, there is provided a voice interaction method for embedded web pages in a smart car machine, comprising the following steps:

Configure response message instructions for each embedded web page;

Obtain user voice commands;

Determine the key instruction message according to the acquired user voice instruction and the configured response message instruction of the embedded web page;

Output key message instructions to the corresponding embedded web page.

According to a second aspect of the present invention, there is provided a voice interaction device for embedded web pages in a smart car machine, including:

The instruction configuration module is used to configure the response message instruction for each embedded web page;

A voice acquisition module, used to acquire user voice commands;

A key message determination module, configured to determine a key instruction message according to the acquired user voice instruction and the configured response message instruction of the embedded web page;

The page communication module is used to output key message instructions to the corresponding embedded web page.

According to a third aspect of the present invention, there is provided an embedded web page system for an intelligent vehicle machine. The embedded web page is configured with key message response mapping information, and the embedded web page executes corresponding page elements according to the received key information instructions. Operation, wherein, the key message instruction comes from the above-mentioned voice interaction device oriented to the embedded web page of the smart car machine.

According to a fourth aspect of the present invention, there is provided an electronic device comprising: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor, The instructions are executed by at least one processor to enable the at least one processor to perform the steps of the above-described method.

According to a fifth aspect of the present invention, there is provided a storage medium on which a computer program is stored, which implements the steps of the above method when the program is executed by a processor.

According to the present invention, a method, device and system are provided, which can control the display and closing of the web page in the in-vehicle system and the operation of related elements inside the page through voice control. It has great expansibility and greatly improves the interaction experience between the user and the in-vehicle system.

Description of drawings

FIG. 1 is a flow chart of a voice interaction method for embedded web pages in a smart car according to an embodiment of the present invention;

FIG. 2 is a schematic block diagram of a voice interaction device oriented to a web page embedded in a smart car according to an embodiment of the present invention;

FIG. 3 is a block diagram of an embedded web page system in a smart car machine according to an embodiment of the present invention;

FIG. 4 is a block diagram of an electronic device according to an embodiment of the present invention.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the embodiments in the present application and the features of the embodiments may be combined with each other in the case of no conflict.

The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, elements, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including storage devices.

In the present invention, "module", "device", "system", etc. refer to relevant entities applied to a computer, such as hardware, a combination of hardware and software, software or software in execution, and the like. In detail, for example, an element may be, but is not limited to, a process running on a processor, a processor, an object, an executable element, a thread of execution, a program, and/or a computer. Also, an application program or script program running on the server, and the server can be a component. One or more elements may be in a process and/or thread of execution and an element may be localized on one computer and/or distributed between two or more computers and may be executed from various computer readable media . Elements may also pass through a signal having one or more data packets, for example, a signal from one interacting with another element in a local system, in a distributed system, and/or with data interacting with other systems through a network of the Internet local and/or remote processes to communicate.

Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence between operations. Furthermore, the terms "comprising" and "comprising" include not only those elements, but also other elements not expressly listed, or elements inherent to such a process, method, article or apparatus. Without further limitation, an element defined by the phrase "comprises" does not preclude the presence of additional identical elements in a process, method, article, or device that includes the element.

The present invention will be described in further detail below in conjunction with the accompanying drawings.

Fig. 1 schematically shows a flow chart of a method for voice interaction oriented to a web page embedded in a smart car machine according to an embodiment of the present invention. As shown in Fig. 1, this embodiment includes the following steps:

Step S101: Configure a response message instruction for each embedded web page. The mapping relationship table is configured for different web page operation function instructions on the vehicle end, so that different response message instructions can call the web page function interface of its corresponding function. Among them, the response message instructions include instructions such as confirm, cancel, close, previous page, next page, enlarge picture, reduce picture, etc., which can be set according to requirements, for example, according to web page content elements and page interaction requirements to set the message to be responded to instruction. Exemplarily, a corresponding relationship is formed between the "OK" response message instruction and the function interface corresponding to invoking the "OK" button on the web page; the "previous page" response message instruction and the interface for invoking the "next page" page-turning function of the web page form a corresponding relationship. The similar corresponding relationship of the configuration is formed into the following mapping table to store:

response message command Web page functional interface confirm Confirm function interface next page Page down function interface Zoom in picture Image zoom function interface

Step S102: Obtain a user voice instruction. The acquisition method can be monitored in real time through an audio acquisition device with a pickup function that is built into the vehicle. Exemplarily, the acquisition is made through the voice assistant of the in-vehicle system.

Step S103: Determine the key instruction message according to the acquired user voice instruction and the configured response message instruction of the embedded web page. In order to provide the accuracy of the interaction method, keywords are extracted from the voice instructions output by the user, and corresponding operation instructions are matched according to the keywords.

First, the currently displayed embedded web page is acquired, which can be achieved by using the existing technology, for example, the currently displayed web page is extracted through the Launcher desktop application. Then match the obtained user voice command with the response message command corresponding to the currently displayed embedded web page, and convert the obtained user voice command into text information through semantic analysis of the prior art, and configure the text information with step S101. The mapping relationship table is matched, and the key message command is determined according to the matching result (that is, the message command issued by the user's voice command that matches the response message command is regarded as the key message command) and the web function call interface corresponding to the key message command.

Step S104: Output the key message instruction to the corresponding embedded web page. The output method can be realized through a custom protocol established between the web page and the vehicle end. Exemplarily, the js code (that is, the Javascript scripting language) is called through the Android system, that is, by calling the loadUrl() of the WebView, the key message instructions are output. to the inline web page side of the response. The embedded web page side performs corresponding page element operations according to key message instructions and corresponding web function invocation interfaces.

Preferably, the js code can also intercept the url address by calling the Android code, that is, through the shouldOverrideUrlLoading() method of WebViewClient, so as to realize the interaction between the web page end and the vehicle end, and execute the execution result of the page element corresponding to the change of the page element after executing the key message instruction. And the page status is fed back to the vehicle client, so that the vehicle client can obtain the information of the current embedded page and the corresponding response message command, so as to start a new round of monitoring and response operations.

Exemplarily, after the car-machine navigates to the destination, a web-view-loaded navigation track playback web page pops up on the car-machine system desktop, and broadcasts relevant driving data (such as total mileage, vehicle speed, etc.), and the user can operate through voice commands. The content of the web page, such as the user saying "Zoom in on the map", listens to this voice command, recognizes the "Zoom in" text information through the voice, and obtains the key message command "Zoom in the picture" and the web page according to the text information and the mapping table. , and transmit it to the web page side through a custom protocol, and the web page side can perform the corresponding operation of magnifying the picture displayed on the current page.

According to the method of this embodiment, the operation of elements in the web page can be controlled by the voice issued by the user, and no additional interface is required. For new page requirements, the operation can be completed only by adding a response to the command on the corresponding page. It has extremely high scalability and improves the user experience.

In other embodiments, the execution protocol of the mapping relationship table may be further configured on the vehicle client, for example, according to the state of the current embedded web page to determine whether to transmit the matched response instruction message to the web page as a key instruction message for execution To perform operations, for example, it can be further configured that when the web interface is activated, the user's voice command to close or confirm will be directly operated by the vehicle client to close or confirm the web page, and will not be transmitted to the web page for processing. Corresponding page operation processing.

Fig. 2 schematically shows a principle block diagram of a voice interaction device oriented to a web page embedded in a smart car machine according to an embodiment of the present invention, as shown in Fig. 2 ,

The voice interaction device for the embedded web page of the intelligent vehicle machine includes an instruction configuration module 201 , a voice acquisition module 202 , a key message determination module 203 and a page communication module 204 .

The instruction configuration module 201 is used to configure response message instructions for each embedded web page, the response message instructions include quick wake-up instructions, and specifically include instructions such as confirm, cancel, close, previous page, next page, zoom in and zoom out. It is configured as a relationship mapping table in the module, the specific implementation can refer to the above method section, and the content of the table can be added according to user requirements. In an example, the execution protocol of the mapping relationship table can be further configured on the vehicle client, for example, according to the state of the current embedded web page, to determine whether to pass the matched response command message as a key command message to the web page for execution, For example, it can be further configured that when the web interface is in the active state, the user's voice command to close or confirm will be directly operated by the vehicle client to close or confirm the button of the web page, and will not be transmitted to the web page for corresponding page operations. deal with.

The voice acquisition module 202 is used to acquire the user's voice command, and is implemented as an audio acquisition device with a pickup function, which can be implemented by using existing equipment on the vehicle-mounted system.

The key message determination module 203 is configured to determine the key instruction message according to the acquired user voice instruction and the configured response message instruction of the embedded web page, and the specific implementation can refer to the above method section.

The page communication module 204 is used to output the key message instruction to the corresponding embedded web page, which stores the customized communication protocol between the vehicle system and the web page. In other implementation examples, the page communication module 204 is further configured to enable the embedded web page to provide message feedback to the vehicle client, that is, the vehicle system, for example, through the above-mentioned interception method, so that the vehicle client understands the page after the operation is performed. Status and page element content to facilitate subsequent response processing.

The device provided according to this embodiment can be simple and convenient to use, does not require additional hardware configuration, has strong expansibility, and controls the operation of elements in the web page through the voice sent by the user, so that the user has a very high sense of experience.

Fig. 3 schematically shows a block diagram of a web page system embedded in a smart car machine according to an embodiment of the present invention, as shown in Fig. 3,

The embedded web page 3 is configured with key message response mapping information, and the mapping information may refer to the implementation manner of the mapping table in the above method part. The embedded web page 3 performs corresponding page element operations according to the received key information instruction, wherein the key message instruction comes from the above-mentioned voice interaction device 2 for the embedded web page of the smart vehicle in the part of FIG. 3 .

The system according to the present embodiment can simply and conveniently realize the voice interaction between the vehicle-machine system and the embedded web page, has extremely high expansibility, and the realization method is simple and convenient.

In some embodiments, embodiments of the present invention provide a non-volatile computer-readable storage medium, where one or more programs including execution instructions are stored in the storage medium, and the execution instructions can be executed by an electronic device (including but not limited to a computer , a server, or a network device, etc.) to read and execute it, so as to execute any of the above-mentioned voice interaction methods oriented to the embedded web page of a smart vehicle of the present invention.

In some embodiments, embodiments of the present invention further provide a computer program product, the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer At the time, the computer is made to execute any one of the above-mentioned voice interaction methods for the embedded web page of the smart car machine.

In some embodiments, embodiments of the present invention further provide an electronic device, which includes: at least one processor, and a memory communicatively connected to the at least one processor, wherein the memory stores instructions executable by the at least one processor , the instructions are executed by the at least one processor, so that the at least one processor can execute the voice interaction method for the embedded web page of the intelligent vehicle machine.

In some embodiments, embodiments of the present invention further provide a storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, a voice interaction method for a web page embedded in a smart car machine is oriented.

The above-mentioned voice interaction device oriented to a web page embedded in a smart car machine according to the embodiment of the present invention can be used to execute the voice interaction method oriented to a web page embedded in a smart car machine according to the embodiment of the present invention, and correspondingly achieve the implementation of the above embodiment of the present invention The technical effect achieved by the voice interaction method for the embedded web page of the smart car machine will not be repeated here. In the embodiment of the present invention, the relevant functional modules may be implemented by a hardware processor (hardware processor).

FIG. 4 is a schematic diagram of the hardware structure of an electronic device for executing a voice interaction method oriented to a web page embedded in a smart car according to an embodiment of the present invention. As shown in FIG. 4 , the device includes:

One or more processors 310 and a memory 320, one processor 310 is taken as an example in FIG. 4 .

The device for executing the voice interaction method for the embedded web page of the smart vehicle may further include: an input device 330 and an output device 340 .

The processor 310, the memory 320, the input device 330, and the output device 340 may be connected through a bus or in other ways, and the connection through a bus is taken as an example in FIG. 4 .

The memory 320, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the smart vehicle-oriented embedded web in the embodiments of the present application. The program instruction/module corresponding to the voice interaction method of the page. The processor 310 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions and modules stored in the memory 320, that is, to realize the voice of the above method embodiments for the embedded web page of the smart car. interactive method.

The memory 320 may include a stored program area and a stored data area, wherein the stored program area may store an operating system and an application program required by at least one function; Use the created data, etc. Additionally, memory 320 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 320 may optionally include memory located remotely relative to the processor 310, and the remote memory may be connected to a voice interaction device oriented to the embedded web page of the intelligent vehicle through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 330 can receive the input numerical or character information, and generate signals related to user setting and function control of the voice interaction device for the embedded web page of the smart car machine. The output device 340 may include a display device such as a display screen.

The one or more modules described above are stored in the memory 320, and when executed by the one or more processors 310, execute the voice interaction method for a web page embedded in a smart car machine in any of the above method embodiments.

The above product can execute the method provided by the embodiments of the present application, and has functional modules and beneficial effects corresponding to the execution method. For technical details not described in detail in this embodiment, reference may be made to the methods provided in the embodiments of this application.

The electronic devices of the embodiments of the present application exist in various forms, including but not limited to:

(1) Mobile communication equipment: This type of equipment is characterized by having mobile communication functions, and its main goal is to provide voice and data communication. Such terminals include: smart phones (eg iPhone), multimedia phones, feature phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has the characteristics of mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as iPads.

(3) Vehicle equipment: This type of equipment can be used in the vehicle field. Such equipment includes: car navigation.

(4) Server: A device that provides computing services. The composition of the server includes a processor, a hard disk, a memory, a system bus, etc. The server is similar to a general computer architecture, but due to the need to provide highly reliable services, the processing power, stability , reliability, security, scalability, manageability and other aspects of high requirements.

(5) Other electronic devices with data interaction function.

The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

From the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and certainly can also be implemented by hardware. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of software products in essence, or the parts that make contributions to related technologies, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic disks , optical disc, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the methods described in various embodiments or some parts of the embodiments.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be The technical solutions described in the foregoing embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions in the embodiments of the present application.

Claims (10)

1. embedding the voice interactive method of web page towards intelligent vehicle device, which comprises the steps of:

It is instructed for each embedded web page configuration response message；

Obtain user speech instruction；

The response message for the embedded web page for being instructed and being configured according to the user speech of acquisition, which instructs, determines key instruction message；

By critical message instruction output to corresponding embedded web page end.

2. the method according to claim 1, wherein described according in the instruction of the user speech of acquisition and configuration The response message of embedding web page, which instructs, determines that key instruction message includes

Obtain the embedded web page currently shown；

Response message instruction corresponding with the embedded web page currently shown is instructed to match the user speech, according to Matching result determines that critical message instructs.

3. method according to claim 1 or 2, which is characterized in that further include:

The embedded web page end carries out corresponding page elements operation according to critical message instruction.

4. according to the method described in claim 3, it is characterized in that, the response message instruction include determine, cancel, close, At least one of page up, lower one page, amplification picture, diminution picture or two or more any combination.

5. embedding the voice interaction device of web page towards intelligent vehicle device, which is characterized in that including

Configuration module is instructed, for instructing for each embedded web page configuration response message；

Voice obtains module, for obtaining user speech instruction；

Critical message determining module, the response message of the embedded web page for being instructed and being configured according to the user speech of acquisition It instructs and determines key instruction message；

Page communication module, for critical message instruction output to be embedded web page end to corresponding.

6. voice interaction device according to claim 5, which is characterized in that the response message instruction includes quick wakes up Instruction.

7. device according to claim 5 or 6, which is characterized in that the response message instruction includes determining, cancelling, closing It closes, page up, lower one page, amplification picture, reduce at least one of picture or two or more any combination.

8. intelligent vehicle device embeds Web page plane system, which is characterized in that responded in the embedded web page configured with critical message Map information, the embedded web page carry out corresponding page elements operation according to the key message instruction received,

Wherein, the critical message instruction is described in any item towards the embedded web page of intelligent vehicle device from claim 5 to 7 Voice interaction device.

9. electronic equipment comprising: at least one processor, and the storage being connect at least one described processor communication Device, wherein the memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one A processor executes, so that at least one described processor is able to carry out the step of any one of claim 1-4 the method Suddenly.

10. storage medium is stored thereon with computer program, which is characterized in that the program realizes right when being executed by processor It is required that the step of any one of 1-4 the method.