CN109947906A - Intelligent voice interactive electronic memorandum and operation method thereof - Google Patents

Abstract

The present invention provides a kind of intelligent sound interactive electronic memorandum and its operating method.The operating method of the intelligent sound interactive electronic memorandum comprises the steps of the step of receiving instruction voice, receives the instruction voice of user；The received instruction voice of institute is converted to instruction text by the step of conversion instruction voice；And the step of decision instruction text, judge that whether converted instruction text contained default arouses instruction, arouses that instruct include first to arouse word and second arouse word.If instruction text contains first and arouses word, the interactive conversation program of memorandum foundation is executed, if instruction text contains second and arouses word, executes the interactive conversation program of memorandum inquiry, if instruction text without instruction is aroused, returns to the step of receiving instruction voice.

Description

Intelligent voice interactive electronic memorandum and operation method thereof

technical field

The present invention relates to an electronic memorandum, in particular to an intelligent voice interactive electronic memorandum and an operation method thereof.

Background technique

With the advancement of technology, various new electronic memos (or notepads) have largely replaced traditional memos to meet the needs of today's fast pace of life. For example, with the gradual popularization of personal mobile devices (such as smart phones, tablet computers), users can record the content of events that happened temporarily or suddenly at any time and place, so as to avoid forgetting in the future, thus providing a better life experience. Considerable convenience.

Although the event content can be recorded anytime and anywhere through the above-mentioned device, the existing input operation methods (mainly keyboard input, handwriting input, camera input, etc.) are also inconvenient to some extent. For example, touch keyboard input or handwriting input requires hand manipulation and is time-consuming. On the other hand, if the input content is simply recorded, but there is no corresponding effective query method, when the amount of recorded data increases in the future, querying the huge amount of recorded data will also cause a burden on the user. For example, when the amount of recorded data is hundreds or more, it will be a considerable burden for the user to search for certain information required in such a huge amount of data.

In particular, these problems have become more serious when users have higher and higher demands for recording and quick query at any time and the amount of memo data is increasing. Therefore, there is an urgent need for a method and a system for creating and inquiring electronic memorandums that can provide fast and simple, so as to overcome the above problems.

SUMMARY OF THE INVENTION

The present invention is made under the above-mentioned background, and involves converting voice input into text content, determining whether the text content contains an evoking command, parsing the text content, and making a memo according to the evoking command and the parsed text content An interactive dialog program for creating or querying memos to automatically store or retrieve memos, thereby overcoming the above-mentioned problems. In addition, the present invention also provides a memorandum reminder and memo synchronization method, thus making the memorandum system more convenient to use.

An embodiment of the present invention relates to an operation method of an intelligent voice interactive electronic memorandum, which includes the following steps. The step of receiving the command voice starts to receive the user's command voice. The step of converting the command voice is to convert the received command voice into command text. The step of judging the command word is to judge whether the converted command word contains a default evoking command, wherein the evoking command includes a first evoking word and a second evoking word. If the command text contains the first arousal, execute the memorandum creation procedure; if the command text contains the second arousal, perform the memorandum query procedure; and if the command text does not contain the arousal command, return to the step of receiving the command voice. The procedure of memorandum creation includes the following steps: the step of obtaining the interactive dialogue of the content of the memorandum to be created; the step of parsing the content of the memorandum to be created, parsing the content of the memorandum to be created into name elements, relation elements, and target elements; The step of analyzing whether the content of the memorandum to be created is correct is an interactive dialogue step. If it is correct, the procedure of storing the memo is performed. If it is not correct, it returns to the step of receiving the command voice. The procedure of memorandum inquiry includes the following steps: the step of obtaining the interactive dialogue of the content of the memorandum to be queried; the step of parsing the content of the memorandum to be queried, and the content of the memorandum to be queried into name elements and relation elements; and confirming the parsed content of the memorandum to be queried Check whether the content of the memo is correct or not. If it is correct, go to the procedure of retrieving the memorandum. If it is not correct, go back to the step of receiving the command voice.

According to an embodiment of the present invention, the step of obtaining the interactive dialogue of the memo content to be created includes: asking the user voice about the memo content to be created; and receiving the voice answered by the user to obtain the memo content to be created. In addition, the step of obtaining the interactive dialogue of the content of the memo to be queried includes: asking the user for the content of the memo to be queried by voice; and receiving the voice answered by the user to obtain the content of the memo to be queried.

According to an embodiment of the present invention, the step of confirming whether the parsed content of the memo to be created is an interactive dialogue includes: a voice questioning the user whether the name element, relationship element, and target element of the parsed content of the memo to be created are correct; And receive the voice answered by the user, so as to confirm whether the parsed name element, relation element and target element of the memo content to be created are correct. In addition, the step of confirming whether the parsed content of the memo to be queried is correct in the interactive dialogue includes: asking the user by voice whether the name element and relation element of the content of the memo to be queried parsed by the user are correct; and receiving a voice answered by the user to confirm the Whether the name element and relation element of the parsed memo content to be queried are correct.

According to an embodiment of the present invention, the program for storing the memorandum includes: a step of comparing the knowledge graph of the terminal memorandum, comparing whether the name element, relationship element, and target element of the memo content to be created already exist in the knowledge graph of the terminal memo; comparing For the step of cloud memo knowledge graph, compare whether the name element, relationship element, and target element of the memo content to be created already exist in the cloud memo knowledge graph; for the step of storing new memo content, compare the name element of the memo content to be created. , relationship elements, and target elements are stored in the terminal memo knowledge graph as the new memo content, and the state of the new memo content is set to unsynchronized; and the steps of storing the new usage record, write the current storage usage record in the form of a database Enter the terminal usage record database as a new usage record. In the step of comparing the knowledge graph of the terminal memorandum, if the name element, relationship element and target element of the memo content to be created already exist, the creation operation error message text is generated, and the creation operation error message text is converted into information voice and output, and then go back to the step of receiving the command voice; if there is no name element, relationship element, and target element of the memo content to be created, continue to the step of comparing the cloud memo knowledge graph. In the step of comparing the cloud memorandum knowledge graph, if the name element, relationship element and target element of the memo content to be created already exist, the creation operation error message text is generated, and the creation operation error message text is converted into an information voice and output, and then go back to the step of receiving the command voice; if there is no name element, relation element, and target element of the memo content to be created, continue to the step of storing the new memo content and the step of storing the new usage record, and then generate the creation The operation success message text is converted into the message voice of the new memo content and the establishment operation success message text and output, and then returns to the step of receiving the command voice.

According to an embodiment of the present invention, the procedure for retrieving memorandum includes: the step of comparing the knowledge graph of the terminal memo, comparing whether the name element and relation element of the memo content to be queried already exist in the knowledge graph of the terminal memo; comparing the knowledge graph of the memo on the cloud The step of mapping, comparing the name element and relationship element of the memo content to be queried in the cloud memorandum knowledge graph; and the step of storing the new usage record, writing the current retrieval usage record into the terminal usage record database in the form of a database as a new usage record. In the step of comparing the knowledge graph of the terminal memo, if the name element and relation element of the memo content to be queried already exist, read the corresponding target element of the memo content to be queried and generate a query operation success message text, and then store a new Use the recorded steps, convert the memo content to be queried and the information text of the successful query operation into information voice and output, and then return to the step of receiving the command voice; if there is no name element and relationship element of the memo content to be queried, then Continue with the steps to compare the cloud memo knowledge graph. In the step of comparing the cloud memo knowledge graph, if the name element and relationship element of the memo content to be queried already exist, read the corresponding target element of the memo content to be queried and generate a query operation success message text, and then store a new Use the recorded steps, convert the memo content to be queried and the information text of the successful query operation into information voice and output, and then return to the step of receiving the command voice; if there is no name element and relationship element of the memo content to be queried, then Generate the query operation error message text, convert the query operation error message text into information voice and output, and then return to the step of receiving the command voice.

In another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a memorandum reminder program, which includes: (a) sending out information according to a preset time interval; (b) reading the terminal memo knowledge A memo content in the map; (c) Parse the read memo content, and parse the memo content into name elements, relationship elements, and target elements; (d) Compare the memo content to see if a voice reminder is required at this time, if If a voice reminder is required, the content of the memo is converted into information voice and output; and (e) the steps (b) to (d) are repeated until all the contents of the memo are processed.

In another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum further includes a procedure for synchronizing the memo from the terminal to the cloud, which includes: (a) sending out information according to a preset time interval; (b) reading The state in the terminal memo knowledge graph is a memo content that is not synchronized; (c) synchronize the memo content to the cloud memo knowledge graph; (d) set the state of the memo content to synchronized; and (e) repeat (b) ) to (d) until all the memo contents whose status is unsynchronized are processed.

In another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum further includes a procedure for synchronizing the memo from the cloud to the terminal, which includes: (a) sending information according to a preset time interval; (b) reading A memo content in the cloud memo knowledge graph; (c) parse the reminder time of the read memo content; (d) determine whether the memo content has a reminder time and is within the valid time range, if the memo content has a reminder time and is valid within the time range, synchronize the memo content to the terminal memo knowledge graph; (e) set the state of the memo content to synchronized; and (f) repeat the steps (b) to (e) until all the memos are processed. content.

In another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum further includes a program for synchronizing the usage records between the cloud and the terminal, which includes: (a) sending information according to a preset time interval; (b) reading Take a usage record whose status in the terminal usage record database is unsynchronized; (c) synchronize the usage record to the cloud usage record database; (d) delete the usage record in the terminal usage record database; and (e) repeat ( Steps from b) to (d) are performed until all usage records whose status is unsynchronized are processed.

Another embodiment of the present invention relates to a computer program product of an intelligent voice interactive electronic memorandum, the computer program product includes a computer-readable medium, and the computer-readable medium is used for storing a computer program, when the computer program is loaded and executed After that, various operation methods of the above-mentioned intelligent voice interactive electronic memorandum can be completed.

Another embodiment of the present invention relates to an intelligent voice interactive electronic memorandum system, which includes: a voice input unit for receiving a user's voice and converting it into a voice signal; a terminal processing unit for executing the memorandum system's The operation includes a memorandum creation and query unit, a data access and synchronization unit, and a text-to-speech module; and a voice output unit for converting voice signals into sound output. The memorandum establishment and query unit includes: a voice-to-text module, which is used to convert the voice signal of the voice input unit into text data; a call-up instruction judgment module, which is used to judge whether the text data of the voice-to-text module contains a call-up instruction, and the call-up instruction includes the first an evocative word and a second evocative word; the interactive dialogue control module is used to control the interactive dialogue program between the memorandum system and the user, including making voice questions and receiving and answering voices; Name element, relationship element, and target element of the queried memo content; memorandum confirmation module, used to confirm whether the parsed memo content to be created or queried is correct; memorandum access module, used to control the storage and retrieval of memorandum a program; a usage record module for controlling a program for storing usage records; and an operation information generation module for generating operation information text. The data access and synchronization unit includes: a first time counting module, used to send information according to a default time interval; an access strategy module, used to execute procedures for storing memos, retrieving memos, and storing usage records; a knowledge map of terminal memos, It is used to store the content of the memo; the terminal use record database is used to store the use record; the terminal data access module is used to access the content of the memo or the use record; and the terminal data synchronization module is used to make the terminal memorandum knowledge map and the terminal use record The database is synchronized with the cloud processing unit through the network. The text-to-speech module is used to receive the text of the operation information, convert it into a voice signal, and send it to the voice output unit.

In another embodiment of the present invention, the terminal processing unit further includes a memorandum reminder unit, which includes: a second time counting module for sending information according to a default time interval; a comparison module for comparing the terminal memo knowledge graph The reminder time of the content of the memo in the system; and the reminder information generating module, which is used to generate the reminder information text and transmit it to the text-to-speech module.

In another embodiment of the present invention, the cloud processing unit includes: a cloud data access module for accessing memo content or usage records; a cloud memo knowledge graph for storing memo contents; a cloud usage record database for storing Usage records; cloud data synchronization module, used to synchronize cloud memorandum knowledge graph and cloud usage record database and terminal data synchronization module through the network; data analysis application tool, used to analyze the data of usage records; and data management system, with to manage the recorded data.

Description of drawings

Embodiments of the present invention will now be described in detail, by way of example and not limitation, with reference to the accompanying drawings. The features and advantages of the present invention should be better understood after reading the following detailed description and drawings, wherein:

FIG. 1 is a schematic flowchart of a memorandum creation procedure according to an embodiment of the present invention.

FIG. 2 is a schematic flowchart of a memo query procedure according to an embodiment of the present invention.

FIG. 3 is a schematic flowchart of a memo reminder program according to an embodiment of the present invention.

4A is a schematic flowchart of a terminal-to-cloud memo synchronization procedure according to an embodiment of the present invention.

4B is a schematic flowchart of a cloud-to-terminal memo synchronization procedure according to an embodiment of the present invention.

4C is a schematic flowchart of a procedure for synchronizing usage records between the cloud and the terminal according to an embodiment of the present invention.

FIG. 5A is a schematic flowchart of a terminal storing memo procedure according to an embodiment of the present invention.

5B is a schematic flowchart of a terminal retrieval memo procedure according to an embodiment of the present invention.

FIG. 5C is a schematic flowchart of a terminal storage usage recording program according to an embodiment of the present invention.

FIG. 6A is a schematic flowchart of a cloud storage memo procedure according to an embodiment of the present invention.

FIG. 6B is a schematic flowchart of a procedure for retrieving a memo from the cloud according to an embodiment of the present invention.

FIG. 6C is a schematic flowchart of a cloud storage usage record procedure according to an embodiment of the present invention.

FIG. 7 is a schematic block diagram of an intelligent voice interactive electronic memo system according to another embodiment of the present invention.

Description of reference numerals

100 How to create a memo

101～131 steps

200 How to Query Memorandum

206～231 steps

300 Memo Reminder Program

301～311 steps

400 Terminal-to-Cloud Memo Sync Program

401～411 steps

420 Cloud-to-Terminal Memo Sync Program

421～435 steps

440 Use record synchronization program between cloud and terminal

441～451 steps

500 Procedure for storing memos

501～511 steps

520 Procedures for retrieving memorandums

Steps 521 to 529

540 Program for storing usage records

Steps 541 to 543

Stored memo program of 600 cloud processing unit

Steps 601 to 605

620 Retrieval Memo Program of Cloud Processing Unit

621～625 steps

640 Cloud processing unit storage usage recorder

Steps 641 to 645

700 Memo System

701 Voice Input Unit

703 Terminal Processing Unit

705 Voice Output Unit

707 Memorandum Creation and Inquiry Unit

709 Data Access and Synchronization Unit

711 Speech-to-text module

713 Invoke command judgment module

715 Interactive Dialogue Control Module

717 Memo Content Analysis Module

719 Memorandum Confirmation Module

721 Memo Access Module

723 Using the logging module

725 Operation information generation module

727 Text-to-speech module

729 first time counting module

731 Access Policy Module

733 terminal data synchronization module

735 Terminal Data Access Module

737 Terminal Memo Knowledge Graph

739 Terminal usage record database

741 Memo Reminder Unit

743 Second time counting module

745 Alignment Module

747 Reminder information generation module

751 Cloud Processing Unit

753 Cloud Data Access Module

755 Cloud Data Synchronization Module

757 Data Analysis Application Tools

759 Data Management Systems

761 Cloud Memo Knowledge Graph

763 Cloud usage record database

Detailed ways

FIG. 1 and FIG. 2 are schematic flowcharts of an operation method of an intelligent voice interactive electronic memo according to an embodiment of the present invention, respectively showing an operation method 100 of creating a memorandum and an operation method 200 of querying a memorandum. First, refer to the operation method 100 of creating a memo in FIG. 1 . In step 101 of receiving the command voice, the user's command voice is started to be received. For example, the user says: "Create memo" or "Inquire memo". In step 103 of converting the command voice, the received command voice is converted into command text. In the step 105 of judging the command text, it is judged whether the converted command text contains a default evoking command. The recall command may include a first arousal (eg, create a memo) and a second arousal (eg, query a memo). In this step, if the command text contains the first arousal, the memorandum system is awakened to execute the memorandum creation procedure 106; if the command text contains the second arousal, the memorandum system is awakened to execute the memorandum query procedure 206 ; but if the command text does not contain an evoking command, go back to step 101 of receiving command voice.

The memo creation process 106 may include the following steps: a step of obtaining an interactive dialogue for the content of the memo to be created, a step of parsing the content of the memo to be created, a step of confirming whether the parsed content of the memo to be created is an interactive dialogue, and storing Memorandum procedure. The contents of each step are described below.

The step of obtaining the interactive dialogue of the content of the memo to be created includes: step 107 of asking the user about the content of the memo to be created by voice, and step 109 of receiving the voice answered by the user. For example, the system asks the user: "Please tell me the content of the memo that you want to create?", and the user replies: "The high blood pressure medicine is in the drawer." Through this interactive dialogue, the content of the memo that the user wants to create can be obtained. The step 111 of parsing the content of the memo to be created is to parse the content of the memorandum to be created into a name element, a relation element, and a target element (for example, the name element is "high blood pressure medicine", the relation element is "put", and the target element is "in the drawer"). The step of confirming whether the content of the parsed memo to be created is correct or not of the interactive dialogue includes: a voice questioning the user whether the name element, relation element, and target element of the parsed memo content to be created are correct; step 113, and receiving an answer from the user Step 115 of speech. For example, the system asks the user: "Is the content of the memo saying high blood pressure medicine is in the drawer?", and the user replies: "Yes". Through this interactive dialogue, it is confirmed whether the name element, relation element and target element of the parsed memo content to be created are correct. If it is correct, execute the procedure of storing the memorandum (details will be described below); if not, return to step 101 of receiving the command voice.

As mentioned above, the procedure for storing the memo may include the following steps: the step 119 of transmitting the contents of the memo to the memo access module, the procedure 121 for storing the memo by using the access policy module (such as the procedure 500 for storing the memo described below), and determining the storage Step 123 of whether the procedure of the memo is successful. If the procedure 121 for storing the memorandum succeeds, the following process is continued: the procedure 125 for storing the usage record (such as the procedure 540 for storing the usage record described below) is performed by using the access policy module, and the text content of the establishment operation success message is generated (step 127), Convert the content of the new memo and the content of the message text of the successful establishment operation into message voice (step 129 ), output the message voice (step 131 ), and then return to step 101 of receiving the command voice. So far, the creation of the new memo content (for example: "Hypertension medicine is placed in the drawer") and the new usage record (for example: the time is "a certain year, month, day, hour, minute, second", the operation is "create memo", the name is "high blood pressure medicine, relationship is "put in", and target is "in the drawer"), and output related voice messages (for example: the system outputs the voice message "successfully created a new memo with the content of high blood pressure medicine in the drawer") ”). In addition, if the procedure 121 for storing the memorandum fails, the following procedures are performed: generating the text content of the establishment operation error message (step 124 ), converting the text content of the establishment operation error message into the message voice (step 129 ), and outputting the message voice (step 131 ) ), and then go back to step 101 of receiving the command voice. In this case, it means that the content of the memo to be created already exists in the terminal or cloud memo knowledge graph (for example: the name is "hypertension drug", the relationship is "put", and the target is "in the drawer"), and Output relevant voice messages (for example: the system outputs a voice message "The content of the memo already exists").

Referring now to FIG. 5A, an embodiment of the above-described procedure for storing a memo will be described. The procedure 500 for storing a memo may include the following processes. Send the memo content to the terminal data access module (step 501 ) and compare the terminal memo knowledge graph (step 503 ). Next, it is checked whether the content of the memo already exists (step 505). If the memo content does not exist in the terminal memo knowledge graph, continue to communicate with the cloud data access module via the network, and compare the cloud memo knowledge graph (step 507 ) to check whether the memo content already exists (step 509 ) . If the memo content still does not exist in the cloud memo knowledge graph, the memo content is stored in the terminal memo knowledge graph as a new memo content (step 511 ), and the status of the new memo content is set to “unsynchronized” (Step 513 ), and then the procedure of storing the memo is ended (successfully stored). On the other hand, in the checking process of step 505 or step 509, if it is checked that the memo content already exists in the terminal memo knowledge graph or the cloud memo knowledge graph, the procedure of storing the memo is directly ended (storage failure).

Referring now to FIG. 5C, an embodiment of the above-described procedure for storing usage records will be described. The procedure 540 for storing the usage records may include the following processes. The usage record is transmitted to the terminal data access module using the access policy module (step 541). The terminal data access module writes the usage record into the terminal usage record database in the form of a database (step 543). Then, the procedure of storing the usage record is ended (successfully stored).

In addition, reference is made to the method of operation 200 of query memo in FIG. 2 . The procedure 206 of the memo query may include the following steps: a step of obtaining an interactive dialogue of the content of the memo to be queried, a step of parsing the content of the memo to be queried, a step of confirming whether the parsed content of the memo to be queried is an interactive dialogue, and retrieval Memorandum procedure. The contents of each step are described below.

The step of obtaining the interactive dialogue of the content of the memo to be queried includes: a step 207 of asking the user about the content of the memo to be queried by voice, and receiving the voice 209 answered by the user. For example, the system asks the user: "Please state the content of the memo that you want to inquire about?", and the user replies: "Where is the high blood pressure medicine?". Through this interactive dialogue, the content of the memo that the user wants to inquire about can be obtained. The step 211 of parsing the content of the memo to be queried is to parse the content of the memorandum to be queried into a name element and a relationship element (for example, the name element is "high blood pressure medicine", and the relationship element is "put"). The step of confirming whether the parsed memo content to be queried is correct or not of the interactive dialogue includes: a voice questioning the user whether the name element and relation element of the parsed memo content to be queried are correct 213 , and a step 215 of receiving the voice answered by the user . For example, the system asks the user, "Would you like to find out where the high blood pressure medicine is stored?", and the user replies: "Yes". Through this interactive dialogue, confirm whether the name element and relation element of the parsed memo content to be queried are correct. If it is correct, execute the procedure of retrieving the memorandum (details will be described below); if not, go back to step 101 of receiving the command voice.

Continuing from the above, the procedure for retrieving memorandum may include the following steps: step 219 of transmitting memorandum content to the memo access module, procedure 221 for retrieving memorandum by using the access policy module (such as the procedure 520 for retrieving memorandum described below), and judging retrieval Step 223 of whether the procedure of the memo is successful. If the procedure 221 for retrieving the memorandum succeeds, the following procedures are continued: read the corresponding memo object and generate the message text content of the memorandum (step 225), and use the access policy module to perform the procedure 227 for storing the usage record (this procedure is as follows: Referring to the program 540 of storing usage records in FIG. 5C above, convert the message text content of the memo into message voice (step 229 ), output the message voice (step 231 ), and then return to step 101 of receiving command voice. At this point, the query of the content of the memo (for example: "Hypertension medicine is placed in the drawer") and the new usage record (for example: the time is "a certain year, month, day, hour, minute and second", the operation is "inquiry memo", and the name is "high blood pressure". medicine”, and the relationship is “put”), and output related voice messages (for example: the system outputs the voice message “successfully inquired a memo, the content is high blood pressure medicine put in the drawer”). In addition, if the procedure 221 for retrieving the memorandum fails, the following procedures are executed: generating the text content of the query operation error message (step 224 ), converting the text content of the query operation error message into message voice (step 229 ), and outputting the message voice (step 231 ) ), and then go back to step 101 of receiving the command voice. In this case, it means that the content of the memo to be queried does not exist in the terminal or cloud memo knowledge graph (for example: the name is "high blood pressure medicine", the relationship is "put"), and the relevant voice message is output (for example: the system Output the voice message "The content of this memo does not exist").

An embodiment of the above-described procedure for retrieving a memo will now be described with reference to FIG. 5B. The procedure 520 for retrieving a memo may include the following flow. Send the memo content to the terminal data access module (step 521 ) and compare the terminal memo knowledge graph (step 523 ). Next, it is checked whether the content of the memo already exists (step 525). If the memo content does not exist in the terminal memo knowledge graph, continue to communicate with the cloud data access module via the network, and compare the cloud memo knowledge graph (step 527 ) to check whether the memo content already exists (step 529 ) . If the content of the memo still does not exist in the cloud memo knowledge graph, the process of retrieving the memorandum ends (the retrieval fails). On the other hand, in the checking process of step 525 or step 529, if it is checked that the memo content already exists in the terminal memo knowledge graph or the cloud memo knowledge graph, the procedure of retrieving memos is directly ended (the retrieval is successful).

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a memorandum reminder program. FIG. 3 shows a schematic flowchart of a memo reminder process 300 , which may include the following steps. First, send out information according to a preset time interval (step 301). For example, set the system to send a message every minute and the time is now 8 am. Next, it is checked whether there is any content of the memo that has not yet been processed (step 303). If there is an unprocessed memo content, read an unprocessed memo content in the memo knowledge graph of the terminal (step 305 ), parse the read memo content, and parse the memo content into name elements, relation elements, and target element (step 307). For example, the name element is "8 am", the relation element is "take", and the target element is "high blood pressure medicine". Next, it is determined whether the content of the memo is to be reminded by voice at this time (step 309). If voice reminder is not required, go back to step 303; if voice reminder is required, generate reminder memo message text content according to the memo content (step 311), and convert the message text content into message voice (step 313), The information voice output is performed (step 315 ), and then the process returns to step 303 . For example, in this case, the system needs to remind the user of the content of the memo, so the system voice reminds the user: "Take the high blood pressure medicine at 8 am". The above steps 303 to 315 are repeated until all the contents of the memo are processed.

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a procedure for synchronizing the memo from the terminal to the cloud. FIG. 4A shows a schematic flowchart of a terminal-to-cloud memo synchronization procedure 400, which may include the following steps. First, a message is sent according to a preset time interval (step 401). Next, it is confirmed whether there is any memo content in the terminal memo knowledge graph that has not yet been processed (step 403 ). If there is an unprocessed memo content, read an unprocessed memo content in the terminal memo knowledge graph (step 405 ), and transmit the memo content to the terminal data access module (step 407 ), and store the memo content through the network and cloud data storage module (step 407 ). The procedure of storing the memorandum in the cloud through communication with the module (step 409 ), then setting the state of the memo content as “synchronized to the cloud” (step 411 ), and then returning to step 403 . The above steps 403 to 411 are repeated until all the contents of the memo are processed.

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a cloud-to-terminal memo synchronization procedure. FIG. 4B shows a schematic flowchart of a cloud-to-terminal memo synchronization procedure 420, which may include the following steps. First, a message is sent according to a preset time interval (step 421). Next, it is confirmed whether there is any memo content in the cloud memo knowledge graph that has not been processed yet (step 423 ). If there is an unprocessed memo content, read an unprocessed memo content in the cloud memo knowledge graph (step 425 ), parse the reminder time of the memo content (step 427 ), and then determine whether the memo content has a reminder time and within the valid time frame (step 429). If the content of the memo has a reminder time and is within the valid time range, the content of the memo is transmitted to the cloud data access module (step 431 ), and the process of storing the memorandum is performed in the terminal by communicating with the terminal data access module via the network (step 431 ). Step 433 ), then set the state of the memo content as “synchronized to the terminal” (step 435 ), and then return to step 423 . Repeat the above steps 423 to 435 until all the contents of the memo are processed.

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a procedure of synchronizing the usage records of the cloud and the terminal. FIG. 4C shows a schematic flowchart of a usage record synchronization procedure 440 between the cloud and the terminal, which may include the following steps. First, a message is sent according to a preset time interval (step 441). Next, it is checked whether there is any usage record in the terminal usage record database that has not been processed (step 443). If there is a usage record that has not been processed yet, read an unsynchronized usage record in the terminal usage record database (step 445 ), and transmit the usage record to the terminal data access module (step 447 ), and store the usage record via the network and the cloud. The procedure of storing the usage record in the cloud by communicating with the module (step 449 ), then removing the usage record from the terminal usage record database (step 451 ), and then returning to step 443 . The above steps 443 to 451 are repeated until all usage records are processed (the usage records are backed up to the cloud).

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a program for storing the memorandum in the cloud. FIG. 6A shows a schematic flowchart of a memo storage procedure 600 of a cloud processing unit, which may include the following steps: transmitting the memo content to the cloud data access module (step 601 ), and transmitting the memo content to the data management system (step 603 ) ), and store the memo content in the cloud memo knowledge graph (step 605 ).

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a procedure for retrieving the memorandum from the cloud. FIG. 6B shows a schematic flowchart of the retrieval memo procedure 620 of a cloud processing unit, which may include the following steps: transmitting the memorandum content to the cloud data access module (step 621 ), and transmitting the memorandum content to the data management system for retrieval (step 623), and compare whether the memo content already exists in the cloud memo knowledge graph (step 625). If it already exists, the retrieval succeeds; if it does not exist, the retrieval fails.

According to another embodiment of the present invention, the operation method of the intelligent voice interactive electronic memorandum may further include a program for storing usage records in the cloud. FIG. 6C shows a schematic flowchart of a storage usage record procedure 640 of a cloud processing unit, which may include the following steps: sending the usage record to the cloud data access module (step 641 ), sending the usage record to the data management system (step 641 ) 643), and store the usage record in the cloud usage record database (step 645).

Embodiments of the present invention may also include a computer program product for an intelligent voice interactive electronic memo. The computer program product includes a computer-readable medium. The computer-readable medium is used to store computer programs. After the computer program is loaded and executed, various operation steps of the above-mentioned intelligent voice interactive electronic memorandum can be completed.

Examples of the above-mentioned computer-readable medium include: hard disk, network attached storage (NAS, network attached storage), read only memory (ROM, read only memory), random access memory (RAM, random access memory), optical disk (CD- ROM, compact disc-ROM), recordable disc (CD-R, CD-recordable), rewritable disc (CD-RW, CD-rewritable), magnetic tape, and other optical and non-optical data storage hardware units . In some embodiments, computer-readable media may include computer-readable physical media that are dispersed over network-coupled computer systems so that a computer program can be stored and executed in a distributed fashion.

7 is a schematic block diagram of an intelligent voice interactive electronic memo system 700 according to an embodiment of the present invention, which can be used to implement various operation steps of the intelligent voice interactive electronic memo as described above. The memo system 700 may include: a voice input unit 701 , a terminal processing unit 703 , and a voice output unit 705 . The voice input unit 701 is used to receive the user's voice and convert it into a voice signal. The terminal processing unit 703 is used to perform various operations of the memorandum system 700 (such as the above-mentioned memorandum creation, query, reminder, and synchronization operations). The terminal processing unit 703 may include: a memo creation and query unit 707 , a data access and synchronization unit 709 , and a text-to-speech module 727 . The voice output unit 705 is used to convert the voice signal from the text-to-speech module 727 into voice output.

The memorandum creation and query unit 707 may include: a speech-to-text module 711 , a call-up command judgment module 713 , an interactive dialogue control module 715 , a memo content analysis module 717 , a memorandum confirmation module 719 , a memorandum access module 721 , a usage record module 723 , and Operation information generation module 725 . The speech-to-text module 711 is used to receive the speech signal from the speech input unit 701 and convert it into text data. The evoking instruction determining module 713 is used for judging whether the text data converted by the speech-to-text module 711 contains an evoking instruction. The recall command may include a first arousal (eg, create a memo) and a second arousal (eg, query a memo). The interactive dialogue control module 715 is used to control the interactive dialogue program between the memorandum system 700 and the user, such as: making voice questions and receiving the user's answering voice. The memo content parsing module 717 is used to parse the name element, relation element, and target element of the memo content that the user wants to create or query. The memorandum confirmation module 719 is used to confirm whether the parsed memo content to be created or queried is correct. If it is confirmed through the interactive dialogue that the content of the memo that the user wants to create is correct, the process of storing the memo is performed; if the content of the memo that the user wants to inquire about is confirmed to be correct through the interactive dialogue, the process of retrieving the memorandum is performed. The memo access module 721 is used to control the procedures for storing memos and retrieving memos. The usage record module 723 is a program for controlling and storing usage records. The operation information generating module 725 is used to generate the text content of the operation information according to the execution result of the memorandum system, and transmit the generated text content to the text-to-speech module 727 for voice signal conversion.

The data access and synchronization unit 709 may include: a first time counting module 729 , an access policy module 731 , a terminal memo knowledge graph 737 , a terminal usage record database 739 , a terminal data access module 735 , and a terminal data synchronization module 733 . The first time counting module 729 is used to send information according to the default time interval. The access policy module 731 is used to execute procedures for storing memos, retrieving memos, and storing usage records. The terminal memo knowledge graph 737 is used to store the memo content. The terminal usage record database 739 is used to store usage records. The terminal data access module 735 is used to access the memo content or usage records. The terminal data synchronization module 733 is used to synchronize the terminal memo knowledge graph and the terminal usage record database with the cloud processing unit 751 through the network.

According to another embodiment of the present invention, the terminal processing unit 703 may further include a memorandum reminding unit 741 . The memo reminder unit 741 may include: a second time counting module 743 , a comparison module 745 , and a reminder information generation module 747 . The second time counting module 743 is used for sending information according to the default time interval. The comparison module 745 is used to compare the reminder time of the memo content in the terminal memo knowledge graph. If the result of the comparison is that a voice reminder needs to be performed at this time, the procedure of the memo reminder is executed. The reminder information generating module 747 is used to generate the text content of the reminder information according to the execution result of the memorandum system, and transmit the generated text content to the text-to-speech module 727 for voice signal conversion.

According to another embodiment of the present invention, the memorandum system 700 may further include a cloud processing unit 751 . The cloud processing unit 751 may include: a cloud data access module 753 , a cloud memo knowledge graph 761 , a cloud usage record database 763 , a cloud data synchronization module 755 , a data analysis application tool 757 , and a data management system 759 . The cloud data access module 753 is used to access the memo content or usage records. The cloud memo knowledge graph 761 is used to store memo content. The cloud usage record database 763 is used to store usage records. The cloud data synchronization module 755 is used to synchronize the cloud memorandum knowledge graph and the cloud usage record database with the terminal processing unit 703 through the network. The data analysis application tool 757 is used to analyze the data of usage records. The data management system 759 is used to manage the data of the usage records.

Various features and advantages of the present invention should become apparent from the foregoing detailed description. For example, with the system and method provided by the present invention, the user can create and query memos at any time and quickly through interactive dialogue. In addition, the present invention also provides the functions of voice reminder of memorandum and synchronization between the terminal and the cloud, so that the function of memorandum can be effectively exerted.

While the present invention has been described in terms of several embodiments, those of ordinary skill in the relevant art will appreciate that many modifications and variations of the present invention are possible based on the above teachings. It will also be understood by those of ordinary skill in the relevant art that the present invention covers all such modifications, variations, additions, permutations, and their equivalents. Therefore, the present invention is not limited to these embodiments, but includes what is included in the true scope and spirit of the appended claims.

Claims (15)

1. an operation method of intelligent voice interactive electronic memorandum is characterized in that, this operation method comprises the following steps: The step of receiving the command voice starts to receive the user's command voice; The step of converting command voice, converting the received command voice into command text; and The step of judging the command text, judging whether the converted command text contains a default evocation command, the evocation command includes a first evocative word and a second evocative word, wherein if the command text contains the first evocative word, then create a memorandum If the command text contains the second evoking word, perform the procedure of memo query, if the command text does not contain the evoking command, then return to the step of receiving command voice; The procedures for establishing the memorandum include the following steps: Steps to obtain an interactive dialogue for the content of the memo to be created; the step of parsing the content of the memorandum to be created, parsing the content of the memorandum to be created into a name element, a relation element, and a target element; and The step of confirming whether the parsed content of the memorandum to be created is correct or not is an interactive dialogue step, if it is correct, perform the procedure of storing the memo, and if it is not correct, return to the step of receiving the command voice; and The procedure of memo query includes the following steps: Steps to obtain the interactive dialogue of the content of the memo to be queried; The step of parsing the memorandum content to be queried, parsing the memorandum content to be queried into name elements and relation elements; and It is an interactive dialogue step of confirming whether the parsed memo content to be queried is correct. If it is correct, the procedure of retrieving the memorandum is performed. If it is not correct, it returns to the step of receiving the command voice. 2. The operation method of the intelligent voice interactive electronic memorandum according to claim 1, wherein the step of obtaining the interactive dialogue of the memo content to be established comprises: Voice questions about the content of the memo that the user wants to create; and Receive the voice answered by the user to obtain the content of the memo to be created. 3. The operation method of the intelligent voice interactive electronic memorandum according to claim 1, wherein the step of obtaining the interactive dialogue of the memo content to be inquired comprises: The content of the memo that the user wants to inquire about by voice questioning; and Receive the voice answered by the user to obtain the content of the memo to be queried. 4. The operation method of the intelligent voice interactive electronic memorandum according to claim 1, wherein the step of confirming whether the parsed memo content to be established is correct interactive dialogue comprises: Whether the name element, relationship element, and target element of the content of the memo to be created parsed by the voice question user are correct; and The voice answered by the user is received to confirm whether the parsed name element, relation element and target element of the content of the memo to be created are correct. 5. The operation method of the intelligent voice interactive electronic memorandum according to claim 1, wherein the step of confirming whether the parsed memo content to be queried is correct interactive dialogue comprises: Whether the name element and relationship element of the memo content to be queried parsed by the voice question user are correct; and The voice answered by the user is received to confirm whether the parsed name element and relation element of the memo content to be queried are correct. 6. the operation method of intelligent voice interactive electronic memorandum according to claim 1, is characterized in that, the program of storing memorandum comprises: The step of comparing the terminal memo knowledge graph, comparing whether the name element, relation element, and target element of the memo content to be created already exist in the terminal memo knowledge graph; The step of comparing the cloud memo knowledge graph, comparing whether the name element, relation element, and target element of the memo content to be created already exist in the cloud memo knowledge graph; The step of storing the new memo content includes storing the name element, relation element and target element of the memo content to be created in the terminal memo knowledge graph as the new memo content, and setting the state of the new memo content as unsynchronized; and The step of storing the new usage record is to write the stored usage record into the terminal usage record database in the form of a database as a new usage record; Wherein, in the step of comparing the knowledge graph of the terminal memo, if the name element, relation element and target element of the memo content to be created already exist, a creation operation error message text is generated, and the creation operation error message text is converted into The information voice is output, and then returns to the step of receiving the command voice. If there is no name element, relationship element, and target element of the memo content to be created, continue to compare the cloud memo knowledge graph; In the step of comparing the cloud memo knowledge graph, if the name element, relationship element, and target element of the memo content to be created already exist, a creation operation error message text is generated, and the creation operation error message text is converted into The information voice is output, and then returns to the step of receiving the command voice. If there is no name element, relationship element, and target element of the memo content to be created, continue to the step of storing the new memo content and the step of storing the new usage record. , and then generate the establishment operation success message text, convert the content of the new memo and the establishment operation success message text into information voice and output, and then return to the step of receiving the command voice. 7. the operation method of intelligent voice interactive electronic memorandum according to claim 1, is characterized in that, the program of retrieving memorandum comprises: The step of comparing the terminal memo knowledge graph, comparing whether the name element and relation element of the memo content to be queried already exist in the terminal memo knowledge graph; The step of comparing the cloud memo knowledge graph, comparing whether the name element and relation element of the memo content to be queried already exist in the cloud memo knowledge graph; and The step of storing the new usage record is to write the current retrieval usage record into the terminal usage record database in the form of a database as a new usage record; Wherein, in the step of comparing the knowledge graph of the memorandum of the terminal, if the name element and the relation element of the memo content to be queried already exist, read the corresponding target element of the memo content to be queried and generate a corresponding target element of the memo content to be queried. Message text, then perform the step of storing the new usage record, and convert the message text of the memo content to be queried into message voice and output, and then return to the step of receiving the command voice, if the name of the memo content to be queried does not exist elements and relational elements, continue to compare the cloud memorandum knowledge graph; Wherein, in the step of comparing the cloud memo knowledge graph, if the name element and relationship element of the memo content to be queried already exist, read the corresponding target element of the memo content to be queried, and generate a corresponding target element of the memo content to be queried. Message text, then perform the step of storing the new usage record, and convert the message text of the memo content to be queried into message voice and output, and then return to the step of receiving the command voice, if the name of the memo content to be queried does not exist element and relation element, generate query operation error message text, convert the query operation error message text into message voice and output, and then return to the step of receiving command voice. 8. The method for operating an intelligent voice interactive electronic memorandum according to any one of claims 1 to 7, further comprising a memo reminder program, the memo reminder program comprising: (a) send out messages according to preset time intervals; (b) reading a memo content in the terminal memo knowledge graph; (c) Parse the read memo content, and parse the memorandum content into name elements, relation elements, and target elements; (d) judging whether the content of the memorandum requires a voice reminder at this time, and if a voice reminder is required, convert the content of the memorandum into information voice and output; and (e) Repeat steps (b) to (d) until all the memo contents are processed. 9 . The method for operating an intelligent voice interactive electronic memorandum according to claim 1 , further comprising a program for synchronizing the memo from the terminal to the cloud, and the program for synchronizing the memo from the terminal to the cloud comprises: 10 . : (a) send out messages according to preset time intervals; (b) reading the content of a memo whose status is unsynchronized in the terminal memo knowledge graph; (c) Synchronize the content of the memorandum to the cloud memorandum knowledge graph; (d) set the status of the contents of the memo to synchronized; and (e) Steps (b) to (d) are repeated until all the memo contents whose status is unsynchronized are processed. 10 . The method for operating an intelligent voice interactive electronic memorandum according to claim 1 , further comprising a cloud-to-terminal memo synchronization program, the cloud-to-terminal memo synchronization program comprising: 11 . : (a) send out messages according to preset time intervals; (b) Read the content of a memo in the cloud memorandum knowledge graph; (c) Parse the reminder time of the read memo content; (d) judging whether the content of the memo has a reminder time and is within the valid time range, and if the content of the memo has a reminder time and is within the valid time range, synchronize the content of the memo to the terminal memo knowledge graph; (e) set the status of the contents of the memo to synchronized; and (f) Repeat steps (b) to (e) until all the contents of the memo have been processed. 11. The method for operating an intelligent voice interactive electronic memorandum according to any one of claims 1 to 7, further comprising a program for synchronizing the use records of the cloud and the terminal, and the cloud and the use records of the terminal are synchronized with each other. The program contains: (a) send out messages according to preset time intervals; (b) reading a usage record whose status in the terminal usage record database is unsynchronized; (c) Synchronize the usage record to the cloud usage record database; (d) delete the usage record in the terminal usage record database; and (e) Steps (b) to (d) are repeated until all usage records whose status is unsynchronized are processed. 12. A computer program product of an intelligent voice interactive electronic memorandum, characterized in that the computer program product comprises a computer-readable medium, and the computer-readable medium is used to store a computer program, and after the computer program is loaded and executed, The operation method of the intelligent voice interactive electronic memorandum according to claim 1 can be completed. 13. An intelligent voice interactive electronic memorandum system, characterized in that, comprising: A voice input unit to receive the user's voice and convert it into a voice signal; a terminal processing unit for executing the operation of the memorandum system, including a memorandum creation and query unit, a data access and synchronization unit, and a text-to-speech module; and The voice output unit is used to convert the voice signal into sound output; The memorandum establishment and query unit includes: A voice-to-text module, which is used to convert the voice signal of the voice input unit into text data; an arousing instruction judgment module for judging whether the text data of the speech-to-text module contains an arousing instruction, and the arousing instruction includes a first arousing word and a second arousing word; The interactive dialogue control module is used to control the interactive dialogue program between the memorandum system and the user, including making voice questions and receiving answer voices; The memo content parsing module is used to parse the name element, relation element, and target element of the memo content that the user wants to create or query; The memorandum confirmation module is used to confirm whether the content of the parsed memo to be created or to be queried is correct; Memorandum access module, used to control the procedure of storing and retrieving memorandum; The usage record module is used to control the program for storing usage records; an operation information generation module for generating operation information text; and Wherein the data access and synchronization unit includes: The first time counting module is used to send information according to the default time interval; The access policy module is used to execute the procedures of storing memos, retrieving memos, and storing usage records; The terminal memo knowledge graph is used to store the memo content; Terminal usage record database to store usage records; The terminal data access module is used to access the contents of the memorandum or use records; a terminal data synchronization module for synchronizing the terminal memorandum knowledge graph and the terminal usage record database with the cloud processing unit through the network; and The text-to-speech module is used for receiving the operation information text, converting it into a voice signal and sending it to the voice output unit. 14. The intelligent voice interactive electronic memorandum system according to claim 13, wherein the terminal processing unit further comprises: Memo reminder unit, which includes: The second time counting module is used to send information according to the default time interval; a comparison module for comparing the reminder time of the memo content in the memo knowledge graph of the terminal; and The reminder information generating module is used to generate reminder information text and transmit it to the text-to-speech module. 15. The intelligent voice interactive electronic memorandum system according to claim 13, wherein the cloud processing unit comprises: The cloud data access module is used to access the memo content or usage records; Cloud memo knowledge graph to store memo content; Cloud usage record database to store usage records; a cloud data synchronization module for synchronizing the cloud memorandum knowledge graph and the cloud usage record database with the terminal data synchronization module through the network; Data analysis application tools to analyze usage record data; and A data management system to manage the data of usage records.