KR20200081925A - System for voice recognition of interactive robot and the method therof - Google Patents

Abstract

The present invention discloses a voice recognition sympathetic robot, a sympathetic robot voice recognition system, and a method thereof. The voice recognition system of the sympathetic robot according to an embodiment of the present invention includes a voice data receiving unit that receives voice data transmitted from an external terminal, a text conversion unit that converts the voice data into text, and a keyword from the converted text. Keyword extracting unit for extracting, response text generating unit for extracting the response text corresponding to the extracted keyword from pre-stored metadata, a voice conversion unit for converting the response text into voice data, and the converted voice data to the outside It may include a transmitter for transmitting to the terminal.
In the sympathetic robot according to an embodiment of the present invention, a voice recognition button unit that receives a command for starting a voice input through a button operation, a voice input unit that receives a voice uttered by a user, and recording data of the input voice It includes a voice transmission unit for transmitting to the external system in the form of PCM data and a voice output unit for receiving and outputting response data from the external system.

Description

Voice recognition sympathetic robot, sympathetic robot voice recognition system, and method thereof{SYSTEM FOR VOICE RECOGNITION OF INTERACTIVE ROBOT AND THE METHOD THEROF}

The present invention relates to a speech recognition sympathetic robot, a speech recognition system of a sympathetic robot, and more particularly, to a system and method for recognizing a user's voice through a sympathetic robot and generating a corresponding event. It is about.

Robots and dolls that can interact with the user play an important role in educational development, such as intelligence development through imagination and creativity development, as infants and children play with them and master physical movement development and functions. Technology development is receiving great attention.

However, the existing robot or doll outputs limited sound or there is no motion, so it is difficult for the user to continuously draw new interest and interest.

Therefore, it is necessary to study a robot and a voice recognition system capable of recognizing and responding to the user's sound, but grasping the user's intention from the user's voice input and expressing the corresponding response.

Prior Art Document: Korean Registered Patent No. 10-1791942

The present invention minimizes the processing capability of the voice recognition sympathetic robot by receiving the user's voice through the voice recognition sympathetic robot and transmitting it to the server to analyze the user's voice and output a corresponding response voice, Provided is a voice recognition sympathetic robot, a sympathetic robot voice recognition system, and a method for reducing the cost.

The present invention transmits and processes the voice input to the voice recognition sympathetic robot to the server, but adjusts the MTU (Maximum Transmission Unit) unit to divide and transmit the data, thereby enabling high-speed voice recognition while using relatively low-spec hardware. Provided are a voice recognition sympathetic robot, a sympathetic robot voice recognition system, and a method.

The present invention connects to a server through wireless communication, analyzes a voice specialized for each user, and outputs a corresponding voice, thereby matching voice characteristics such as language habits of individual users to enable more accurate voice recognition. Provided is a robot voice recognition system and method.

The present invention converts the input voice into text and extracts keywords from the text, but extracts similar words and category attributes of the extracted keywords, so that voice recognition capable of generating response texts corresponding to the similar words and category attributes more effectively Provided is a sympathetic robot, a sympathetic robot voice recognition system, and a method thereof.

The voice recognition system of the sympathetic robot according to an embodiment of the present invention includes a voice data receiving unit that receives voice data transmitted from an external terminal, a text conversion unit that converts the voice data into text, and a keyword from the converted text. Keyword extracting unit for extracting, response text generating unit for extracting the response text corresponding to the extracted keyword from pre-stored metadata, a voice conversion unit for converting the response text into voice data, and the converted voice data to the outside It may include a transmitter for transmitting to the terminal.

According to an aspect of the present invention, a user management unit that receives a primary key that identifies a user of the external terminal and reads a setting value corresponding to the unique key may be further included.

According to an aspect of the present invention, the keyword extracting unit extracts a plurality of nouns existing in the converted text, generates a set of synonyms of the noun, and matches the extracted noun category to a preset category. Thus, it is possible to assign similar word sets and category attributes for each extracted keyword.

According to an aspect of the present invention, the response text generation unit extracts a set of related question lists corresponding to the set of similar words and the category attribute of each extracted keyword, and extracts a common question between the question lists. You can generate response text.

In the sympathetic robot according to an embodiment of the present invention, a voice recognition button unit that receives a command for starting a voice input through a button operation, a voice input unit that receives a voice uttered by a user, and recording data of the input voice It includes a voice transmission unit for transmitting to the external system in the form of PCM data and a voice output unit for receiving and outputting response data from the external system.

According to an aspect of the present invention, the output unit checks whether the delay value of each register of the voice codec is 0, and when it is not 0, calls a delay function for waiting for a setting operation of the voice codec to correspond to the delay value of each register You can give a waiting time.

The voice recognition method of the sympathetic robot according to an embodiment of the present invention includes receiving voice data transmitted from an external terminal, converting the voice data into text, and extracting keywords from the converted text, And extracting the response text corresponding to the extracted keyword from pre-stored metadata, converting the response text to voice data, and transmitting the converted voice data to the external terminal.

According to an embodiment of the present invention, by receiving a user's voice through a voice recognition sympathetic robot and transmitting it to the server, the server analyzes the user's voice and outputs a corresponding response voice, thereby Provided is a voice recognition sympathetic robot, a sympathetic robot voice recognition system, and a method for minimizing processing capacity and reducing cost.

According to an embodiment of the present invention, the voice input to the voice recognition sympathetic robot is transmitted to a server for processing, and data is divided and transmitted by adjusting a maximum transmission unit (MTU) unit, thereby using hardware with a relatively low specification. Provided are a voice recognition sympathetic robot, a sympathetic robot voice recognition system, and a method for enabling high-speed voice recognition.

According to an embodiment of the present invention, by connecting to a server through wireless communication and analyzing a voice specialized for each user and outputting a corresponding voice, a voice capable of more accurate voice recognition in accordance with characteristics of individual users' language habits, etc. A cognitive sympathetic robot, a sympathetic robot voice recognition system, and a method are provided.

According to an embodiment of the present invention, by converting the input voice to text and extracting keywords from the text, by extracting the similar words and category attributes of the extracted keywords, the response text corresponding to the similar words and category attributes more effectively A speech recognition sympathetic robot, a sympathetic robot speech recognition system, and a method are provided.

1 is a view showing the overall system and a system for generating an event for voice recognition by receiving a voice through a voice recognition sympathetic robot according to an embodiment of the present invention and transmitting it to a sympathetic robot voice recognition system. .
2 is a block diagram showing the detailed configuration of a sympathetic robot voice recognition system according to an embodiment of the present invention.
3 is a block diagram showing the detailed configuration of a voice recognition sympathetic robot according to an embodiment of the present invention.
4 is an operational flow diagram showing the flow of a sympathetic robot voice recognition method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the contents described in the accompanying drawings. However, the present invention is not limited or limited by the embodiments. The same reference numerals in each drawing denote the same members.

Conventionally, the technology of recognizing the user's voice through a robot, doll, etc. and outputting a response message to it does not accurately grasp the intention of the user's question through the user's voice. Accordingly, the response message also consists of simple messages, etc. There was a problem.

The present invention is an invention designed to solve the problems of the prior art, and the configuration of the present invention will be described in detail below.

1 is a view showing the overall system and a system for generating an event for voice recognition by receiving a voice through a voice recognition sympathetic robot according to an embodiment of the present invention and transmitting it to a sympathetic robot voice recognition system. .

Referring to FIG. 1, a user recognizes, questions, and emotions through the voice recognition sympathetic robot 200 after preparing a procedure for the voice recognition sympathetic robot 200 to communicate with the agent server using the connected smart device 300. When an expression message or the like is input through voice, the input voice data may be transmitted to the robot voice recognition system 100.

Thereafter, the robot voice recognition system 100 converts the voice data into text, extracts keywords, generates a response text corresponding to the extracted keywords, and transmits it to the voice recognition sympathetic robot 200, thereby The cognitive sympathetic robot 200 may output it through a speaker or the like to interact with the user.

At this time, the user can input a voice through the voice recognition sympathetic robot 200, and can confirm the response voice through the voice recognition sympathetic robot 200.

Hereinafter, detailed procedures and configurations for inputting a voice and generating a response text corresponding thereto will be described in more detail.

2 is a block diagram showing the detailed configuration of a sympathetic robot voice recognition system according to an embodiment of the present invention.

Referring to FIG. 2, the sympathetic robot voice recognition system 100 includes a voice data receiving unit 110, a text conversion unit 120, a keyword extraction unit 130, a response text generation unit 140, and a voice conversion unit 150 ) And the transmitter 160.

The voice data receiving unit 110 may receive voice data transmitted from an external terminal. That is, when the user's voice is recognized through the sympathetic robot 200 or the smart device 300 connected thereto, the voice data receiving unit 110 may receive and receive it.

At this time, the received voice data may be various types of data including PCM data.

For example, the sympathetic robot 200 may use Artik053, when the user's voice is recognized in the Artik053, it is transmitted to the voice data receiving unit 110, and the voice data transmitted in this process is greater than or equal to a set MTU value. In this case, it is divided into several packets and transmitted so that high-speed voice recognition can be supported through the sympathetic robot 200 using relatively low-spec hardware (ex. Artik053) as described above.

In addition, since low-end hardware such as Artik053 cannot install the SDK for using the API service, if the voice data is divided into small packets and delivered as described above, the part processed by the microphone input in the existing STT API through communication as above The received voice data can be converted into a received format, and through this, a streaming service for quickly converting voice to text can be provided even in low-spec hardware such as an embodiment of the present invention.

After receiving the voice data, the text conversion unit 120 may convert the voice data into text. At this time, since the sympathetic robot voice recognition system 100 has different language habits for each individual use, it receives a primary key that identifies a user of the external terminal to match the characteristics of the individual user, and the unique key A user management unit may be further included to read a setting value corresponding to.

That is, a user-customized voice recognition may be achieved by performing an optimized voice recognition and text conversion process for individual users by setting different voice recognition and text setting values for each user.

Meanwhile, in the Speech to Text (STT) process for converting voice to text, you can use APIs supported through the cloud, recognize more than 120 languages and dialects, and use real-time streaming or pre-recording using machine learning technology. Can process audio.

When the voice data is converted to text, the keyword extracting unit 130 may extract a key keyword from the converted text.

To this end, a plurality of nouns existing in the converted text are extracted, a set of synonyms of the noun is matched, and the category of the extracted noun is matched to a preset category, and the set of synonyms for each extracted keyword Category attributes can be assigned.

For example, if the sentence entered by the user is "I'm going on a picnic tomorrow", the nouns'Tomorrow' and'Excursion' included in the sentence are extracted, and'tomorrow' and'tomorrow', which are synonyms for'tomorrow'. ,'The next day', and the like, and a set of similar words is extracted, and'tomorrow' is a word representing time, so a'time word' can be assigned as a category attribute.

Also, in the case of'excursion', a set of similar words such as'picnic','outing' and'outing party' are extracted, and'excursion' is a word indicating action in the outdoors, so it is a category attribute. Word'.

Therefore, the response text generation unit 140 to be described below can more accurately grasp the user's intention using the similar word set and category attributes for the keyword and derive the corresponding response text.

Accordingly, in response to this, the response text generation unit 140 may extract the response text corresponding to the extracted keyword from pre-stored metadata.

To this end, the response text generation unit 140 extracts each set of related question lists corresponding to the similar word set and category attribute of each extracted keyword, and extracts a common question between the question lists to extract the response text Can generate

For example, if five questions are included in the set of question lists related to the extracted keyword'tomorrow', and seven questions are included in the set of question lists related to'excursion', the contents of the two question list sets overlap as much as possible You can extract a question and decide it as the text to respond to the user.

Accordingly, the voice conversion unit 150 may convert the determined response text into voice data.

Here, in the text to speech (TTS) process for converting text to speech, Using deep learning technology, you can synthesize sounds like a real person's voice, set various languages and voices, generate voices in a form similar to the user's language habits according to the user's settings, and create custom vocabulary. Alternatively, it may be generated by reflecting the pronunciation of a specific word according to the stored term (company name, acronym, foreign language, new word, etc.).

The transmitter 160 may transmit the converted voice data to the external terminal. At this time, the data to be transmitted can be transmitted as voice data in various formats, including the MP3 format.

As described above, by recognizing the voice using the sympathetic robot voice recognition system and generating the corresponding response text, it is possible to generate individual user-specific voice recognition and response text, and more accurately grasp the user's intention to meet this The effect of providing a response can occur.

Hereinafter, a configuration for receiving a voice through a voice recognition sympathetic robot, transmitting it to a sympathetic robot voice recognition system, and receiving and outputting response text (voice converted data) from the sympathetic robot voice recognition system will be described in more detail. do.

3 is a block diagram showing the detailed configuration of a voice recognition sympathetic robot according to an embodiment of the present invention. At this time, the voice recognition sympathetic robot 200 may include an ARTIK053 board as an example.

Referring to FIG. 3, the voice recognition sympathetic robot 200 may include a voice recognition button unit 210, a voice input unit 220, a voice transmission unit 230, and a voice output unit 240.

The voice recognition button unit 210 may receive a command for starting voice input through a button operation. That is, in the conventional case, voice input is started by detecting sound through a smart speaker or the like, but in one embodiment of the present invention, voice input is started only through a user's active operation, since a user has to operate a button. Since the user's voice conversation is not monitored until after, it can be managed so that the conversation is recorded regardless of the user's intention and not leaked to third parties.

The button is located on the hand portion of the sympathetic robot, and by providing the emotion of holding the robot's hand when the button is operated, the user can be set to feel more sympathetic with the robot.

The voice input unit 220 receives a voice uttered by a user, and when voice input is started through the voice recognition button, the user's voice may be input through a microphone input or the like.

The voice transmission unit 230 may transmit the recorded data of the input voice to an external system in the form of PCM data. That is, by transmitting data in the form of PCM data, data can be transmitted more effectively and without loss.

On the other hand, the voice transmission is the maximum datagram size value that can be sent without a segment on the network interface, and the maximum size that a packet can send at one time can be transmitted by setting the MTU size to 590. Since it can be divided into packets and transmitted, data can be transmitted more effectively.

When the voice output unit 240 receives the response data in the form of voice data from the external system, the voice output unit 240 may output the response data for the user to recognize through an output device such as a speaker.

Meanwhile, the voice output unit 240 may use the following method to minimize the delay that occurs when setting a codec used for voice output.

In the process of setting the codec register before using codec, the delay function is called to wait for the codec setting operation. As a result, script[i].delay has a waiting time. In practice, the script[i].delay value is 0. There are many. Therefore, in order to prevent the delay due to the time to call the script[i].delay function itself, check that the value of script[i].delay in each register is 0, and wait for the setting operation of the voice codec only when it is not 0. By calling the [i].delay function, a wait time corresponding to the delay value of each register can be assigned. Here, the member of script[i] is the register address, and script[i].delay corresponds to the delay value of each register.

As described above, through the sympathetic robot according to an embodiment of the present invention, an apparatus capable of minimizing the processing capability of the speech recognition sympathetic robot and reducing costs may be provided.

4 is an operational flow diagram showing the flow of a sympathetic robot voice recognition method according to an embodiment of the present invention.

On the other hand, in the following, it will be described as an example that the voice recognition sympathetic robot 200 has an ARTIK053 board and communicates with the voice recognition system 100 of the sympathetic robot through socket communication.

To this end, in step 410, voice data transmitted from an external terminal may be received.

That is, when a client (ARITK053) connects to the voice recognition system 100 server of the sympathetic robot through socket communication with the ARTIK053 board, User_info_check() for user identification is executed, and the user enters a primary key with a unique value. Can be distinguished through.

If the client information is passed along with the action_thread() call, the user's voice data (PCM data) can be brought to the server by using the corresponding client socket, using google_cloud_streaming().

Next, in step 420, the voice data may be converted into text. At this time, it can be converted to text through the Google cloud streaming Speech To Text API.

In step 430, a keyword may be extracted from the converted text, and in step 440, a response text corresponding to the extracted keyword may be extracted from pre-stored metadata.

In step 450, the response text may be converted into voice data, and in step 460, the converted voice data may be transmitted to the external terminal.

To this end, the response text is generated as an mp3 file of 1-Chenal, Mono, 22050HZ using the AWS Polly Text To Speech API, and the corresponding mp3 file is converted to 2-Channel Stereo 44000HZ using the FFmpeg module and delivered to the ARTIK053 board. This can proceed.

According to an embodiment of the present invention as described above, by receiving a user's voice through a voice recognition sympathetic robot and transmitting it to the server, the server analyzes the user's voice and outputs a corresponding response voice, thereby recognizing voice recognition. Provided is a voice recognition sympathetic robot, a sympathetic robot voice recognition system, and a method for minimizing the processing capability of a robot and reducing cost.

According to an embodiment of the present invention, by connecting to a server through wireless communication and analyzing a voice specialized for each user and outputting a corresponding voice, a voice capable of more accurate voice recognition in accordance with characteristics of individual users' language habits, etc. A cognitive sympathetic robot, a sympathetic robot voice recognition system, and a method are provided.

According to an embodiment of the present invention, by converting the input voice to text and extracting keywords from the text, by extracting the similar words and category attributes of the extracted keywords, the response text corresponding to the similar words and category attributes more effectively A speech recognition sympathetic robot, a sympathetic robot speech recognition system, and a method are provided.

In addition, according to one embodiment of the present invention, low power consumption and lightness are facilitated by using low-spec hardware, and the initial cost can be significantly lowered, and an effect that a user can be provided with a high-speed voice recognition service while moving is generated. Can be.

In addition, according to an embodiment of the present invention, the sympathetic robot voice recognition method may be recorded in a computer-readable medium including program instructions for performing various computer-implemented operations. The computer-readable medium may include program instructions, data files, data structures, or the like alone or in combination. The media may be program instructions specially designed and constructed for the present invention, or may be known and usable by those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs, DVDs, and magnetic media such as floptical disks. -Hardware devices specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language code that can be executed by a computer using an interpreter, etc., as well as machine language codes produced by a compiler.

As described above, although one embodiment of the present invention has been described by a limited embodiment and drawings, one embodiment of the present invention is not limited to the above-described embodiment, which is a general knowledge in the field to which the present invention pertains. Various modifications and variations can be made by those who have this description. Accordingly, one embodiment of the present invention should be understood only by the claims set forth below, and all equivalents or equivalent modifications thereof will be said to fall within the scope of the spirit of the present invention.

100: sympathetic robot voice recognition system
110: voice data receiving unit
120: text conversion unit
130: keyword extraction unit
140: response text generation unit
150: speech converter
160: transmitter
200: sympathetic robot
210: voice recognition button unit
220: voice input
230: voice transmission unit
240: audio output unit

Claims (7)

A voice data receiver configured to receive voice data transmitted from an external terminal;
A text conversion unit that converts the voice data into text;
A keyword extraction unit extracting keywords from the converted text;
A response text generator for extracting response text corresponding to the extracted keyword from pre-stored metadata;
A voice converter for converting the response text into voice data; And
A transmitter which transmits the converted voice data to the external terminal;
Speech recognition system of a sympathetic robot comprising a. According to claim 1,
A user management unit that receives a primary key that identifies a user of the external terminal and reads a setting value corresponding to the unique key
Voice recognition system of the sympathetic robot, characterized in that it further comprises. According to claim 1,
The keyword extraction unit,
Extracting a number of nouns existing in the converted text,
Generating a set of similar words of the noun and matching the extracted noun category to a preset category,
A speech recognition system of a sympathetic robot, characterized in that similar keyword sets and category attributes are assigned to each extracted keyword. According to claim 3,
The response text generation unit,
The sympathetic robot characterized in that each of the extracted keyword sets and associated question list sets corresponding to the keyword set and category attributes are extracted, and the common text between the question lists is extracted to generate the response text. Voice recognition system. A voice recognition button unit that receives a command for starting voice input through a button operation;
A voice input unit that receives a voice uttered by a user;
A voice transmission unit transmitting the recorded data of the input voice to an external system in the form of PCM data, and dividing and transmitting the data in units of a preset MTU; And
A voice output unit for receiving and outputting response data from the external system;
Sympathetic robot comprising a. The method of claim 5,
The output unit,
The sympathy characterized in that the delay value of each register of the voice codec is 0, and when it is not 0, a delay function for waiting for the setting operation of the voice codec is called to give a waiting time corresponding to the delay value of each register. Type robot. Receiving voice data transmitted from an external terminal;
Converting the voice data into text;
Extracting keywords from the converted text;
Extracting a response text corresponding to the extracted keyword from pre-stored metadata;
Converting the response text into speech data; And
Transmitting the converted voice data to the external terminal;
Speech recognition method of a sympathetic robot comprising a.

Images