WO2019106811A1

WO2019106811A1 - Query response system and query response method

Info

Publication number: WO2019106811A1
Application number: PCT/JP2017/043192
Authority: WO
Inventors: 明信船山; 輝栗原
Original assignee: 株式会社三井住友銀行
Priority date: 2017-11-30
Filing date: 2017-11-30
Publication date: 2019-06-06
Also published as: JPWO2019106811A1; JP6694069B2

Abstract

Provided is a query response system. This query response device receives an input, and generates a query telegram on the basis of the input to transmit the query telegram to a server computer. The server computer transmits a connection confirmation request telegram to a client computer, receives a connection confirmation response telegram including a first identifier from the client computer, identifies the query response device by using the first identifier, determines that a connection is established between the client computer and the query response device by determining whether the first identifier matches a stored second identifier, and generates a response telegram corresponding to the query telegram to transmit the response telegram to the query response device in response to the determination that the first identifier matches the second identifier. The query response device outputs the response telegram.

Description

Query response system and query response method

The present invention relates to a query response system and a query response method, and more particularly to a query response system and a query response method for responding to queries from a user in a secure manner.

There is known a query response system that recognizes a voice (utterance) uttered by a user and returns a voice response corresponding to the utterance. For example, Amazon (R) Echo analyzes speech from a user as an AI (Artificial Intelligence) speaker, and returns an appropriate voice response. Such an AI speaker learns how to respond to the user's speech and returns an appropriate response as the use is repeated.

An AI speaker can work in conjunction with an application that provides a particular service. The AI speaker selects an application based on a specific keyword in the utterance from the user (that is, implementing a process of returning an appropriate response to the user's utterance). The selected application executes a process of returning a response according to the utterance, and the AI speaker outputs the response in voice.

When cooperating with the application described above, the AI speaker needs to communicate with the computer device on which the application is implemented. Usually, when performing such communication, wireless communication such as WiFi is used. In the prior art, when performing wireless communication, the user is required to utter an authentication code. For example, when the user utters "Turn on TV", the AI speaker responds such as "Tell me PIN code" etc., and the user utters the PIN code, whereby the authentication is performed.

Japanese Patent Laid-Open No. 2000-099600

It is also conceivable to inquire about secret information including the balance of account information and the like from the above-mentioned AI speaker. In such a case, since secret information is to be exchanged, it is necessary to make a speech response via a method in which security is ensured, that is, predetermined authentication. As authentication methods in AI speakers, (1) authentication via an authentication code by speech, (2) biometric authentication of speech, and (3) two-path authentication in cooperation with a computer device of a mobile phone (such as a smartphone) are considered. Be

Authentication via the authentication code requires the user to utter the authentication code every time, which is inconvenient. In addition, since the authentication code is issued by voice, the authentication code may be leaked to a third party. The biometric authentication of the uttered voice is a voice biometric authentication method that determines whether the user is a valid person based on the voice. Voice biometric authentication is less accurate and less reliable than fingerprints and irises.

Two-pass authentication is an authentication method employed in online banking and the like. In this method, a transaction is established by creating transaction data at a first computer device of two interconnected computer devices and approving at a second computer device.

Such a scheme can ensure security, but requires operation by a user via a computer device and lacks convenience. In particular, in the AI speaker, as long as information is exchanged by voice, it is required to simplify human operations. This is useful, for example, when driving a car, when working in a kitchen, or when it is required to simplify the operation through a computer device.

Patent Document 1 discloses a technology for executing a bank transaction by voice according to voice from a customer. In the technique according to Patent Document 1, the user is identified by voice input of information such as an account number from a customer and a service code. Further, in the technology according to Patent Document 1, the identification is performed by comparing the voiceprint of the customer registered in advance with the voiceprint of the voice data uttered by the customer himself.

The technology according to Patent Document 1 uses (1) authentication through an authentication code by speech and (2) biometric authentication of speech. This technology does not solve the above-mentioned problems at all.

The present invention has been made in view of such problems, and an object thereof is to provide a query response system that returns a response to a query from a user in a security secured manner.

In order to solve the above problems, a query response system according to the present invention is a computer system comprising a server computer and a query response device, wherein the query response device receives an input and a query based on the input. A telegram is generated and transmitted to the server computer, the server computer transmits a connection confirmation request telegram to the client computer, receives a connection confirmation reply telegram including the first identifier from the client computer, and the first identifier A connection between the client computer and the query response device is established by identifying the query response device and determining whether the first identifier and the stored second identifier match. And the first identifier matches the second identifier. In response to determining that generates a response message corresponding to the query message sent to the query response device, wherein the query response device, and outputs the response message.

According to the query response system according to the present invention, it is possible to secure security when returning a response to a query from a user.

It is a figure showing an example of composition of the whole computer system which constitutes a query response system concerning one embodiment of the present invention. It is a figure which shows the example of the detailed structure of the computer system which comprises the query response system which concerns on one Embodiment of this invention. It is a figure which shows the example of the data structure of the user data table which concerns on the 1st Embodiment of this invention. It is a figure which shows the example of the data structure of the account data table which concerns on the 1st Embodiment of this invention. It is a figure which shows the example of the process which the query response system which concerns on the 1st Embodiment of this invention performs. It is a figure which shows the example of the relationship between the keyword contained in the speech which concerns on the 2nd Embodiment of this invention, and identification object. It is a figure which shows the example of the process which the query response system which concerns on the 2nd Embodiment of this invention performs. It is a figure which shows the example of the data structure of the user data table which concerns on the 2nd Embodiment of this invention.

Hereinafter, the query response system according to the present invention will be described in detail with reference to the attached drawings. The query response system according to the present embodiment provides a specific application service via a response to a query from a user. FIG. 1 is a diagram showing an example of the overall configuration of a computer system that constitutes a query response system according to an embodiment of the present invention. In the embodiment described below, the query response system according to the present invention is described as an example in which a response is returned in the form of voice (that is, voice output) in response to an utterance from the user Do.

The query response system comprises a server computer 1, a query response device 2, and a client computer 3. The server computer 1 and the query response device 2 and the client computer 3 are connected via the network 4 (a public network such as the Internet), and the connection method may be either wired or wireless. The query response device 2 and the client computer 3 are connected by a connection method in accordance with a short distance wireless communication standard such as Bluetooth (registered trademark).

The server computer 1 is a server computer device that provides application services to users. The server computer 1 executes an application program corresponding to the application service to be implemented in response to a query (speech) from the user through the query response device 2, and generates a response message corresponding to the speech. The response message is sent to the query response device 2.

The server computer 1 may be implemented by a single device or may be implemented by a plurality of devices. Also, the server computer 1 may be implemented by a plurality of devices each implementing a different service. In this case, the query response device 2 recognizes an utterance from the user (for example, based on a specific keyword in the utterance), and selects a server computer 1 implementing an application service corresponding to the utterance.

The query response device 2 is a speaker device with a learning function that responds with speech in response to speech from the user. The query response device 2 connects with the client computer 3 (via Bluetooth connection) by detecting that the client computer 3 is within a certain range. Then, when the user utters, the voice is recognized, a query message corresponding to the utterance is transmitted to the server computer 1, a response message corresponding to the query message is received, converted to voice, and voice output is performed. That is, the query response device 2 selects the server computer 1 which returns a response corresponding to the speech from the user, and functions as an intermediary device which outputs the response from the server computer 1 as voice. The query response device 2 may also be implemented by a single device or by multiple devices.

The client computer 3 is a computer device used to authenticate a user. When establishing the connection with the query response device 2, the client computer 3 transmits connection information to the server computer 1. The server computer 1 confirms the connection between the client computer 3 and the query response device 2 to authenticate the user. In the present embodiment, the client computer 3 is assumed to be a mobile phone including a smartphone, but is not limited to such a device, and it is a computer device having a short distance wireless communication function (in particular, a Bluetooth connection function) Especially, the equipment is not limited. For example, it may be a wearable device (smart watch and smart glass) worn by a user on clothes or the like.

Next, with reference to FIG. 2, an example of a detailed configuration of a computer system constituting the query response system according to an embodiment of the present invention will be described. As shown in FIG. 2, the server computer 1 includes a control unit 11, a memory 12, a storage unit 13, and a communication unit 14. These components are mutually connected via a bus.

The controller 11 may be implemented by a processor or the like, and may include a central processing unit (CPU), a graphic processing unit (GPU), and / or one or more processor cores. The server computer 1 implements a DBMS (Database Management System), and the control device 11 executes programs implementing an OS (Operating System), application programs implementing an application service, and programs implementing a DBMS. . The memory 12 functions as a volatile storage area, and may include, for example, random access memory (RAM), dynamic RAM, or cache memory. The control device 11 reads the program described above into the memory 12 and executes the program.

The storage device 13 is a storage device built in the server computer 1 and may include, for example, a hard disk drive, a solid state drive, an optical disk, and a flash drive. The storage device 13 stores the above-described program and a database table 13a such as a supply destination data table described later. The communication device 14 is implemented by, for example, a network interface card (for example, a LAN card) and transmits and receives data between the query response device 2 and the client computer 3 via the network 4.

The query response device 2 includes a control unit 21, a memory 22, a storage unit 23, a communication unit 24, an input driver 25, a microphone 26, an output driver 27, and a speaker 28, whose components are mutually coupled via a bus. It is done.

The control device 21 is implemented by a CPU or the like as in the server computer 1. The control device 21 implements a program for implementing the OS, a program for implementing a codec that encodes audio signals into digital data and decodes the digital data into audio signals (codec program), and a program for implementing a learning function (learning program) Are read into the memory 22 and executed. Note that the learning function may be implemented using known techniques, such as neural network models.

Similar to the server computer 1, the storage device 23 is a built-in storage device including a hard disk drive and the like, and stores learning data accumulated according to a neural network model or the like. The communication device 24 includes a wireless LAN card, a Bluetooth adapter, and the like. The communication device 24 transmits and receives data to and from the server computer 1 via the network 4, and transmits and receives data to and from the client computer 3 via a Bluetooth connection.

The microphone (input device) 26 receives an utterance by the user via the input driver 25. The received speech is encoded by the control device 21 (codec) and converted into a query message. The speaker (output device) 28 outputs the voice signal converted from the response message received from the server computer 1 as voice. The response message is decoded by the control device 21 (codec) and transmitted to the speaker 28 via the output driver 27.

The client computer 3 has a communication device and a control device (not shown). The communication device transmits / receives data to / from the server computer 1 via the network 4 and transmits / receives data to / from the client computer 3 via the Bluetooth connection. The control device executes a client application program corresponding to the OS and an application program executed by the server computer 1. The client application program is downloaded from the server computer 1 in advance.

Next, an example of the data structure of the user data table 300 according to the embodiment of the present invention will be described with reference to FIG. In the present embodiment, the application service provided by the server computer 1 will be described as the Internet banking service. On that premise, the utterance from the user relates to the inquiry about the balance of his account, and the response to it relates to the balance. The user data table 300 is a data table used for authenticating the user with respect to the inquiry about the balance among the database tables 13 a stored in the storage device 13 of the server computer 1.

As shown in FIG. 3, the user data table 300 includes data items “user ID”, “client computer notification ID”, “used device name”, and “valid flag”. Each data record is generated for each user. As the user ID, a unique identifier is set for each user in an application service (hereinafter, "application service") implemented by the server computer 1. The client computer notification ID is an ID by which the server computer 1 identifies a transmission destination for transmitting a connection confirmation request message described later to the client computer. The name (for example, model number etc.) of the query response device 2 which a target user uses is set as a utilization device name. That is, the target user and the query response device 2 to be used are stored in association with each other. The validity flag is set to a value indicating whether the service responding to the inquiry about the balance is valid, and is, for example, "1: valid" or "2: invalid".

The data record of the target user in the user data table 300 is generated (added), for example, when the target user registers in the application service. When the user registers with the application service, a unique user ID is assigned and logs in with a predetermined authentication (such as a password). The user ID assigned at this time is set in the target data record of the user data table 300.

Further, a connection confirmation request message for performing connection confirmation, which will be described later, is transmitted, for example, using a push notification service of the OS mounted on the server computer 1. The push notification service uses, for example, “APN (Apple Push Notification Service)” when the client computer 3 implements iOS (registered trademark) and “GCM (Google Google) when Android (registered trademark) is installed. Use Cloud Messaging). Therefore, the ID assigned when the user registers in the push notification service is set in the target data record of the user data table 300 (client computer notification ID).

The above-described push notification service is merely an example, and is not limited to the above example. Any method by which the server computer 1 can transmit a connection confirmation request message to the client computer 3 may be used.

In Bluetooth connection, pairing needs to be performed between two devices (devices compatible with Bluetooth connection). When the two devices are within the communicable range, the presence of the other device is detected mutually and the device name of the object is recognized. Thereafter, when a PIN code is input in any device, pairing is completed, and pairing information is stored in both devices (such as the device name of the other device). The client computer 3 and the query response device 2 are paired in advance, and the device name of the query response device 2 is set to the use device name of the user data table 300 (that is, the client computer 3 and the query response device The pairing information with 2 is registered in the user data table 300).

In Bluetooth connection, two devices emit radio waves in the 2.4 GHz band defined by IEEE (Institute of Electrical and Electronics Engineers) 802.15.1 and communicate in a range of several meters to several tens of meters. That is, communication between the client computer 3 and the query response device 2 is effective only when both are in the range of several meters to several tens of meters.

Next, with reference to FIG. 4, an example of the data structure of the account data table 400 according to the embodiment of the present invention will be described. The account data table 400 is a data table storing account information for each user among the database tables 13a stored in the storage device 13 of the server computer 1 necessary for implementing the above-described service.

As shown in FIG. 4, the account data table 400 includes data items "user ID", "account number", "financial institution code", "branch code", "account type", "nominee", "balance", And "limit amount". Each data record is generated for each user who uses the Internet banking service described above. That is, each user who uses the application service according to the present embodiment is generated as a pair with the data record of the user data table 300 described in FIG. The limit amount is set to a predetermined value when limiting the response to the inquiry about the balance described later.

First Embodiment
Next, processing performed by the query response system according to the first embodiment of the present invention will be described with reference to FIG. In this process, the user A utters the query response system to inquire about its balance, and a response relating to the balance is audibly returned. It is assumed that the account information of the user A is registered in the account data table 400.

Also, communication between the client computer 3 and the query response device 2 is performed by Bluetooth connection, pairing is already performed between the two, user ID of the user A, use device name, and client computer notification It is assumed that the ID is registered in the user data table 300. In such a state, when the client computer 3 enters a range in which a Bluetooth connection can be made with the voice compatible device, the connection state is automatically established.

The process executed by the server computer 1 in the process described in FIG. 5 is implemented by the control device 11 of the server computer 1 executing an application program. Also, the processing executed by the query response device 2 is implemented by the control device 21 of the query response device 2 executing a codec program, a learning program, and the like. Furthermore, the processing executed by the client computer 3 is implemented by the control device of the client computer 3 executing the client application program.

First, in step S501, the communication device 24 of the query response device 2 detects the presence of the client computer 3 (or the client computer 3 detects the presence of the query response device 2). The process of this detection is executed by the query response device 2 detecting the radio wave emitted by the client computer 3. When the query response device 2 detects the presence of the client computer 3 in step S501, a connection between the two is established, and the client computer 3 can recognize the device name of the query response device 2.

Next, the user A utters, for example, "Please tell me the balance of the account" to the query response device 2 (step S502). Next, when the microphone 26 of the query response device 2 receives the speech in step S502 and converts it into an audio signal, the microphone 26 transmits the speech signal to the control device 21. The control device 21 converts the voice signal into digital data, and analyzes the keyword included in the digital data (that is, analyzes the speech of the user A) (step S503). The analysis of keywords is performed by extracting keywords in the speech converted to digital data. The keyword extraction is performed using known feature word extraction algorithms such as, for example, TF-IDF (Term Frequency-Inverse Document Frequency) and SVM (Support Vector Machine).

As a result of this analysis, an application service corresponding to the analyzed keyword is specified according to learning data such as a neural network (step S504). In the present embodiment, for example, data in which a keyword such as “balance” and the Internet banking service are associated is stored in the learning data. When the utterance from the user includes the keyword "balance", the control device 21 specifies the server computer 1 providing the internet banking service.

Next, the control device 21 generates a query message, and the communication device 24 transmits it to the server computer 1 identified in step S504 (step S505). The query message includes at least information indicating the type of request by the user A of the client computer 3 acquired in step S501. The type of request is stored in the learning data in association with a predetermined keyword. For example, the keyword “balance” is associated with an inquiry request regarding the balance.

Next, when the communication device 14 of the server computer 1 receives the query message transmitted in step S505, the control device 11 acquires a target data record from the user data table 300 (step S506). Then, the control device 11 generates a connection confirmation request message for confirming whether a connection is established between the client computer 3 and the query response device 2. Then, the communication device 14 transmits a connection confirmation request message with the client computer notification ID included in the user data record acquired in step S506 as the destination (that is, the client computer 3) (step S507). The connection confirmation request message is transmitted using the above-described push notification service or the like.

Next, when the client computer 3 receives the connection confirmation request message transmitted in step S507, the client computer 3 generates a connection confirmation response message and transmits it to the server computer 1 (step S508). The connection confirmation response message includes at least the device name of the query response device 2 acquired in step S501.

When the client computer 3 receives the connection confirmation request message in step S508, the client application program needs to be executed on the client computer 3. When the client application program is not executed, the OS of the client computer 3 may start the client application program. When starting the client application program, the target application can be identified by referring to the port number of the connection confirmation request message (the port number is associated with the port number assigned to the application program of the server computer 1) ).

Next, when the communication device 14 of the server computer 1 receives the connection confirmation response message transmitted in step S508, the control device 11 determines that the device name (first identifier) included in the connection confirmation response message is in step S506. It is determined whether or not the used device name (second identifier) included in the user data table acquired in step S2 matches (step S509). In this process, if the used device name included in the user data record matches the device name included in the connection confirmation response message, connection is established between the client computer 3 and the query response device 2 corresponding to the target device name. Can be confirmed. That is, it can be confirmed that the speech from the user A is a user having the client computer 3 connected to the target query response device 2, and consequently, the identity of the user A can be confirmed.

If the connection between the query response device 2 and the client computer 3 can not be confirmed in the process of step S 509, the server computer 1 may notify the target user to urge the connection. Specifically, the communication device 14 of the server computer 1 sends a predetermined message to the query response device 2 and / or the client computer 3. The query response device 2 and / or the client computer 3 outputs the transmitted message in a predetermined format such as audio or visual display.

Next, the control device 11 executes processing in accordance with the type of request included in the query message transmitted in step S505. In the present embodiment, since the type of request is an inquiry request regarding balance, the control device 11 acquires the target data record from the account data table 400 based on the user ID included in the data record acquired in step S506. (Step S510). When acquiring the data record, the control device 11 generates a query response message based on the acquired data record, and the communication device 14 transmits it to the query response device 2 (step S511). The query response message includes at least the balance included in the data record acquired in step S510.

Next, when the communication device 24 of the query response device 2 receives the query response message transmitted in step S511, the control device 21 converts the query response message into an audio signal (step S512). The converted audio signal is output as audio through the speaker 28 via the output driver 27 (step S513). For example, the voice output is "The balance is 1,029,389 yen."

If the device names do not match in step S509, that is, the identity of the user A can not be confirmed, and a message notifying that effect is notified, the process of step S510 is performed after a predetermined time has passed since the notification. An error response is returned without being executed. In this case, in step S511, an error response message indicating that the identity verification could not be made is generated, and that effect is voice-outputted through the processing in steps S512 and S513. For example, the voice output is "I can not answer because I could not confirm my identity."

The error response described above may also be applied when the balance included in the data record of the account data table 400 acquired in step S510 exceeds the limit amount. This makes it possible to limit the response to the inquiry when the user has a balance exceeding a certain amount.

The server computer 1 notifies the client computer 3 that there is an inquiry about the balance from the user A at any time after the process of step S 505 (that is, any after the user A has made an inquiry about the balance). It may be sent (eg, in the form of an email). This process allows the user A to confirm that an attempt has been made by a third party to make an inquiry regarding a balance inquiry.

In addition, a notification indicating that the user A has responded to the inquiry about the balance is transmitted to the client computer 3 at any time after the process of step S 509 (that is, any one after the user A's identity verification is successful). It is also good. Furthermore, if identity verification fails in the process of step S509, a notification may be sent to the client computer 3 indicating that identity verification could not be performed in response to the inquiry regarding the balance from the user A, in any of subsequent processes. . With any of the processes, the user A can confirm that the identification of the third party's inquiry about the balance is successful or unsuccessful.

In addition, the user A can invalidate the function of the inquiry about the balance described above through the operation of the client computer 3. For this invalidation, the valid flag included in the target data record of the user data table 300 through the operation of the client computer 3 is updated to “2: invalid”. By this processing, the control device 11 can return an error response to the query response device 2 by setting the value set in the valid flag in the processing after step S508 described above.

As described above, the query response system according to the first embodiment of the present invention has been described. According to the query response system according to the present embodiment, user authentication can be performed without requiring an utterance or input of a PIN code or the like, and security can be secured in exchange of secret information such as a balance. Further, since the response is returned via the Bluetooth connection between the client computer 3 and the query response device 2, at least the client computer 3 is not returned from the query response device 2 as a response. Thus, for example, it is possible to prevent a third party computer device from tapping the balance by remote control or the like via the network.

In addition, since the Bluetooth connection between the client computer 3 and the query response device 2 is a condition, even if one of the devices is stolen etc., it is possible to prevent eavesdropping by a third party unless both devices are aligned. can do.

Furthermore, security can be further enhanced by implementing the client computer 3 with a computer device with a lock function. On the other hand, when the client computer 3 is implemented by a wearable device, the query response system according to the present invention can be used without requiring an operation by the user. In the wearable device, when the user wears the device, the lock is released (by the internal sensor detecting the contact state between the user and the device), the user performs an operation to release the lock. It is because it is not necessary.

In the first embodiment, the connection between the client computer 3 and the query response device 2 is described as being established according to the Bluetooth communication standard, but the present invention is not limited to such a format. Any communication method may be adopted which performs a procedure equivalent to pairing similar to Bluetooth. In this case, at the time of the first inter-device connection, both sides hold information identifying the other device, and the subsequent communication is that the communication is encrypted by the secret key when both devices are within the predetermined range. Become. The same applies to the second embodiment described below.

In addition, even when using a communication method other than Bluetooth, in order to ensure security by restricting the use of the query response system according to the present embodiment within a certain range, a communication method of near field wireless connection is used. It is desirable to do. For example, near-field wireless communication using ZigBee or infrared light is used.

Second Embodiment
Next, processing performed by the query response system according to the second embodiment of the present invention will be described with reference to FIGS. 6 and 7. FIG. 6 shows that there are a plurality of identification targets identified based on the keyword in the utterance from the user, and each identification target is identified based on the corresponding keyword. That is, based on one or more keywords included in the utterance, a plurality of different identification targets such as the application service and the user are determined.

In the present embodiment, the identification target includes the application service provided to the user, that is, the application service is identified based on the first keyword in the speech from the user (in the present embodiment, the Internet banking service). Further, the identification target includes the type of the request by the user, and the type of the request is identified based on the second keyword in the utterance from the user (in the present embodiment, the inquiry about the balance). Furthermore, the identification target includes the inquired user, that is, the inquired user is identified (authenticated) based on the third keyword in the speech from the user.

In the example shown in FIG. 6, it is assumed that the utterance from the user is "Smith, tell me the account balance of the ○○ bank." Then, the keyword “○○ bank” in this utterance is the first keyword, and is associated with the Internet banking service in the present embodiment. That is, the query response device 2 selects the server computer 1 that provides the target internet banking service, in response to the determination that the “soo bank” is included in the speech from the user. The association (first correspondence relationship) between the first keyword and the application service is stored in learning data.

The keyword "balance" in the utterance is the second keyword, and is associated with the processing request for the balance related inquiry in the present embodiment. That is, the query response device 2 generates a query message including information indicating that it is an inquiry request regarding the balance, in response to the determination that the “speech” is included in the utterance from the user. The association (second correspondence relationship) between the second keyword and the processing request is stored in learning data.

The keyword "Smith" in the utterance is the third keyword, and is associated with the inquired user in the present embodiment. This keyword is included in the query message sent from the query response device 2 and the server computer 1 authenticates the user based on this keyword.

Next, processing performed by the query response system according to the second embodiment of the present invention will be described with reference to FIG. The second embodiment has a portion in which the processing overlaps with the first embodiment, so only the different portion will be described. Among the processes of the steps in FIG. 7, the processes of the steps shown in Table 1 below correspond to the processes of the steps described in FIG.

In step S702, the user A utters, for example, "Smith, tell me the account balance of the bank OO." To the query response device 2. In step S704, the control device 21 of the query response device 2 specifies the corresponding application service from the keyword analyzed in step S703 according to the first correspondence stored in the learning data. That is, in response to having determined that the first keyword "○○ bank" is included in the speech from the user A, the server computer 1 providing the internet banking service is specified.

In step S705, the control device 21 determines the type of request from the user A according to the second correspondence relationship stored in the learning data, from the keyword analyzed in step S703. Then, a query request including information indicating the type of the request and the keyword analyzed in step S703 is generated. The query message is transmitted to the server computer 1 by the communication device 24.

In step S706, the control device 11 of the server computer 1 acquires the target data record from the user data table 300. Referring to FIG. 8, the data structure of the user data table 800 in the second embodiment will be described. An example will be described.

As shown in FIG. 8, the user data table 800 according to the second embodiment includes an authentication keyword in addition to the data items included in the user data table described in FIG. 3. The authentication keyword is set by the user to an arbitrary keyword value.

Referring back to FIG. 7, in step S709, in addition to the device name included in the data record acquired in step S706, it is determined whether the keyword set in the authentication keyword is included in the query message transmitted in step S705. . That is, it is determined whether the speech from the user A includes a preset keyword. By this process, the user A can be authenticated by setting a predetermined keyword in advance and including the keyword in the utterance.

In the present embodiment, the determination of the third keyword match is executed in the server computer 1, but the present invention is not limited to such a format. For example, the query response device 2 may determine whether the authentication keyword set in the dialog from the user is included. In this case, the correspondence between the device identifier such as the BD address obtained from the client computer 3 and the keyword is stored in the learning data of the query response device 2, and the keyword included in the dialog from the user is determined according to the learning data.

As described above, the query response system according to the second embodiment of the present invention has been described. According to the query response system according to the present embodiment, secret information can be exchanged in a system in which security is further ensured. Also, as in the method described in the first embodiment, user authentication can be performed without requiring an operation by the user.

<Other Embodiments>
In addition to the configuration described above, the response to the speech from the user may be limited by determining whether the client computer 3 is within a predetermined position range. The specific example of the process in this case is shown below.

As a premise, the connection confirmation response message transmitted from the client computer 3 in step S 507 (in the second embodiment, step S 707) described in FIG. 5 includes the position information of the client computer 3. In this case, the client computer 3 needs to have a GPS receiver, and the position information is generated based on the GPS signal received from the satellite by the GPS receiver.

Further, position information indicating a predetermined range is stored in the above-described user data table 300 (in the second embodiment, the user data table 800). Then, the server computer 1 determines whether the position information included in the connection confirmation response message transmitted from the client computer 3 is within the range of the position information included in the target data record of the user data table 300.

According to the query response system according to the present embodiment, the response to the utterance is not output in voice only within the range designated by the user. This is because, for example, even if both the query response device 2 and the client computer 3 are stolen etc., it is restricted to use only at the designated position, so that a third party eavesdrops on the balance. It can prevent the act.

In the above embodiment, an example is described in which the query response device 2 returns a response in the form of voice in response to a query from a user uttered (that is, voice). However, the present invention is not limited to such embodiment. For example, the query from the user may include input from the user on any medium other than voice. The returned response may also include the output of the response on any medium other than voice. In any case, the query response device 2 will be implemented as a multimedia response device that accepts input on media other than voice and outputs a response.

The input from the user may be, for example, pressing of a physical button provided on the query response device 2, touch operation on a touch screen (touch and slide, etc.), tactile operation on the entire query response device 2, and the query response device 2. It may include input on any medium, such as visual input of

The tactile operation on the entire query response device 2 may include, for example, an operation of tilting and / or moving the query response device 2 in a predetermined direction. Both operations are determined by the query response device 2 detecting the angular velocity and acceleration of the tilt and movement of the device. With regard to any of the tilt and movement of the device, the combination of a predetermined direction, a predetermined distance, and / or a predetermined speed may be associated with the content of the query, and the query response device 2 may determine the query. For example, the operation in which the user tilts the query response device 2 45 degrees to the right corresponds to a query for inquiring the balance of the account.

The visual input to the query response device 2 is, for example, an operation in which the user or a part of the user (such as a face) approaches a predetermined range of the query response device 2 and an operation in which the predetermined color and brightness are held over the query response device 2 Etc. may be included. Both actions are determined by detecting the proximity of the query response device user to the device, light, and the like. For any of these operations, the query response device 2 may determine the query, with predetermined proximity, color and / or intensity combinations associated with the content of the query. For example, an operation in which the user wears black clothes and approaches within 50 cm of the query response device 2 corresponds to a query for querying the balance of the account.

In any of the above cases, the query response device 2 includes a touch screen and a camera as input devices, and includes a proximity sensor, an acceleration sensor, an angular velocity sensor, an optical sensor and the like as detection elements.

The output of the response may include, for example, an output on any medium, such as a visual display on the display of the query response device 2. In this case, the query response device 2 includes a display or the like as an output device.

The query input described above may be accepted by the client device 3 instead of the query response device 2. For example, when the client computer 3 detects a tilt operation or the like, a value (angular velocity or the like) corresponding to the operation may be transmitted to the query response device 2, and the query response device 2 may determine the query content corresponding to the operation. Also, the client computer 3 may determine the contents of the query.

The response output may also be output by the client device 3 instead of the query response device 2. For example, when the query response device 2 generates a response, the response may be transmitted to the client computer 3 and displayed on a display or the like.

Furthermore, in the above embodiment, an example in which pairing information of a single query response device 2 and a single client computer 3 is registered in the server computer 1 has been described, but the pairing information associates a plurality of pairs. May be registered. For example, N client computers 3 may be associated with M query response devices 2 and registered in the user data table 300 or 800.

An example in which each of two client computers 3 is paired with the query response device 2 will be described. In this example, client computer notification IDs of both of the two client computers 3 are registered in the user data table 300 or 800 in association with the user ID and the use device name. In the authentication process, a connection confirmation request message is sent from the server computer 1 to both of the two client computers 3, and it is confirmed whether both are connected to the query response device 2.

With such a configuration, for example, even if one of the two client computers 3 and the query response device 2 is stolen or the like, eavesdropping by a third party can be performed unless the three devices are aligned. It can be prevented. As a result, security can be further strengthened.

All the configurations described in the above embodiments are merely illustrative, and the present invention is not limited to such configurations. For example, in the present embodiment, although the response to the utterance is output by the server computer 1 and the query response device 2 cooperating with each other, the above process may be implemented by a single computer device on which a speaker is implemented. Also, some of the processing performed by the server computer 1 described above may be performed by the query response device 2 without departing from the basic concept of the present invention, and vice versa .

In addition, although the query response device described above (that is, the device on which the speaker and the microphone are mounted) has been described as being implemented as an AI speaker, the query response device does not necessarily have to have a learning function. When a query response device is implemented without having a learning function, a correspondence relationship in which a predetermined keyword is associated with request processing and the like is stored, and processing is executed according to the correspondence relationship.

The data structures, such as user data table 300 described above, are exemplary only, and may include other necessary data items, and may be alternative without departing from the basic concept of the present invention. Data tables may be used. In addition, the order of the processes described in the above embodiment need not necessarily be performed in the order described, and may be performed in an arbitrary order. Furthermore, additional steps may be added newly or the described steps may be omitted without departing from the basic concept of the present invention.

1 server computer 2 query response device 3 client computer 4 network 300 user data table 400 account data table 800 user data table A user

Claims

A computer system comprising a server computer and a query response device, comprising:
The query response device receives an input, generates a query message based on the input, and sends it to a server computer.
The server computer is
Send a connection confirmation request message to the client computer,
Receiving a connection acknowledgment message including a first identifier from the client computer, the first identifier identifying the query response device;
Determining that a connection between the client computer and the query response device has been established by determining whether the first identifier and the stored second identifier match;
In response to determining that the first identifier and the second identifier match, a response message corresponding to the query message is generated and transmitted to the query response device.
The computer system, wherein the query response device outputs the response message.
The computer system according to claim 1, wherein the first identifier is obtained by the client computer by the query response device detecting that the client computer is within a predetermined range.
The computer system according to claim 1 or 2, wherein a connection between the client computer and the query response device is established according to a Bluetooth communication standard.
A method performed by a computer system comprising a server computer and a query response device, the method comprising:
The query response device receiving an input, generating a query message based on the input and sending it to a server computer;
The server computer is
Sending a connection confirmation request message to the client computer;
Receiving from the client computer a connection acknowledgment message including a first identifier, wherein the first identifier identifies the query response device;
Determining that a connection between the client computer and the query response device has been established by determining whether the first identifier and the stored second identifier match.
Generating a response telegram corresponding to the query telegram in response to determining that the first identifier and the second identifier match, and transmitting the response telegram to the query response device;
And D. the query response device outputting the response message.
A computer program comprising computer executable instructions, wherein the computer executable instructions, when executed by a computer, cause the computer to perform the method of claim 4.