JP2019139758A - System and method for conducting transaction - Google Patents

Abstract

To provide a payment system that is convenient and also secure and efficient and prevents shoppers from finding it troublesome to make payments using electronic devices in physical retail stores.SOLUTION: A method for assisting in a transaction in a transaction conducting system comprises: pairing a multi-sensory interactive point-of-sale terminal with a mobile device at a first time point; receiving a transaction selection; and processing a payment at a second time point.SELECTED DRAWING: Figure 2

Description

  While the present invention is primarily concerned with systems and methods for executing transactions, it is not exclusive.

  Physical retailers are facing intense competition from e-commerce. In competition, retailers must be competitive and successful by applying innovative solutions to their businesses.

  To attract shoppers, retailers invest considerable resources in in-store customer service. However, hiring in-store employees increases the overhead cost of store operations. To reduce such costs, retailers use technology. For example, stores receive orders and payments from shoppers using electronic devices.

  However, shoppers often find it cumbersome to pay using electronic devices. It is also an issue to provide a convenient, safe and efficient payment system. Currently, there are problems with making payments using electronic devices. Because they interfere with the shopping experience.

  Accordingly, there is a need to provide a transaction execution system and method that addresses at least one of the above problems and provides a useful alternative.

According to the first aspect of the present invention,
A method for executing a transaction,
Pairing a multi-sense interactive point-of-sale terminal with a mobile device at a first point of time, comprising:
Receiving a transaction initiation instruction including customer identification data and an identifier associated with the multi-sense interactive point-of-sale terminal;
Transmitting authentication information to a mobile terminal registered with the customer based on the received identification data; and
Receiving a transaction selection;
Processing a payment at a second time, wherein the transaction selection occurs between the first time and the second time;
Receiving a settlement request for the payment of the transaction, wherein the settlement request includes a sensed authentication input;
Approving the transaction based on a comparison between the received sensed authentication input and authentication information transmitted to the registered mobile terminal;
Is provided.

  The authentication information and the sensed authentication input may include one or more of alphabetic and numerical data, numerical values, gestures, images, facial expressions, and utterances.

The method further includes using a display screen of the multi-sensing interactive point-of-sale terminal to display a list of products that can be purchased;
Receiving the transaction selection via the display screen, wherein the transaction selection includes a selection of one or more items;
including.

  Receiving the payment request may include receiving the authentication input provided on the display screen.

Receiving the payment request includes:
Receiving the utterance using a microphone of the multi-sensing interaction point-of-sale terminal;
Processing the utterance into machine-readable data to determine text of the utterance.

Receiving the payment request includes:
Using the imaging device of the multi-sensing interaction point-of-sale terminal to capture a gesture image presented to the multi-sensing interaction point-of-sale terminal;
Processing the image into machine readable data to determine the gesture.

  The transaction start instruction may be received via an Internet network.

  The identifier associated with the multi-sense interactive point-of-sale terminal may include a barcode.

  The authentication information may be transmitted via a telephone network.

Sending the authentication information includes:
Encoding the authentication information into a barcode;
Transmitting the encoded barcode to the registered mobile terminal.

  Receiving the payment request may include scanning the encoded barcode using a barcode reader of the multi-sense interactive point-of-sale terminal.

  The multi-sensing interactive point-of-sale terminal may be a humanoid robot configured to engage in interactive operations.

According to the second aspect of the present invention,
A computer system for executing a transaction,
At least one processor;
At least one memory module storing computer program code, wherein the computer program code is stored in the computer system using the at least one processor;
Pairing a multi-sensing interactive point-of-sale terminal with a mobile device at a first time, the computer system comprising:
Receiving a transaction initiation instruction including customer identification data and an identifier associated with the multi-sense interactive point-of-sale terminal;
Performing authentication information to a mobile terminal registered with the customer based on the received identification data; and
Receiving a transaction selection;
Processing a payment at a second time, wherein the computer system receives the transaction selection between the first time and the second time, at which the computer system is ,
Receiving a payment request for payment of the transaction, wherein the payment request includes a sensed authentication input;
A system is provided that performs the step of approving the transaction based on a comparison between the received sensed authentication input and the authentication information transmitted to the registered mobile terminal. Is done.

  The processor may be configured to compare the received sensed authentication input with the authentication information transmitted to the registered mobile terminal.

According to the third aspect of the present invention,
A system for executing transactions,
A multi-sensing interaction point-of-sale terminal,
Receiving a payment request for payment of the transaction, wherein the payment request includes a sensed authentication input;
Sending said payment request; and a multi-sense interactive point-of-sale terminal configured to perform:
A database to store the data;
The multi-sensing interactive point-of-sale terminal and a processor in communication with the database;
The processor is
Pairing a multi-sensing interactive point-of-sale terminal with a mobile device at a first time, the processor comprising:
Receiving a transaction initiation instruction including customer identification data and an identifier associated with the multi-sense interactive point-of-sale terminal;
Transmitting authentication information to a mobile terminal registered with the customer based on the received identification data, and details of the mobile terminal are stored in the database;
Receiving a transaction selection;
Processing the payment at a second time, wherein the transaction selection is received between the first time and the second time, at which the processor
Receiving the payment request for the payment of the transaction from the multi-sense interactive point-of-sale terminal;
Approving the transaction based on a comparison between the received sensed authentication input and the authentication information transmitted to the registered mobile terminal;
A system may be provided that performs

  The multi-sensing interactive point-of-sale terminal may include a display screen and may be configured to receive the authentication input provided on the display screen.

The multi-sensing interactive point-of-sale terminal includes a microphone, and
Receive an utterance using the microphone,
The utterance may be processed into machine readable data to determine text of the utterance.

The multi-sensing interaction point-of-sale terminal includes an imaging device;
Using the imaging device, to capture the gesture image presented to the multiple sensing interaction point of sale terminal,
The image may be configured to process the image into machine readable data to determine the gesture.

The processor further includes:
Encoding the authentication information into a barcode;
The encoded barcode may be configured to be transmitted to the registered mobile terminal.

  The multi-sensing interactive point of sale terminal may be further configured to scan the encoded bar code using a bar code reader of the multi-sensing interactive point of sale terminal.

  This embodiment is provided for illustrative purposes only and will be well understood and readily apparent to those skilled in the art from the following description and accompanying drawings.

FIG. 1 is a diagram illustrating a transaction execution system and method according to the present embodiment. FIG. 2 is a flowchart illustrating a transaction execution system and method according to this embodiment. FIG. 3 is a conceptual diagram showing a computer suitable for implementing the system and method of this embodiment.

  With reference to the drawings, this embodiment will be described by way of example only. Like reference symbols and characters in the different drawings indicate like elements or equivalents.

  Some portions of the following disclosure are presented explicitly or implicitly in terms of algorithms and functional or symbolic operational representations of data in computer memory. These algorithmic disclosures and functional or symbolic representations are means used by those skilled in the data processing arts to most effectively convey the substance of processing to others skilled in the art. Here, the algorithm is generally recognized as a self-consistent sequence of steps leading to the desired result. This step requires physical manipulation of physical quantities (eg, electronic, magnetic, or optical signals that can be stored, transferred, combined, compared, or manipulated).

  Throughout this disclosure, unless otherwise specified, and as is obvious from the following, through this disclosure, “receive”, “transmit”, “approved”, “display”, “process”, “imaging”, “encode”, etc. The discussion using the terminology refers to computer systems or similar electronic devices (that is, data represented as physical quantities in a computer system, other data presented in a similar fashion as physical quantities in a computer system or other information storage) Operation and processing).

  The present disclosure also discloses an apparatus for performing the operations of the method. Such devices may be specially configured for the required purposes, and may include other devices that are selectively enabled or reconfigured by a computer or computer program stored on the computer. The algorithms and displays of this disclosure are not inherently related to any particular computer or other apparatus. Various devices may be used with the program in accordance with the teachings of this disclosure. Alternatively, it is also appropriate to build a more specialized device to perform the required method steps. The structure of the computer is shown below.

  Furthermore, the present disclosure also implicitly discloses a computer program. This is because it will be apparent to those skilled in the art that the individual steps of the disclosed method may be validated by computer code. A computer program is not limited to any particular programming language and implementation. It should be understood that various programming languages and their coding may be used to implement the teachings contained in this disclosure. Further, the computer program is not limited to any particular control flow. There are many other variations of computer programs. This can use different control flows without departing from the spirit or scope of the present invention.

  Further, one or more steps of the computer program may be performed in parallel rather than sequentially. Such a computer program may be stored on any computer readable medium. The computer readable medium may include a storage device (eg, a magnetic or optical disk, memory chip) or other storage device suitable for interfacing with a computer. Computer-readable media may also include wired media (eg, as exemplified in the Internet system) or wireless media (eg, as exemplified in the GSM mobile phone system). A computer program, when loaded and executed on such a computer, becomes a device that implements the steps of the preferred method.

  As in this disclosure, the terms “server”, “terminal”, and “database” refer to a single computing device or a plurality of interconnected computing devices that operate together to perform a particular function. ). That is, the “server”, “terminal”, and “database” may be contained within a single hardware unit or distributed across multiple or many different hardware units. An exemplary computing device that operates as a “server”, “terminal”, and “database” is described below with reference to FIG.

  As in the present disclosure, the term “sensing authentication input” is sensed by a multi-sensing interactive point-of-sale terminal (ie, one or more microphones, cameras, touch screens, barcode readers mounted on the point-of-sale terminal). Or any authentication information that can be detected. Examples of sensory authentication inputs include, but are not limited to, alphabetic and numeric data, characters, numeric values, images, sounds, gestures and expressions.

  FIG. 1 is a diagram illustrating a transaction execution system and method according to the present embodiment. FIG. 1 is described with respect to the situation in a physical store (hereinafter referred to as “store”). Here, the customer 100 uses a multi-sensing interactive point-of-sale terminal (hereinafter referred to as “multi-sensing POS”) installed in the store, and uses the product or service (the product or service is described below). (Collectively referred to as “product”). The store may include one or more multi-sensing POS depending on the visitor to the store. A multiple sensing POS is shown in FIG.

  The humanoid robot 102 is configured to engage in an interaction operation with the customer 100. For example, the humanoid robot 102 has a humanoid shape and is configured to perform operations such as shaking hands with the customer 100 and matching the line of sight. In the embodiment, the humanoid robot 102 includes a display screen (hereinafter referred to as “screen”), and displays a list of products that can be purchased in the store. The humanoid robot 102 has a touch screen function that allows the customer 100 to make a transaction selection (eg, selecting one or more products listed on the display screen).

  To initiate the purchase process, customer 100 enables a merchant mobile application (hereinafter referred to as a “merchant app”) installed on the electronic device (shown as mobile device 104 in FIG. 1). Typically, a merchant app is developed by the merchant and causes the customer 100 to perform in-app purchases or in-app payments. In an embodiment, the merchant app is integrated with the application call or makes an application call to the digital wallet. Thereby, the seller application enables the customer 100 to make in-app payment using the digital wallet for the item purchased in the store using the humanoid robot 102. Customer 100 typically must provide identification data to access merchant apps and / or digital wallets.

  Note that instead of using a digital wallet, other payment methods may be selected to make in-app payments within the merchant app. Payment means may involve using payment means such as in-app credits, credit / debit cards, and third party online payment platforms (eg, PayPal and Alipay). Details of these payment instruments may be stored in the merchant app and selected to perform in-app payments.

  In step A, the customer 100 pairs (pairs) the mobile device 104 and the humanoid robot 102 at the first time point. The customer 100 may be prompted to pair the mobile device 104 with the humanoid robot 102, and the pairing between the mobile device 104 and the humanoid robot 102 may be automatically initiated. In an embodiment, the humanoid robot 102 is assigned a name. The screen displays a request to say the name of the humanoid robot 102 and initiates interaction with the humanoid robot 102. For example, the name of the humanoid robot 102 is “robot”, and the customer 100 starts the transaction by saying “robot” or “Hi Robot” to the humanoid robot 102. It should be appreciated that customer 100 may also initiate interaction with humanoid robot 102 in other ways. For example, the customer 100 may simply touch the screen or may wave the hand to the humanoid robot 102 to initiate an interaction with the humanoid robot 102.

  Next, the barcode is displayed on the screen of the humanoid robot 102. The bar code indicates a unique identifier (hereinafter referred to as “identifier”) of the humanoid robot 102. In an embodiment, the merchant app is configured to send a signal to the camera of the mobile device 104 to image the barcode and extract data from the captured barcode. The customer 100 operates the seller application, accesses the camera of the mobile device 104, and scans the barcode displayed on the screen using the barcode reading function. In other embodiments, the merchant app is granted access to the image gallery on the mobile device 104 and retrieves the barcode image stored in the image gallery on the mobile device 104. The merchant app is configured to extract the identifier from the scanned barcode.

  In step B, the customer 100 transmits a transaction start instruction (hereinafter referred to as “instruction”) to the seller server 106 using the mobile device 104. This instruction helps inform the merchant server 106 that the mobile device 104 is about to pair with the humanoid robot 102. At this time, the pairing indicates the start of the sequence, and purchase with the humanoid robot 102 is performed. In the embodiment, the instruction is transmitted to the merchant server 106 via the Internet network. The instruction includes an identifier and identification data of the customer 100. Merchant server 106 receives a transaction initiation instruction (which includes customer identification data from mobile device 104 and an identifier associated with the multi-sensing interaction POS). The identification data is registered in the customer account signed up with the merchant app and is used by the customer 100 to log in to his customer account using the merchant app. In the embodiment, the identification data includes an access code (for example, customer account name, customer identification number, customer telephone number) and authentication data (for example, biometric data, password). For example, a customer logs into a customer account using an account name and password. The identification data may be identification data registered with a customer account signed up for a payment instrument (eg, digital wallet, online payment platform, credit / debit card) selected to make in-app payments. In the embodiment, when the barcode scanning is successful, the identifier and the identification data are automatically transmitted from the seller application to the seller server 106 via the Internet network.

  In an embodiment, merchant server 106 also receives digital wallet details from mobile device 104. For example, the mobile device 104 sends a payment token to the merchant server 106. The payment token is used to obtain other payment data that is used to complete the transaction. Note that the type of payment instrument details received by merchant server 106 varies depending on the selected payment instrument. For example, if a credit card is selected for transaction payment, the mobile device 104 sends credit card details (eg, credit card number and card verification value (CVV)) to the merchant server 106.

  The bar code includes an identifier of the humanoid robot 102. Thus, by receiving the barcode from the mobile device 104, the merchant server can pair the humanoid robot 102 with the mobile device 104. In other words, if the customer identity verification process is successful during the payment, the next purchase made using the humanoid robot 102 will use a digital wallet integrated with the merchant app installed on the mobile device 104. Paid using.

  Upon receiving a transaction start instruction from the mobile device 104, the merchant server 106 gains access to the customer details registered with the customer account (step C). Customer details are stored in customer database 108 and include contact details of mobile terminals registered under the customer account. The authentication information is generated specifically for use in the upcoming transaction and is sent to the registered mobile terminal based on the contact details obtained from the customer database 108. In step D, the merchant server 106 transmits authentication information to the mobile terminal registered with the customer 100 based on the received identification data. For example, if the mobile device 104 is a registered mobile terminal, the authentication information is transmitted to the mobile device 104 (FIG. 1). In the embodiment, the authentication information is transmitted to the registered mobile terminal via the telephone network.

  The authentication information is used for customer authentication by the humanoid robot 106 during settlement. This is because the authentication information provides a means for verifying that the customer 100 is actually the object that he claims. In particular, the humanoid robot 102 prompts the customer 100 to provide a sensed authentication input (hereinafter referred to as “authentication input”). Transactions are only approved when the authentication input is correct. The authentication input is correct when it matches the authentication information sent to the mobile device 104. Otherwise, the transaction is not approved. One method of performing this matching is performed in step F (see below). In the embodiment, the authentication information may be an image of an item (for example, an umbrella image).

  Note that instead of the telephone network, the authentication information may be sent over the Internet network to a registered mobile terminal (eg, to a mobile messaging application). Note that if the mobile device 104 is not a mobile terminal registered with a customer account, the authentication information may not be sent to the mobile device 104 (which initiates pairing with the humanoid robot 102).

  Upon receiving the authentication information, the customer 100 performs transaction selection using the screen of the humanoid robot 102. The transaction selection includes one or more items (which the customer 100 wishes to purchase from the store). When the transaction selection is completed, the customer 100 transmits a confirmation of the transaction selection using the screen of the humanoid robot 102. Merchant server 106 receives a transaction selection from humanoid robot 102.

  Upon receipt of the transaction selection, the payment is processed at a second time. As described above, the pairing process between the humanoid robot 102 and the mobile device 104 occurs at the first time point. After the pairing process, the customer 100 releases his / her mobile device 104 and selects a product he / she wants to purchase from the store. Upon completing the transaction selection, the customer 100 proceeds with the payment process without accessing its mobile device 104. In other words, the customer 100 performs transaction selection at a time interval between the first time point and the second time point. Transaction selections made by customer 100 are received by merchant server 106. Note that the payment process at the second point in time includes the authentication process of the customer identity (step E). Specifically, at step E, the screen prompts the customer 100 to provide an authentication input. The authentication input is detected by the humanoid robot 102. In embodiments where the authentication input is an image, the screen displays a plurality of images (eg, a pair of shoes, a shirt, a building, a cup, a fruit and an umbrella image) for selection by the customer 100. Referring to Step C above, the image transmitted to the registered mobile terminal is an umbrella image. If the customer 100 selects an image of an image displayed on the screen from a plurality of images displayed on the screen, the authentication process is successful.

  It should be noted that in addition to images, authentication information and authentication input may be in a variety of formats (eg, alphabetic and numeric data, letters, numbers, voice, gestures and expressions). For example, the authentication information transmitted to the registered mobile terminal includes a gesture or a facial expression. When the customer 100 provides the authentication input, the customer 100 performs a gesture or a facial expression on the humanoid robot 102. The characters may be sent to the registered mobile terminal in text format. Customer 100 must provide authentication input to humanoid robot 102 by saying words to humanoid robot 102. Authentication information (eg, alphabetic and numeric data, words, and numeric values) may also be encoded into a barcode for transmission to registered mobile terminals.

  In the embodiment, the humanoid robot 102 includes a microphone. The customer 100 can provide the authentication input to the humanoid robot 102 by speaking into the microphone. The humanoid robot 102 uses text recognition software to process the utterance into machine readable data and determine the text of the utterance. In other embodiments, the humanoid robot 102 includes a camera. The customer 100 can provide an authentication input by gesturing the humanoid robot 102. The camera can capture the gesture presented to the humanoid robot 102 as an image or video. The humanoid robot 102 can process an image or video into machine readable data to determine gestures. In another embodiment, the humanoid robot 102 includes a bar code reader. If the authentication information is encoded into a barcode and transmitted to the registered mobile terminal, the customer 100 can provide the authentication input by scanning the barcode using a barcode reader. The humanoid robot 102 can process the barcode and determine the authentication input.

  The authentication process in step E may be adapted to the game format. For example, in a store selling yoga equipment, the authentication information provided to the registered mobile terminal may be an image of yoga posture. Customer 100 is required to provide an authentication input to humanoid robot 102 by selecting a yoga posture. Therefore, the customer 100 can pay in a safe manner and at the same time play a fun game with the humanoid robot 102.

  In step F, the merchant server 106 receives a settlement request for payment for a transaction for purchasing a product in the store. The settlement request includes a sensed authentication input provided by the customer 100 to the humanoid robot 102. The payment request may also include the total transaction amount and item details (eg, item amount and item description). Next, merchant server 102 approves the transaction based on a comparison between the sensed authentication input received from humanoid robot 102 at step E and the authentication information transmitted to the registered mobile terminal at step C. . If the authentication input received from the humanoid robot 102 matches the authentication information provided to the registered mobile terminal, customer authentication is successful and the transaction is approved. Otherwise the transaction is rejected.

  In one example, the word “coffee” is transmitted in step C to the registered mobile terminal during the pairing process at the first time point. The customer then proceeds to transaction selection using the screen of the humanoid robot 102. Upon completing the transaction selection, customer 100 proceeds to payment at the second point in time by providing an authentication input. In this example, the customer provides an authentication input at step E by saying the word “coffee” to the humanoid robot 102. The utterance “coffee” is processed by the humanoid robot 102. The text of the utterance is determined to be “coffee”. Data relating to the text “coffee” and the total transaction amount are sent to merchant server 106. In response to determining that the authentication input matches the authentication information sent to the registered mobile terminal, merchant server 106 uses the digital wallet selected by customer 100 to make the in-app payment, and sums the transaction amount. Approve a payment transaction by setting a value.

  Note that in response to the pairing of the humanoid robot 102 and the mobile device 104 (see steps A and B), the merchant server 106 can also send authentication information to the humanoid robot 102 (step D). I want to be. Thus, a comparison between the sensed authentication input provided by the customer 100 to the humanoid robot 102 and the authentication information transmitted to the mobile device 104 can be performed by the humanoid robot 102. The humanoid robot 102 transmits the result of the comparison (that is, whether it matches or does not match) to the merchant server 106. Merchant server 106 then approves the transaction based on the comparison made by humanoid robot 102. As a result, the transaction is approved when the result of the comparison is “match”.

  Embodiments provide systems and methods that support customer approval of transactions made within a store. The payment means details are stored in the mobile device and transmitted to the merchant server prior to settlement at the store. For this reason, the customer 100 can make a hands-free payment and a cashless payment experience at the time of payment at the store. In other words, after pairing the humanoid robot 102 and the mobile device 104, the customer 100 does not need to interact further with the mobile device 104 to proceed with the transaction payment.

  If the person who interacts with the humanoid robot does not have the mobile device registered under the customer account, they will not be able to provide the correct authentication input to the humanoid robot during the settlement, which is done with the humanoid robot Unable to pay for purchase. For example, a person may obtain customer identification data by impersonation. Impersonators can log into customer accounts within the merchant app and pair humanoid robots with the mobile devices used by them. However, the impersonator does not receive authentication information from the merchant server in response to the pairing. This is because the mobile device used by them is not a mobile terminal registered in a customer account. Therefore, the impersonator cannot provide the correct authentication input to the humanoid robot and cannot complete the authentication process. In other words, even if a person has legitimate customer identification data, this embodiment may include an authentication process that prevents the person from making fraudulent payments.

  Since no in-store employees are needed to support the transaction, the system and method are also useful in providing in-store customer service without adding overhead costs. The system and method are also suitable for performing transactions at a self-service point-of-sale terminal (hereinafter referred to as “POS”) that does not require any person placement. For example, a POS may be installed in a vehicle to provide an unattended vehicle sharing service. The POS may be arranged in a vehicle (for example, a rental car (rental vehicle)). The customer is required to complete the customer authentication process using POS before completing the transaction and starting the car rental engine. As an example of the customer authentication process, the term “rental” is sent to the mobile device registered in the customer account, and the customer is asked to say the word “rental” to the POS to complete the customer authentication process. . Clearly, the system and method provides a safe and efficient way to make payments. However, the customer experience is not compromised.

  FIG. 2 is a flowchart 200 illustrating a transaction execution method according to this embodiment. In step 2020, the multi-sense interactive point-of-sale terminal is paired with the mobile device at a first point in time. The pairing step includes steps 202a and 202b. At step 202a, a transaction initiation indication (which includes customer identification data and an identifier associated with a multi-sense interactive point of sale terminal) is received. In step 202b, the authentication information is transmitted to the mobile terminal registered with the customer based on the received identification data. At step 204, a transaction selection is received. At step 206, the payment is processed at a second time. At this time, receiving the transaction selection occurs between the first time point and the second time point. The step of processing the payment includes steps 206a and 206b. At step 206a, a settlement request for payment for a transaction is received. The settlement request includes a sense authentication input. At step 206b, the transaction is approved based on a comparison between the received sensed authentication input and the authentication information sent to the registered mobile terminal.

  One advantage of this embodiment is that authentication information is sent to the customer's mobile device (step C in FIG. 1) during the pairing process at a first time, and after the pairing process, the customer 100 Turn off the power and proceed to transaction selection. When the customer 100 completes his / her transaction selection, the customer 100 may proceed to the transaction payment process at a second point of time without having to reference or access his / her mobile device. In other words, the transaction can only be performed in a single transaction between the customer 100 and the mobile device 104. Thus, transaction processing is more convenient. This is because repeated use of the mobile device is not required.

  In other embodiments, the authentication information may be valid for multiple transactions. The customer 100 may initiate a second transaction using the authentication information and pay for the second transaction. For example, customer 100 may initiate and process a transaction from his vehicle on a connected in-vehicle robot. In this situation, customer 100 may initiate and complete multiple transactions with only one pairing of his mobile device to the in-vehicle robot.

  FIG. 3 shows an exemplary computing device 300. These are hereinafter shown as computer system 300 interchangeably. One or more such computing devices 300 may be used to perform transactions (eg, implement humanoid robot 102 and merchant server 106). The following description of computing device 300 is provided for illustrative purposes only, and not for limitation.

  As shown in FIG. 3, an exemplary computing device 300 includes a processor 304 for executing software routines. A single processor is shown for purposes of clarity. However, the computing device 300 may also include a multiple processor system. The processor 304 is connected to a communication infrastructure 306 for communicating with other components of the computing device 300. The communication infrastructure 306 may include, for example, a communication bus, a crossbar, or a network.

Software routines or computer programs may be stored in memory (eg, main memory 308) and executed by processor 304 to cause computer system 300 to perform the following:
(A) Pair the multi-sensing interaction point-of-sale terminal with the mobile device at the first point in time,
(A1) receiving a transaction start instruction including customer identification data and an identifier associated with a multi-sense interactive point-of-sale terminal; (A2) registering authentication information with the customer based on the received identification data (B) receiving the transaction selection, (C) processing the payment at the second time point, and receiving the transaction selection between the first time point and the second time point. (C1) receive a payment request for payment of a transaction, the payment request includes a sensory authentication input, and (C2) a comparison between the sensory authentication input received and the authentication information sent to the registered mobile device Approve the transaction based on The software routine or computer program also includes steps executable by the processor to allow the computer system 300 to compare various other analysis steps (eg, the received sensed authentication input with the authentication information sent to the registered mobile terminal). Display a list of available products, receive transaction selections, transaction selections include selection of one or more products, receive utterances using a multi-sensing POS microphone, and process the utterances into machine-readable data Then, the text of the utterance is determined).

  The computer system 300 further includes a main memory 308 (for example, a random access memory (RAM)), an auxiliary memory 310, and the like. The auxiliary memory 310 may include a hard disk drive 312 and / or a removable storage drive 314 (eg, floppy disk drive, magnetic tape drive, optical disk drive, etc.). The removable storage drive 314 may read from or write to the removable storage unit 318 in a well-known manner. The removable storage unit 318 may include a floppy disk, a magnetic disk, an optical disk, etc., which can be read or written by a removable storage drive 314. As will be appreciated by those skilled in the art, the removable storage unit 318 includes a computer-readable storage medium that stores computer-executable program code instructions and / or data.

  In the alternative, the auxiliary memory 310 may additionally or alternatively include other similar means that allow computer programs or other instructions to be loaded into the computer device 300. Such means may include, for example, a removable storage unit 322 and an interface 320. Examples of removable storage unit 322 and interface 320 include a program cartridge and cartridge interface (eg, in a video game console device), removable memory chips (eg, EPROM or PROM) and associated sockets, and other removable devices. A possible storage unit 322 and interface 320 may be included, which allows software and data to be transferred from the removable storage unit 322 to the computer system 300.

  Computing device 300 also includes at least one communication interface 324. Communication interface 324 allows software and data to be transferred between computing device 300 and external devices via communication path 326. In various embodiments, the communication interface 324 allows data to be transferred between the computing device 300 and a data communication network (eg, a public or private data communication network). Communication interface 324 may be used to exchange data between different computing devices 300. Such a computing device 300 forms part of an interconnected computer network. Examples of communication interface 324 may include a modem, a network interface (eg, an Ethernet card), a communication port, an antenna with associated circuitry, and the like. The communication interface 324 may be wired or wireless. Software and data transferred via the communication interface 324 are in signal format. This may be an electronic, electromagnetic, optical signal, or other signal that can be received by the communication interface 324. These signals may be provided to the communication interface via communication path 326.

  As shown in FIG. 3, the computing device 300 further includes a display interface 302. This performs an operation of providing an image to the related display 330 and the audio interface 332, and an operation of reproducing audio content via the related speaker 334.

  As in the present disclosure, the term “computer program product” partially refers to a removable storage unit 318, a removable storage unit 322, a hard disk built into the hard disk drive 312, or a communication path 326 ( A carrier wave that carries software to the communication interface 324 over a wireless link or cable). A computer-readable storage medium refers to a non-transitory nonvolatile tangible storage medium. This provides the recorded instructions and / or data to the computing device 300 for execution and / or processing. Examples of such storage media are floppy disks, magnetic tapes, CD-ROMs, DVDs, Blu-ray® disks, hard disk drives, ROMs or integrated circuits, USB memory magnetic optical disks, or computer readable cards (eg PCMCIA Card). It does not matter whether such a device is internal or external to computing device 300. Examples of transitory or non-volatile computer readable transmission media (which provide software, application programs, instructions and / or data to computing device 300) include wireless or infrared transmission channels and other computer or network devices. Network connection to the Internet, and may include the Internet or an intranet containing information recorded in email transmissions and websites.

The computer program product may be stored in the main memory 308 in the form of instructions executable by the processor to cause the computer system 300 to:
(A) Pairing a multi-sensing interactive point-of-sale terminal with a mobile device at a first point of time, and (A1) starting a transaction including customer identification data and an identifier associated with the multi-sensing interactive point-of-sale terminal Receive instructions, (A2) send authentication information to the mobile terminal registered with the customer based on the received identification data, (B) receive the transaction selection, (C) pay at the second time And receiving a transaction selection occurs between a first time point and a second time point, (C1) receiving a payment request for payment of the transaction, the payment request including a sensed authentication input, C2) Approve the transaction based on a comparison between the received sensed authentication input and the authentication information sent to the registered mobile terminal. The computer program may also include steps executable by the processor to allow the computer system 300 to compare various other analysis steps (eg, the received sensed authentication input with the authentication information sent to the registered mobile terminal). Display a list of products available for purchase, receive transaction selections, transaction selections include selection of one or more products, receive utterances using a multi-sense POS microphone, and process the utterances into machine-readable data To determine the text of the utterance).

  Computer programs (also called computer program codes) are stored in the main memory 308 and / or the auxiliary memory 310. A computer program may also be received via communication interface 324. Such a computer program, when executed, may enable the computing device 300 to perform the disclosed method. In various embodiments, the computer program, when executed, enables the processor 304 to perform the functions of the above embodiments. Accordingly, such a computer program represents a controller of computer system 300.

  The software may be stored in a computer program and loaded into the computing device 300 using a removable storage drive 314, hard disk drive 312 or interface 320. Alternatively, the computer program product may be downloaded to computer system 300 over communication path 326. The software, when executed by the processor 304, causes the computing device 300 to execute embodiments of the present disclosure.

  It should be understood that the embodiment of FIG. 3 is presented for illustrative purposes only. Thus, in some embodiments, one or more functions of computing device 300 may be omitted. Also, in some embodiments, one or more functions of computing device 300 may be combined together. Alternatively, in some embodiments, one or more functions of computing device 300 may be divided into one or more component parts.

  It will be appreciated by those skilled in the art that many variations and / or modifications may be made to the invention shown in the specific embodiments, as broadly described without departing from the spirit and scope of the invention. Understood. For example, this embodiment is disclosed and described with respect to a humanoid robot. However, the disclosed embodiments include other types of robots (eg, non-humanoid robots), digital assistants (eg, Echo and Siri), chatbots, and any similar interaction interface for performing transactions. May be used. Therefore, the present embodiment is considered by way of example from every viewpoint, and is not considered to be limited.

Claims (20)

A method for executing a transaction,
Pairing a multi-sense interactive point-of-sale terminal with a mobile device at a first point of time, comprising:
Receiving a transaction initiation instruction including customer identification data and an identifier associated with the multi-sense interactive point-of-sale terminal;
Transmitting authentication information to a mobile terminal registered with the customer based on the received identification data; and
Receiving a transaction selection;
Processing a payment at a second time, wherein the transaction selection occurs between the first time and the second time;
Receiving a settlement request for the payment of the transaction, wherein the settlement request includes a sensed authentication input;
Approving the transaction based on a comparison between the received sensed authentication input and authentication information transmitted to the registered mobile terminal;
Including methods.   2. The method according to claim 1, wherein the authentication information and the sensing authentication input include one or more of alphabetic and numerical data, numerical values, gestures, images, facial expressions, and utterances. . The method according to claim 1 or 2, further comprising:
Using a display screen of the multi-sensing interaction point-of-sale terminal to display a list of products that can be purchased;
Receiving the transaction selection via the display screen, wherein the transaction selection includes a selection of one or more items;
Including methods.   4. The method of claim 3, wherein receiving the payment request includes receiving the authentication input provided on the display screen. The method of claim 2, wherein receiving the payment request comprises:
Receiving the utterance using a microphone of the multi-sensing interaction point-of-sale terminal;
Processing the utterance into machine readable data to determine text of the utterance. The method of claim 2, wherein receiving the payment request comprises:
Using the imaging device of the multi-sensing interaction point-of-sale terminal to capture a gesture image presented to the multi-sensing interaction point-of-sale terminal;
Processing the image into machine readable data to determine the gesture.   A method according to any one of the preceding claims, wherein the transaction initiation indication is received via an internet network.   The method according to any one of the preceding claims, wherein the identifier associated with the multi-sense interactive point-of-sale terminal comprises a barcode.   A method according to any one of the preceding claims, wherein the authentication information is transmitted over a telephone network. The method according to claim 1 or 2, wherein transmitting the authentication information comprises:
Encoding the authentication information into a barcode;
Transmitting the encoded barcode to the registered mobile terminal.   11. The method of claim 10, wherein receiving the payment request comprises scanning the encoded barcode using a barcode reader of the multi-sense interactive point-of-sale terminal.   A method according to any one of the preceding claims, wherein the multi-sensing interactive point-of-sale terminal is a humanoid robot configured to engage in interactive operations. A computer system for executing a transaction,
At least one processor;
At least one memory module storing computer program code, wherein the computer program code is stored in the computer system using the at least one processor;
Pairing a multi-sensing interactive point-of-sale terminal with a mobile device at a first time, the computer system comprising:
Receiving a transaction initiation instruction including customer identification data and an identifier associated with the multi-sense interactive point-of-sale terminal;
Performing authentication information to a mobile terminal registered with the customer based on the received identification data; and
Receiving a transaction selection;
Processing a payment at a second time, wherein the computer system receives the transaction selection between the first time and the second time, at which the computer system is ,
Receiving a payment request for payment of the transaction, wherein the payment request includes a sensed authentication input;
Approving the transaction based on a comparison between the received sensed authentication input and the authentication information transmitted to the registered mobile terminal.   14. The computer system of claim 13, wherein the processor is configured to compare the received sensed authentication input with the authentication information transmitted to the registered mobile terminal. A system for executing transactions,
A multi-sensing interaction point-of-sale terminal,
Receiving a payment request for payment of the transaction, wherein the payment request includes a sensed authentication input;
Sending said payment request; and a multi-sense interactive point-of-sale terminal configured to perform:
A database to store the data;
The multi-sensing interactive point-of-sale terminal and a processor in communication with the database;
The processor is
Pairing a multi-sensing interactive point-of-sale terminal with a mobile device at a first time, the processor comprising:
Receiving a transaction initiation instruction including customer identification data and an identifier associated with the multi-sense interactive point-of-sale terminal;
Transmitting authentication information to a mobile terminal registered with the customer based on the received identification data, and details of the mobile terminal are stored in the database;
Receiving a transaction selection;
Processing the payment at a second time, wherein the transaction selection is received between the first time and the second time, at which the processor
Receiving the payment request for the payment of the transaction from the multi-sense interactive point-of-sale terminal;
Approving the transaction based on a comparison between the received sensed authentication input and the authentication information transmitted to the registered mobile terminal;
Run the system.   16. The system of claim 15, wherein the multi-sensing interactive point of sale terminal includes a display screen and is further configured to receive the authentication input provided on the display screen. 16. The system of claim 15, wherein the multi-sensing interactive point-of-sale terminal includes a microphone, and
Receive an utterance using the microphone,
A system configured to process the utterance into machine readable data to determine text of the utterance. 16. The system of claim 15, wherein the multi-sensing interactive point-of-sale terminal includes an imaging device, and
Using the imaging device, to capture the gesture image presented to the multiple sensing interaction point of sale terminal,
A system configured to process the image into machine readable data to determine the gesture. 17. The system according to claim 15 or 16, wherein the processor further comprises:
Encoding the authentication information into a barcode;
A system configured to transmit the encoded barcode to the registered mobile terminal.   20. The system of claim 19, wherein the multi-sensing interactive point-of-sale terminal is further configured to scan the encoded bar code using a bar code reader of the multi-sensing interactive point of sale terminal. ,system.

Images