TWI846122B - Flexible conversational code scanning system, method and computer readable medium thererof - Google Patents

Abstract

The present invention is a flexible conversational code scanning system and a method thereof. The system comprises a first-end device and a second-end device. A conversation message is converted by the first-end device into a first-end code. The first-end code is read and analyzed by the second end device to get the conversation message. The second end device automatically converts a response message replying to the conversation message into a second end code. The second end code is read and analyzed by the first end device to obtain the response message. The first-end device and the second-end device perform data or message transmission through a code-scanning conversation, thus a two-way code-scanning communication mechanism and expansion of data payload capacity can be achieved. The present invention also provides a computer-readable medium for executing the method of the present invention.

Description

Highly flexible interactive barcode scanning system, method and computer-readable medium thereof

The present invention relates to the technology of code scanning, and more particularly to a highly flexible interactive code scanning system, method and computer-readable medium thereof that enables interactive interaction between devices.

The current development of QR code payment technology has matured. Many retail or consumer-to-consumer (C2C) transactions have introduced QR code payment methods for payment and collection between stores and consumers.

The common scanning payment technology currently used is, for example, a 2D barcode (QR-Code) provided by the store, allowing consumers to pay by scanning the 2D barcode, or, for example, a QR-Code for payment displayed on the consumer's smartphone for the store to scan the QR-Code with a POS (Point of Sale) device to collect the cancellation fee. However, the aforementioned payment or collection methods are all one-way payment methods performed by the store or the consumer. Therefore, the other party cannot immediately confirm the correctness of the payment behavior. For example, if someone pretends to be a merchant and uses his own QR-Code to deceive cancellation fee customers to pay, the payment object will be incorrect. In addition, the current QR code payment technology cannot be modularly combined with other consumer behaviors, such as using coupons, showing membership information, or using electronic invoices. In other words, when QR code payment is executed, other behaviors cannot be added and can only be executed separately. This causes customers to go through multiple procedures during the payment process (such as showing membership, showing coupons, opening the vehicle, etc.), making the QR code payment process inconvenient and cumbersome. Therefore, the current QR code payment technology is prone to inconvenience in the transaction process, and the existing QR code payment architecture (such as active QR code scanning, passive QR code scanning) has high limitations in information security, overall transaction speed, and hardware adaptability, which also affects the popularization and usability enhancement of QR code payment.

In view of the above problems, how to provide a scanning technology, especially one that can perform scanning payment through a two-way dialogue to improve information security and provide hardware adaptation functions, will become a goal that people in this technical field are eager to pursue.

In order to solve the above problems of the prior art, the present invention discloses a highly flexible interactive barcode scanning system, comprising: a first-end device having a first-end lens and a first-end display; and a second-end device having a second-end lens and a second-end display, wherein when the first-end device interacts with the second-end device, the first-end device converts the interactive message into a first-end barcode displayed on the first-end display, so as to The second end device captures the first end barcode through the second end lens and analyzes the first end barcode to obtain the dialogue message and generate a response message corresponding to the dialogue message. Afterwards, the second end device converts the response message into a second end barcode displayed on the second end display, so that the first end device captures the second end barcode through the first end lens and analyzes the second end barcode to obtain the response message.

In one embodiment, the first end device divides the dialogue message into multiple first end barcodes and displays them sequentially on the first end display, so that the second end device can sequentially capture the multiple first end barcodes and then analyze the multiple first end barcodes to integrate them into the dialogue message.

In another embodiment, after capturing the multiple first-end barcodes, the second-end device displays a reception completion barcode on the second-end display, so that the first-end device obtains information that the multiple first-end barcodes have been received.

In another embodiment, when the first end device displays all of the multiple first end barcodes and does not capture the reception completion barcode from the second end display, the multiple first end barcodes are resent or the interaction is terminated.

In another embodiment, the second end device divides the response message into multiple second end barcodes and displays them sequentially on the second end display, so that the first end device can sequentially capture the multiple second end barcodes and integrate them into the response message after analysis.

In another embodiment, the dialog message or the response message includes an encryption key or a key signature.

In another embodiment, the interaction between the first end device and the second end device is one of a payment request dialogue, an integrated electronic invoice dialogue, an integrated coupon selection dialogue, an integrated member identity verification dialogue, and a delivery request dialogue, or any combination thereof.

In another embodiment, the first end device and the second end device further include performing hardware adaptation interaction before the interaction. The hardware adaptation interaction is that the first end device arranges and displays a plurality of first end positioning barcodes for calibrating the screen position on the first end display, and the second end device captures the plurality of first end positioning barcodes through the second end lens, and obtains the visible range of the second end lens according to the corresponding range analyzed according to the quantity of the plurality of first end positioning barcodes captured, and the second end device displays the visible range and the hardware data of the second end device on the second end display through the second end hardware specification barcode, so that the first end device can determine the area on the first end display that can display the barcode in the subsequent dialogue.

The present invention further discloses a highly flexible interactive barcode scanning method, which provides a first end device having a first end lens and a first end display and a second end device having a second end lens and a second end display for interaction, wherein the method includes: allowing the first end device to convert a dialog message into a first end barcode displayed on the first end display; the second end device captures the at least one first end barcode through the second end lens and analyzes the at least one first end barcode to obtain the dialog message; allowing the second end device to generate a response message corresponding to the dialog message according to the dialog message; allowing the second end device to convert the response message into a second end barcode displayed on the second end display; and allowing the first end device to capture the second end barcode through the first end lens and analyze the second end barcode to obtain the response message.

In another embodiment, the step of causing the first end device to convert the dialogue message into a first end barcode displayed on the first end display and causing the second end device to capture the first end barcode through the second end lens and analyze the first end barcode to obtain the dialogue message further includes: the first end device divides the dialogue message into multiple first end barcodes and sequentially displays them on the first end display, so that the second end device sequentially captures the multiple first end barcodes and then analyzes the multiple first end barcodes to integrate them into the dialogue message.

In another embodiment, after capturing the multiple first-end barcodes, the second-end device displays a reception completion barcode on the second-end display, so that the first-end device obtains information that the multiple first-end barcodes have been received.

In another embodiment, when the first end device displays all of the multiple first end barcodes and does not capture the reception completion barcode from the second end display, the multiple first end barcodes are resent or the interaction is terminated.

In another embodiment, the second end device divides the response message into multiple second end barcodes and displays them sequentially on the second end display, so that the first end device can sequentially capture the multiple second end barcodes and integrate them into the response message after analysis.

In another embodiment, the dialog message or the response message includes an encryption key or a key signature.

In another embodiment, the interaction between the first end device and the second end device is one of a payment request dialogue, an integrated electronic invoice dialogue, an integrated coupon selection dialogue, an integrated member identity verification dialogue, and a delivery request dialogue, or any combination thereof.

In another embodiment, the first end device and the second end device further include performing hardware adaptation interaction before the interaction, wherein the hardware adaptation interaction includes the following steps: the first end device arranges and displays a plurality of first end positioning barcodes for calibrating the screen position on the first end display; the second end device captures the plurality of first end positioning barcodes through the second end lens, and obtains the visible range of the second end lens according to the corresponding range analyzed according to the quantity of the plurality of first end positioning barcodes captured; and the second end device displays the visible range and the hardware data of the second end device on the second end display through the second end hardware specification barcode, so that the first end device determines the area on the first end display that can display the barcode in the subsequent dialogue.

The present invention further discloses a computer-readable medium, which is used in a computing device or a computer and stores instructions for executing the aforementioned highly flexible interactive code scanning method.

As can be seen from the above, the highly flexible conversational barcode scanning system, method and computer-readable medium of the present invention provides the conversation message in the form of a first-end barcode to the second-end device for reading and analysis, so that the second-end device receives the conversation message. Then, the second-end device provides the response message of the reply conversation message in the form of a second-end barcode to the first-end device for reading and analysis, thereby obtaining the response message of the second-end device. The first device and the second device can communicate with each other by reading the barcode. In addition, before the first device and the second device communicate or interact with each other, the present invention can perform capability identification of the devices of both parties through hardware adaptation communication or interaction, so that both parties can obtain information about each other's hardware specifications (i.e., device capabilities), thereby avoiding the problem that the barcode provided by one party cannot be successfully identified by the other party. In summary, the present invention allows both devices to transmit data by scanning to achieve information exchange between the two parties. If a message with a large amount of data is encountered, the message can be transmitted by scanning the code multiple times. Therefore, the present invention can achieve a two-way scanning communication mechanism and expand the data payload capacity. Therefore, compared with the existing payment method that only has a unilateral scanning mechanism, the present invention can provide a highly secure verification process and can integrate other behaviors such as coupons and electronic invoices, so as to avoid the cumbersome procedures of frequent switching during the transaction process of the existing payment method, or the occurrence of forgery or counterfeiting.

1: Interactive scanning system

11: First end device

111: First end lens

112: First end display

113: First end barcode

114, 114’: Dialogue message

115: First end positioning barcode

12: Second end device

121: Second end lens

122: Second end display

123: Second end barcode

124, 124’: Response message

125: Second end hardware specification barcode

126: Second end positioning barcode

21: Payee device

214: Payment request message

214’, 214”: Dialogue message

22: Payer device

224: Payment message

224’, 224”: Response message

S810~S850: Steps

S910~S930: Steps

Figure 1 is a schematic diagram of the architecture of the highly flexible interactive scanning system of the present invention.

Figures 2A-2D are schematic diagrams of the operation of the highly flexible interactive scanning system of the present invention.

Figures 3A-3D are schematic diagrams of the operation of the highly flexible interactive barcode scanning system of the present invention performing hardware adaptation.

Figure 4 is a schematic diagram of the operation of the present invention in an embodiment of requesting a payment dialogue.

Figures 5A-5C are schematic diagrams of the operation of an embodiment of the present invention in which a payment request dialogue is combined with an integrated electronic invoice dialogue.

FIG6 is a schematic diagram of the operation of the embodiment of the present invention in the integrated coupon selection dialogue.

Figures 7A-7D are schematic diagrams of the operation of the present invention in an embodiment of a delivery request dialogue.

Figure 8 is a step diagram of the highly flexible interactive code scanning method of the present invention.

Figure 9 is a step diagram of the highly flexible interactive scanning method of the present invention for executing hardware adaptation dialogue or interaction.

The following describes the technical content of the present invention through a specific concrete implementation form. People familiar with this technology can easily understand the advantages and effects of the present invention from the content disclosed in this manual. However, the present invention can also be implemented or applied through other different specific implementation forms.

FIG1 is a schematic diagram of the structure of the highly flexible interactive barcode scanning system of the present invention. As shown in the figure, the highly flexible interactive barcode scanning system 1 of the present invention at least includes a first-end device 11 having a first-end lens 111, a first-end display 112 and a first-end image recognition unit, and a second-end device 12 having a second-end lens 121, a second-end display 122 and a second-end image recognition unit, wherein the first-end device 11 and the second-end device 12 may be the same or different in hardware specifications such as hardware configuration, image resolution capability of the lens, display resolution capability of the display, and recognition speed of the image recognition unit; in addition, the first-end device 11 and the second-end device 12 may be, for example, smart phones, but are not limited thereto. Accordingly, when the first end device 11 and the second end device 12 are communicating or interacting, the first end barcode 113 and the second end barcode 123 displayed on the corresponding display are read by the respective lenses of the first end device 11 and the second end device 12. The first end image recognition unit of the first end device 11 and the second end image recognition unit of the second end device 12 recognize the barcode to obtain the information transmitted to each other, so as to achieve the purpose of automatically executing the exchange of data. After each barcode is scanned, the relevant information or data contained in the barcode can be obtained. The specific description of the highly flexible interactive barcode scanning system 1 of the present invention is described in detail as follows.

FIG2A-2D are schematic diagrams of the operation of the highly flexible conversational barcode scanning system of the present invention. As shown in FIG2A-2B, when the first end device 11 and the second end device 12 are in conversation or interaction, the first end device 11 converts the conversation message 114 (as shown in FIG2A) into a first end barcode 113 (as shown in FIG2B) displayed on the first end display 112, wherein the conversation message 114 may include information such as the transaction amount (such as 1600 yuan) and the random transaction code (such as 7B124391). In one embodiment, the first end barcode 113 may be a one-dimensional barcode (Barcode), a two-dimensional barcode (QR code) or other barcodes in other forms that can be used to provide scanning for data reading. It should be noted that in the present invention, what is displayed on the respective displays of the first end device 11 and the second end device 12 should be a barcode, that is, both devices communicate through barcode display and reading, but for the convenience of explaining the embodiments, the contents displayed by the barcode are represented by text in the partial figures of the present invention, which is explained here first.

As shown in FIG. 2B , after the first end device 11 displays the first end barcode 113, the second end device 12 captures the first end barcode 113 through the second end lens 121, and after reading, the second end image recognition unit analyzes and obtains the dialogue message 114 contained in the first end barcode 113. Therefore, the second end device 12 can obtain the requested transaction amount and the random transaction code of the transaction from the first end device 11.

As shown in FIG2C , after receiving the dialogue message 114, the second end device 12 will process the dialogue. For example, if the dialogue is a payment transaction, the second end device 12 will generate a withdrawal voucher (for example, encrypting and signing information such as the payment object, payment amount, and random transaction code) that must be submitted to the first end device 11 for payment. Then, the second end device 12 can generate a response message 124 corresponding to the dialogue message 114 based on the processing result of the dialogue message 114 and display it on the second end display 122; that is, as shown in FIG2C , the second end device 12 generates information such as "Agree to pay 1,600 yuan" and the received random transaction code "7B124391" based on the dialogue message.

In one embodiment, after capturing the first-end barcode 113, the second-end device 12 first displays an acknowledgment message (ACK) of the barcode reception completion on the second-end display 122, so that the first-end device 11 obtains information that the reading and reception of the first-end barcode 113 has been completed. That is, after the first end device 11 displays the first end barcode 113, the first end lens 111 can be used to scan the second end display 122 to determine whether the second end device 12 has completed reading the first end barcode 113. When the first end device 11 reads the reception completion barcode displayed by the second end device 12, the information that the second end device 12 has completed reading the first end barcode 113 can be obtained. On the contrary, if the first end device 11 does not read the reception completion barcode displayed by the second end device 12, the first end barcode 113 can be re-sent, or even the dialogue or interaction can be terminated, thereby achieving the purpose of providing transaction security.

As shown in FIG2D , the second-end device 12 converts the response message 124 into a second-end barcode 123 and displays it on the second-end display 122 for the first-end device 11 to capture through the first-end lens 111. The first-end image recognition unit analyzes the second-end barcode 123 on the second-end display 122 to obtain the response message. Therefore, the first-end device 11 can complete the transaction after receiving the response from the second-end device 12 agreeing to pay. In addition, the highly flexible interactive barcode scanning system 1 of the present invention mutually transmits and returns random transaction codes between the first end device 11 and the second end device 12. The first end device 11 confirms that the random transaction code returned by the second end device 12 in the response message 124 is compared with the random transaction code sent in the interactive message 114 to confirm the correctness of the transaction, thereby achieving the purpose of improving transaction security. Furthermore, since the transaction process is automatically performed by the first end device 11 and the second end device 12, there is no room for human intervention, which can prevent malicious persons from taking advantage of the opportunity to commit fraud, further improving transaction security.

The highly flexible interactive barcode scanning system 1 of the present invention automatically communicates or interacts with each other by scanning barcodes with the first end device 11 and the second end device 12, thereby achieving the purpose of automatically transmitting data to each other. In actual application, the store or consumer does not need to manually select options at each step in the payment process before making a payment. In other words, the store and the consumer only need to bring the first end device 11 (such as the store's POS machine or smart phone, tablet and other handheld devices) and the consumer's second end device 12 (such as smart phone, tablet and other handheld devices) close to each other, and the first end device 11 and the second end device 12 can automatically communicate or interact with each other to complete the transaction.

In one embodiment, the first end device 11 and the second end device 12 of the present invention are configured with corresponding applications, and the first end device 11 and the second end device 12 are automatically controlled by the application, so that the first end device 11 converts the dialogue message 114, displays the first end barcode 113, activates the first end lens 111, and reads the second end barcode 123, and the second end device 12 converts the response message 124, displays the second end barcode 123, activates the second end lens 121, and reads the first end barcode 113. Thus, the purpose of automatically making the first end device 11 and the second end device 12 conduct dialogue or interaction is achieved, and the time spent on manual operation and the information security issues that may occur in manual operation are avoided.

In another embodiment, during the process of dialogue or interaction between the first-end device 11 and the second-end device 12, or after the first-end device 11 receives a response message 124 from the second-end device 12, if there is other request, such as a request to provide an invoice carrier number, the first-end device 11 can automatically continue to submit an invoice carrier number dialogue message through another first-end barcode. When the second-end device 12 reads the other first-end barcode and obtains the invoice carrier number dialogue message, it returns a corresponding invoice carrier number response message through another second-end barcode, so that the first-end device 11 can store the electronic invoice corresponding to the invoice carrier number. It can be seen that the highly flexible interactive barcode scanning system 1 of the present invention automatically and continuously communicates or interacts with each other through the first end device 11 and the second end device 12. In the transaction process, if the transaction requires multiple interactions between the store and the consumer, or requires the execution of multiple different program requests (such as payment requests, invoice carrier number requests, etc.), it is only necessary to allow the first end device 11 and the second end device 12 to continuously communicate or interact, and other dialogues or interactions can be automatically completed. In addition, since the time for each device to actually scan, read and exchange data is quite short, the time required for the transaction process can be further reduced.

2A-2D of the present invention illustrate the dialogue or interaction between the first end device 11 and the second end device 12, so the dialogue message 114 is displayed on the first end device 11 and the response message 124 is displayed on the second end device 12. In other words, in actual application, the dialogue message 114 of the first end device 11 and the response message 124 of the second end device 12 of the present invention do not need to be displayed. As mentioned above, the present invention only needs to display the first end barcode 113 for the second end device 12 to scan when requesting payment, and display the second end barcode 123 for the first end device 11 to read when responding to agreeing to pay the amount. In other words, the communication between the two parties is carried out through barcodes, and the text in the diagram is only for the convenience of explaining the drawing. Similarly, the subsequent embodiments are also the same, so they will not be described one by one.

In another embodiment, since the amount of data that a barcode can carry in a single display is limited, when the amount of data or file of the conversation or interactive data of the first-end device 11 is large, the first-end device 11 can divide the conversation message into multiple first-end barcodes 113. As shown in FIG. 2A, the first-end device can divide the conversation message into "Agree to pay 1,600 yuan" and the random transaction code "7B124391", and then form "Agree to pay 1,600 yuan" into the first first-end barcode, and form the random transaction code "7B124391" into the second first-end barcode. In addition, the first first-end barcode and the second first-end barcode further include a data serial number for distinguishing the barcode sequence, so as to be displayed sequentially on the first-end display 112, and the second-end device 12 sequentially captures each first-end barcode 113, and after being analyzed by the second-end image recognition unit, they can be integrated and reorganized to form a dialogue message 114. Conversely, the second-end device 12 can also divide the response message 124 into a plurality of second-end barcodes, so as to be displayed sequentially on the second-end display 122, so as to allow the first-end device 11 to sequentially capture each second-end barcode, and analyze, integrate, and reorganize them by the first-end image recognition unit to form a response message 124. Therefore, the present invention scans multiple barcodes formed by dialogue messages or response messages in batches to read the message content contained in each barcode, so that after integrating the message content of each barcode, a message with a larger amount of data can be obtained. Therefore, the highly flexible interactive scanning system 1 of the present invention has no limit on the amount of data that can be transmitted between devices for dialogue or interaction. That is, by enclosing the message in multiple barcodes, the other device can read and integrate them in sequence, and by overcoming the limitation that the barcode can carry a small amount of data at a time, the two devices can be widely used in many scenarios in interactive scanning. Other examples will be described later.

In one embodiment, based on the highly flexible conversational barcode scanning system 1 of the present invention described above, a large amount of data can be transmitted to each other during the conversation or interaction process. The present invention can add an encryption key or a key signature (such as a private key signature or a public key signature) to the conversation message or response message during the conversation or interaction process to enhance the security of the process. That is, through the use of key signatures, before the store and the consumer conduct a transaction, the certificate used to verify the identity of both parties is downloaded and stored in advance, so that encrypted messages and/or signature messages that are difficult to forge can be transmitted to each other during the transaction process, and identity confirmation can be performed, so that the function of offline transactions can be provided. The concept of certificate verification is called chain of trust, which is widely used in secure transmission between websites. The root certificate can verify the authenticity of the certificates of both parties layer by layer. The use of encryption, signature and random code technology for offline transactions is a mature technology widely used in offline credit card transactions, which will not be described in detail here.

In one embodiment, after capturing a plurality of first-end barcodes, the second-end device 12 first displays an acknowledgment message (ACK) of the reception completion barcode on the second-end display 122, so that the first-end device 11 obtains information that the second-end device 12 has completed the reception of the plurality of first-end barcodes 113, wherein the first-end device 11 adds a data sequence number or a dialogue sequence number that can mark the order of each first-end barcode 113 to the image of the plurality of consecutive first-end barcodes 113. Specifically, after displaying all the first-end barcodes 113, the first-end device 11 can scan the second-end display 122 through the first-end lens 111 to determine whether the second-end device 12 has completed the reading of all the first-end barcodes 113 in sequence. When the second-end device 12 completes reading of all first-end barcodes 113, the second-end device 12 displays a corresponding confirmation message of the reception completion barcode, and when the second-end device 12 displays the confirmation message (ACK), it also returns the data sequence number of the first-end barcode 113 observed in the most recent time period. In this way, when the first-end device 11 reads the confirmation message displayed by the second-end device 12, it can obtain the information that the second-end device 12 has completed reading the first-end barcode 113, and can determine the receiving status of the second-end device 12 by comparing the data sequence number.

On the contrary, if the first end device 11 has displayed all the multiple first end barcodes 113 but has not read the confirmation message of the reception completion barcode from the second end device 12, the first end barcode will be resent. That is, if the first end device 11 has continuously sent multiple first end barcodes 113 but has not received a confirmation message from the second end device 12, the first end device 11 determines that the second end device 12 has not received the relevant message. At this time, the first end device 11 will resend all the first end barcodes 113. Furthermore, if the first end device 11 receives a confirmation message from the second end device 12 during retransmission, it will not continue to retransmit the part that has been confirmed to have been received. In detail, since the first end device 11 sequentially adds data sequence numbers to the multiple first end barcodes 113 transmitted, the second end device 12 can determine whether the retransmitted data is new data or repeated data based on the data sequence number, and reorganize the data in the correct order accordingly. Therefore, if the second end device 12 only omits the front or middle part of the data, When the first-end device 11 retransmits the missing portion of the first-end barcode 113 (i.e., new data) and the second-end device 12 reads the missing portion of the first-end barcode 113, a complete dialogue message can be reassembled, and the first-end device 11 does not continue the retransmission process. In other words, the first-end device 11 can scan the second-end device 12 at any time during the retransmission process, so as to stop the retransmission process when the second-end device 12 displays a confirmation message of the reception completion barcode. In addition, the first-end device 11 can also terminate the dialogue or interaction after retransmission if the reception completion barcode of the second-end device 12 is not received. Through the above mechanism, the present invention can detect whether the dialogue message is completely transmitted, thereby achieving the purpose of providing transaction security. In addition, when the second-end device 12 transmits the data stream of the response message 124, the transmitted second-end barcode 123 may also have another set of data sequence numbers or dialogue sequence numbers in addition to the ACK data.

In one embodiment, after the session time ends (Timeout), that is, after the transaction is completed or the retransmission is completed, the data sequence number or session sequence number in the barcode will be randomly changed to avoid mixing old and new transaction images. For example, during a transaction, the consumer removes the device to terminate or end the transaction, and another consumer starts another transaction. At this time, the store's device may have two behaviors, namely, actively terminating the transaction because it cannot wait for the ACK of the previous consumer's device and the session time ends, and passively terminating the transaction because it reads another session sequence number of another consumer. The data sequence number or session sequence number in the barcode will be randomly changed to avoid mixing two different transactions.

In one embodiment, the interaction between the first end device 11 and the second end device 12 may be a hardware adaptation dialogue or interaction, a payment request dialogue, an integrated electronic invoice dialogue, an integrated coupon selection dialogue, an integrated member identity verification dialogue, a delivery request dialogue, or an integrated use of electronic pass dialogue. In addition, when there are multiple dialogues or interactions between the first end device 11 and the second end device 12, the multiple dialogues or interactions may be any combination of hardware adaptation dialogues or interactions, payment request dialogues, integrated electronic invoice dialogues, integrated coupon selection dialogues, integrated member identity verification dialogues, delivery request dialogues, or integrated use of electronic pass dialogues. Specific descriptions of the scenarios of various dialogues or interactions are described in detail below.

Figures 3A-3D are schematic diagrams of the operation of the highly flexible interactive barcode scanning system of the present invention for hardware adaptation. As shown in the figure, since the first end device 11 and the second end device 12 may have different relative positions, display capabilities of the display, and image resolution capabilities and image recognition speeds of the lens, when the hardware of the two devices is not yet adapted, the data dialogue between the devices may fail due to various reasons such as lens resolution, display update frequency mismatch, or difference in visual range of the two lenses. Therefore, the present invention establishes correct recognition between the two devices through a low-speed protocol with the lowest resolution requirement and the highest resistance to the change of the update frequency and the lens visual range. That is, when the first end device 11 and the second end device 12 are communicating or interacting with each other, they will first perform hardware adaptation communication or interaction, as described below.

As shown in FIG. 3A , in the hardware adaptation dialogue or interaction, the first end device 11 arranges and displays a plurality of first end positioning barcodes 115 for calibrating the screen position on the first end display 112. Specifically, the first end device 11 first displays a positioning characteristic image with a simple structure, low information content, and can effectively mark the positioning position as the first end positioning barcode 115, and activates the first end lens 111 for observation.

As shown in FIG. 3B , the second end device 12 captures a plurality of first end positioning barcodes 115 through the second end lens 121. According to the quantity and distribution range of the captured plurality of first end positioning barcodes 115, the corresponding range is analyzed to obtain the visible range of the second end lens 121. That is, the first end device 11 moves to the front of the second end device 12 so that the two devices face each other to scan the screen of the other device. After the value of the acceleration sensor in the second end device 12 is stable, the second end lens 121 is activated to start recognizing the first end positioning barcode 115. Specifically, as shown in the figure, the second end lens 121 of the second end device 12 can only capture 6 barcodes, namely the 1st to 6th barcodes, among which the calibration value of the 1st barcode is 1-4, and the calibration value of the 6th barcode is 21-24. It can be known that the visual range of the second end lens 121 at this time is specific to the screen range covered by the calibration values of 1-24 in the 1st to 6th barcodes.

As shown in FIG3C , the second-end device 12 displays the obtained visible range and other hardware data of the second-end device 12 (e.g., lens resolution, display update frequency) on the second-end display 122 via a low-data-density second-end hardware specification barcode 125, so as to provide the first-end device 11 with an area range in which the barcode can be displayed during subsequent dialogue or interaction, i.e., to inform the first-end device 11 to display the message within the range covered by the calibration value of 1-24 so that the second-end device 12 can read it. In detail, when the second-end device 12 observes successfully, it feeds back the visible range to the first-end lens 111 with multiple second-end hardware specification barcodes 125 with low data density (i.e., low complexity, easy to identify, and small area). For example, the second-end device 12 uses multiple two-dimensional barcodes to express "60F15,1,6,19,24", where 60 is 60Hz, 15 is the positioning point closest to the center, and 1, 6, 19, and 24 are the positioning points describing the boundary of the visible range, so as to inform the first-end device 11 of the current update frequency of the second-end device 12, the lens resolution, and the lens visible range.

As shown in FIG. 3D , after the first end device 11 has observed successfully, the first end device 11 provides the first end hardware specification barcode to the second end device 12 according to the visual range, resolution, lens scanning frequency and other conditions of the second end device 12, and responds to the first end device 11 with image information, such as the resolution and lens scanning frequency, and at the same time carries an instruction to request the second end device 12 to display a positioning feature image for marking the positioning position (see above for details). , i.e., the second end positioning barcode 126, is used to obtain the visual range of the first end lens 111 of the first end device 11 in a similar manner as described above, and then the hardware capability of the first end device 11 is provided to the second end device 12 by displaying the barcode. Therefore, the first end device 11 and the second end device 12 can obtain the relative position between the two and the screen range within the visual range of the other device that can display the barcode.

After the first end device 11 and the second end device 12 complete the observation of the visual range of each other, they will conduct a dialogue or interaction through a high-speed protocol, that is, according to the optimization parameters of the visual range, lens resolution, and lens frame rate of the other party's lens, through the optimization parameters including display image data density, image size, timeout time when there is no response, etc., that is, the first end device 11 displays the barcode and the first end device 11 responds. Based on this, the two devices can complete the adaptation of each other's hardware characteristics, and can fully conduct dialogue or interaction with the high-speed protocol.

In one embodiment, the first end device 11 and the second end device 12 of the present invention preferentially use the following principles during the dialogue or interaction process to speed up the reading of the barcode.

First, when the camera of each device simultaneously displays multiple barcode images in the field of view, the image with the larger area is read first, that is, the area size is used as the basis for reading the barcode.

Secondly, when transmitting continuously, the position of the barcode in the previous frame is read first as the position of the barcode to be displayed next time, which can reduce the time required for the lens to rescan and focus to find the barcode on the display.

Furthermore, when each device has the ability to transmit and receive multiple spectra (such as three primary colors (RGB) and infrared (IR)), part of the spectrum can be used to mark the image range or boundary to speed up the reading.

After the hardware adaptation, the present invention has established a point-to-point underlying communication protocol between the first end device 11 and the second end device 12, which can be used to run dialogues or interactions such as payment, membership points, coupon selection and use, providing electronic invoice carrier numbers or access control permissions. Through the dialogue-based scanning architecture adopted by the present invention, the present invention can solve the problems currently encountered in the above-mentioned various application scenarios, and thus improve the existing user experience in these scenarios. Other dialogues related to the present invention are illustrated as follows.

FIG4 is a schematic diagram of the operation of the embodiment of the present invention in the payment request dialogue. In the payment scenario of the present embodiment, the payee is a retail store and the payee is a consumer. The common payment scenario is that the payee presents a static barcode and the store reads the barcode to make the payment. However, the existing problem of the known payment scenario is that the data carrying capacity of the transmission protocol information such as QR Code is too low, and only a debit code that lacks anti-counterfeiting and anti-peeping properties can be used. To enhance security, consumers need to connect to the Internet during transactions to obtain a very short-term debit code from the backend platform. This will limit the passive barcode scanning mechanism when the mobile phone is offline and cannot complete the transaction. In addition, in the known payment scenario, when consumers present the static barcode, there is a risk of being spied on and swiped in real time.

Specifically, there are many existing problems in the transaction scenarios for payment. First, the first problem is that consumers cannot confirm whether the payment object is correct from the QR code displayed by the payment store. In fact, it is difficult for the store to judge the correctness of the consumer with the naked eye. For example, criminals have replaced the QR code of shared bicycles in New York to commit fraud. Moreover, in the first problem mentioned above, when multiple consumers pay at the same time, the store cannot effectively judge the amount paid by each consumer, and when the store delivers the goods, it is impossible to confirm whether the person who picks up the goods is the payer of the order by naked eye alone. Secondly, the second problem is that after consumers complete the payment operation, the payment success information given to consumers by the payment platform is also difficult to judge the authenticity through the naked eye. Therefore, if consumers pay to individuals or other stores that impersonate store identities, it is difficult to prevent the transaction scenario. For example, in Guangxi, China, there was a case where criminals formed a team of two, one person used the store's display name and displayed barcode image, and the other person actively scanned the code to pay for the fake store, creating the illusion of successful payment to the store.

In view of this, the present invention adopts a dialog-based code scanning architecture to provide a new payment method. In this embodiment, the first end device and the second end device are the payee device 21 of the payee end and the payer device 22 of the payer end, respectively, and the dialog message is a payment request message 214, and the response request is a payment message 224 for illustration. Specifically, as shown in FIG. 4 , assuming that the payee is Chunghwa Telecom (CHT) and the consumer is Tesla Feng, during the transaction, the payee CHT first presents a payment request message 214 using a payee device 21 (e.g., a POS terminal), wherein the payment request message 214 may be signed by CHT. In practical applications, for example, the payment request message includes a payment amount of NT$1,600 and a random transaction code for encryption. Accordingly, the payee device 21 converts the aforementioned payment request message into a first-end barcode after being signed by CHT. The payee Tesla After Feng uses the payee device (e.g., mobile phone) to identify and authenticate the barcode displayed by the payee device 21, the payee device 22 will automatically specify the payment object's payment permission (i.e., payment information) through the private key signature, and then encrypt it with the public key of CHT, and then automatically form a second end barcode for the payee device 21 of CHT to read, and the payment can be completed quickly, which can fully meet the security requirements of anti-peeping and anti-counterfeiting during the transaction process. Therefore, under the interactive scanning payment architecture adopted by the present invention, the first problem mentioned above can be avoided because the interactive scanning payment architecture of the present invention can mutually confirm the transaction information during the dialogue or interaction process of each device, so the problem of fraud by malicious persons can be avoided. Furthermore, the interactive scanning payment framework of the present invention can greatly expand the amount of information that can be carried, so that the store can easily prevent the barcode image code from being counterfeited by signing the payment request with a private key. Therefore, the second problem mentioned above can be solved by the cloud platform or the payment receiving store distributing a set of order keys to the payer, and providing a highly anti-counterfeiting and highly anti-peeping pick-up voucher based on a simple method such as a hash message authentication code challenge (HMAC challenge) or a private key signature. The highly secure pick-up voucher provided in this case allows the store and the consumer to scan the code with each other at the time of delivery, so that each device can communicate or interact, and quickly confirm whether the pick-up person is the same person who completed the payment previously or the person who is entrusted by the payee to have the pick-up key.

Specifically, as shown in FIG. 4 , at first the payee CHT only needs to sign the payment request because when the payee device 21 presents the payment request message 214 , it is not clear who wants to pay. However, the payer can find the payee's certificate on the payee device 22 through the cache, or download the payee's certificate online, or the payee device 21 can carry its own certificate through the payment request message 214 through the unique description of its own company name, unified number, etc. in the signed data (not encrypted, so anyone can understand it as long as they parse it according to the format). Then, after the payer device 22 obtains the certificate through any of the above three methods, it can be repeatedly verified through the trust chain formed by the digital certificate certification authority (CA) certificate. After the verification is completed, the payer device 22 will be able to believe that the payment request is not forged. After the payer device 22 believes the payment request, it can generate a payment certificate signed with its own payment private key to the payee device 21 (this mechanism is a common technology for credit card payment). This payment certificate will contain the payment object, the payment object's unified number and other unique descriptions, the random code of this payment, etc. The purpose of the random code here is to prevent the payee CHT from requesting payment from the financial system multiple times with a payment certificate, but it is not absolutely necessary. This message is also encrypted by the public key in the CHT voucher, so only the CHT can decrypt and understand it. However, this is not necessary, it is just an extra layer of protection, because the payment voucher can specify that the payee is CHT and cannot be changed. When the CHT successfully decrypts and obtains the payment voucher, it can transfer this unforgeable payment voucher to the financial system for debit after connection, just like a credit card POS machine.

Based on the above, the present invention uses the two-way scanning communication mechanism and expanded data payload capacity brought by the interactive scanning payment architecture, so that when the payee submits the payment request message 214 and the payer submits the payment message 224, the present embodiment can add symmetric and/or asymmetric keys to realize data signatures and random transaction code responses that are difficult or impossible to realize in the known scanning payment system, so as to protect the rights and interests of both parties in the transaction from illegal infringement based on forgery and peeping, such as forgery of payment request or malicious peeping of deduction code.

Furthermore, since the present invention adopts interactive scanning, each device or the corresponding application (APP) installed in the device can select the public key encrypted transmission of the cache (or the recipient's device through image transmission) according to the store code, or encrypt according to the private key signature downloaded and saved from the back-end platform in advance, so as to specify the payment object in the ciphertext. Furthermore, by using the private key signature of both parties and the public key encryption of the store, the transaction information between the two parties can avoid the risk of being spied on, stolen or forged. In addition, the private key for payment stored in the device or APP is equivalent to the common "coded credit card", so it can support offline credit transactions.

Figures 5A-5C are schematic diagrams of the operation of the present invention in an embodiment of combining a payment request dialogue with an integrated electronic invoice dialogue. As shown in the figure, for the convenience of explanation, the present invention displays the barcode with the corresponding message to facilitate understanding of the corresponding meaning of each barcode. In actual application, the barcodes displayed by each device in Figures 5A-5C are used for scanning and reading by the other party's device, which is described first.

As shown in FIG. 5A , the payee device 21 and the payer device 22 are communicating or interacting with each other using the payment request message 214 and the payment message 224 respectively in a payment request dialogue, as described above in FIG. 4 , so no further explanation is given. As shown in FIG. 5B , after the payment is completed, the payee device 21 replies with a dialogue message 214' of "Payment successful" and "Please show your carrier number". The payee device 21 can divide the dialogue message 214' into multiple first-end barcodes for the payee device 22 to read in batches. The payee device 22 will automatically read all the first-end barcodes and integrate them into the corresponding dialogue message 214', and confirm that the payment has been completed. The payee device 22 then converts the response message 224' including the electronic invoice carrier number into a second-end barcode according to the request of the dialogue message 214', so that the payee device 21 can obtain the electronic invoice carrier number after reading the second-end barcode. As shown in FIG5C , the payee device 21 registers the corresponding electronic invoice data with the electronic invoice carrier number and responds with a dialogue message 214”. After receiving the dialogue message 214”, the payee device 22 responds with a response message 224” to end the dialogue (ACK). In other words, in this embodiment, after the payee completes the payment procedure, the payee device 22 continues to present the electronic invoice carrier number. At this time, if a dialogue-based scanning payment architecture is used, the payee can automatically complete the invoice registration through a continuous command dialogue as shown in FIG5A-5C, thereby improving transaction efficiency and user experience. The architecture of the conversational QR code scanning payment request dialogue of the present invention can perform two-way responses. Therefore, at any breakpoint (before, during, or after) of the transaction task, the original payment process can be jumped through a plug-in or an extended instruction set to execute another new task (i.e., a new dialogue). Therefore, the payee device 21 can automatically prompt the payer device 22 to provide the electronic invoice carrier number information in this way, and after successfully receiving the electronic invoice carrier number, prompt the payer device 22 to continue the original payment task without the need for the payee to personally intervene in the operation. Therefore, this embodiment can achieve the purpose of improving the convenience of operation and reducing the operation time.

FIG6 is an operation diagram of the embodiment of the present invention in the integrated coupon selection dialogue. In this embodiment, the payee is a retail store and the payee is a consumer. Since it is known that the payee presents a paper or electronic static barcode to allow the store to scan the barcode to modify the payment amount to the discount amount on the coupon, this is a transaction scenario that has been widely implemented. However, in the known transaction scenario, the user experience of both the payee and the payee is very inconvenient. Accordingly, as shown in FIG6, the present invention uses a dialogue-based scanning payment architecture to apply to the scenarios of requesting payment and integrating coupon selection, wherein the application scenario of requesting payment is similar to the aforementioned requesting payment. The following is a description of the scenario of integrating coupon selection in this embodiment.

In the context of integrated coupon selection, the payee device 21 and the payer device 22 are allowed to conduct an integrated coupon selection dialogue or interaction, wherein the payer device 22 pre-stores coupon information with coupon codes. In one embodiment, the payer device 22 can also manage coupons through an installed application, so as to provide the coupon code of the coupon for use during the integrated coupon dialogue or interaction. Specifically, during the payment request dialogue between the payee device 21 and the payee device 22, the payee device 22 automatically searches for the stored coupon information upon receiving the payment request message 214 from the payee device 21, and then adds the coupon code of the coupon information to the payment message 224, so that when the payee device receives the payment amount of the payment message 224, it also receives the coupon code, and modifies the requested payment amount according to the coupon code and confirms the payment amount, thereby completing the payment request dialogue or interaction.

Specifically, in the embodiment of the present invention that integrates the coupon dialogue, when conducting the request-response dialogue during the transaction process, the original payment process can be jumped through a plug-in or an extended instruction set to perform the tasks of automatically matching, comparing, and using coupons. The specific process includes three steps. First, the payer device 22 obtains the product price list message (i.e., the payment request message 214) from the payee device 21, or the payer device 22 provides a list of all electronic coupons applicable to the payee's store. Then, the payer device 22 performs multiple calculations on the product price list it holds and the applicable products and applicable conditions of the coupons to find the best result that meets the pre-set conditions (such as the lowest total price, the fastest expiration). Finally, after receiving the product price list message formed by the payer device 22 based on the calculation result, the payee device 21 responds to the payment system with the calculation result to complete the transaction. Therefore, when this embodiment is actually applied, a store-specific plug-in can be pre-loaded to perform optimization calculations. In this way, the present invention can further enhance the convenience of the transaction process.

In addition, in the embodiment of the present invention of the interactive code scanning integrated with member identity verification, for example, when the store calculates discounts and rewards, different discounts or rewards are often required based on the consumer's membership card qualifications. However, when the consumer holds more membership cards, the management and use of membership cards will easily become a problem. Although there are APPs on the market that have improved by integrating membership cards issued by different stores, the aforementioned APPs do not have the ability to actively read store information. Therefore, consumers still need to open the APP to find the membership card. Moreover, the purpose of the aforementioned APP is only to replace the physical membership card, and it does not integrate the electronic coupons that consumers have obtained for combined calculations, and it cannot be automatically presented during the payment process, so it cannot solve the existing problems. The present invention integrates member identity verification into the scan code payment through a conversational scan code method, and can automatically find the member card and the corresponding discount. The operation method of this embodiment is the same as the above-mentioned integrated coupon selection dialogue or interaction, so it is not repeated. Therefore, since the conversational scan code system of the present invention can perform two-way responses, the management of member cards can be the same as the above-mentioned integrated electronic invoice and coupon selection, which are just an extended instruction set or plug-in of the scan code payment system, which can be activated at any time and integrated into the payment process, speeding up the transaction while reducing the inconvenience of users managing cards (whether physical or virtual).

7A-7D are schematic diagrams of the operation of the embodiment of the present invention in the delivery request dialogue. First, since the system of the present invention can expand the data payload capacity through a two-way scanning communication mechanism, a key signature can be added to the dialogue message or response message, so the system of the present invention can have the function of providing a pickup certificate. Furthermore, since the interactive scanning system of the present invention can respond in both directions, after the payee (store) and the payee (consumer) confirm that the payment is successful, the payee device 21 can send a set of order numbers and order-specific key information (order verification key) to the payee device 22, so that the payee and the payee can run the interactive query verification of the delivery request dialogue without a mutual trust mechanism and platform support to ensure the rights and convenience of both parties. In addition, the store can also deliver the order-specific asymmetric key to the logistics company to confirm that the pick-up is the payee or its agent, and after the logistics completes the delivery, the unforgeable information of the pick-up device can also be used to confirm the completion of the delivery task and request service fees from the store. The delivery request dialogue or interaction related to the present invention is described in detail below.

As shown in FIG. 7A , when delivering the goods, the store owner or the delivery person presents the dialogue message 114 including the order number and the random code A through the first end device 11 . After the first end device 11 uses the order verification key to sign and encrypt the dialogue message 114 , it is converted into a first end barcode. As shown in FIG. 7B , the consumer uses a mobile phone as the second end device 12 to read the first end barcode and receive a dialogue message 114 encrypted by the order verification key. The second end device 12 uses the order verification key received when the payment is successful to decrypt the dialogue message 114, and then confirms that the order number and random code A are correct. Then, the random code B is used as a reverse verification code, and the order number, random code A and random code B are encrypted by the order verification key to form a response message 124, which is converted into the second end barcode. As shown in FIG7C , after the first end device 11 reads the second end barcode, it obtains the encrypted response message 124, decrypts it using the order verification key, and confirms that the order number, random code A, and random code B are correct, then the identity of the consumer can be confirmed, and then a dialogue message 114' is responded. As shown in FIG7D , after the store confirms the identity of the consumer, the barcode provides the second end device 12 with a message that the order number, random code A, and random code B are correct, and after replying to the store with a successful verification response message 124', the goods can be delivered.

In other words, as shown in Figure 7A, the verification code presented by the store at the time of delivery, the data presented by the store is signed by the store's private key, and the data itself cannot be forged by a third party.

As shown in Figure 7B, the verification data presented by the store contains a random code A encrypted by the order verification key. Therefore, the counterfeit consumer cannot correctly present the reverse verification code without the order verification key. This can prevent the goods from being picked up by criminals pretending to be consumers. The reason for the need for reverse verification is that if the criminal pretends to be a consumer to pick up the goods, and there is no reverse verification mechanism, the criminal can obtain the verification data presented by the store and then use it to defraud the real consumer.

As shown in Figure 7C, the reverse verification data (i.e., order number, verification code A, and verification code B) can be encrypted by the order verification key, that is, the reverse verification data includes the random code A generated by the store and the random code B generated by the consumer. Therefore, even if the criminal has obtained the verification code of the store, he will still not be able to correctly read the random code B, and therefore cannot generate reverse verification success information.

As shown in Figure 7D, since the store can show that the reverse verification response is correct, the identities of both parties have been verified, allowing the store and the consumer to deliver or receive goods quickly and safely.

The above-mentioned dialogue or interaction for requesting delivery can also be used for payment and delivery of goods by stalls. In short, the payee is the stall owner and the payee is the consumer. In this simple transaction scenario, the store usually does not have a cash register, and the consumer only verbally expresses the items he needs, and the store will manually record the order and then prepare the goods for delivery to the consumer. However, the aforementioned orders are not recorded, so stall owners often misdeliver goods or forget to prepare them due to being busy, or cannot find consumers when they are ready. Furthermore, when accepting orders, stores often have to stop their work to collect cash, and when work is frequently interrupted, work efficiency will be greatly reduced. In addition, when the network connection is poor or unstable (such as during New Year's Eve events, large-scale sports events, and suburban stall network overloads), the known active or passive scanning payment mechanism usually requires connection with the payment platform to complete. Therefore, the integration of traditional technology and order management system will become an operational obstacle, and of course it is impossible to achieve the convenience of importing order or invoice integration in this invention. Accordingly, through the delivery request dialogue or interactive delivery verification mechanism of the present invention, the conversational QR code payment architecture provides a complete security and anti-counterfeiting mechanism, which can achieve high security similar to that of HCE credit cards, and can directly exchange information without going through a third-party platform. Therefore, the present invention can still provide a good transaction experience in an offline environment. In addition, the conversational QR code architecture of the present invention has high transaction step integration capabilities and usage flexibility, and can still be used in poor network conditions or offline situations, so it can avoid stall interruptions and speed up service.

In addition, the present invention can also be applied to the implementation of interactive scanning electronic pass. The two most common existing solutions in the known technology are physical NFC (Near-Field Communication) cards and mobile phone HCE (Host Card Emulation) virtual ID cards. However, in the known technology, the existing problem is that the issuance price or cost of physical NFC cards is relatively high, and the key replacement is not easy. In addition, although the mobile phone HCE virtual ID card can solve the problem of issuance cost and key replacement flexibility of physical NFC cards, the NFC function of the mobile phone has serious model compatibility barriers. In other words, the current electronic pass is not applicable. The NFC protocol mainly uses the simulation technology of HCE virtual ID card. Although the simulation technology of HCE virtual ID card effectively overcomes the inconvenience and high cost of issuing and updating physical pass cards, mobile phone manufacturers generally do not pay much attention to the compatibility issue of NFC. Therefore, although the simulation technology of HCE virtual ID card is very mature, there are still a large number of mobile phones and NFC devices on the market that are not compatible with each other.

In this regard, the embodiment of the interactive code scanning electronic pass of the present invention can handle most device compatibility issues by adding the above-mentioned hardware adaptation dialogue or interaction; furthermore, if common problems such as unclear lens and damaged display that cannot output images correctly occur, users can easily complete preliminary troubleshooting by themselves. Therefore, through the application of this embodiment, the above-mentioned hardware incompatibility problem can be solved. In other words, the interactive code scanning architecture adopted by the present invention can overcome the problems of high cost and hardware compatibility at the same time, as described below.

First, install the key into any smart device with a display and camera using the HCE virtual ID card issuance method, making the smart device a second-end device. Before identity verification, the holder of the HCE virtual ID card can use fingerprints, facial recognition, gestures or passwords to unlock the APP used to manage the electronic pass and enter the identity verification state.

When verifying identity, the smart device and the access control machine with a display and a camera (first-end device) first conduct hardware adaptation dialogue or interaction. After adaptation, the access control machine sends a random verification code in the form of a barcode for the smart device to read the barcode. In addition, since the amount of data in the electronic pass is small, the hardware adaptation step can be simplified or abandoned.

The smart device (device of the certificate holder) performs anti-counterfeiting calculations on the random verification code using technologies such as private key signature or key encryption/HMAC hashing, and then sends the barcode image back to the access control machine so that the access control machine can release the person after successful verification. Anti-counterfeiting calculations are existing technologies. In short, a symmetric or asymmetric key can be stored on the mobile phone, and then a communication protocol can be established between the two mobile phones to design an anti-counterfeiting calculation. Different anti-counterfeiting technologies are used for different needs, so I will not elaborate on them here.

In summary, the interactive scanning architecture of the present invention can provide expanded data payload capacity and a two-way scanning communication mechanism, thereby achieving high security strength that is difficult or impossible to achieve with conventional technology. Therefore, the present invention can be fully applicable to the field of electronic passes.

FIG8 is a step diagram of the highly flexible interactive code scanning method of the present invention. As shown in the figure, the present invention enables a first-end device having a first-end lens and a first-end display and a second-end device having a second-end lens and a second-end display to communicate or interact. The description of each step of the present invention is described in detail as follows.

In step S810, the first end device displays the first end barcode corresponding to the dialogue message. Specifically, the first end device converts the dialogue message into at least one first end barcode to be displayed on the first end display. In a specific embodiment, the first end barcode can be a one-dimensional barcode or a two-dimensional barcode.

In step S820, the second end device obtains the dialogue message by capturing the first end barcode. That is, the second end device scans the first end display through the second end lens to capture the first end barcode, and after analysis, obtains the dialogue message corresponding to the captured first end barcode.

In step S830, the second end device generates a response message. When the second end device obtains the dialogue message of the first end device according to the first end barcode, the second end device performs corresponding processing on the dialogue message and automatically generates a response message in response to the dialogue message according to the dialogue message.

In step S840, the second end device displays the second end barcode corresponding to the response message. After generating the response message, the second end device automatically converts the response message into at least one second end barcode to be displayed on the second end display.

In step S850, the first end device obtains a response message by capturing the second end barcode. In short, after the first end device displays the first end barcode, it activates the first end lens. Accordingly, the first end device captures the second end barcode from the second end display through the first end lens, and obtains the response message by analyzing the captured second end barcode.

In one embodiment, the highly flexible interactive code scanning method of the present invention can further install corresponding applications on the first end device and the second end device, and each application automatically operates the first end device and the second end device to perform a dialogue or interaction between the two. Therefore, the highly flexible interactive code scanning method of the present invention automatically communicates or interacts with each other between the first end device and the second end device to transmit messages or data, thereby reducing the operation time of manual operation, thereby achieving the purpose of increasing security and avoiding possible fraud in manual operation.

In one embodiment, if the first-end device wants to conduct a conversation or interaction with a large amount of data in the dialogue message, the first-end device can divide the dialogue message into multiple first-end barcodes to be displayed in sequence on the first-end display, so that the second-end device can sequentially capture the multiple first-end barcodes and integrate them into the dialogue message after analysis. That is, the first-end device displays one first-end barcode at a time, and the second-end device reads all the first-end barcodes of the first-end device in sequence by continuously activating the second-end lens, and then integrates the corresponding data read each time, so as to obtain a dialogue message with a larger amount of data transmitted by the first-end device. In addition, when the second-end device wants to respond to a response message with a large amount of data, the second-end device can also divide the response message into multiple second-end barcodes to be displayed in sequence on the second-end display, so that the first-end device can sequentially capture each second-end barcode, so that after the first-end device reads all the second-end barcodes, they are analyzed and integrated into a response message. The amount of data contained in a single barcode in the learning method is limited. Therefore, the barcode in the learning method can only provide limited data information in application. The present invention utilizes the aforementioned automatic dialogue between the first-end device and the second-end device, and the message transmission can be dispersed in multiple barcodes, so the highly flexible dialogue scanning method of the present invention can be widely used in many situations.

In addition, in order to enable the first end device or the second end device to instantly know whether the other device has actually read all the barcodes when transmitting multiple first end barcodes or multiple second end barcodes, and to be able to re-read or terminate the dialogue or interaction when the other device has not actually read all the barcodes, the present invention further includes a processing mechanism for transmitting multiple barcodes. Specifically, taking the first end sending a dialogue message as an example, after the first end device sequentially sends all the first end barcodes corresponding to the dialogue message, and the second end device captures all the first end barcodes, the first end device activates the first end lens (or keeps the first end lens turned on from the beginning), and the second end device first displays a confirmation message of receiving the barcode on the second end display, so that the first end device obtains the completion of receiving multiple first end barcodes. Information can be used to determine that all the first-end barcodes sent have been read by the second-end device. If the first-end device displays all the first-end barcodes but does not receive the confirmation message of the reception completion barcode, the first-end device can immediately resend the first-end barcodes to ensure the smooth completion of the conversation. In addition, the first-end device can also directly terminate the conversation or interaction, so that users such as stores or consumers can confirm and find the problem of conversation termination.

In one embodiment, since the present invention can provide a message with a large amount of data when the first end device and the second end device are talking or interacting, the present invention can add an encryption key or a key signature to the conversation message or the response message. In this way, when a conversation message or a response message is sent each time, an encryption key or a key signature for verification is added to the first end barcode or the second end barcode, which can enhance the security of the conversation and provide offline transactions.

According to the above, in the highly flexible conversational scanning method of the present invention, the conversation or interaction between the first end device and the second end device can be a payment request conversation, an electronic invoice integration conversation, a coupon selection integration conversation, a member identity verification integration conversation, or a delivery request conversation. Furthermore, the first end device and the second end device can have multiple conversations or interactions, that is, any combination of payment request conversation, electronic invoice integration conversation, coupon selection integration conversation, member identity verification integration conversation, or delivery request conversation.

FIG9 is a step diagram of the highly flexible interactive scanning method of the present invention for executing hardware adaptation dialogue or interaction. Before the first end device and the second end device perform the above-mentioned various dialogues or interactions, or during the dialogue or interaction, if the first end device or the second end device cannot transmit information of the high-speed protocol due to hardware specification differences, the present invention first executes the hardware adaptation dialogue or interaction between the first end device and the second end device, wherein the hardware adaptation dialogue or interaction includes the following steps.

In step S910, the first end device displays a plurality of first end positioning barcodes for calibrating the screen position. Specifically, the first end device displays a plurality of first end positioning barcodes on the first end display in an arranged manner, each first end positioning barcode includes position information for calibrating the screen position, wherein the position information may be the range of each first end positioning barcode. For example, as shown in FIG. 3A, each first end positioning barcode is arranged in an array of four rows and two columns, and each vertex of each first end positioning barcode is numbered in sequence.

In step S920, the second end device captures each of the multiple first end positioning barcodes to obtain the visible range of the second end lens. That is, the second end device scans the first end display of the first end device through the second end lens to capture the multiple first end positioning barcodes displayed on the first end display, and analyzes the corresponding range according to the number of the multiple first end positioning barcodes that can be captured to obtain the visible range of the second end lens. As shown in Figure 3B, the second end lens of the second end device can only observe six first end positioning barcodes in three rows and two columns, that is, the visible range of the second end lens is the range distributed by numbers 1 to 24.

In step S930, the second end device provides the first end device with the visible range through the second end hardware specification barcode. In short, the second-end device uses the number of the above-mentioned visible range and the corresponding distribution range and the hardware data of the second-end device to form a second-end hardware specification barcode and display it on the second-end display, so that the first-end device can obtain information about the area where the barcode can be displayed during subsequent dialogues. That is, when executing a payment request dialogue, for example, the first-end device uses the aforementioned visible range (i.e., the range distributed by numbers 1 to 24) as the area for displaying the barcode, that is, the first-end barcode is only displayed in this area, that is, by making the display conditions of the first-end barcode meet the hardware specifications of the second-end device, the second-end device can read the first-end barcode, thereby achieving the purpose of hardware adaptation.

Similarly, the second-end device also allows the first-end device to perform hardware adaptation in the same way, that is, the two parties exchange data through the positioning barcode and the hardware specification barcode, so that the first-end device and the second-end device can obtain information about the hardware capabilities of the other party, thus avoiding the situation where barcode reading fails due to insufficient hardware capabilities of one party.

In addition, the present invention also discloses a computer-readable medium, which is applied to a computing device or computer having a processor (e.g., CPU, GPU, etc.) and/or a memory, and stores instructions, and the computing device or computer can execute the computer-readable medium through the processor and/or memory to execute the above-mentioned method and each step when executing the computer-readable medium.

In summary, the highly flexible interactive code scanning system and method of the present invention enable the first end device and the second end device to automatically scan each other to provide an expanded data payload capacity and a two-way code scanning communication mechanism, thereby achieving the effect of improving the convenience of operation and the security of transactions. That is, the present invention can expand the use of short-distance communication between two information devices through a communication architecture that can be used for code scanning payment, wherein the scenarios are as described in the above-mentioned embodiments. Compared to other QR code payment technologies, the present invention has the characteristics of being able to carry a large amount of data, providing a highly anti-counterfeiting and highly secure transaction process, and having the function of hardware adaptation. Therefore, it is adaptable to the problem of different lens levels or screen quality between hardware. Furthermore, the present invention enables each device to automatically interact in a dialog-like manner, thus having the potential to integrate more payment behaviors in the transaction, such as presenting a membership card number, selecting the lowest-priced coupon, presenting payment information, presenting electronic invoice information, etc. in the integration of payment transactions. Therefore, the advantages of the present invention compared to other short-distance communication architectures are that it breaks through the defects of the security, overall transaction speed, hardware adaptability, etc. of the known technology, increases the applicable scenarios of the QR code payment technology, and enhances the user experience of existing scenarios. Therefore, the highly flexible interactive code scanning system and method of the present invention have the following characteristics.

First, the invention has a larger and theoretically unlimited amount of data that can be carried, and can effectively prevent counterfeiting and eavesdropping during the transaction process.

Second, the present invention can support the high-security two-way verification process required for offline scanning transactions.

Third, the present invention has the feature of being able to integrate multiple payment actions and automatically complete them in one operation.

Fourth, the present invention has a high degree of hardware adaptability, so that devices with high-end lenses and/or screens can be compatible with devices of inferior quality, thereby reducing the possibility of scanning failure.

Fifth, the present invention can be expanded to various applications such as access control.

Sixth, the present invention can be applied to all smartphones, computers and most payment scenarios on the market, so it has strong commercial practicality.

In addition, the modules, units, devices, etc. of the present invention include microprocessors and memories, and algorithms, data, programs, etc. are stored in memories or chips. The microprocessor can load data or algorithms or programs from the memory to perform data analysis or calculations, etc., which will not be elaborated here. In other words, the highly flexible interactive barcode scanning system and its method of the present invention can be executed on electronic devices, such as general computers, tablets or servers, and perform data analysis and calculations after receiving data. Therefore, the program performed by the highly flexible interactive barcode scanning system and its method of the present invention can be designed and constructed on electronic devices with components such as processors and memories through software to run on various types of electronic devices; in addition, each module or unit in the highly flexible interactive barcode scanning system can be composed of independent components, such as calculators, memories, storages or firmware with processing units, which can all be used to implement the present invention, that is, the present invention can be presented in software programs, hardware or firmware architectures.

The above embodiments are only illustrative and not intended to limit the present invention. Anyone familiar with this technology may modify and change the above embodiments without violating the spirit and scope of the present invention. Therefore, the scope of protection of the present invention is defined by the scope of the patent application attached to the present invention. As long as it does not affect the effect and implementation purpose of the present invention, it should be covered by this public technical content.

1: Interactive scanning system

11: First end device

111: First end lens

112: First end display

113: First end barcode

12: Second end device

121: Second end lens

122: Second end display

123: Second end barcode

Claims (15)

A highly flexible interactive barcode scanning system includes: a first-end device having a first-end lens and a first-end display; and a second-end device having a second-end lens and a second-end display, wherein the first-end device and the second-end device firstly perform hardware adaptation interaction, wherein the hardware adaptation interaction is that the first-end device arranges and displays a plurality of first-end positioning barcodes for calibrating the screen position on the first-end display, and the second-end device captures the plurality of first-end positioning barcodes through the second-end lens, and obtains the visible range of the second-end lens according to the corresponding range analyzed according to the quantity of the plurality of first-end positioning barcodes captured, and the second-end device transmits the visible range and the hardware data of the second-end device through the second-end hardware. The physical specification barcode is displayed on the second end display, so that the first end device can determine the area on the first end display that can display the barcode during the subsequent dialogue, so that when the first end device interacts with the second end device, the first end device converts the dialogue message into the first end barcode displayed on the first end display, so that the second end device captures the first end barcode through the second end lens and analyzes the first end barcode to obtain the dialogue message and generate a response message corresponding to the dialogue message. Afterwards, the second end device converts the response message into the second end barcode displayed on the second end display, so that the first end device captures the second end barcode through the first end lens and analyzes the second end barcode to obtain the response message. A highly flexible conversational barcode scanning system as described in claim 1, wherein the first end device divides the conversation message into multiple first end barcodes and displays them sequentially on the first end display, so that the second end device sequentially captures the multiple first end barcodes and then analyzes the multiple first end barcodes to integrate them into the conversation message. A highly flexible interactive barcode scanning system as described in claim 2, wherein after the second end device captures the multiple first end barcodes, it displays a reception completion barcode on the second end display, so that the first end device obtains information that the multiple first end barcodes have been received. A highly flexible interactive barcode scanning system as described in claim 3, wherein when the first end device displays all of the multiple first end barcodes and does not capture the reception completion barcode from the second end display, the multiple first end barcodes are resent or the interaction is terminated. A highly flexible interactive barcode scanning system as described in claim 1, wherein the second end device divides the response message into multiple second end barcodes and displays them sequentially on the second end display, so that the first end device sequentially captures the multiple second end barcodes and integrates them into the response message after analysis. A highly flexible conversational scanning system as described in claim 1, wherein the conversation message or the response message includes an encryption key or a key signature. A highly flexible conversational barcode scanning system as described in claim 1, wherein the interaction between the first end device and the second end device is one of a payment request conversation, an integrated electronic invoice conversation, an integrated coupon selection conversation, an integrated member identity verification conversation, and a delivery request conversation, or any combination thereof. A highly flexible interactive barcode scanning method provides a first-end device having a first-end lens and a first-end display and a second-end device having a second-end lens and a second-end display for interaction, wherein the method includes: allowing the first-end device to display a plurality of first-end positioning barcodes for calibrating the screen position on the first-end display; allowing the second-end device to capture the plurality of first-end positioning barcodes through the second-end lens, and to obtain the visible range of the second-end lens by analyzing the corresponding range according to the quantity of the plurality of first-end positioning barcodes captured; allowing the second-end device to display the visible range and the hardware data of the second-end device through the second-end hardware specification barcode On the second-end display, the first-end device determines the area on the first-end display that can display the barcode during the subsequent conversation; the first-end device converts the conversation message into the first-end barcode displayed on the first-end display; the second-end device captures the first-end barcode through the second-end lens and analyzes the first-end barcode to obtain the conversation message; the second-end device generates a response message corresponding to the conversation message according to the conversation message; the second-end device converts the response message into the second-end barcode displayed on the second-end display; and the first-end device captures the second-end barcode through the first-end lens and analyzes the second-end barcode to obtain the response message. The highly flexible conversational barcode scanning method as described in claim 8, wherein the step of causing the first end device to convert the conversation message into a first end barcode displayed on the first end display and causing the second end device to capture the first end barcode through the second end lens and analyze the first end barcode to obtain the conversation message further comprises: the first end device divides the conversation message into a plurality of first end barcodes and sequentially displays them on the first end display, so that the second end device sequentially captures the plurality of first end barcodes, and then analyzes the plurality of first end barcodes to integrate them into the conversation message. A highly flexible interactive barcode scanning method as described in claim 9, wherein after the second end device captures the multiple first end barcodes, it displays a reception completion barcode on the second end display, so that the first end device obtains information that the multiple first end barcodes have been received. A highly flexible interactive barcode scanning method as described in claim 10, wherein when the first end device displays all of the multiple first end barcodes and does not capture the reception completion barcode from the second end display, the multiple first end barcodes are resent or the interaction is terminated. As described in claim 8, the highly flexible interactive barcode scanning method, wherein the second end device divides the response message into a plurality of second end barcodes and sequentially displays them on the second end display, so that the first end device sequentially captures the plurality of second end barcodes and integrates them into the response message after analysis. A highly flexible conversational scanning method as described in claim 8, wherein the conversation message or the response message includes an encryption key or a key signature. A highly flexible conversational code scanning method as described in claim 8, wherein the interaction between the first end device and the second end device is one of a payment request conversation, an integrated electronic invoice conversation, an integrated coupon selection conversation, an integrated member identity verification conversation, and a delivery request conversation, or any combination thereof. A computer-readable medium, used in a computing device or a computer, stores instructions for executing a highly flexible interactive scanning method as described in any one of claims 8 to 14.

Images