KR20170029859A - User equipment, service providing device, POS terminal, payment system comprising the same, control method thereof and computer readable medium having computer program recorded thereon - Google Patents

Abstract

The present invention discloses a user device, a service providing device, a POS terminal, a payment system including the same, a control method thereof, and a recording medium on which a computer program is recorded. That is, the present invention analyzes and analyzes the face of the user through the camera configured in the POS terminal to confirm whether or not the user joins the membership, stores the image information obtained through the camera at the time of settlement as history, The security can be improved, and the burden of the operation of the user's terminal can be reduced, thereby improving convenience.

Description

TECHNICAL FIELD [0001] The present invention relates to a user equipment, a service providing apparatus, a POS terminal, a payment system including the same, a control method thereof, and a recording medium on which a computer program is recorded medium having computer program recorded thereon}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user apparatus, a service providing apparatus, a POS terminal, a payment system including the same, a control method thereof, and a recording medium on which a computer program is recorded. In the case where the POS terminal enters the store where the terminal is installed, the terminal device stores the feature information of the reference object corresponding to the user of the user apparatus transmitted from the service providing apparatus in advance, The image information including the user is acquired while scanning the goods to be paid (or recognizing the barcode attached to the goods to be paid) for the goods to be settled (or the settled goods) And extracts the feature information of the extracted user from the feature information of the reference object stored in advance A service providing apparatus, a POS terminal, a payment system including the same, and a payment system including the POS terminal, the POS terminal, the POS terminal, and the POS terminal, which performs the additional authentication procedure when the degree of similarity between the two objects is smaller than a preset reference value, A control method thereof, and a recording medium on which a computer program is recorded.

A beacon or a wireless hub installed in a store transmits a wireless signal such as a BLE beacon signal for publicity or service promotion of the store, and a user apparatus adjacent to the beacon or wireless hub transmits a beacon or a wireless signal transmitted from the wireless hub And displays information included in the received radio signal.

Such a user device simply receives and displays the information provided by the store, and is difficult to perform the additional service function based on the information provided by the store.

In addition, since authentication is performed based only on information provided by the user apparatus operator, there arises a problem concerning the theft or fraudulent use.

Korean Patent Publication No. 10-2015-0002067 [entitled " Payment Service Method, Terminal and Server Using App-Based Mobile Card]

SUMMARY OF THE INVENTION It is an object of the present invention to provide a user apparatus, a service providing apparatus, and a method for analyzing a face of a user through a camera configured in a POS terminal to confirm and identify whether or not a user joins membership, A POS terminal, a payment system including the POS terminal, a control method thereof, and a recording medium on which a computer program is recorded.

It is another object of the present invention to provide a POS terminal which detects information on a user of a corresponding user apparatus in advance when a check-in process is performed through a beacon in performing a simple settlement and identifies the user of the corresponding user apparatus to the POS terminal A POS terminal, a payment system including the POS terminal, a control method thereof, and a recording medium on which a computer program is recorded.

A POS terminal according to an embodiment of the present invention includes a communication unit for receiving characteristic information of an object corresponding to identification information of a user equipment visiting a store provided with a POS terminal transmitted from a service providing apparatus; A storage unit for temporarily storing the feature information of the object corresponding to the identification information of the received user equipment; A recognition unit that scans at least one item to be paid by the user of the user apparatus; A display unit for displaying product information on one or more items to be paid out; An imaging unit that acquires image information including a user of the user apparatus in a background state while scanning at least one item to be paid through the recognition unit; And recognizing one or more objects included in the image information by performing an object recognition function on the acquired image information, and storing the feature information of the recognized one or more objects and the characteristics of the object corresponding to the identification information of the user apparatus temporarily stored in the storage unit And a controller for checking whether the payment card is fraudulently used based on the information.

As an example related to the present invention, the control unit may extract the feature information in the acquired image information, and recognize one or more objects included in the image information based on the extracted feature information.

As an example related to the present invention, the controller calculates the similarity between the feature information of the recognized one or more objects and the feature information of the object corresponding to the identification information of the user apparatus temporarily stored in the storage unit, and if the calculated similarity is equal to or greater than a preset reference value Can be confirmed.

As an example related to the present invention, when the calculated degree of similarity is equal to or greater than a predetermined reference value, it is determined that the payee who wishes to make a settlement matches a user registered in advance, In order to perform the settlement function by the settlement method, the communication section can be controlled so as to transmit at least one item of goods to be settled, identification information of the POS terminal, and identification information of the user apparatus to the settlement server.

As an example related to the present invention, when the calculated similarity is smaller than a preset reference value, the control unit may perform an additional authentication procedure by interlocking with the user apparatus.

A method of controlling a POS terminal according to an exemplary embodiment of the present invention includes: receiving characteristic information of an object corresponding to identification information of a user equipment visiting a store equipped with a POS terminal transmitted from a service providing apparatus through a communication unit; Temporarily storing feature information of the object corresponding to the identification information of the received user equipment through the storage unit; Acquiring image information including a user of a user apparatus in a background state through a photographing unit while scanning at least one item to be selected by a user of the user apparatus through a recognition unit; Recognizing at least one object included in the image information by performing an object recognition function on the acquired image information through the control unit; Calculating a degree of similarity between the feature information of the recognized one or more objects and the feature information of the object corresponding to the identification information of the user apparatus temporarily stored in the storage unit through the control unit; Checking whether the calculated degree of similarity is equal to or greater than a preset reference value through the control unit; And a communication unit which, when the calculated degree of similarity is equal to or greater than a preset reference value, determines that the payee who wishes to make a settlement matches a user registered in advance and selects a predetermined settlement method To the payment server, at least one item of goods to be settled, identification information of the POS terminal, and identification information of the user apparatus.

According to another aspect of the present invention, there is provided a method for controlling a payment card, comprising the steps of: performing an additional authentication procedure by interlocking with a user device to prevent fraudulent use of a payment card through a control unit when the calculated similarity is smaller than a preset reference value; And transmitting the identification information of the POS device and the identification information of the POS device to the payment server through the communication unit after the additional authentication procedure between the POS terminal and the user device is normally performed, have.

A computer program for carrying out the method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

A billing system according to an embodiment of the present invention includes a user device for providing identification information of a user device when entering a store; A service providing apparatus for providing characteristic information of an object corresponding to identification information of a user apparatus; Temporarily storing feature information of an object corresponding to identification information of a user apparatus provided from a service providing apparatus, scanning at least one item to be settled, acquiring image information including a user of the user apparatus, Recognizes one or more objects included in the image information by performing an object recognition function for the payment card, and recognizes one or more objects included in the image information based on the feature information of the recognized one or more objects and the feature information of the object corresponding to the identification information of the temporarily stored user apparatus A POS terminal for confirming illegal use; And transmits the identification information of the user apparatus transmitted from the POS terminal to the service providing apparatus and transmits at least one payment based on the card information, the user information, and the benefit information transmitted from the service providing apparatus in response to the identification information of the transmitted user apparatus And a payment server for performing a payment function for the goods.

As an example related to the present invention, when the similarity between the feature information of the recognized one or more objects and the feature information of the object corresponding to the identification information of the temporarily stored user apparatus is smaller than a preset reference value, Additional authentication procedures can be performed.

The present invention analyzes a face of a user through a camera configured in a POS terminal to confirm and identify whether or not a user joins membership, and stores image information obtained through a camera at the time of settlement as a history to prevent fraudulent use of the payment card There is an effect that can be tracked when used illegally.

Also, when performing a check-in process using a beacon when performing a simple settlement, the present invention detects information on a user of the corresponding user device in advance and provides the detected information to the POS terminal. Thus, even when the communication environment is poor, it is possible to effectively identify, improve the security, and reduce the burden on the user's terminal to improve convenience.

1 is a block diagram showing a configuration of a payment system according to an embodiment of the present invention.
2 is a cross- FIG. 8 is a block diagram illustrating a configuration of a user apparatus according to an embodiment of the present invention.
3 is a block diagram illustrating a configuration of a POS terminal according to an embodiment of the present invention.
4 to 6 are flowcharts illustrating a method of controlling a payment system according to an embodiment of the present invention.
7 is a diagram illustrating a screen of a user apparatus according to an embodiment of the present invention.
8 is a diagram illustrating a screen of a POS terminal according to an embodiment of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art can be properly understood. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. The term "comprising" or "comprising" or the like in the present invention should not be construed as necessarily including the various elements or steps described in the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a settlement system 10 according to an embodiment of the present invention.

1, the billing system 10 includes a user apparatus 100, a beacon 200, a service providing apparatus 300, a POS terminal 400, and a payment server 500. Not all of the components of the billing system 10 shown in Fig. 1 are essential components, and the billing system 10 may be implemented by more components than the components shown in Fig. 1, The payment system 10 may also be implemented.

The user device 100 may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a telematics terminal, A portable terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (for example, a watch type A smart TV, a digital broadcasting terminal, a television (TV), a digital television (TV), a digital television (TV) A home theater system, an AVN (Audio Video Navigation) terminal, an A / V (Audio / Video) system, a flexible terminal, and the like.

2, the user device 100 includes a user device communication unit 110, a user device storage unit 120, a user device display unit 130, a user device audio output unit 140, and a user device control unit 150 ). Not all of the components of the user device 100 shown in Fig. 2 are required, and the user device 100 may be implemented by more components than the components shown in Fig. 2, The user device 100 may be implemented.

The user device communication unit 110 communicates with any one of the internal components or external at least one terminal through a wired / wireless communication network. At this time, an external arbitrary terminal may include a beacon 200, a service providing device 300, a POS terminal 400, a payment server 500, and the like. Here, the wireless Internet technology includes a wireless LAN (WLAN), a digital living network alliance (DLNA), a wireless broadband (Wibro), a world interoperability for a microwave (WiMAX), a high speed downlink packet access ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) And the user device communication unit 110 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above. In addition, the near field communication technology includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct. The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the user device communication unit 110 can transmit information to and from an arbitrary terminal through a universal serial bus (USB).

In addition, the user equipment communication unit 110 may be configured to communicate with a plurality of mobile communication systems, such as a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE (High Speed Downlink Packet Access) The beacon 200, the service providing device 300, the POS terminal 400, the payment server 500, and the like on a mobile communication network constructed according to a service provider's name,

The user device communication unit 110 may also be configured to transmit the identification information of the beacon 200 transmitted from the beacon 200 or the unique identification information of the store having the beacon 200, ).

The user device storage unit 120 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

Also, the user device storage unit 120 stores data and programs necessary for the user device 100 to operate.

That is, the user device storage unit 120 may store a plurality of application programs (application programs or applications) driven by the user device 100, data for operation of the user device 100, and commands. At least some of these application programs may be downloaded from the external service providing device via wireless communication. Also, at least some of these applications may reside on the user device 100 since the time of shipment for the basic functions (e.g., phone call incoming, outgoing, message receiving, originating functions) of the user device 100. The application program may be stored in the user device storage unit 120 and may be installed in the user device 100 and may be operated by the user device control unit 150 to perform the operation have.

The user device storage unit 120 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM) , And a programmable read-only memory (PROM). In addition, the user device 100 may operate web storage or operate in association with web storage to perform the storage function of the user device storage unit 120 on the Internet.

The user device storage unit 120 stores identification information of the corresponding beacon 200 received through the user device communication unit 110 under the control of the user device controller 150 Unique identification information).

The user device display unit 130 may display various contents such as various menu screens by using the user interface and / or graphical user interface stored in the user device storage unit 120 under the control of the user device controller 150. [ Here, the content displayed on the user device display unit 130 includes various text or image data (including various information data) and a menu screen including data such as an icon, a list menu, and a combo box. Also, the user device display unit 130 may be a touch screen.

The user device display unit 130 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) And may include at least one of a flexible display, a 3D display, an e-ink display, and a light emitting diode (LED).

In addition, the user device display unit 130 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), a projection system (holographic system) can be applied.

The user device display unit 130 displays the identification information of the beacon 200 received through the user device communication unit 110 under the control of the user device controller 150 Identification information).

The user device audio output unit 140 outputs audio information included in the signal processed by the user device control unit 150. Here, the user device audio output unit 140 may include a receiver, a speaker, a buzzer, and the like.

Also, the user device audio output unit 140 outputs the guidance audio generated by the user device control unit 150.

The user device audio output unit 140 outputs the identification information of the corresponding beacon 200 received through the user device communication unit 110 under the control of the user device controller 150 (I.e., unique identification information of the user).

The user device control unit 150 executes the overall control function of the user device 100. [

The user device controller 150 executes the overall control functions of the user device 100 using the programs and data stored in the user device storage unit 120. [ The user device controller 150 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the user device storage unit 120 and performs booting using the O / S stored in the user device storage unit 120. The CPU can access various programs stored in the user device storage unit 120, And the like.

In addition, the user device control unit 150 performs the membership registration procedure for the user of the user device 100 by interlocking with the service providing device 300.

The user device control unit 150 must complete the authentication function through the authentication means (for example, a mobile phone, a credit card, an Ipfin, an e-mail, etc.) The subscription process can be completed normally.

When the user having the user device 100 enters the store, the user device control unit 150 determines whether the beacon 200 has been received from the beacon 200 The unique identification information of the store).

The user device controller 150 also stores unique identification information of the received beacon 200 (or the unique identification information of the store where the beacon 200 is provided), identification information of the user device 100, 110 to the service providing apparatus 300. Here, the identification information of the user device 100 includes a mobile directory number (MDN), a mobile IP, a mobile MAC, a SIM (subscriber identity module) card unique information, and a serial number.

If the user of the user device control unit 150 is not a registered member of the service providing apparatus 300 in advance, the user device control unit 150 may transmit the guide information related to membership registration provided from the service providing apparatus 300 And performs a membership registration procedure for the corresponding user device 100 (or the user of the user device 100).

When the user of the user device controller 150 is a member registered in advance in the service providing apparatus 300, the user device controller 150 transmits unique identification information of the transmitted beacon 200 (or the corresponding beacon 200) One or more pieces of advertisement information, one or more benefit information, a recommended card list, and the like transmitted from the service providing apparatus 300 in response to the identification information of the user apparatus 100, ≪ / RTI > Here, the benefit information includes coupon information, membership benefit information, discount benefit information, and the like. In addition, the recommended card list includes one or more cards that are applicable to the benefit information among a plurality of cards (or one or more cards) previously issued to the user device 100.

Also, the user device controller 150 outputs the received one or more pieces of advertisement information, benefit information, recommendation card list, etc. through the user device display unit 130 and / or the user device audio output unit 140.

Also, the user device control unit 150 confirms one payment card (or unique identification information of the payment card) selected from a plurality of payment cards registered (or issued) in a specific application installed in advance in the user device 100 do.

Also, the user device controller 150 may check the payment card selected from the recommended card list transmitted from the service providing device 300. [

In addition, the user device control unit 150 may be configured to receive at least one of the plurality of payment cards registered in advance in the user device 100 based on the one or more benefit information provided from the service providing device 300, And displays the generated recommendation card list on the user device display unit 130. [0156] FIG. Also, one payment card selected from the recommended card list displayed on the user device display unit 130 can be confirmed.

Also, the user device controller 150 receives a personal identification number (PIN) corresponding to a user input through a specific application installed in the user device 100 in advance. Here, the PIN number may be a PIN number corresponding to the identified payment card type.

Also, the user device controller 150 transmits the confirmed payment card type (or unique identification information of the payment card), the PIN number, the identification information of the user device 100, etc. to the service providing device 300 .

Also, the user device controller 150 receives the token transmitted from the service providing device 300 through the user device communication unit 110 in response to the previously transmitted PIN number.

In addition, the user device controller 150 generates a barcode (or QR code (Quick Response code)) including the received token (or token information) and the identification information of the user device 100.

In addition, the user device controller 150 stores the generated barcode (or QR code) in the user device storage unit 120.

When the payment method is selected in a predetermined manner through a specific application installed in the user device 100 in advance, the user device controller 150 displays barcode information (or QR code) corresponding to the barcode (or QR code) Information to the POS terminal 400 via the user device communication unit 110. [ Here, the barcode information (or QR code information corresponding to the QR code) corresponding to the barcode includes a token (or token information), identification information of the user device 100, and the like. At this time, the settlement methods include cash settlement, card settlement, electronic settlement, and the like, and the predetermined method may be electronic settlement.

As described above, when the user apparatus 100 and the POS terminal 400 are connected through a wire / wireless communication method, the barcode information (or QR code information) can be transmitted from the user apparatus 100 to the POS terminal 400.

When the user device 100 and the POS terminal 400 are not connected via a wire / wireless communication method, a user of the user device 100 may receive a preset connection via a specific application installed in the user device 100 (Or QR code) displayed on the user device display unit 130 may be recognized (or scanned / tagged) by the POS terminal 400. In this case,

In addition, after the settlement function is performed for at least one product to be settled by the user of the corresponding user device 100 based on the previously transmitted barcode information (or QR code information), the user device controller 150 transmits the previously transmitted Through the user device communication unit 110, a payment function execution result transmitted from the POS terminal 400 (or the service providing device 300) in response to bar code information (or QR code information).

Also, the user device controller 150 outputs the received payment function execution result through the user device display unit 130 and / or the user device voice output unit 140.

In addition, the user device 100 may further include an interface unit (not shown) that serves as an interface with all the external devices connected to the user device 100. For example, the interface unit may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / Input / output (I / O) port, video I / O (input / output) port and earphone port. Here, the identification module is a chip that stores various information for authenticating the usage right of the user device 100, and includes a user identity module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. In addition, a device provided with the identification module can be manufactured in a smart card format. Thus, the identification module can be connected to the user device 100 via the port. The interface unit receives data from an external device or receives power and transmits the data to each component in the user device 100 or data in the user device 100 is transmitted to an external device.

The interface unit may be a path through which power from the cradle is supplied to the user device 100 when the user device 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals input from the cradle or the corresponding power source may be operated as a signal for recognizing that the user device 100 is correctly mounted on the cradle.

The user device 100 also includes an input unit (not shown) for receiving a command or a control signal generated by an operation such as a button operation by the user or a signal according to an arbitrary function selection or a touch / Not shown).

The input unit may include at least one of a command, a selection, data, and information of a user. The input unit may include a plurality of input keys and function keys for inputting numeric or character information and setting various functions.

The input unit may include a key pad, a dome switch, a touch pad (static / static), a touch screen, a jog wheel, a jog switch, a jog shuttle, a mouse, , A stylus pen, a touch pen, and the like can be used. Particularly, when the user device display unit 130 is formed as a touch screen, some or all of the functions of the input device can be performed through the user device display unit 130. [

In addition, each component (or module) of user device 100 may be software stored on the memory (or user device storage 120) of user device 100. The memory may be an internal memory of the user device 100 and may be an external memory or other type of storage device. Further, the memory may be a non-volatile memory. The software stored on the memory may include a set of instructions that, when executed, cause the user device 100 to perform certain operations.

The beacon 200 communicates with the user device 100, the POS terminal 400, and the like.

The beacon 200 also receives store information related to a store provided with the corresponding beacon 200 transmitted from the POS terminal 400 and unique identification information of the store in which the beacon 200 is provided.

The beacon 200 broadcasts (or transmits) store information, identification information of the beacon 200 (or unique identification information of a store in which the beacon 200 is provided), and the like.

The service providing apparatus 300 communicates with the user apparatus 100, the POS terminal 400, the payment server 500, and the like.

The service providing apparatus 300 includes a user apparatus communication unit 110 included in the user apparatus 100, a user apparatus storage unit 120, a user apparatus display unit 130, a user apparatus audio output unit 140, (Not shown), a display unit (not shown), an audio output unit (not shown), and a control unit (not shown), which correspond to the control unit 150, respectively.

In addition, the service providing apparatus 300 performs a membership subscription procedure for the user of the corresponding user device 100 by interlocking with the user apparatus 100, respectively.

In addition, the service providing apparatus 300 receives unique identification information of the beacon 200 transmitted from the user apparatus 100, identification information of the user apparatus 100, and the like.

The service providing apparatus 300 may also be configured to allow the user corresponding to the user apparatus 100 to register with the service providing apparatus 300 in advance based on the received identification information of the corresponding user apparatus 100 (Or confirms) whether or not it is.

If the result of the determination (or the result of the check) is that the user corresponding to the user device 100 is not a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 transmits the guide information related to membership registration, (100).

The service providing apparatus 300 also performs a membership registration procedure for the user apparatus 100 (or the user of the user apparatus 100) by interlocking with the user apparatus 100. [

When the user corresponding to the user device 100 is a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 transmits the beacon 200 received previously, Of the plurality of advertisement information and the plurality of benefit information stored in advance based on the unique identification information of the user device 100 and the identification information of the user device 100, Information, and one or more benefits information.

In addition, the service providing apparatus 300 may include a recommended recommendation card including at least one recommendation card capable of applying (or reflecting) the benefit information among a plurality of cards issued to the user apparatus 100 based on the one or more benefit information that has been confirmed. Create a card list. Here, the benefit information includes coupon information, membership benefit information, discount benefit information, and the like.

In addition, the service providing apparatus 300 may include at least one advertisement information, at least one benefit information, at least one recommendation card, and at least one recommendation card list including at least one advertisement information that can be provided to the corresponding user apparatus 100, And the like to the user device 100.

That is, when the user corresponding to the user apparatus 100 is a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 selects the corresponding beacon 200) corresponding to the unique identification information. In addition, the service providing device 300 checks one or more pieces of advertisement information, benefit information, and the like that can be provided to the corresponding user device 100 in the corresponding store based on the confirmed store information and the identification information of the received user device 100 . Also, the service providing apparatus 300 generates a recommendation card list including one or more cards to which the benefit information can be applied, from among a plurality of cards (or one or more cards) previously issued to the user apparatus 100. In addition, the service providing device 300 transmits to the user device 100 the identified one or more pieces of advertisement information, one or more benefit information, a generated recommendation card list, and the like.

Also, the service providing apparatus 300 receives the type of payment card transmitted from the user apparatus 100, the PIN number, the identification information of the user apparatus 100, and the like.

In addition, the service providing apparatus 300 generates a token (or disposable token, token information, temporary token) corresponding to the received PIN number. Here, the token is a temporary token, randomly generated corresponding to the PIN number, and may be a state in which the number of times of use or the use period is set in advance. At this time, the service providing apparatus 300 may generate a token corresponding to the received PIN number and payment card type.

Also, the service providing apparatus 300 manages (or stores) the generated token in association with the type of payment card, the PIN number, the identification information of the user apparatus 100, and the like.

Also, the service providing apparatus 300 transmits the generated token (or the token corresponding to the PIN number, the PIN number, and the token corresponding to the payment card type) to the user device 100.

The service providing apparatus 300 may further include a payment server 500 for performing an authentication function for the user before performing a payment function for the product in association with at least one item to be paid by the user of the user apparatus 100, (Or QR code information) to be transmitted from the wireless base station.

The service providing apparatus 300 also checks whether the token in the corresponding bar code information (or QR code information) is valid based on the token in the received bar code information (or QR code information) and the identification information of the user apparatus 100 do.

That is, the service providing apparatus 300 stores the token in the received barcode information (or QR code information) and the identification information of the user device 100 in the identification information of the user apparatus for each of a plurality of tokens stored in advance (or issued in advance) Whether the corresponding token and the identification information of the user equipment are included (or are present).

In this way, the service providing apparatus 300 can verify the validity of the issued token.

As a result, the token in the received barcode information (or QR code information), the token corresponding to the identification information of the user device 100, and the token in the user device 100, If the identification information of the device is not included, that is, if the token in the received barcode information (or QR code information) is invalid, the service providing device 300 transmits the authentication failure information to the payment server 500.

As a result of the confirmation, the token in the received barcode information (or QR code information) and the token corresponding to the identification information of the user device 100 are stored in the identification information of the plurality of tokens in the user device 100 stored in advance in the service providing device 300 And the token in the received barcode information (or QR code information) is valid, the service providing apparatus 300 transmits the barcode information (or QR code information) included in the received barcode information User information, benefit information, and the like corresponding to the identification information of the payment server 500 (100). At this time, the service providing apparatus 300 transmits a payment card type (or a PIN managed in association with the corresponding payment card type / token, which is confirmed based on the token generated in correspondence with the PIN number and the payment card type, User information, benefit information, and the like corresponding to the payment card type, the type of the payment card that is confirmed based on the identification number, the type of the payment card, and the identification information of the user device). Here, the card information includes a card number, an expiration date, a CVC (card verification code) number, a user name, and the like. Also, the user information includes a user name, date of birth, address, image, and the like. In addition, the benefit information includes coupon information, membership benefit information, discount benefit information, and the like.

That is, when the token in the received bar code information (or QR code information) is valid as a result of checking, the service providing apparatus 300 corresponds to the identification information of the user apparatus 100 in the received bar code information (or QR code information) User information, benefit information, and the like stored in advance in the service providing apparatus 300 with respect to the user (or the user apparatus 100) who performs the payment, and confirms the card information, user information, To the server (500). At this time, the service providing apparatus 300 confirms the card information, the user information, the benefit information, and the like corresponding to the type of the payment card transmitted from the user apparatus 100, and transmits the confirmed card information, user information, Or may be transmitted to the server 500.

Also, the service providing apparatus 300 receives a payment function execution result (or payment information) transmitted from the payment server 500. [

In addition, the service providing apparatus 300 stores the received payment function execution result in association with the identification information of the corresponding user apparatus 100.

Also, the service providing apparatus 300 may transmit the received payment function execution result to the user apparatus 100 corresponding to the identification information of the corresponding user apparatus 100.

Also, the service providing apparatus 300 may be implemented in the form of a web server, a database server, a proxy server, or the like. In addition, the service providing apparatus 300 may be provided with at least one of a network load balancing mechanism, and various software for allowing the service providing apparatus 300 to operate on the Internet or another network, Can be implemented. The network may also be an http network, a private line, an intranet or any other network. Furthermore, the connection of the service providing device 300 and the user device 100 may be connected to the secure network so that the data is not attacked by any hacker or other third party. In addition, the service providing apparatus 300 may include a plurality of database servers, and the database server may be implemented in such a manner that the database servers are separately connected to the service providing apparatus 300 through any type of network connection including a distributed database server architecture .

Further, a processor mounted on the user apparatus 100 or the service providing apparatus 300 according to the present invention can process program instructions for executing the method according to the present invention. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multi-threaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

A POS (Point of Sales) terminal 400 communicates with a user apparatus 100, a beacon 200, a service providing apparatus 300, a payment server 500, and the like.

The POS terminal 400 includes a user device communication unit 110 included in the user device 100, a user device storage unit 120, a user device display unit 130, a user device audio output unit 140, (Not shown), a display unit (not shown), a sound output unit (not shown), and a control unit (not shown), respectively.

The POS terminal 400 also transmits to the beacon 200 store information related to the store where the beacon 200 (or the corresponding POS terminal) is provided, unique identification information of the store where the beacon 200 is provided .

In addition, the POS terminal 400 scans (or recognizes the barcode attached to the product to be paid for) a product to be paid for at least one product to be paid (or a payment product) selected by the user of the user device 100 .

In addition, the POS terminal 400 displays product information for one or more items to be scanned (or recognized). Here, the product information includes a product name, a product unique code, a unit price, a quantity, an amount, a total total amount, and the like.

When the user device 100 is not connected to the POS terminal 400 through the wired / wireless communication method, the user of the user device 100 may receive the preset application through the specific application installed in the user device 100 The POS terminal 400 recognizes (or scans / tags) the bar code (or QR code) displayed on the corresponding user device 100. [

In addition, the POS terminal 400 receives bar code information (or QR code information) transmitted from the user device 100. [

When the POS terminal 400 recognizes the bar code (or QR code) displayed on the user device 100, the POS terminal 400 confirms the recognized bar code information (or QR code information)

In addition, the POS terminal 400 displays or stores the received (or verified) bar code information (or QR code information).

The POS terminal 400 also transmits to the payment server 500 one or more pieces of merchandise information to be paid (or merchandise information to be recognized), barcode information (or QR code information), identification information of the POS terminal 400, do.

In addition, the POS terminal 400 receives the authentication failure information transmitted from the payment server 500 in response to the barcode information (or QR code information) transmitted to the payment server 500.

In addition, the POS terminal 400 displays the received authentication failure information.

In addition, the POS terminal 400 may transmit the received authentication failure information to the user device 100. [

Also, immediately before the payment function for one or more products selected by the user of the user device 100 is performed based on the barcode information (or QR code information) transmitted to the payment server 500, And receives user information transmitted from the server 500. Here, the user information includes a user name, date of birth, address, image, etc. related to the user corresponding to the identification information of the user device 100.

Also, the POS terminal 400 displays the received user information.

In addition, the user of the POS terminal 400 confirms the image of the user information displayed on the corresponding POS terminal 400 and the user of the user device 100 desiring to pay the corresponding goods, The POS terminal 400 receives the information indicating the user agreement according to the user input of the POS terminal 400. In this case,

In addition, the POS terminal 400 transmits information indicating the received user agreement, identification information of the POS terminal 400, and the like to the payment server 500.

When the payment function for one or more products selected by the user of the user device 100 is normally performed based on the barcode information (or QR code information) transmitted to the payment server 500, (Or payment information) transmitted from the payment server 500 in response to the barcode information (or QR code information) transmitted to the payment server 500. Here, the payment function execution result (or the payment information Includes a product name, a product specific code, a unit price, a quantity, a discount amount, a coupon application availability, an amount, a total total amount, a payment date and time information, and a payment card type.

Also, the POS terminal 400 transmits the received payment function execution result to the user device 100. [

In addition, the POS terminal 400 may output the received payment function execution result through a print such as a receipt.

The payment server 500 communicates with the user device 100, the service providing device 300, the POS terminal 400, and the like.

The payment server 500 includes a user device communication unit 110 included in the user device 100, a user device storage unit 120, a user device display unit 130, a user device audio output unit 140, (Not shown), a display unit (not shown), a sound output unit (not shown), and a control unit (not shown), respectively.

The settlement server 500 may further include one or more goods information to be paid (or goods information to be recognized) transmitted from the POS terminal 400, barcode information (or QR code information), identification information of the POS terminal 400 Lt; / RTI >

In addition, the payment server 500 transmits the received barcode information (or QR code information) to the service providing apparatus 300 in order to perform the authentication procedure related to the user apparatus 100. [

If the token in the bar code information (or QR code information) transmitted to the service providing apparatus 300 is invalid, the payment server 500 transmits the bar code information (or QR code information) transmitted to the service providing apparatus 300, The authentication failure information transmitted from the service providing apparatus 300 is received.

In addition, the payment server 500 transmits the received authentication failure information to the POS terminal 400.

When the token in the bar code information (or QR code information) transmitted to the service providing apparatus 300 is valid, the payment server 500 responds to the bar code information (or QR code information) transmitted to the service providing apparatus 300 User information, benefit information (or card information, user information, benefit information corresponding to the identification information of the user device 100 in the barcode information (or QR code information)) transmitted from the service providing apparatus 300, And the like.

In addition, the payment server 500 performs a payment function for the payment amount corresponding to the at least one item information to be paid based on the received card information, user information, and benefit information. At this time, the payment server 500 transmits the benefit information corresponding to the benefit information (or the benefit information applicable to the user of the user device 100) transmitted from the service providing device 300 to the price information on the one or more goods to be settled The user can perform a payment function for the payment amount to which the amount is applied.

At this time, just before the payment function is performed, the payment server 500 transmits the user information transmitted from the service providing apparatus 300 to the POS terminal 400.

If the user of the user device 100 intending to pay the corresponding item does not match the image in the user information, the payment server 500 transmits the payment cancellation information for the one or more goods information to the POS terminal 400 Or may perform a settlement function after performing an additional authentication procedure with respect to the corresponding user device 100.

When the user of the user apparatus 100 who intends to settle the product matches the image in the user information, the payment server 500 receives the user information from the POS terminal 400 in response to the user information transmitted to the POS terminal 400 Information indicating the correspondence of the user to be transmitted, identification information of the POS terminal 400, and the like.

In addition, the payment server 500 may perform a payment function for the payment amount corresponding to the at least one item information to be paid based on the received card information, user information, benefit information, and information indicating user agreement.

In addition, the payment server 500 transmits the payment function execution result (or payment information) to the POS terminal 400, the service providing apparatus 300, and the like. Here, the payment function execution result (or payment information) includes a product name, a product unique code, a unit price, a quantity, a discount amount, a coupon application availability, an amount, a total total amount, a settlement date and time information,

Further, the billing system 10 according to another embodiment of the present invention may be configured as follows.

That is, when the user having the user apparatus 100 enters the store, the POS terminal 400 provided in the store corresponds to the identification information of the corresponding user apparatus 100 provided from the service providing apparatus 300 The feature information of the reference object is temporarily stored. Then, the POS terminal 400 recognizes a product item to be paid for at least one product selected by the user of the user device 100, and the POS terminal 400 recognizes the user of the user device 100 Acquires the image information included therein, and recognizes the object in the acquired image information. After that, the POS terminal 400 performs an additional authentication process according to a result of checking whether or not the feature information of the recognized object is similar to the feature information of the reference object corresponding to the identification information of the user device 100 temporarily stored , Identification information of the user device 100, identification (identification) of the POS terminal 400, identification information of the user terminal 100, Information and the like to the payment server 500. Then, the payment server 500 transmits the identification information of the user apparatus 100 to the service providing apparatus 300. [ Then, the service providing apparatus 300 transmits the card information, the user information, the benefit information, and the like corresponding to the identification information of the user apparatus 100 transmitted from the payment server 500 to the payment server 500. Thereafter, the payment server 500 responds to the identification information of the user device 100 transmitted in advance, and then, based on the card information, user information, benefit information, etc. transmitted from the service providing apparatus 300, And provides the payment function execution result to the user device 100 via the POS terminal 400. [

After the user having the user device 100 enters the store, the user device 100 selects one or more payment cards to perform the simple payment function, and inputs the PIN number corresponding to the selected payment card to the user input (Or information on the type of the payment card), the PIN number corresponding to the payment card, the identification information of the user apparatus 100, and the like to the service providing apparatus 300 .

When the payment method is selected by a predetermined method (or a preset payment method) through a specific application installed in advance in the user device 100, the user device 100 selects one or more payment methods selected by the user of the user device 100 To the POS terminal 400, settlement request information through a predetermined settlement method in order to perform a settlement function for a commodity to be settled.

When additional authentication is requested at the POS terminal 400, the user device 100 performs an additional authentication function (for example, authentication of a mobile phone, confirmation of a payment card, etc.) by interlocking with the POS terminal 400 .

The user device 100 receives the payment function execution result transmitted from the POS terminal 400 after the payment function for the selected one or more goods is normally performed.

Also, the user device 100 displays the result of the received payment function execution.

The service providing apparatus 300 communicates with the user apparatus 100, the POS terminal 400, the payment server 500, and the like.

In addition, after the user who has the user apparatus 100 enters the store, the service providing apparatus 300 may transmit information (or payment information) of the corresponding payment card transmitted from the user apparatus 100 to perform the simple payment function A PIN number corresponding to the payment card, identification information of the user apparatus 100, and the like.

In addition, the service providing apparatus 300 maintains a standby state (or check-in state) for easy settlement.

Also, the service providing apparatus 300 may check the feature information of the reference object (or the user of the user apparatus 100) corresponding to the identification information of the user apparatus 100 among the feature information of the plurality of user apparatus-specific objects , And transmits the feature information of the reference object corresponding to the identification information of the identified user device 100 to the POS terminal 400 related to the unique identification information of the beacon 200.

Also, the service providing apparatus 300 confirms the information on the payment card related to the user device 100, the PIN number and the like based on the identification information of the user apparatus 100 transmitted from the payment server 500, User information, benefit information, and the like corresponding to the identification information of the user device 100 and / or the information about the confirmed payment card (or the payment card / payment card type) to the payment server 500. [

The POS terminal 400 communicates with the user apparatus 100, the service providing apparatus 300, the payment server 500, and the like.

3 is a block diagram illustrating the configuration of a POS terminal 400 according to an embodiment of the present invention.

3, the POS terminal 400 includes a communication unit 410, a storage unit 420, a display unit 430, a sound output unit 440, a recognition unit 450, a photographing unit 460, (470). Not all the components of the POS terminal 400 shown in Fig. 3 are essential components, and the POS terminal 400 may be implemented by more components than the components shown in Fig. 3, The POS terminal 400 may be implemented.

The communication unit 410 communicates with at least one external terminal or any internal component via a wired / wireless communication network. At this time, an external arbitrary terminal may include a user apparatus 100, a beacon 200, a service providing apparatus 300, a payment server 500, and the like. The wireless Internet technology includes a wireless LAN (WLAN), a DLNA, a Wibro, a WiMAX, HSDPA, HSUPA, IEEE 802.16, Long Term Evolution (LTE), LTE- ), And the communication unit 410 transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above. Near field communication technologies may include Bluetooth, RFID, IrDA, UWB, ZigBee, NFC, Ultrasound (USC), Visible Light (VLC), WiFi and WiFi Direct. have. In addition, the wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, and an optical / coaxial cable.

In addition, the communication unit 410 can transmit information to an arbitrary terminal through a universal serial bus (UUSB).

In addition, the communication unit 410 may be configured to perform communication based on technical standards or communication schemes for mobile communication (e.g., GSM, CDMA, CDMA2000, EV-DO, WCDMA, HSDPA, HSUPA, LTE, LTE- And transmits and receives radio signals to and from the base station, the user equipment 100, the beacon 200, the service providing apparatus 300, and the payment server 500 on the communication network.

Under the control of the control unit 470, the communication unit 410 also communicates with the user of the user apparatus 100 that has entered (or visited) the store provided with the corresponding POS terminal 400 transmitted from the service providing apparatus 300 And receives the feature information of the related reference object.

The storage unit 420 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

In addition, the storage unit 420 stores data and programs necessary for the POS terminal 400 to operate.

That is, the storage unit 420 may store a plurality of application programs (applications), data for operation of the POS terminal 400, and commands that are driven by the POS terminal 400. At least some of these application programs may be downloaded from the external service providing device via wireless communication. The application program may be stored in the storage unit 420 and installed in the POS terminal 400 and may be operated by the control unit 470 to perform the operation (or function) of the POS terminal 400. [

The storage unit 420 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a magnetic memory, a magnetic disk, SRAM, a ROM, an EEPROM, and a PROM. In addition, the POS terminal 400 may operate web storage that performs the storage function of the storage unit 420 on the Internet, or may operate in association with web storage.

The storage unit 420 stores the feature information of the reference object received through the communication unit 410 under control of the controller 470 or the temporary information of the reference object corresponding to the identification information of the user apparatus 100, .

The display unit 430 can display various contents such as various menu screens by using the user interface and / or graphical user interface stored in the storage unit 420 under the control of the controller 470. Here, the content displayed on the display unit 430 includes various text or image data (including various information data) and a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 430 may be a touch screen.

The display unit 430 may include at least one of a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light emitting diode (OLED), a flexible display, a three dimensional display,

In addition, the display unit 430 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), a projection system (holographic system) can be applied.

The display unit 430 displays the feature information of the reference object related to the user of the user device 100 received through the communication unit 410 under the control of the control unit 470. [

The voice output unit 140 outputs voice information included in the signal processed by the control unit 150. Here, the audio output unit 140 may include a receiver, a speaker, a buzzer, and the like.

Also, the voice output unit 140 outputs the guidance voice generated by the control unit 150. [

The voice output unit 140 outputs voice information corresponding to the feature information of the reference object related to the user of the user device 100 received through the communication unit 110 under the control of the control unit 150. [

The recognition unit (or the tagging unit) 450 scans the goods to be paid (or the barcode attached to the goods to be paid) for one or more items to be paid (or a payment product) selected by the user of the user device 100 Recognition).

The recognition unit 450 outputs the product information for one or more products that are previously scanned (or recognized) under control of the control unit 470 through the display unit 430 and / or the audio output unit 440 do.

The photographing unit 460 includes at least one camera configured on at least one side of the POS terminal 400. [

The photographing unit 460 processes an image frame such as a still image or a moving image obtained by an image sensor (camera module or camera) in a video communication mode, a photographing mode, a video conference mode, and the like. That is, the image data obtained by the image sensor according to the codec (CODEC) is encoded / decoded according to each standard. The processed image frame can be displayed on the display unit 140 under the control of the control unit 470. [ For example, the photographing section 460 photographs an object (or a subject) (a user image or a video conference), and outputs a video signal corresponding to the photographed image (object image).

The image frame processed by the photographing unit 460 may be stored in the storage unit 420 or transmitted to an external terminal (including any video conferencing terminal included in the video conferencing system) through the communication unit 410. [

In addition, a lens unit (not shown) for photographing an enlarged image may be further provided on the upper part of the photographing unit 460. [

The photographing section 460 photographs the image information under the control of the control section 470. [ At this time, the image information captured by the photographing unit 460 may include an object located on the front or side of the POS terminal 400 for payment.

That is, the merchandise to be paid is scanned for one or more items to be paid by the user of the user apparatus 100 through the recognition unit 450, and simultaneously the user apparatus 100 (Or photographs) the image information including the user of the user.

The control unit 470 executes the overall control function of the POS terminal 400. [

In addition, the control unit 470 executes the overall control function of the POS terminal 400 using the program and data stored in the storage unit 420. The control unit 470 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the storage unit 420 and performs booting using the O / S stored in the storage unit 420. The CPU can perform various operations using various programs, contents, data stored in the storage unit 40, Can be performed.

In addition, the control unit 470 performs an object recognition function on the image information obtained through the photographing unit 460. FIG.

That is, the control unit 470 extracts (or calculates) the feature information in the acquired image information.

In addition, the control unit 470 recognizes (or identifies) one or more objects (or objects) included in the image information based on the extracted feature information.

In addition, the controller 470 confirms (or determines) whether the recognized feature information of the object is similar to the feature information of the reference object corresponding to the identification information of the user device 100 provided from the service providing device 300 . Here, the feature information of the preset reference object may be feature information related to the user of the user device 100.

That is, the controller 470 calculates the degree of similarity between the feature information of the recognized object and the feature information of the reference object corresponding to the identification information of the user device 100. In addition, the control unit 470 confirms (or determines) whether the calculated similarity degree (or similarity degree of the feature information between the two objects) is equal to or greater than a predetermined reference value.

If the feature information of the recognized object is similar to the feature information of the reference object corresponding to the identification information of the user device 100 (or the similarity degree of the feature information between the two calculated objects is equal to or greater than a preset reference value) The control unit 470 determines that the payee who wishes to make a payment matches the pre-registered user, and performs a payment function using a predetermined payment method selected through a specific application installed in the user device 100 in advance, The identification information of the POS terminal 400, the identification information of the user apparatus 100, and the like to the payment server 500 through the communication unit 410. [0064] At this time, the settlement methods include cash settlement, card settlement, electronic settlement, and the like, and the predetermined settlement method may be electronic settlement.

If the feature information of the recognized object is not similar to the feature information of the reference object corresponding to the identification information of the user device 100 (or if the similarity of the feature information between the two calculated objects is smaller than a preset reference value The control unit 470 determines that the user who has made a payment is inconsistent with the user registered in advance and prevents (or prevents) fraudulent use of the payment card. In this case, To request further authentication.

In addition, the control unit 470 performs an additional authentication function (for example, authentication of a mobile phone, confirmation of a payment card, etc.) by interlocking with the corresponding user device 100 based on the additional authentication requested earlier.

If the feature information of the recognized object is not similar to the feature information of the reference object corresponding to the identification information of the user device 100 (or if the similarity of the feature information between the two calculated objects is smaller than a preset reference value The control unit 470 determines that the card is fraudulent through the payment card, generates the authentication failure information (or the payment failure information), and transmits the generated authentication failure information to the user device 100 . Also, the user device 100 receives the authentication failure information transmitted from the POS terminal 400, and displays the received authentication failure information.

After the additional authentication procedure between the POS terminal 400 and the user device 100 is normally performed, the controller 470 performs a payment function using a predetermined payment method selected through a specific application installed in the user device 100 in advance The identification information of the POS terminal 400, the identification information of the user apparatus 100, and the like to the payment server 500 through the communication unit 410 (step < RTI ID = 0.0 > . At this time, the settlement methods include cash settlement, card settlement, electronic settlement, and the like, and the predetermined settlement method may be electronic settlement.

The control unit 470 receives the payment function execution result transmitted from the payment server 500 through the communication unit 410. [

In addition, the controller 470 transmits the received payment function execution result to the user device 100 through the communication unit 410.

In addition, the controller 470 outputs the received payment function execution result through a print such as a receipt.

The control unit 470 outputs the received payment function execution result through the display unit 430 and / or the voice output unit 440.

The control unit 470 deletes the feature information of the object corresponding to the identification information of the corresponding user device 100 temporarily stored in the storage unit 420 after the completion of the payment function related to the user device 100. [

The payment server 500 communicates with the user device 100, the service providing device 300, the POS terminal 400, and the like.

The settlement server 500 may further include at least one commodity information to be settled (or commodity information to be recognized) transmitted from the POS terminal 400, identification information of the POS terminal 400, identification information of the user apparatus 100 Lt; / RTI >

The payment server 500 also transmits the identification information of the user device 100 to the service providing device 300 in order to perform the authentication procedure related to the user device 100. [

In addition, the payment server 500 receives card information, user information, benefit information, and the like transmitted from the service providing apparatus 300 in response to the identification information of the user apparatus 100 transmitted in advance.

In addition, the payment server 500 performs a payment function for the payment amount corresponding to the at least one item information to be paid based on the received card information, user information, and benefit information. At this time, the payment server 500 transmits the benefit information corresponding to the benefit information (or the benefit information applicable to the user of the user device 100) transmitted from the service providing device 300 to the price information on the one or more goods to be settled The user can perform a payment function for the payment amount to which the amount is applied.

In addition, the payment server 500 transmits the payment function execution result (or payment information) to the POS terminal 400, the service providing apparatus 300, and the like. Here, the payment function execution result (or payment information) includes a product name, a product unique code, a unit price, a quantity, a discount amount, a coupon application availability, an amount, a total total amount, a settlement date and time information,

As described above, the user's face is analyzed through the camera configured in the POS terminal to confirm and identify whether or not the user has joined the membership, and the image information obtained through the camera at the time of payment can be stored as history.

Also, when the check-in process is performed through the beacon in the simple settlement, information on the user of the corresponding user device is detected and provided to the POS terminal, and the identification of the user of the corresponding user device is performed by the POS terminal can do.

Hereinafter, a method of controlling a payment system according to the present invention will be described in detail with reference to FIGS. 1 to 8. FIG.

4 to 6 are flowcharts illustrating a method of controlling a payment system according to an embodiment of the present invention.

First, when a user having the user apparatus 100 enters a store, the user apparatus 100 transmits identification information of the beacon 200 transmitted from the beacon 200 (or a store having the beacon 200) (I.e., unique identification information of the user).

For example, when a user having the user apparatus 100 enters the store A, the user apparatus 100 transmits the beacon 200 broadcasted (or transmitted) from the beacon 200 provided in the store A Identification information is received (S410).

The user device 100 then transmits the unique identification information of the received beacon 200 (or the unique identification information of the store where the beacon 200 is provided), the identification information of the user device 100 to the service providing device 300 . Here, the identification information of the user device 100 includes an MDN, a mobile IP, a mobile MAC, a SIM (subscriber identity module) card specific information, a serial number, and the like.

For example, the user device 100 may include unique identification information of the previously received beacon 200, information indicating the unique identification information of the beacon 200 received from the user device 100, The identification information of the service providing apparatus 100 to the service providing apparatus 300 (S420).

Then, the service providing apparatus 300 receives unique identification information of the beacon 200 transmitted from the user apparatus 100, identification information of the user apparatus 100, and the like.

The service providing apparatus 300 may also be configured to allow the user corresponding to the user apparatus 100 to register with the service providing apparatus 300 in advance based on the received identification information of the corresponding user apparatus 100 (Or confirms) whether or not it is.

For example, the service providing apparatus 300 determines whether the user is a member based on the identification information of the user apparatus 100 (S430).

If the result of the determination (or the result of the check) is that the user corresponding to the user device 100 is not a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 transmits the guide information related to membership registration, (100).

The service providing apparatus 300 also performs a membership registration procedure for the user apparatus 100 (or the user of the user apparatus 100) by interlocking with the user apparatus 100. [

In addition, when the membership subscription process for the user device 100 is normally completed, the following processes can be performed normally.

For example, when the user apparatus 100 is not a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 may link the guide information related to the membership to the user apparatus 100 And performs a membership registration procedure for the corresponding user device 100 (S440).

When the user corresponding to the user device 100 is a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 transmits the beacon 200 received previously, Of the plurality of advertisement information and the plurality of benefit information stored in advance based on the unique identification information of the user device 100 and the identification information of the user device 100, Information, and one or more benefits information.

In addition, the service providing apparatus 300 may be configured to apply (or reflect) the benefit information among a plurality of cards (or a plurality of payment cards) issued to the user device 100 based on the one or more benefit information (Or a recommended payment card list) containing the above recommended cards. Here, the benefit information includes coupon information, membership benefit information, discount benefit information, and the like.

In addition, the service providing apparatus 300 may include at least one advertisement information, at least one benefit information, at least one recommendation card, and at least one recommendation card list including at least one advertisement information that can be provided to the corresponding user apparatus 100, And the like to the user device 100.

That is, when the user corresponding to the user apparatus 100 is a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 selects the corresponding beacon 200) corresponding to the unique identification information. In addition, the service providing device 300 checks one or more pieces of advertisement information, benefit information, and the like that can be provided to the corresponding user device 100 in the corresponding store based on the confirmed store information and the identification information of the received user device 100 . Also, the service providing apparatus 300 generates a recommendation card list including one or more cards to which the benefit information can be applied, from among a plurality of cards (or one or more cards) previously issued to the user apparatus 100. In addition, the service providing device 300 transmits to the user device 100 the identified one or more pieces of advertisement information, one or more benefit information, a generated recommendation card list, and the like.

For example, when the user device 100 is a member registered in advance in the service providing apparatus 300, the service providing apparatus 300 selects the beacon 200 among the store information for each unique identification information of the plurality of beacons stored in advance And confirms clothing store information corresponding to the unique identification information. Also, the service providing apparatus 300 may store the first to third advertisement information that can be provided to the corresponding user apparatus 100 in the clothing shop and the first to third advertisement information that can be provided to the user apparatus 100, based on the identified clothing store information and the identification information of the user apparatus 100, And the second benefit information (for example, discount coupon information, membership benefit information, etc.). Also, the service providing apparatus 300 may include a recommended card list including AA cards, BB cards, CC cards, and DD cards that can be applied to the first to the second benefit information among a plurality of cards issued to the user device 100 . Also, the service providing apparatus 300 may receive the first to third advertisement information, the first or second benefit information (e.g., discount coupon information, membership benefit information, etc.), the AA card, the BB card, And transmits a recommended card list including the DD card to the user device 100 (S450).

Thereafter, the user device 100 transmits one or more pieces of advertisement information transmitted from the service providing apparatus 300, one or more pieces of benefit information, and at least one piece of advertisement information transmitted from the service providing apparatus 300 in response to the unique identification information of the beacon 200 transmitted earlier, identification information of the user apparatus 100, A recommended card list, and the like.

Also, the user device 100 displays the received one or more pieces of advertisement information, one or more benefit information, a recommended card list, and the like.

7, the user apparatus 100 includes first to third advertisement information 710 transmitted from the service providing apparatus 300, first to third advertisement information 710 transmitted from the service providing apparatus 300, (E.g., discount coupon information, membership benefit information, etc.) 720, a recommended card list (e.g., AA payment card, BB payment card, CC payment card, and DD payment card) 730 (S460).

Then, the user device 100 transmits a payment card type (or unique identification information of the payment card), a personal identification number (PIN), and a personal identification number according to a user input (or a user selection) through a specific application installed in the user device 100, And the like.

That is, the user device 100 confirms the type of payment card selected (or selected) according to user input (or user selection) among a plurality of cards registered in advance in the corresponding user device 100. At this time, the user device 100 may check the type of the payment card (or the unique identification information of the payment card) for the payment card selected from the recommended card list transmitted from the service providing device 300.

Also, the user device 100 receives a PIN number according to a user input (or a user selection) through a specific application installed in the user device 100 in advance. Here, the PIN number may be a PIN number corresponding to the identified payment card type.

Also, the user device 100 transmits the confirmed payment card type (or unique identification information of the payment card), the PIN number, the identification information of the user device 100, and the like to the service providing device 300.

For example, the user device 100 identifies one AA payment card selected from among a plurality of payment cards registered (or issued) in an electronic wallet application installed in advance in the corresponding user device 100. Also, the user device 100 receives the PIN number corresponding to the user input through the corresponding electronic wallet app. Also, the user device 100 transmits the confirmed AA payment card (or AA payment card type), the PIN number corresponding to the received AA payment card, the identification information of the user device 100, etc. to the service providing apparatus 300 do.

In another example, the user device 100 identifies a BB payment card selected from a list of recommended cards displayed on the user device 100. Also, the user device 100 receives the PIN number corresponding to the BB payment card according to the user input through the corresponding electronic wallet app. Also, the user device 100 transmits the confirmed BB payment card (or BB payment card type), the received PIN number, identification information of the user device 100, etc. to the service providing device 300 (S470).

Then, the service providing apparatus 300 receives the type of payment card transmitted from the user apparatus 100, the PIN number, the identification information of the user apparatus 100, and the like.

In addition, the service providing apparatus 300 maintains a standby state (or check-in state) for easy settlement.

Also, the service providing apparatus 300 may check the feature information of the reference object (or the user of the user apparatus 100) corresponding to the identification information of the user apparatus 100 among the feature information of the plurality of user apparatus-specific objects , And transmits the feature information of the reference object corresponding to the identification information of the identified user device 100 to the POS terminal 400 related to the unique identification information of the beacon 200.

For example, the service providing apparatus 300 may check the feature information of the reference object corresponding to the identification information of the user apparatus 100 among the feature information of the plurality of user apparatus-specific objects stored in advance, To the POS terminal 400 configured in the store A provided with the corresponding beacon 200 corresponding to the unique identification information of the beacon 200. [

In the embodiment of the present invention, the characteristic information of the reference object corresponding to the identification information of the user device 100 is transmitted to the corresponding POS terminal 400 at the time of maintaining the waiting state for the simple settlement in the service providing device 300 However, the present invention is not limited to this. However, the present invention is not limited to this, and at the time of transmitting one or more pieces of advertisement information, one or more benefit information, a generated recommendation card list, The feature information of the reference object corresponding to the information may be confirmed and the feature information of the reference object corresponding to the identification information of the identified user device 100 may be transmitted to the POS terminal 400 in operation S480.

The POS terminal 400 receives the characteristic information of the reference object related to the user of the user device 100 entering (or visiting) the store provided with the corresponding POS terminal 400 transmitted from the service providing device 300 do.

Also, the POS terminal 400 temporarily stores feature information of the received reference object (or feature information of the reference object corresponding to the identification information of the user apparatus 100).

For example, the POS terminal 400 provided in the store A receives the feature information of the reference object related to the user of the user device 100 entering the store A transmitted from the service providing device 300, (Or check-in state) for simple settlement in a state where the feature information of the reference object related to the user of the mobile terminal 100 is temporarily stored (S490).

Then, the POS terminal 400 scans (or recognizes the barcode attached to the product to be paid for) the product to be paid for one or more items to be paid (or a payment product) selected by the user of the user device 100 .

In addition, the POS terminal 400 displays product information for one or more items to be scanned (or recognized). Here, the product information includes a product name, a product unique code, a unit price, a quantity, an amount, a total total amount, and the like.

In addition, the POS terminal 400 scans the goods to be paid for at least one item selected by the user of the user apparatus 100, and at the same time, the photographing unit 460 provided in the POS terminal 400 in the background state, (Or photographed) the image information including the user of the user apparatus 100 via the network.

For example, the POS terminal 400 recognizes the bar codes attached to the eleventh to thirteenth products respectively for the eleventh to thirteenth products selected by the user of the corresponding user device 100, Product information 810 for the recognized eleventh to thirteenth products and displays the first image information 820 including the user of the corresponding user device 100 obtained through the photographing unit 460 (S500).

Then, the POS terminal 400 performs an object recognition function on the acquired image information.

That is, the POS terminal 400 extracts (or calculates) feature information within the acquired image information.

In addition, the POS terminal 400 recognizes (or identifies) one or more objects (or objects) included in the image information based on the extracted characteristic information.

For example, the POS terminal 400 extracts feature information from the acquired first image information, and extracts the first object (or the corresponding user apparatus 100) included in the first image information based on the extracted feature information (I.e., an object corresponding to the user who owns the terminal) (S510).

Then, the POS terminal 400 confirms (or determines) whether or not the feature information of the recognized object is similar to the feature information of the reference object corresponding to the identification information of the user apparatus 100 provided from the service providing apparatus 300, do. Here, the feature information of the preset reference object may be feature information related to the user of the user device 100.

That is, the POS terminal 400 calculates the similarity between the feature information of the recognized object and the feature information of the reference object corresponding to the identification information of the user device 100. Also, the POS terminal 400 confirms (or determines) whether the calculated similarity degree (or the similarity degree of the characteristic information between the two objects) is equal to or greater than a preset reference value.

For example, the POS terminal 400 calculates a first degree of similarity (e.g., 96%) between the feature information of the first object recognized in the first image information and the feature information of the preset reference object. Also, the POS terminal 400 checks whether the calculated first degree of similarity (for example, 96%) is not less than a preset reference value (for example, 90%).

In another example, the POS terminal 400 calculates a second similarity degree (for example, 87%) between the feature information of the first object recognized in the first image information and the feature information of the preset reference object. Also, the POS terminal 400 determines whether the calculated second similarity (for example, 87%) is not less than a preset reference value (for example, 90%) (S520).

If the feature information of the recognized object is similar to the feature information of the reference object corresponding to the identification information of the user device 100 (or the similarity degree of the feature information between the two calculated objects is equal to or greater than a preset reference value) The POS terminal 400 judges that the payee who wishes to make a settlement matches the pre-registered user and performs a payment function using a predetermined payment method selected through a specific application installed in the user device 100 in advance, The identification information of the POS terminal 400, the identification information of the user device 100, and the like to the settlement server 500. [0120] At this time, the settlement methods include cash settlement, card settlement, electronic settlement, and the like, and the predetermined settlement method may be electronic settlement.

For example, when the first similarity (for example, 96%) of the feature information between the two calculated objects is equal to or greater than a preset reference value (for example, 90%), the POS terminal 400 transmits, The POS terminal 400, the user device 100, and the like, and transmits the settlement request information to the user terminal 100. [0064] To the server 500 (S530).

If the feature information of the recognized object is not similar to the feature information of the reference object corresponding to the identification information of the user device 100 (or if the similarity of the feature information between the two calculated objects is smaller than a preset reference value , The POS terminal 400 determines that the payee who wishes to make a settlement does not coincide with a user registered in advance and thus prevents the illegal use of the payment card from occurring in the corresponding user device 100 ) To request further authentication.

In addition, the POS terminal 400 may perform an additional authentication function (for example, authentication of a mobile phone, confirmation of a payment card, etc.) by interlocking with the corresponding user device 100 based on the previously requested additional authentication.

For example, when the second similarity (for example, 87%) of the feature information between the two calculated objects is smaller than a preset reference value (for example, 90%), the POS terminal 400 To perform additional authentication functions.

If the feature information of the recognized object is not similar to the feature information of the reference object corresponding to the identification information of the user device 100 (or if the similarity of the feature information between the two calculated objects is smaller than a preset reference value The POS terminal 400 determines that it is fraudulent through the payment card, generates authentication failure information (or payment failure information), and transmits the generated authentication failure information to the user device 100. [

Also, the user device 100 receives the authentication failure information transmitted from the POS terminal 400 and displays the received authentication failure information (S540).

After the additional authentication procedure between the POS terminal 400 and the user device 100 is normally performed, the POS terminal 400 performs a payment function using a preset payment method selected through a specific application installed in the user device 100 The identification information of the POS terminal 400, the identification information of the user apparatus 100, and the like, to the payment server 500. The settlement server 500 receives the settlement information, At this time, the settlement methods include cash settlement, card settlement, electronic settlement, and the like, and the predetermined settlement method may be electronic settlement.

For example, after the additional authentication procedure between the POS terminal 400 and the user device 100 is normally performed, the POS terminal 400 transmits a settlement request through the electronic settlement, which is transmitted from the user device 100 via the BLE communication, The identification information of the POS terminal 400, the identification information of the user apparatus 100, and the like to the payment server 500 (S550).

Thereafter, the payment server 500 transmits the goods information (or the goods information to be recognized) to be paid, the identification information of the POS terminal 400, the identification information of the user apparatus 100, etc. Lt; / RTI >

The payment server 500 also transmits the identification information of the user device 100 to the service providing device 300 in order to perform the authentication procedure related to the user device 100. [

For example, the payment server 500 receives merchandise information for the eleventh merchandise to thirteenth merchandise, identification information of the POS terminal 400, identification information of the user apparatus 100, and the like transmitted from the POS terminal 400 , Identification information of the received user equipment 100, and the like to the service providing apparatus 300 (S560).

Thereafter, the service providing apparatus 300 receives the identification information of the user apparatus 100 transmitted from the payment server 500.

The service providing apparatus 300 may also receive information about the payment card stored (or temporarily stored) in association with the user apparatus 100 (or the payment card / payment card type ), A PIN number (or a PIN number corresponding to information on the payment card), and the like.

The service providing device 300 may also store card information, user information, benefit information, and the like corresponding to the identification information of the user device 100 and / or the information on the payment card (or the payment card / payment card type) 500). Here, the card information includes a card number, an expiration date, a CVC number, a user name, and the like for the card registered in advance in the user device 100. [ Also, the user information includes a user name, date of birth, address, image, and the like.

In other words, the service providing apparatus 300 may be configured to transmit information related to the user (or the user apparatus 100) corresponding to the identification information of the user apparatus 100 and / or the information about the payment card (or the payment card / User information, benefit information, and the like stored in advance in the service providing apparatus 300, and transmits the confirmed card information, user information, benefit information, and the like to the payment server 500. [

For example, the service providing apparatus 300 may transmit first card information, first user information, first benefit information, and the like corresponding to the identification information of the user apparatus 100 and information on the AA payment card to the payment server 500 send.

In addition, the service providing apparatus 300 may store information (or a type of payment card / payment card) stored in association with the user device 100 (or temporarily stored), a PIN number (Or an authentication procedure is performed) on the basis of the payment card issued to the user device 100 on the basis of the identification number, The card information, user information, benefit information, and the like corresponding to the payment card may be transmitted to the payment server 500 (S570).

Then, the payment server 500 receives the card information, user information, benefit information, and the like transmitted from the service providing apparatus 300 in response to the identification information of the user apparatus 100 transmitted previously.

In addition, the payment server 500 performs a payment function for the payment amount corresponding to the at least one item information to be paid based on the received card information, user information, and benefit information. At this time, the payment server 500 transmits the benefit information corresponding to the benefit information (or the benefit information applicable to the user of the user device 100) transmitted from the service providing device 300 to the price information on the one or more goods to be settled The user can perform a payment function for the payment amount to which the amount is applied.

For example, the payment server 500 receives the first card information, the first user information, the first benefit information, and the like transmitted from the service providing apparatus 300 in response to the identification information of the user apparatus 100 transmitted previously , A payment function for a payment amount to which the benefit amount corresponding to the first benefit information is applied to the eleventh to thirteenth products to be settled (S580).

Then, the payment server 500 transmits the payment function execution result (or payment information) to the POS terminal 400, the service providing apparatus 300, and the like. Here, the payment function execution result (or payment information) includes a product name, a product unique code, a unit price, a quantity, a discount amount, a coupon application availability, an amount, a total total amount, a settlement date and time information,

For example, the payment server 500 transmits a payment function execution result for the eleventh to thirteenth goods to the POS terminal 400, the service providing device 300, and the like (S590).

Then, the POS terminal 400 receives the payment function execution result transmitted from the payment server 500. [

Also, the POS terminal 400 transmits the received payment function execution result to the user device 100. [

For example, the POS terminal 400 transmits to the user device 100 a result of performing a payment function for the received eleventh to thirteenth goods.

In addition, the POS terminal 400 may output the received payment function execution result through a print such as a receipt (S600).

Thereafter, the user device 100 receives the payment function execution result transmitted from the POS terminal 400 after the payment function for the selected one or more goods is normally performed.

Also, the user device 100 displays the result of the received payment function execution.

For example, the user device 100 receives a result of performing a payment function for the selected eleventh to thirteenth goods. In addition, the user device 100 displays the result of performing the payment function through the electronic wallet app (S610).

The user device, the service providing device, the POS terminal, and the settlement system including the user terminal, the POS terminal, and the billing system according to the embodiment of the present invention can be created in a computer program. Codes and code segments constituting the computer program can be easily Can be deduced. In addition, the computer program is stored in a computer readable medium and read by a computer, a user apparatus, a beacon, a service providing apparatus, a POS terminal, a payment server, or the like according to an embodiment of the present invention Thereby realizing a user apparatus, a service providing apparatus, a POS terminal, and a payment system including the same.

The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium. The computer program embodying the user apparatus, the service providing apparatus, the POS terminal, and the payment system including the same according to the embodiment of the present invention is stored and installed in a built-in memory such as a user device, a beacon, a service providing device, a POS terminal, . Alternatively, an external memory such as a user device, a service providing device, a POS terminal, a smart card storing and installing a computer program implementing the payment system including the user terminal, a beacon and a service A POS terminal, a payment server, or the like.

As described above, in the embodiment of the present invention, the face of the user is analyzed through the camera configured in the POS terminal to confirm and identify whether or not the user joins membership, and the image information obtained through the camera at the time of payment is stored as history , Fraudulent use of payment cards can be prevented, and fraudulent use can be tracked.

As described above, in the embodiment of the present invention, when a check-in process is performed through a beacon when performing a simple payment, information on a user of the corresponding user device is detected and provided to the POS terminal, The identification of the user is performed by the POS terminal, so that even when the communication environment is poor, it is possible to effectively identify, improve the security, and reduce the user's operation burden on the terminal, thereby improving convenience.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention analyzes and analyzes whether a user joins membership by analyzing a user's face through a camera configured in a POS terminal, stores image information acquired through a camera at the time of settlement as a history, and prevents fraudulent use And can be widely used in a field of a simple payment field, an advertisement field, a field of a service providing device, a field of a user device, a field of a POS terminal, a field of a payment server, etc. have.

10: Payment system 100: User device
200: Beacon 300: Service providing device
400: POS terminal 500: Payment server
110: user device communication unit 120: user device storage unit
130: User device display part 140: User device audio output part
150: User device control unit 410:
420: storage unit 430: display unit
440: Audio output unit 450:
460: photographing unit 470:

Claims (10)

A communication unit for receiving the feature information of the object corresponding to the identification information of the user equipment that visited the store provided with the POS terminal transmitted from the service providing apparatus;
A storage unit for temporarily storing the feature information of the object corresponding to the identification information of the received user equipment;
A recognition unit that scans at least one item to be paid by the user of the user apparatus;
A display unit for displaying product information on the one or more items to be paid out;
A photographing unit for acquiring image information including a user of the user apparatus in a background state while scanning at least one item to be paid through the recognition unit; And
Recognizing one or more objects included in the image information by performing an object recognition function on the acquired image information, and storing the feature information of the recognized one or more objects and the identification information of the user apparatus temporarily stored in the storage unit And a controller for checking whether the payment card is illegally used based on the characteristic information of the object. The method according to claim 1,
Wherein the controller extracts feature information from the obtained image information and recognizes one or more objects included in the image information based on the extracted feature information. The method according to claim 1,
The control unit may calculate the similarity between the feature information of the recognized one or more objects and the feature information of the object corresponding to the identification information of the user equipment temporarily stored in the storage unit and determine whether the calculated similarity is equal to or greater than a predetermined reference value Wherein the POS terminal comprises: The method of claim 3,
Wherein the control unit determines that the payee who wishes to make a payment matches the pre-registered user when the calculated degree of similarity is equal to or larger than a predetermined reference value, The control unit controls the communication unit to transmit at least one item of merchandise to be paid, identification information of the POS terminal, and identification information of the user apparatus to the payment server. The method of claim 3,
Wherein the control unit performs an additional authentication procedure by interlocking with the user device when the calculated similarity is smaller than a preset reference value. Receiving characteristic information of an object corresponding to identification information of a user equipment visiting a store provided with a POS terminal transmitted from a service providing apparatus through a communication unit;
Temporarily storing feature information of an object corresponding to identification information of the received user equipment through a storage unit;
Acquiring image information including a user of the user apparatus in a background state through a photographing unit while scanning at least one item to be selected by a user of the user apparatus through a recognition unit;
Recognizing one or more objects included in the image information by performing an object recognition function on the acquired image information through a control unit;
Calculating a degree of similarity between the feature information of the recognized one or more objects and the feature information of the object corresponding to the identification information of the user equipment temporarily stored in the storage unit through the control unit;
Confirming whether the calculated similarity is greater than or equal to a preset reference value through the control unit; And
When the calculated degree of similarity is equal to or greater than a preset reference value, it is determined through the communication unit that the payee who wishes to make a settlement matches a pre-registered user, And transmitting the at least one item of goods to be settled, the identification information of the POS terminal, and the identification information of the user apparatus to the payment server in order to perform the payment function with the set payment method. The method according to claim 6,
Performing an additional authentication procedure by interlocking with the user device to prevent fraudulent use of the payment card through the controller when the calculated similarity is smaller than a preset reference value; And
Transmitting the identification information of the POS terminal and the identification information of the POS terminal to the payment server through the communication unit after the additional authentication procedure between the POS terminal and the user terminal is normally performed, The method of claim 1, further comprising: A recording medium on which a computer program for performing the method according to any one of claims 6 to 7 is recorded. A user device, upon entering the store, for providing identification information of the user device;
A service providing apparatus for providing characteristic information of an object corresponding to identification information of the user apparatus;
Temporarily storing feature information of an object corresponding to identification information of the user equipment provided from the service providing apparatus, scanning at least one item to be settled, acquiring image information including a user of the user apparatus, Recognizing one or more objects included in the image information by performing an object recognition function on the acquired image information, and storing the feature information of the recognized one or more objects and characteristics of the object corresponding to the temporarily stored user equipment identification information A POS terminal for confirming illegal use of the payment card based on the information; And
Transmitting the identification information of the user apparatus transmitted from the POS terminal to the service providing apparatus, and transmitting card information, user information, and benefit information transmitted from the service providing apparatus in response to the transmitted identification information of the user apparatus, And a payment server for performing a payment function for the at least one item to be paid out. 10. The method of claim 9,
When the similarity between the feature information of the recognized at least one object and the feature information of the object corresponding to the identification information of the temporarily stored user equipment is smaller than a preset reference value, And performs an authentication procedure.

Images