[go: up one dir, main page]

WO2019095884A1 - Image recognition technology-based self-service vending method, apparatus, electronic device and computer storage medium - Google Patents

Image recognition technology-based self-service vending method, apparatus, electronic device and computer storage medium Download PDF

Info

Publication number
WO2019095884A1
WO2019095884A1 PCT/CN2018/109160 CN2018109160W WO2019095884A1 WO 2019095884 A1 WO2019095884 A1 WO 2019095884A1 CN 2018109160 W CN2018109160 W CN 2018109160W WO 2019095884 A1 WO2019095884 A1 WO 2019095884A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
information
account
image recognition
recognition technology
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/109160
Other languages
French (fr)
Chinese (zh)
Inventor
斯科特·马修·罗伯特
黄鼎隆
傅恺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Malong Technologies Co Ltd
Original Assignee
Shenzhen Malong Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Malong Technologies Co Ltd filed Critical Shenzhen Malong Technologies Co Ltd
Publication of WO2019095884A1 publication Critical patent/WO2019095884A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/20Point-of-sale [POS] network systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/20Point-of-sale [POS] network systems
    • G06Q20/201Price look-up processing, e.g. updating
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions

Definitions

  • the method further includes:
  • the identifier comprises: a character string, a two-dimensional code, and a barcode.
  • the sales situation is sent to the manager's mobile terminal for viewing by the management system.
  • a generating module configured to: when detecting that a user who has an account associated with is in a preset detection area, photographing the selected item of the user to generate a captured picture;
  • An association module configured to receive an association request of the user, where the association request includes account information and a user-defined identifier
  • the embodiment of the present application further provides a computer storage medium having stored thereon a computer program, the computer executing the steps of the method of any of the above first aspects when the computer program runs.
  • the embodiment of the present application proposes an unattended method, device, electronic device and computer storage medium based on image recognition technology, which is applied to an unmanned vending system, wherein the method includes: when it is detected that it is associated When the user having the account is in the preset detection area, the user selected the product is photographed to generate a captured picture; the captured picture is identified by a neural network to determine information of the selected item of the user; The information includes the amount information; the account is paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount in the amount information of each selected item.
  • the automated way of unmanned goods is realized, which greatly improves the efficiency, reduces the labor cost, and facilitates the smooth circulation of the flow of people, thereby improving the user experience.
  • FIG. 4 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • the expression “or” or “at least one of A or / and B” includes any or all combinations of the simultaneously listed characters.
  • the expression “A or B” or “at least one of A or / and B” may include A, may include B, or may include both A and B.
  • the term "user” as used in various embodiments of the present disclosure may indicate a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).
  • Step 101 When detecting that the user who has been associated with the account is in the preset detection area, shooting the selected item of the user to generate a captured picture;
  • the neural network is obtained by training a picture of the item in the place of sale.
  • the neural network may be a RNN neural network (RNN, Recurrent Neural Network), a CNN neural network (CNN, Convolutional Neural Network), and an LSTM network (LSTM, Long Short-Term Memory). Network) and so on. This application does not specifically limit it.
  • the user when the user enters the supermarket, the user needs to associate the account, and after the subsequent purchase is completed, when the selected product is identified through the neural network, the amount to be paid and the information of the user are determined (may be a string, two Dimension code or barcode, etc., and deduct the amount to be paid from the account associated with the user.
  • the method further includes: performing an amount calculation on the information of the item selected by the user, The amount to be paid is obtained.
  • the method further includes:
  • the data input by the user is specifically related to the account provided by the user when the account is associated, and may be an identifier, such as a character string, a two-dimensional code, a barcode, etc., Make restrictions.
  • the user is set as a user who has an account associated with;
  • the associated account may be a bank card account, an Alipay account, a WeChat account, etc., as long as the payment can be realized, and is not limited to these specific methods, and the associated process is the process of authorizing the payment. .
  • the method further includes:
  • the association request includes account information and a user-defined identifier
  • the association relationship is stored.
  • the method further includes:
  • the generating module 201 is configured to: when detecting that the user who has associated the account is in the preset detection area, photographing the selected item of the user, and generating a captured picture;
  • the identification module 202 is configured to identify the captured picture by using a neural network to determine information of the item selected by the user; wherein the information includes amount information;
  • the method further includes:
  • An association module configured to receive an association request of the user, where the association request includes account information and a user-defined identifier
  • the method further includes:
  • the electronic device includes: a processor 300, a memory 301, a bus 302, and a communication interface 303.
  • the processor 300, the communication interface 303, and the memory 301 are connected by a bus 302.
  • the processor 300 is configured to execute an executable module, such as a computer program, stored in the memory 301.
  • the steps of the method as described in the method embodiments are implemented when the processor executes the extremes and programs.
  • the process C is to pay the amount to be paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount in the amount information of each selected item.
  • the computer program is further configured to perform the following processes:
  • the neural network is obtained by training a picture of the item in the place of sale.
  • the computer program is further configured to perform the following processes:
  • the sales situation is sent to the manager's mobile terminal for viewing by the management system.
  • the unattended method, device, electronic device and computer storage medium based on image recognition technology provided by the embodiments of the present application realize an automated manner for unmanned sales, greatly improving efficiency, reducing labor cost, and facilitating The smooth flow of people's flow further enhances the user experience.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Image Analysis (AREA)

Abstract

The embodiments of the present application provide an image recognition technology-based self-service vending method, an apparatus, an electronic device and a computer storage medium, being applied to a self-service vending system. Said method comprises: when it is detected that a user associated with an account is located in a preset detection area, photographing a commodity selected by the user, so as to generate a picture; recognizing the picture by means of a neural network, so as to determine information about the commodity selected by the user, the information comprising pricing information; and using the account associated with the user to pay the bill to be paid, the bill to be paid being obtained by integrating prices in the pricing information of the selected commodities In this way, self-service vending is realized in an automated manner, improving the efficiency, reducing the labor cost, facilitating a faster flow of people, further improving the user experience.

Description

一种基于图像识别技术的无人售货方法、装置、电子设备及计算机存储介质Unmanned sales method, device, electronic device and computer storage medium based on image recognition technology

相关申请的交叉引用Cross-reference to related applications

本申请要求于2017年11月15日提交中国专利局的优先权号为2017111271551、名称为“一种基于图像识别技术的无人售货方法和设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 2017111271551, entitled "An Unattended Method and Apparatus Based on Image Recognition Technology", filed on November 15, 2017, the entire contents of which is hereby incorporated by reference. This is incorporated herein by reference.

技术领域Technical field

本申请涉及数据处理领域,特别涉及一种基于图像识别技术的无人售货方法、装置、电子设备及计算机存储介质。The present application relates to the field of data processing, and in particular, to an unattended method, device, electronic device and computer storage medium based on image recognition technology.

背景技术Background technique

目前,商店或者超市等,在进行销售时,结算时都是依赖于收银员进行结算的,在这种方式下,由于是依赖人工的方式进行的结算,一则成本较高,且随着社会的发展,人力的成本将越来越高,另外,人工的方式导致效率比较低下,特别是在大型的超市,往往结算时用户需要排很久的队,导致用户的体验特别不好,另外,也导致人流无法顺畅流通,导致大量本应该出去的人出不去,或者放弃购物,或者导致想购物的人进不来,特别是商场的面积相对不足的情况下更是如此。At present, in the case of sales, such as shops or supermarkets, settlement is dependent on the cashier to settle. In this way, because it is a labor-dependent settlement, one is costly and with society. The development, the cost of manpower will be higher and higher, in addition, the artificial way leads to relatively low efficiency, especially in large supermarkets, often the user needs to queue for a long time, resulting in a particularly bad user experience, in addition, As a result, people cannot flow smoothly, causing a large number of people who should have gone out, or giving up shopping, or causing people who want to shop to enter, especially when the area of the mall is relatively insufficient.

申请内容Application content

针对现有技术中的缺陷,本申请的目的包括,提供一种基于图像识别技术的无人售货方法、装置、电子设备及计算机存储介质,以自动化的方式进行无人售货,大大提高了效率,降低了人工使用成本,且利于人流的顺畅流通,进而提升了用户的使用体验。In view of the deficiencies in the prior art, the object of the present application includes providing an unattended method, device, electronic device and computer storage medium based on image recognition technology, and unmanned sales in an automated manner, greatly improving Efficiency, reducing the cost of labor, and facilitating the smooth flow of people, thus improving the user experience.

为了实现上述目的,本申请提出了以下具体的实施例:In order to achieve the above object, the present application proposes the following specific embodiments:

本申请实施例提出了一种基于图像识别技术的无人售货方法,应用于无人售货系统,该方法包括:The embodiment of the present application proposes an unattended method based on image recognition technology, which is applied to an unattended system, and the method includes:

当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;When detecting that the user who has associated the account is in the preset detection area, shooting the selected item of the user to generate a captured picture;

通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;Identifying the captured picture by a neural network to determine information of the item selected by the user; wherein the information includes amount information;

通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。The payment is made by the account associated with the user; wherein the amount to be paid is obtained based on the amount of money in the amount information of each selected item.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;When it is detected that the user is in the preset detection area, the data input by the user is acquired within a preset time period;

基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship;

若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with;

若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;Receiving an association request of the user; wherein the association request includes account information and a user-defined identifier;

将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship;

存储所述关联关系。The association relationship is stored.

在一个具体的实施例中,所述标识包括:字符串、二维码、条形码。In a specific embodiment, the identifier comprises: a character string, a two-dimensional code, and a barcode.

在一个具体的实施例中,所述神经网络为通过对售卖场所中的商品的图片进行训练得到。In a specific embodiment, the neural network is obtained by training a picture of the item in the place of sale.

在一个具体的实施例中,在确定所述用户所选商品的信息之后,在通过所述用户关联的账户对待支付金额进行支付之前,该方法还包括:In a specific embodiment, after determining the information of the item selected by the user, before the payment of the amount to be paid by the account associated with the user, the method further includes:

对所述用户所选商品的信息进行金额计算,得到所述待支付金额。Calculating the amount of information of the item selected by the user, and obtaining the amount to be paid.

在一个具体的实施例中,在通过所述用户关联的账户对待支付金额进行支付之后,该方法还包括:In a specific embodiment, after the payment of the amount to be paid by the account associated with the user, the method further includes:

接收完成支付操作后所生成的支付成功信息;Receiving payment success information generated after completing the payment operation;

根据所述支付成功信息,对售卖场所的销售情况信息进行记录;Recording sales information of the sales place according to the payment success information;

根据所述销售情况信息,确定所述售卖场所的当前存货情况及补货信息;Determining current inventory status and replenishment information of the sales place according to the sales situation information;

将所述补货信息发送至管理者的移动终端。The replenishment information is transmitted to the administrator's mobile terminal.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

获取售卖场所在目标时间段内的销售情况查询请求,所述销售情况查询请求为管理者的移动终端发送的请求;Obtaining a sales situation inquiry request of the sales place during the target time period, where the sales situation inquiry request is a request sent by the manager's mobile terminal;

基于所述销售情况查询请求确定所述售卖场所在目标时间段内的销售情况;Determining, according to the sales situation inquiry request, sales of the sales place within a target time period;

将所述销售情况发送至所述管理者的移动终端,以使所述管理制度进行查看。The sales situation is sent to the manager's mobile terminal for viewing by the management system.

在一个具体的实施例中,所述账户包括以下任一种:银行卡账户,支付宝账户,微信账户。In a specific embodiment, the account includes any one of the following: a bank card account, an Alipay account, and a WeChat account.

本申请实施例还提出了一种基于图像识别技术的无人售货装置,应用于无人售货系统,该装置包括:The embodiment of the present application further provides an unattended device based on image recognition technology, which is applied to an unmanned vending system, and the device includes:

生成模块,配置成当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;a generating module configured to: when detecting that a user who has an account associated with is in a preset detection area, photographing the selected item of the user to generate a captured picture;

识别模块,配置成通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;An identification module, configured to identify the captured picture by a neural network to determine information of the item selected by the user; wherein the information includes amount information;

支付模块,配置成通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。The payment module is configured to pay the amount to be paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount of money in the amount information of each selected item.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

处理模块,配置成当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;The processing module is configured to acquire data input by the user within a preset time period when detecting that the user is in the preset detection area;

基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship;

若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with;

若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

关联模块,配置成接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;An association module, configured to receive an association request of the user, where the association request includes account information and a user-defined identifier;

将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship;

存储所述关联关系。The association relationship is stored.

在一个具体的实施例中,所述标识包括:字符串、二维码、条形码。In a specific embodiment, the identifier comprises: a character string, a two-dimensional code, and a barcode.

在一个具体的实施例中,所述神经网络为通过对售卖场所中的商品的图片进行训练得到。In a specific embodiment, the neural network is obtained by training a picture of the item in the place of sale.

本申请实施例还提出了一种电子设备,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述第一方面中任一项所述的方法。The embodiment of the present application further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor implements the foregoing The method of any of the aspects.

本申请实施例还提出了一种计算机存储介质,其上存储有计算机程序,所述计算机运行所述计算机程序时执行上述第一方面中任一项所述的方法的步骤。The embodiment of the present application further provides a computer storage medium having stored thereon a computer program, the computer executing the steps of the method of any of the above first aspects when the computer program runs.

以此,本申请实施例提出了一种基于图像识别技术的无人售货方法、装置、电子设备及计算机存储介质,应用于无人售货系统,其中,该方法包括:当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。以此实现了自动化的方式进行无人售货,大大提高了效率,降低了人工使用成本,且利于人流的顺畅流通,进而提升了用户的使用体验。Therefore, the embodiment of the present application proposes an unattended method, device, electronic device and computer storage medium based on image recognition technology, which is applied to an unmanned vending system, wherein the method includes: when it is detected that it is associated When the user having the account is in the preset detection area, the user selected the product is photographed to generate a captured picture; the captured picture is identified by a neural network to determine information of the selected item of the user; The information includes the amount information; the account is paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount in the amount information of each selected item. In this way, the automated way of unmanned goods is realized, which greatly improves the efficiency, reduces the labor cost, and facilitates the smooth circulation of the flow of people, thereby improving the user experience.

为使本申请的上述目的、特征和优点能更明显易懂,下文特举较佳实施例,并配合所附附图,作详细说明如下。The above described objects, features, and advantages of the present invention will become more apparent from the following description.

附图说明DRAWINGS

为了更清楚地说明本申请实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本申请的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings to be used in the embodiments will be briefly described below. It should be understood that the following drawings show only certain embodiments of the present application, and therefore It should be seen as a limitation on the scope, and those skilled in the art can obtain other related drawings according to these drawings without any creative work.

图1为本申请实施例提出的一种基于图像识别技术的无人售货方法的流程示意图;1 is a schematic flow chart of an unattended method based on image recognition technology according to an embodiment of the present application;

图2为本申请实施例提出的一种基于图像识别技术的无人售货装置的装置示意图;2 is a schematic diagram of an apparatus for an unattended device based on image recognition technology according to an embodiment of the present application;

图3为本申请实施例提出的一种基于图像识别技术的无人售货装置的装置示意图;3 is a schematic diagram of an apparatus for an unattended device based on image recognition technology according to an embodiment of the present application;

图4为本申请实施例提出的一种电子设备的示意图。FIG. 4 is a schematic diagram of an electronic device according to an embodiment of the present application.

具体实施方式Detailed ways

在下文中,将更全面地描述本公开的各种实施例。本公开可具有各种实施例,并且可在其中做出调整和改变。然而,应理解:不存在将本公开的各种实施例限于在此公开的特定实施例的意图,而是应将本公开理解为涵盖落入本公开的各种实施例的精神和范围内的所有调整、等同物和/或可选方案。In the following, various embodiments of the present disclosure will be described more fully. The present disclosure can have various embodiments, and adjustments and changes can be made therein. It should be understood, however, that the present invention is not limited to the specific embodiments disclosed herein, but the invention is to be construed as being included within the spirit and scope of the various embodiments of the present disclosure. All adjustments, equivalents and/or alternatives.

在下文中,可在本公开的各种实施例中使用的术语“包括”或“可包括”指示所公开的功能、操作或元件的存在,并且不限制一个或更多个功能、操作或元件的增加。此外,如在本公开的各种实施例中所使用,术语“包括”、“具有”及其同源词仅意在表示特定特征、数字、步骤、操作、元件、组件或前述项的组合,并且不应被理解为首先排除一个或更多个其它特征、数字、步骤、操作、元件、组件或前述项的组合的存在或增加一个或更多个特征、数字、步骤、操作、元件、组件或前述项的组合的可能性。In the following, the term "comprising" or "including" may be used in the various embodiments of the present disclosure to indicate the existence of the disclosed function, operation or element, and does not limit one or more functions, operations or elements. increase. In addition, the terms "comprising," "having," "," It should not be understood that the existence or addition of one or more features, numbers, steps, operations, components or components of one or more other features, numbers, steps, operations, components, components or combinations of the foregoing are excluded. Or the possibility of a combination of the foregoing.

在本公开的各种实施例中,表述“或”或“A或/和B中的至少一个”包括同时列出的文字的任何组合或所有组合。例如,表述“A或B”或“A或/和B中的至少一个”可包括A、可包括B或可包括A和B二者。In various embodiments of the present disclosure, the expression "or" or "at least one of A or / and B" includes any or all combinations of the simultaneously listed characters. For example, the expression "A or B" or "at least one of A or / and B" may include A, may include B, or may include both A and B.

在本公开的各种实施例中使用的表述(诸如“第一”、“第二”等)可修饰在各种实施例中的各种组成元件,不过可不限制相应组成元件。例如,以上表述并不限制所述元件的顺序和/或重要性。以上表述仅用于将一个元件与其它元件区别开的目的。例如,第一用户装置和第二用户装置指示不同用户装置,尽管二者都是用户装置。例如,在不脱离本公开的各种实施例的范围的情况下,第一元件可被称为第二元件,同样地,第二元件也可被称为第一元件。Expressions used in various embodiments of the present disclosure (such as "first", "second", etc.) may modify various constituent elements in various embodiments, but the corresponding constituent elements may not be limited. For example, the above statements do not limit the order and/or importance of the elements. The above statements are only used for the purpose of distinguishing one element from another. For example, the first user device and the second user device indicate different user devices, although both are user devices. For example, a first element could be termed a second element, and a second element could be termed a first element, without departing from the scope of the various embodiments of the present disclosure.

应注意到:如果描述将一个组成元件“连接”到另一组成元件,则可将第一组成元件直接连接到第二组成元件,并且可在第一组成元件和第二组成元件之间“连接”第三组成元件。相反地,当将一个组成元件“直接连接”到另一组成元件时,可理解为在第一组成元件和第 二组成元件之间不存在第三组成元件。It should be noted that if the description "connects" one constituent element to another constituent element, the first constituent element can be directly connected to the second constituent element and can be "connected" between the first constituent element and the second constituent element. "The third component. On the contrary, when a constituent element is "directly connected" to another constituent element, it can be understood that there is no third constituent element between the first constituent element and the second constituent element.

在本公开的各种实施例中使用的术语“用户”可指示使用电子装置的人或使用电子装置的装置(例如,人工智能电子装置)。The term "user" as used in various embodiments of the present disclosure may indicate a person using an electronic device or a device using an electronic device (eg, an artificial intelligence electronic device).

在本公开的各种实施例中使用的术语仅用于描述特定实施例的目的并且并非意在限制本公开的各种实施例。如在此所使用,单数形式意在也包括复数形式,除非上下文清楚地另有指示。除非另有限定,否则在这里使用的所有术语(包括技术术语和科学术语)具有与本公开的各种实施例所属领域普通技术人员通常理解的含义相同的含义。所述术语(诸如在一般使用的词典中限定的术语)将被解释为具有与在相关技术领域中的语境含义相同的含义并且将不被解释为具有理想化的含义或过于正式的含义,除非在本公开的各种实施例中被清楚地限定。The terms used in the various embodiments of the present disclosure are only for the purpose of describing the specific embodiments and are not intended to limit the various embodiments of the present disclosure. As used herein, the singular forms " All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the various embodiments of the present disclosure pertain, unless otherwise defined. The term (such as a term defined in a commonly used dictionary) will be interpreted as having the same meaning as the contextual meaning in the related art and will not be interpreted as having an idealized meaning or an overly formal meaning, Unless clearly defined in the various embodiments of the present disclosure.

实施例1Example 1

本申请实施例提出了一种基于图像识别技术的无人售货方法,应用于无人售货系统,如图1所示,该方法包括:The embodiment of the present application proposes an unattended method based on image recognition technology, which is applied to an unmanned vending system. As shown in FIG. 1 , the method includes:

步骤101、当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;Step 101: When detecting that the user who has been associated with the account is in the preset detection area, shooting the selected item of the user to generate a captured picture;

具体实现时,预设的检测区域是指用户选择好商品后进行商品登记的区域,该预设的检测区域在一个售卖场所中可以有多个,当然也可以有一个。当预设的检测区域有多个时,该预设的检测区域可按照商品类型进行设置,一类商品类型对应一个预设的检测区域,当然以上实现方式仅是实例性说明,具体还可以采用其他实现方式。In a specific implementation, the preset detection area refers to an area where the user selects a good product and then registers the product. The preset detection area may have multiple in one sales place, and of course, there may be one. When there are multiple preset detection areas, the preset detection area may be set according to the product type, and one type of commodity type corresponds to a preset detection area. Of course, the above implementation manner is only an example description, and specifically may also be adopted. Other implementations.

步骤102、通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;Step 102: Identify, by using a neural network, the captured picture to determine information of the item selected by the user; wherein the information includes amount information;

在实际应用的优选方式中,该神经网络为通过对所述售卖场所中的商品的图片进行训练得到。该神经网络可以为RNN神经网络(RNN,Recurrent Neural Network,循环神经网络)、CNN神经网络(CNN,Convolutional Neural Network,卷积神经网络)以及LSTM网络(LSTM,Long Short-Term Memory,长短期记忆网络)等。本申请不对其进行具体限制。In a preferred mode of practical application, the neural network is obtained by training a picture of the item in the place of sale. The neural network may be a RNN neural network (RNN, Recurrent Neural Network), a CNN neural network (CNN, Convolutional Neural Network), and an LSTM network (LSTM, Long Short-Term Memory). Network) and so on. This application does not specifically limit it.

另外,确定得到的用户所选商品的信息还可以包括商品的名称。In addition, the information determining the obtained item selected by the user may further include the name of the item.

在一种实施方式中,商品的图片作为样本数据,可以有清晰度高于第一预设值的商品图片,以及清晰度低于第一预设值,但是高于第二预设值的商品图片;此外还可以增加与该售卖场所中商品不同的商品的图片作为对照样本数据一起训练神经网络。上述第一预设值和第二预设值具体可根据拍摄设备的所拍得的拍摄图片的清晰度进行设定,在这里不进行具体限制。In an embodiment, the picture of the item as the sample data may have a product picture with a higher definition than the first preset value, and an item with a lower definition than the first preset value but higher than the second preset value. In addition, it is also possible to increase the picture of the item different from the item in the sales place as the control sample data to train the neural network together. The first preset value and the second preset value may be specifically set according to the sharpness of the captured picture taken by the photographing device, and no specific limitation is imposed herein.

步骤103、通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。Step 103: Paying a payment amount by the account associated with the user; wherein the to-be-paid amount is obtained based on the amount in the amount information of each selected item.

在一种实现方式中,用户在进入超市时,需要关联账户,后续选购完成之后,在通过神经网络识别出所选购的商品时,确定待支付金额以及用户的信息(可以为字符串,二维码或者条形码等),并从用户关联的账户中扣除待支付金额。In an implementation manner, when the user enters the supermarket, the user needs to associate the account, and after the subsequent purchase is completed, when the selected product is identified through the neural network, the amount to be paid and the information of the user are determined (may be a string, two Dimension code or barcode, etc., and deduct the amount to be paid from the account associated with the user.

需要说明的是,在确定所述用户所选商品的信息之后,在通过所述用户关联的账户对待支付金额进行支付之前,该方法还包括:对所述用户所选商品的信息进行金额计算,得到所述待支付金额。It should be noted that, after determining the information of the item selected by the user, before the payment of the payment amount by the account associated with the user, the method further includes: performing an amount calculation on the information of the item selected by the user, The amount to be paid is obtained.

在一个具体的实施例中,该方法还包括:In a specific embodiment, the method further includes:

当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;When it is detected that the user is in the preset detection area, the data input by the user is acquired within a preset time period;

在一种实施方式中,用户输入的数据具体为在进行账户关联时,用户提供的与账户相关联的数据,可以为标识,比如:字符串、二维码、条形码等,本申请对其不进行限制。In an embodiment, the data input by the user is specifically related to the account provided by the user when the account is associated, and may be an identifier, such as a character string, a two-dimensional code, a barcode, etc., Make restrictions.

基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship;

在得到用户输入的数据后,在预设的关联关系中确定是否存在与用户输入的数据相关联的账户信息。After the data input by the user is obtained, it is determined in the preset association relationship whether there is account information associated with the data input by the user.

若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with;

若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account.

在一种实施方式中,关联的账户可以为银行卡账户,支付宝账户,微信账户等等,只要能实现支付即可,并不限于这几种具体的方式,关联的过程也即授权支付的过程。In an embodiment, the associated account may be a bank card account, an Alipay account, a WeChat account, etc., as long as the payment can be realized, and is not limited to these specific methods, and the associated process is the process of authorizing the payment. .

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;Receiving an association request of the user; wherein the association request includes account information and a user-defined identifier;

将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship;

存储所述关联关系。The association relationship is stored.

可选地,在关联时,用户自定义的标识包括:字符串、二维码、条形码。Optionally, when associated, the user-defined identifier includes: a string, a two-dimensional code, and a barcode.

后续用户基于该标识可以直接关联到对应的账户,进而进行支付。在一种实施方式中,如,标识可以为6位数字(即字符串),例如可以为123654,后续当用户需要支付时,按下这6个数字,就能关联到对应的账户,即可自动完成支付,方便快捷。Subsequent users can directly associate to the corresponding account based on the identifier, and then perform payment. In an embodiment, for example, the identifier may be a 6-digit number (ie, a character string), for example, may be 123654. When the user needs to pay, the user can press the 6 digits to associate with the corresponding account. Automatically complete payment, convenient and fast.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

接收完成支付操作后所生成的支付成功信息;Receiving payment success information generated after completing the payment operation;

根据所述支付成功信息,对所述售卖场所的销售情况信息进行记录;Recording sales information of the sales place according to the payment success information;

根据所述销售情况信息,确定所述售卖场所的当前存货情况及补货信息;Determining current inventory status and replenishment information of the sales place according to the sales situation information;

将所述补货信息发送至管理者的移动终端。The replenishment information is transmitted to the administrator's mobile terminal.

在接收到支付成功信息后,对该成交单中的商品进行记录,以对售卖场所的销售情况信息进行统计。进一步,通过上述销售情况信息和历史库存信息,可以知道当前的商品剩余量,及确定该售卖场所需要补充的商品名称及数量,即上述存货情况和补货信息。在确定售卖场所的补货信息后,将其发送给管理者的移动终端,以使管理人员进行及时的补货操作,进而满足用户的购物需求。After receiving the payment success information, the goods in the transaction order are recorded to perform statistics on the sales situation information of the sales place. Further, through the above sales situation information and historical inventory information, the current product remaining amount can be known, and the name and quantity of the product to be replenished by the selling place, that is, the above inventory situation and replenishment information are determined. After determining the replenishment information of the sales place, it is sent to the manager's mobile terminal, so that the manager can perform the timely replenishment operation, thereby satisfying the user's shopping demand.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

获取所述售卖场所在目标时间段内的销售情况查询请求,所述销售情况查询请求为管理者的移动终端发送的请求;Obtaining a sales situation inquiry request of the sales place within a target time period, where the sales situation inquiry request is a request sent by the manager's mobile terminal;

基于所述销售情况查询请求确定所述售卖场所在目标时间段内的销售情况;Determining, according to the sales situation inquiry request, sales of the sales place within a target time period;

将所述销售情况发送至所述管理者的移动终端,以使所述管理制度进行查看。The sales situation is sent to the manager's mobile terminal for viewing by the management system.

实施例2Example 2

本申请实施例2还公开了一种基于图像识别技术的无人售货装置,应用于无人售货系统,如图2所示,该装置包括:Embodiment 2 of the present application also discloses an unattended device based on image recognition technology, which is applied to an unmanned vending system. As shown in FIG. 2, the device includes:

生成模块201,配置成当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;The generating module 201 is configured to: when detecting that the user who has associated the account is in the preset detection area, photographing the selected item of the user, and generating a captured picture;

识别模块202,配置成通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;The identification module 202 is configured to identify the captured picture by using a neural network to determine information of the item selected by the user; wherein the information includes amount information;

支付模块203,配置成通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。The payment module 203 is configured to pay the amount to be paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount of money in the amount information of each selected item.

在一个具体的实施例中,如图3所示,还包括:In a specific embodiment, as shown in FIG. 3, the method further includes:

处理模块204,配置成当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;The processing module 204 is configured to: when it is detected that the user is in the preset detection area, obtain the data input by the user within a preset time period;

基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship;

若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with;

若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

关联模块,配置成接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;An association module, configured to receive an association request of the user, where the association request includes account information and a user-defined identifier;

将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship;

存储所述关联关系。The association relationship is stored.

在一个具体的实施例中,所述标识包括:字符串、二维码、条形码。In a specific embodiment, the identifier comprises: a character string, a two-dimensional code, and a barcode.

在一个具体的实施例中,所述神经网络为通过对所述售卖场所中的商品的图片进行训练得到。In a specific embodiment, the neural network is obtained by training a picture of the item in the place of sale.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

金额计算模块,配置成对所述用户所选商品的信息进行金额计算,得到所述待支付金额。The amount calculation module is configured to perform an amount calculation on the information of the product selected by the user to obtain the to-be-paid amount.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

接收模块,配置成接收完成支付操作后所生成的支付成功信息;a receiving module, configured to receive payment success information generated after completing the payment operation;

根据所述支付成功信息,对售卖场所的销售情况信息进行记录;Recording sales information of the sales place according to the payment success information;

根据所述销售情况信息,确定所述售卖场所的当前存货情况及补货信息;Determining current inventory status and replenishment information of the sales place according to the sales situation information;

将所述补货信息发送至管理者的移动终端。The replenishment information is transmitted to the administrator's mobile terminal.

在一个具体的实施例中,还包括:In a specific embodiment, the method further includes:

获取模块,配置成获取售卖场所在目标时间段内的销售情况查询请求,所述销售情况查询请求为管理者的移动终端发送的请求;The obtaining module is configured to obtain a sales situation query request of the sales place within the target time period, where the sales situation query request is a request sent by the manager's mobile terminal;

基于所述销售情况查询请求确定所述售卖场所在目标时间段内的销售情况;Determining, according to the sales situation inquiry request, sales of the sales place within a target time period;

将所述销售情况发送至所述管理者的移动终端,以使所述管理制度进行查看。The sales situation is sent to the manager's mobile terminal for viewing by the management system.

在一个具体的实施例中,所述账户包括以下任一种:银行卡账户,支付宝账户,微信账户。In a specific embodiment, the account includes any one of the following: a bank card account, an Alipay account, and a WeChat account.

实施例3Example 3

本申请实施例提供了一种电子设备,参考图4,该电子设备包括:处理器300,存储器301,总线302和通信接口303,处理器300、通信接口303和存储器301通过总线302连接;处理器300配置成执行存储器301中存储的可执行模块,例如计算机程序。处理器执行极端及程序时实现如方法实施例中描述的方法的步骤。The embodiment of the present application provides an electronic device. Referring to FIG. 4, the electronic device includes: a processor 300, a memory 301, a bus 302, and a communication interface 303. The processor 300, the communication interface 303, and the memory 301 are connected by a bus 302. The processor 300 is configured to execute an executable module, such as a computer program, stored in the memory 301. The steps of the method as described in the method embodiments are implemented when the processor executes the extremes and programs.

其中,存储器301可能包含高速随机存取存储器(RAM,Random Access Memory),也可能还包括非不稳定的存储器(non-volatile memory),例如至少一个磁盘存储器。通过至少一个通信接口303(可以是有线或者无线)实现该系统网元与至少一个其他网元之间的通信连接,可以使用互联网,广域网,本地网,城域网等。The memory 301 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is implemented by at least one communication interface 303 (which may be wired or wireless), and may use an Internet, a wide area network, a local network, a metropolitan area network, or the like.

总线302可以是ISA总线、PCI总线或EISA总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,图30中仅用一个双向箭头表示,但并不表示仅有一根总线或一种类型的总线。The bus 302 can be an ISA bus, a PCI bus, or an EISA bus. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one double-headed arrow is shown in Figure 30, but it does not mean that there is only one bus or one type of bus.

其中,存储器301配置成存储程序,处理器300在接收到执行指令后,执行程序,前述本申请实施例任一实施例揭示的流过程定义的装置所执行的方法可以应配置成处理器300中,或者由处理器300实现。The memory 301 is configured to store a program, and the processor 300 executes the program after receiving the execution instruction. The method executed by the device defined by the flow process disclosed in any embodiment of the present application may be configured in the processor 300. Or implemented by the processor 300.

处理器300可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器300中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器300可以是通用处理器,包括中央处理器(Central Processing Unit,简称CPU)、网络处理器(Network Processor,简称NP)等;还可以是数字信号处理器(Digital Signal Processing,简称DSP)、专用集成电路(Application Specific Integrated Circuit,简称ASIC)、现成可编程门阵列(Field-Programmable Gate Array,简称FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器301,处理器300读取存储器301中的信息,结合其硬件完成上述方法的步骤。Processor 300 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 300 or an instruction in a form of software. The processor 300 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP processor, etc.), or a digital signal processor (DSP). ), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the memory 301, and the processor 300 reads the information in the memory 301 and completes the steps of the above method in combination with its hardware.

在本申请的另一个实施例中,还提供了一种计算机存储介质,其上存储有计算机程序,所述计算机运行所述计算机程序时执行上述方法实施例一中任一项所述的方法的步骤。In another embodiment of the present application, there is also provided a computer storage medium having stored thereon a computer program, the computer executing the method of any of the above method embodiments step.

实施例4Example 4

本申请实施例还提出了一种计算机存储介质,该计算机存储介质中包括有计算机程序,该计算机程序配置成执行以下流程:The embodiment of the present application further provides a computer storage medium, which includes a computer program configured to perform the following processes:

流程A、当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;In the process A, when detecting that the user who has associated the account is in the preset detection area, the user selected the item is photographed to generate a captured picture;

流程B、通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;In the process B, the captured picture is identified by a neural network to determine information of the item selected by the user; wherein the information includes amount information;

流程C、通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到.The process C is to pay the amount to be paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount in the amount information of each selected item.

在一个具体的实施例中,该计算机程序还配置成执行以下流程:In a specific embodiment, the computer program is further configured to perform the following processes:

流程D、当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;In the process D, when it is detected that a user is in a preset detection area, the data input by the user is acquired within a preset time period;

基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship;

若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with;

若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account.

在一个具体的实施例中,该计算机程序还配置成执行以下流程:In a specific embodiment, the computer program is further configured to perform the following processes:

流程E、接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;The process E: receiving an association request of the user; where the association request includes account information and a user-defined identifier;

将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship;

存储所述关联关系。The association relationship is stored.

在一个具体的实施例中,所述标识包括:字符串、二维码、条形码。In a specific embodiment, the identifier comprises: a character string, a two-dimensional code, and a barcode.

在一个具体的实施例中,所述神经网络为通过对售卖场所中的商品的图片进行训练得到。In a specific embodiment, the neural network is obtained by training a picture of the item in the place of sale.

在一个具体的实施例中,该计算机程序还配置成执行以下流程:In a specific embodiment, the computer program is further configured to perform the following processes:

流程F、对所述用户所选商品的信息进行金额计算,得到所述待支付金额。In the process F, an amount calculation is performed on the information of the product selected by the user, and the to-be-paid amount is obtained.

在一个具体的实施例中,该计算机程序还配置成执行以下流程:In a specific embodiment, the computer program is further configured to perform the following processes:

流程G、接收完成支付操作后所生成的支付成功信息;Process G, receiving payment success information generated after completing the payment operation;

根据所述支付成功信息,对售卖场所的销售情况信息进行记录;Recording sales information of the sales place according to the payment success information;

根据所述销售情况信息,确定所述售卖场所的当前存货情况及补货信息;Determining current inventory status and replenishment information of the sales place according to the sales situation information;

将所述补货信息发送至管理者的移动终端。The replenishment information is transmitted to the administrator's mobile terminal.

在一个具体的实施例中,该计算机程序还配置成执行以下流程:In a specific embodiment, the computer program is further configured to perform the following processes:

流程H、获取售卖场所在目标时间段内的销售情况查询请求,所述销售情况查询请求为管理者的移动终端发送的请求;a process H, obtaining a sales situation inquiry request in a target time period of the sales place, where the sales situation inquiry request is a request sent by the manager's mobile terminal;

基于所述销售情况查询请求确定所述售卖场所在目标时间段内的销售情况;Determining, according to the sales situation inquiry request, sales of the sales place within a target time period;

将所述销售情况发送至所述管理者的移动终端,以使所述管理制度进行查看。The sales situation is sent to the manager's mobile terminal for viewing by the management system.

在一个具体的实施例中,所述账户包括以下任一种:银行卡账户,支付宝账户,微信账户。In a specific embodiment, the account includes any one of the following: a bank card account, an Alipay account, and a WeChat account.

以此,本申请实施例提出了一种基于图像识别技术的无人售货方法、装置、电子设备及计算机存储介质,应用于无人售货系统,其中,该方法包括:当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。以此实现了自动化的方式进行无人售货,大大提高了效率,降低了人工使用成本,且利于人流的顺畅流通,进而提升了用户的使用体验。Therefore, the embodiment of the present application proposes an unattended method, device, electronic device and computer storage medium based on image recognition technology, which is applied to an unmanned vending system, wherein the method includes: when it is detected that it is associated When the user having the account is in the preset detection area, the user selected the product is photographed to generate a captured picture; the captured picture is identified by a neural network to determine information of the selected item of the user; The information includes the amount information; the account is paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount in the amount information of each selected item. In this way, the automated way of unmanned goods is realized, which greatly improves the efficiency, reduces the labor cost, and facilitates the smooth circulation of the flow of people, thereby improving the user experience.

本领域技术人员可以理解附图只是一个优选实施场景的示意图,附图中的模块或流程并不一定是实施本申请所必须的。A person skilled in the art can understand that the drawings are only a schematic diagram of a preferred implementation scenario, and the modules or processes in the drawings are not necessarily required to implement the application.

本领域技术人员可以理解实施场景中的装置中的模块可以按照实施场景描述进行分布于实施场景的装置中,也可以进行相应变化位于不同于本实施场景的一个或多个装置中。上述实施场景的模块可以合并为一个模块,也可以进一步拆分成多个子模块。A person skilled in the art may understand that the modules in the apparatus in the implementation scenario may be distributed in the apparatus for implementing the scenario according to the implementation scenario description, or may be correspondingly changed in one or more devices different from the implementation scenario. The modules of the above implementation scenarios may be combined into one module, or may be further split into multiple sub-modules.

上述本申请序号仅仅为了描述,不代表实施场景的优劣。The above serial numbers are only for the description, and do not represent the advantages and disadvantages of the implementation scenario.

以上公开的仅为本申请的几个具体实施场景,但是,本申请并非局限于此,任何本领域的技术人员能思之的变化都应落入本申请的保护范围。The above disclosure is only a few specific implementation scenarios of the present application, but the present application is not limited thereto, and any changes that can be made by those skilled in the art should fall within the protection scope of the present application.

工业实用性Industrial applicability

本申请实施例提供的基于图像识别技术的无人售货方法、装置、电子设备及计算机存储介质,实现了自动化的方式进行无人售货,大大提高了效率,降低了人工使用成本,且利于人流的顺畅流通,进而提升了用户的使用体验。The unattended method, device, electronic device and computer storage medium based on image recognition technology provided by the embodiments of the present application realize an automated manner for unmanned sales, greatly improving efficiency, reducing labor cost, and facilitating The smooth flow of people's flow further enhances the user experience.

Claims (16)

一种基于图像识别技术的无人售货方法,其特征在于,应用于无人售货系统,该方法包括:An unattended method based on image recognition technology, characterized in that it is applied to an unmanned vending system, the method comprising: 当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;When detecting that the user who has associated the account is in the preset detection area, shooting the selected item of the user to generate a captured picture; 通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;Identifying the captured picture by a neural network to determine information of the item selected by the user; wherein the information includes amount information; 通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。The payment is made by the account associated with the user; wherein the amount to be paid is obtained based on the amount of money in the amount information of each selected item. 如权利要求1所述的一种基于图像识别技术的无人售货方法,其特征在于,还包括:The unattended method based on image recognition technology according to claim 1, further comprising: 当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;When it is detected that the user is in the preset detection area, the data input by the user is acquired within a preset time period; 基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship; 若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with; 若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account. 如权利要求1或2所述的一种基于图像识别技术的无人售货方法,其特征在于,还包括:The unattended method based on image recognition technology according to claim 1 or 2, further comprising: 接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;Receiving an association request of the user; wherein the association request includes account information and a user-defined identifier; 将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship; 存储所述关联关系。The association relationship is stored. 如权利要求3所述的一种基于图像识别技术的无人售货方法,其特征在于,所述标识包括:字符串、二维码、条形码。The unattended method based on image recognition technology according to claim 3, wherein the identifier comprises: a character string, a two-dimensional code, and a barcode. 如权利要求1所述的一种基于图像识别技术的无人售货方法,其特征在于,所述神经网络为通过对售卖场所中的商品的图片进行训练得到。The unattended method based on image recognition technology according to claim 1, wherein the neural network is obtained by training a picture of an item in a sales place. 如权利要求1至5中任一项所述的一种基于图像识别技术的无人售货方法,其特征在于,在确定所述用户所选商品的信息之后,在通过所述用户关联的账户对待支付金额进行支付之前,该方法还包括:An unattended method based on image recognition technology according to any one of claims 1 to 5, characterized in that after determining information of the item selected by the user, in an account associated with the user Before paying the amount to be paid, the method also includes: 对所述用户所选商品的信息进行金额计算,得到所述待支付金额。Calculating the amount of information of the item selected by the user, and obtaining the amount to be paid. 如权利要求1至6中任一项所述的一种基于图像识别技术的无人售货方法,其特征在于,在通过所述用户关联的账户对待支付金额进行支付之后,该方法还包括:The unattended method based on image recognition technology according to any one of claims 1 to 6, wherein after the payment of the amount to be paid by the account associated with the user, the method further comprises: 接收完成支付操作后所生成的支付成功信息;Receiving payment success information generated after completing the payment operation; 根据所述支付成功信息,对售卖场所的销售情况信息进行记录;Recording sales information of the sales place according to the payment success information; 根据所述销售情况信息,确定所述售卖场所的当前存货情况及补货信息;Determining current inventory status and replenishment information of the sales place according to the sales situation information; 将所述补货信息发送至管理者的移动终端。The replenishment information is transmitted to the administrator's mobile terminal. 如权利要求1至7中任一项所述的一种基于图像识别技术的无人售货方法,其特征在于,还包括:The unattended method based on image recognition technology according to any one of claims 1 to 7, further comprising: 获取售卖场所在目标时间段内的销售情况查询请求,所述销售情况查询请求为管理者的移动终端发送的请求;Obtaining a sales situation inquiry request of the sales place during the target time period, where the sales situation inquiry request is a request sent by the manager's mobile terminal; 基于所述销售情况查询请求确定所述售卖场所在目标时间段内的销售情况;Determining, according to the sales situation inquiry request, sales of the sales place within a target time period; 将所述销售情况发送至所述管理者的移动终端,以使所述管理制度进行查看。The sales situation is sent to the manager's mobile terminal for viewing by the management system. 如权利要求1所述的一种基于图像识别技术的无人售货方法,其特征在于,所述账户包括以下任一种:银行卡账户,支付宝账户,微信账户。The unattended method based on image recognition technology according to claim 1, wherein the account comprises any one of the following: a bank card account, an Alipay account, and a WeChat account. 一种基于图像识别技术的无人售货装置,其特征在于,应用于无人售货系统,该装置包括:An unattended device based on image recognition technology, characterized in that it is applied to an unmanned vending system, the device comprising: 生成模块,配置成当检测到已关联有账户的用户处于预设的检测区域时,对所述用户所选商品进行拍摄,生成拍摄图片;a generating module configured to: when detecting that a user who has an account associated with is in a preset detection area, photographing the selected item of the user to generate a captured picture; 识别模块,配置成通过神经网络对所述拍摄图片进行识别,以确定所述用户所选商品的信息;其中,所述信息中包括金额信息;An identification module, configured to identify the captured picture by a neural network to determine information of the item selected by the user; wherein the information includes amount information; 支付模块,配置成通过所述用户关联的账户对待支付金额进行支付;其中,所述待支付金额基于综合各所选商品的金额信息中的金额得到。The payment module is configured to pay the amount to be paid by the account associated with the user; wherein the amount to be paid is obtained based on the amount of money in the amount information of each selected item. 如权利要求10所述的一种基于图像识别技术的无人售货装置,其特征在于,还包括:An unattended device based on image recognition technology according to claim 10, further comprising: 处理模块,配置成当检测到有用户处于预设的检测区域时,在预设时间段内获取到所述用户输入的数据;The processing module is configured to acquire data input by the user within a preset time period when detecting that the user is in the preset detection area; 基于预设的关联关系确定所述数据是否关联有账户信息;Determining whether the data is associated with account information based on a preset association relationship; 若判断结果为是,将所述用户设置为已关联有账户的用户;If the judgment result is yes, the user is set as a user who has an account associated with; 若判断结果为否,则提示所述用户进行关联账户的操作。If the judgment result is no, the user is prompted to perform an operation of the associated account. 如权利要求11所述的一种基于图像识别技术的无人售货装置,其特征在于,还包括:An unattended device based on image recognition technology according to claim 11, further comprising: 关联模块,配置成接收所述用户的关联请求;其中,所述关联请求中包含有账户信息以及用户自定义的标识;An association module, configured to receive an association request of the user, where the association request includes account information and a user-defined identifier; 将所述账户信息以及所述标识进行关联,以生成关联关系;Associating the account information and the identifier to generate an association relationship; 存储所述关联关系。The association relationship is stored. 如权利要求12所述的一种基于图像识别技术的无人售货装置,其特征在于,所述标识包括:字符串、二维码、条形码。The unattended device based on image recognition technology according to claim 12, wherein the identifier comprises: a character string, a two-dimensional code, and a barcode. 如权利要求10所述的一种基于图像识别技术的无人售货装置,其特征在于,所述神经网络为通过对售卖场所中的商品的图片进行训练得到。An unattended device based on image recognition technology according to claim 10, wherein said neural network is obtained by training a picture of a product in a place of sale. 一种电子设备,其特征在于,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述权利要求1至9中任一项所述的方法。An electronic device, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the computer program to implement the above claim 1 The method of any of 9. 一种计算机存储介质,其特征在于,其上存储有计算机程序,所述计算机运行所述计算机程序时执行上述权利要求1至9中任一项所述的方法的步骤。A computer storage medium having stored thereon a computer program, the computer executing the steps of the method of any one of claims 1 to 9 when the computer program is run.
PCT/CN2018/109160 2017-11-15 2018-09-30 Image recognition technology-based self-service vending method, apparatus, electronic device and computer storage medium Ceased WO2019095884A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711127155.1A CN107944859A (en) 2017-11-15 2017-11-15 A kind of self-service method and apparatus based on image recognition technology
CN201711127155.1 2017-11-15

Publications (1)

Publication Number Publication Date
WO2019095884A1 true WO2019095884A1 (en) 2019-05-23

Family

ID=61932248

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/109160 Ceased WO2019095884A1 (en) 2017-11-15 2018-09-30 Image recognition technology-based self-service vending method, apparatus, electronic device and computer storage medium

Country Status (2)

Country Link
CN (1) CN107944859A (en)
WO (1) WO2019095884A1 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107944859A (en) * 2017-11-15 2018-04-20 深圳码隆科技有限公司 A kind of self-service method and apparatus based on image recognition technology
CN108596137A (en) * 2018-05-02 2018-09-28 济南浪潮高新科技投资发展有限公司 A kind of commodity scanning record method based on image recognition algorithm
CN108921645B (en) * 2018-06-07 2021-07-13 深圳码隆科技有限公司 Commodity purchase judgment method and device and user terminal
CN108806133A (en) * 2018-06-08 2018-11-13 准动网络科技(厦门)有限公司 Self-service cash method and system
CN109003155A (en) * 2018-06-19 2018-12-14 杭州创匠信息科技有限公司 Unmanned vending system and method
CN108647671B (en) * 2018-06-28 2023-12-22 武汉市哈哈便利科技有限公司 Optical identification visual identification method and unmanned sales counter based on same
CN109034980B (en) * 2018-08-23 2021-12-28 深圳码隆科技有限公司 Collocation commodity recommendation method and device and user terminal
CN109190706A (en) * 2018-09-06 2019-01-11 深圳码隆科技有限公司 Self-service method, apparatus and system
CN109146500A (en) * 2018-09-10 2019-01-04 深圳市宇墨科技有限公司 Unmanned supermarket's method of payment and relevant apparatus
CN109191682A (en) * 2018-11-16 2019-01-11 广州批霸电子商务有限公司 A kind of self-service machine and its method based on artificial intelligence technology
CN109767559A (en) * 2019-01-21 2019-05-17 深圳市智莱科技股份有限公司 The method that the cargo path of automatic vending equipment defines
WO2021072699A1 (en) * 2019-10-17 2021-04-22 Shenzhen Malong Technologies Co., Ltd. Irregular scan detection for retail systems
CN110136326A (en) * 2019-04-24 2019-08-16 深兰科技(上海)有限公司 A kind of sales counter control method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011043810A1 (en) * 2009-10-06 2011-04-14 Deloitte Development, Llc Systems and methods for providing and commercially exploiting online persona validation
CN105989527A (en) * 2015-02-10 2016-10-05 黄金富知识产权咨询(深圳)有限公司 Commodity sale system based on image identification and corresponding method
CN106096882A (en) * 2016-06-10 2016-11-09 中山市科全软件技术有限公司 A fully automatic unmanned supermarket device
CN205862437U (en) * 2015-12-14 2017-01-04 天翼电子商务有限公司 A kind of automatic selling system paid based on recognition of face
CN106875203A (en) * 2015-12-14 2017-06-20 阿里巴巴集团控股有限公司 A kind of method and device of the style information for determining commodity picture
CN107146325A (en) * 2017-07-13 2017-09-08 杭州宗盛智能科技有限公司 Automatic vending machine and its control method, control device and system
CN107944859A (en) * 2017-11-15 2018-04-20 深圳码隆科技有限公司 A kind of self-service method and apparatus based on image recognition technology
CN108062667A (en) * 2017-11-15 2018-05-22 深圳码隆科技有限公司 A kind of identity-based identification and the self-service method and apparatus of commodity identification

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011043810A1 (en) * 2009-10-06 2011-04-14 Deloitte Development, Llc Systems and methods for providing and commercially exploiting online persona validation
CN105989527A (en) * 2015-02-10 2016-10-05 黄金富知识产权咨询(深圳)有限公司 Commodity sale system based on image identification and corresponding method
CN205862437U (en) * 2015-12-14 2017-01-04 天翼电子商务有限公司 A kind of automatic selling system paid based on recognition of face
CN106875203A (en) * 2015-12-14 2017-06-20 阿里巴巴集团控股有限公司 A kind of method and device of the style information for determining commodity picture
CN106096882A (en) * 2016-06-10 2016-11-09 中山市科全软件技术有限公司 A fully automatic unmanned supermarket device
CN107146325A (en) * 2017-07-13 2017-09-08 杭州宗盛智能科技有限公司 Automatic vending machine and its control method, control device and system
CN107944859A (en) * 2017-11-15 2018-04-20 深圳码隆科技有限公司 A kind of self-service method and apparatus based on image recognition technology
CN108062667A (en) * 2017-11-15 2018-05-22 深圳码隆科技有限公司 A kind of identity-based identification and the self-service method and apparatus of commodity identification

Also Published As

Publication number Publication date
CN107944859A (en) 2018-04-20

Similar Documents

Publication Publication Date Title
WO2019095884A1 (en) Image recognition technology-based self-service vending method, apparatus, electronic device and computer storage medium
CN107180371B (en) Method, system and computer-readable storage medium for purchasing goods using coupons
US12400205B2 (en) Virtual point of sale
US8774462B2 (en) System and method for associating an order with an object in a multiple lane environment
KR102216514B1 (en) Service system for returning goods with fast return and refund
WO2019076011A1 (en) Commodity checking method and commodity checking device
RU2695056C1 (en) System and method for detecting potential fraud on the part of a cashier, as well as a method of forming a sampling of images of goods for training an artificial neural network
US20190019207A1 (en) Apparatus and method for store analysis
TWI724530B (en) Offline self-service settlement method, device and system
WO2019096222A1 (en) Unmanned vending method and device based on identity identification and product identification
CN111612657A (en) Client type identification method and device, electronic equipment and storage medium
TW201734917A (en) Two-dimensional code capable of logging in feature shopping mall, and method and system for shopping in the mall
US20190370885A1 (en) Data processing method, device and storage medium
KR20200101024A (en) Service system of returning goods being able to pickup request using location information included in photo of returning goods
TW201911180A (en) Article evaluation method and apparatus
WO2019076010A1 (en) Commodity code scanning device
WO2020047918A1 (en) Self-service vending method, apparatus, and system, electronic device, and computer storage medium
CN109978668A (en) Based on the matched transaction customer recognition methods of timestamp, system, equipment and medium
KR20210039783A (en) Method and user terminal for providing custom clothing purchase service
WO2019215966A1 (en) Registration system, registration method, and program
CN104616183B (en) Network trading identification system, client and discrimination method
CN113297462A (en) Data processing method, device, equipment and storage medium
CN109214548B (en) Method and device for predicting order preparation time
CN115034852A (en) Information confirmation method, device, electronic device and readable storage medium
WO2019096192A1 (en) Unmanned sales method and device based on electronic tags and identity recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18877777

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18877777

Country of ref document: EP

Kind code of ref document: A1