Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art. Therefore, the vending machine provided by the invention can realize convenient and fast vending.
The invention further provides a control method of the vending machine.
The present application is based on the discovery and recognition by the inventors of the following facts and problems: the current unmanned automatic vending machine can only realize that people operate the vending machine by hands to finish shopping.
To achieve the above object, an embodiment according to a first aspect of the present invention proposes a vending machine comprising: a vending machine body; the voice interaction module is arranged on the vending machine body and used for voice interaction with a user; the identification module is used for identifying the user identity; and the control module is respectively connected with the voice interaction module and the recognition module and is used for recognizing the voice input by the user and received by the voice interaction module, controlling the vending machine body to vend goods for the user according to the shopping information when the voice input by the user is recognized as the shopping information, and playing shopping details to the user through the voice interaction module.
According to the vending machine provided by the embodiment of the invention, the first acquisition module, the second acquisition module and the interaction module are arranged, so that the function of man-machine interaction can be realized, the door body can be opened and closed according to the control instruction, and the order information is generated according to the access information, so that the automatic vending of goods can be realized, and the vending machine also has the function of man-machine interaction and meets the requirements of different users.
In addition, the vending machine according to the above-described embodiment of the present invention may further have the following additional technical features:
in some embodiments, the control module is further configured to generate an interactive voice corresponding to the voice input by the user according to the recognition result when the voice input by the user is recognized as the non-shopping information, and play the interactive voice to the user through the voice interaction module.
In some embodiments, the recognition module comprises a face recognition module for determining the identity of the user based on the collected face information.
In some embodiments, the face recognition module includes a first camera and a first fill-in light.
In some embodiments, the control module is configured to upload the shopping information and the user identity to a cloud server, so that the cloud server determines a fee according to the shopping information and deducts a fee from an account corresponding to the user identity.
In some embodiments, the voice interaction module comprises a microphone and a pick-up noise reduction unit.
In some embodiments, the vending machine further comprises: and the detection module is connected with the control module, detects images before and after the goods are taken by the user, and compares the images to obtain the shopping information.
In some embodiments, the identification module comprises a second camera and a second fill light.
In some embodiments, one or more layers of storage lattices are arranged in the vending machine body and used for placing goods, and the second camera is arranged at the top of each layer of storage lattice.
In some embodiments, the vending machine further comprises: the display screen is arranged on the vending machine body and connected with the control module.
In some embodiments, the voice interaction module and the recognition module are integrated on the display screen.
According to a second aspect of the present invention, a method for controlling a vending machine according to the above description is provided, the method comprising: and recognizing the voice input by the user and received by the voice interaction module, controlling the vending machine body to vend goods for the user according to the shopping information when the voice input is recognized as the shopping information, and playing shopping details to the user through the voice interaction module.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
With reference to fig. 1 to 3, an embodiment of a first aspect of the present invention proposes a vending machine 100, the vending machine 100 comprising: vending machine body 1, voice interaction module 2, identification module 3, control module. The vending machine body 1 can be used for providing and storing goods for sale, the voice interaction module 2 can be used for realizing voice interaction, the recognition module 3 can be used for recognizing user information or user instructions and the like, and the control module can be used for providing data collection, analysis, processing or uploading and the like.
The voice interaction module 2 is arranged on the vending machine body 1 and used for voice interaction with a user. The identification module 3 is used for identifying the user identity. The control module is respectively connected with the voice interaction module 2 and the recognition module 3 and used for recognizing voice input by the user and received by the voice interaction module 2, and controlling the vending machine body 1 to vend goods for the user according to shopping information when the voice input is recognized as the shopping information.
Specifically, the voice interaction module 2 can recognize the input voice information and send the voice information to the control module for processing, and when the control module recognizes that the voice information is shopping information, the vending machine body 1 is controlled to vend goods for the user.
According to the vending machine 100 provided by the embodiment of the invention, the identity, the voice information and the like of the user can be identified, whether the user needs to purchase goods or not is determined according to the identification result, and when the user needs to purchase a backroom, the vending machine provides automatic vending service for the user, so that the vending machine is simpler and more intelligent to operate when used for shopping, and better shopping experience is provided.
In addition, the control module can also play shopping details to the user according to the voice interaction module 2. For example, the shopping condition can be displayed to the user in the modes of voice broadcasting, displaying and the like, and the shopping list, the expense details, the payment information and the like can be displayed to the user, so that the user can conveniently know the shopping condition.
The control module can also identify whether the information input by the user is shopping information according to the voice information input by the user, and when the information is identified as the shopping information, the control module sells goods for the user and when the information is identified as non-shopping information, the control module provides interaction for the user.
Specifically, the control module is further configured to generate an interactive voice corresponding to the voice input by the user according to the recognition result when the voice input by the user is recognized as the non-shopping information, and play the interactive voice to the user through the voice interaction module 2.
For example, when the control module receives voice information input by a user, the voice information is analyzed. When the voice information is non-shopping information, the voice interaction module 2 is used for broadcasting the information to the user. For example, when the control module recognizes that the user needs to inquire weather conditions, the weather forecast is displayed to the user through the voice interaction module 2; when the control module identifies that the user needs to inquire a specific position nearby, the required information is presented to the user through the voice interaction module 2.
The voice interaction module 2 may play information to the user in a display mode, a voice mode, and the like, for example, the voice interaction module 2 is a speaker, and may provide the user with the required information in a voice mode; for another example, the voice interaction module 2 may further include a display module, and the display module may broadcast the information to be provided to the user by means of text, graphics, and the like.
Optionally, the recognition module 3 of the present invention may further include a face recognition module 3, configured to determine the user identity according to the collected face information, and the face recognition module 3 may determine the user identity.
In addition, specific goods can be recommended according to the user identity, and payment (face payment) and the like can be completed according to the user identity.
Wherein, the face recognition module 3 may include a first camera and a light supplement lamp. First camera can accomplish face identification through acquireing user facial information, and when light is not enough, can carry out the light filling through the light filling lamp to improve face identification's precision.
Of course, face recognition may be accomplished in other ways. Moreover, the identification module 3 in the present invention may further include payment code identification, voice print identification, and the like.
Optionally, after the control module receives the shopping information and the user identity, the control module is configured to upload the shopping information and the user identity to the cloud server, so that the cloud server determines a fee according to the shopping information and deducts the fee according to an account corresponding to the user identity. Thereby simplifying the control logic of the vending machine 100 and further providing intelligent vending services.
The control module can finish data uploading through a wifi network, a 4G network, a 5G network and the like.
In addition, in the invention, the voice interaction module 2 may include a microphone and a sound pickup and noise reduction unit, and the voice information may be collected by the microphone, and the sound pickup and noise reduction unit may effectively reduce noise and improve the recognition accuracy.
Optionally, the voice interaction module 2 may further include a display module, a speaker, and the like, and information may be played in the form of characters, patterns, and the like through the display module; information can be played in voice form through a speaker.
Optionally, the vending machine 100 further comprises: and the detection module is connected with the control module, detects images before and after the goods are taken by the user, and compares the images to obtain shopping information. The detection module is used for detecting the goods access condition in the vending machine body 1, so that the shopping information of the goods user is obtained.
For example, the change of the goods stored in the vending machine body 1 before and after shopping is obtained by the detection module, so that the goods purchased by the user are obtained.
Alternatively, the detection module may acquire images of the goods in the cabinet 11, and compare the images of the goods before and after the goods are taken by the user, so as to determine the shopping information of the user.
Optionally, the detection module can include second camera and second light filling lamp, can acquire the goods image before and after the user gets goods through the second camera, and under the not enough condition of light, can carry out the light filling through the second light filling lamp, improve the precision of testing result.
Optionally, be equipped with one deck or multilayer matter storage lattice in the vending machine body 1 and be used for putting the goods, the top of each layer of matter storage lattice is provided with the second camera. Through setting up the matter storage lattice, can increase the categorised ability of depositing the goods of vending machine body 1, and all set up the second camera on each layer, can judge the access condition of each layer goods.
Alternatively, the shopping information of the user can be judged according to the article access conditions of all the storage compartments, so that more accurate shopping information can be obtained.
Optionally, the vending machine 100 further comprises: display screen 6, display screen 6 sets up on the vending machine body 1, display screen 6 with control module connects.
In addition, the voice interaction module 2 and the recognition module 3 in the invention can be integrated on the display screen 6. The positions for placing the voice interaction module 2 and the recognition module 3 do not need to be additionally arranged on the vending machine body 1, so that the modularization of the vending machine 100 can be effectively improved, the assembly efficiency is improved, and the maintenance is convenient.
Optionally, in the present invention, the display screen 6 may be installed in front of the vending machine body 1, the recognition module 3 may be disposed above the display screen 6, and the voice interaction module 2 may be disposed below the display screen 6.
Optionally, the vending machine body 1 in the present invention includes a cabinet 11, a door 12 and a lock, goods can be stored in the cabinet 11, the door 12 is connected to the cabinet 11, and the door 12 can be switched between a state of opening the cabinet 11 and a state of closing the cabinet 11. When the door 12 is opened, the user takes out the article from the cabinet 11. The lock can change the state of the door 12, for example, when the door 12 is closed, the door 12 is locked and the position of the cabinet 11 is closed by the lock; for another example, when the door 12 needs to be opened, the latch can be controlled to release the door 12, so that the door 12 can be opened conveniently.
After the door body 12 is opened, the interior of the cabinet body 11 can be detected through the detection module, so that the shopping information of the user and the behavior of the user in the shopping process can be acquired.
Optionally, the lock may be connected to the control module, and when the control module determines that the door 12 needs to be opened, the lock may be placed in a release state, so as to open or facilitate a user to open the door 12.
The control module can detect the identity information and shopping information (such as voice signals 'door opening', 'I want to shop' and the like) of the user, and judges that the door body 12 needs to be opened, and at the moment, the control module controls the lockset to release the door body 12, so that the door body 12 is convenient to open.
In the invention, the first camera and the second camera can be used for collecting image information or video information.
Optionally, at least a portion of the door body 12 is a transparent panel. Therefore, the user can check the article condition in the vending machine body 1 through the door body 12, and the user can select the article conveniently.
Optionally, the recognition module 3 and the voice interaction module 2 may be disposed on the cabinet 11, and the recognition module 3 and the voice interaction module 2 may be disposed in front of the cabinet 11 and outside the door 12, so as to facilitate operation.
Optionally, the vending machine body 1 further comprises: and the refrigeration control module is connected with the control module and used for controlling the refrigeration system of the vending machine body 1.
The second aspect of the present invention also provides a control method of the vending machine 100.
The control method of the vending machine 100 according to the embodiment of the present invention includes: the voice input by the user and received by the voice interaction module 2 is recognized, and when the voice input is recognized as shopping information, the vending machine body 1 is controlled to vend goods for the user according to the shopping information, and shopping details are played to the user through the voice interaction module 2.
According to the control method of the vending machine 100 of the embodiment of the invention, by using the vending machine 100 according to the embodiment of the first aspect of the invention, quick and convenient automatic vending can be realized.
The invention discloses a vending machine 100 based on voice and vision and a control method thereof, wherein the vending machine 100 comprises: vending machine body 1, door body 12, matter storage lattice, tool to lock install control module, light, camera (including first camera and second camera) and banks spare (including first light filling lamp and second light filling lamp) on the vending machine body 1, wherein in the control module, control module (for example tall and erect nuclear core plate) connect pronunciation interactive module 2, identification module 3 etc.. The refrigeration system, the lighting system and the lockset (such as an electronic lock) of the cabinet machine are controlled by the refrigeration control module.
The detection module comprises a camera, and a camera module is installed at the top of each storage lattice layer and is communicated with the control module through a USB. Voice interaction module 2 can play the advertisement when unmanned shopping, dabs display screen 6 or awakens up the entering shopping interface through pronunciation, control module unblanks after carrying out identification through identification module 3 to send and shoot the instruction and give detection module, detection module receives and begins to go up electric work behind the instruction, uploads control module with the picture of every layer of shooting, control module uploads the high in the clouds through 4G communication, the high in the clouds is compared through discernment, the completion is deducted money.
On the premise of meeting the functions of the traditional vending machine 100, the voice recognition system is added, and the virtual robot is presented through the screen, so that interaction between people and equipment in a speaking mode is achieved, the interestingness of the unmanned retail equipment is greatly improved, consumers are attracted to use the vending machine 100 for consumption, and the development of the unmanned vending machine 100 is promoted.
The core technical difficulty of the invention is the reliability of voice pickup and noise reduction and voice recognition and the compatibility of the vending machine 100 system. Vending machine 100 is placed in the comparatively hot position of environment mostly, and sound is noisy, accurate discernment target person's sound under this kind of environment to it is this patent core to carry out effectual interaction.
In the invention, one to six layers of storage lattices are arranged in the vending machine body 1 and are suitable for placing goods; a second camera is arranged at the top end of each layer of storage lattice; a microphone and a sound pickup and noise reduction module (a voice interaction module 2) are integrated in the structure of the display screen 6; the control module arranged in the vending machine body 1 comprises android industrial control, and is connected with the refrigeration control module, the power supply module, the display screen 6, the detection module, the lockset, the voice interaction module 2 and the recognition module 3; the data information of the server is sent and received through the network, and a user inquires shopping and payment details through accessing the server; the door body 12 is connected with the vending machine body 1, and the door body 12 is transparent and can be used for seeing goods on a goods shelf in the vending machine; the second camera and the second light supplement lamp are mounted on the door body 12, wherein the first camera is used for shooting pictures in the container and monitoring videos of user behaviors; the lamp assembly consists of a plurality of groups of illuminating lamps and is used for supplementing light in the shooting process of the camera when the light is insufficient; the lockset is controlled by the control module and can keep the door body 12 closed.
The voice interaction module 2 arranged below the display screen 6 not only can accurately identify the voice, but also can judge the voice direction, and simultaneously supports the loudspeaker to be awakened by the voice of a person in the voice playing process; the face recognition module is arranged above the display screen 6 and is used for carrying out face recognition payment (WeChat and Paibao) during shopping; the android industrial control system is connected with a refrigeration control module, a power supply module, a display screen 6, a detection module, a lockset, a voice module and a face recognition module 3; the android industrial control is connected with a voice interaction module 2, the voice interaction module 2 is respectively composed of a microphone board and a sound pickup and noise reduction board, and is used for completing sound pickup and noise reduction transmission work respectively, sending voice signals to an industrial control APK for processing, and realizing a voice interaction function; the android industrial control is connected with the refrigeration control module, the refrigeration control module realizes constant temperature in the vending machine body 1, the android industrial control can send target temperature to the refrigeration control module, and accurate temperature control is realized through the refrigeration control module; the power supply module is connected with the control module and used for supplying power to the system; the display screen 6 is connected with the control module and used for displaying information and displaying the scanning two-dimensional code; the name and the number of products in the current container can be displayed, information such as purchasing and payment details of a user can be displayed, and advertisements can be played in a shopping-free state.
The invention combines the voice recognition technology with the existing visual unmanned vending machine 100 technology, realizes the language communication between the unmanned vending machine 100 and the customer through the screen virtual robot, and greatly improves the shopping experience of the customer. The artificial intelligence is combined with the unmanned vending machine 100, so that a new application case of the artificial intelligence AI technology in the new retail field is realized;
in this scheme, voice interaction module 2 is placed in the below of display screen 6, and the actual optional position that can put at vending machine body 1 all can, all belongs to the protection scope of this scheme. In the invention, a user wakes up the vending machine 100 by voice, opens the door by scanning codes or identifies the face of the user, and selects goods at will; the user may communicate with the vending machine 100 at zero distance by voice, either related or unrelated to shopping, such as weather, accessory food, etc.;
the control module also comprises a voice control module and a wake-up module, wherein the voice control module receives the signal of the voice interaction module 2, and the wake-up module sends an instruction for identifying the identity information of the customer to the identification device. The identification module 3 is arranged on the front surface of the body. The height of the identification module 3 from the ground is 0.9m-1.8 m.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.