TWI859977B - Smart vending machine with augmented reality virtual try-on function - Google Patents

Abstract

A smart automatic vending machine with augmented reality virtual try-on function includes a storage space, a touch display module, an image module, a processing module and a checkout module. The storage space stores a plurality of commodities. The touch display module displays a plurality of commodity models corresponding to the commodities and receives a user's input command to select one of the commodity models. The image module captures a first real-time image of the user. The processing module combines the user's selected commodity model with the first real-time image to generate a real-time try-on image. The checkout module receives the user's purchase instruction to perform the checkout procedure. The processing module removes the commodity corresponding to the user's selected commodity model from the storage space after the checkout procedure is completed.

Description

Smart vending machine with augmented reality virtual try-on function

The present invention relates to a smart automatic vending machine, in particular to a smart automatic vending machine with an augmented reality virtual try-on function.

The detailed features and advantages of the present invention are described in detail in the following implementation method. The content is sufficient for anyone familiar with the relevant technology to understand the technical content of the present invention and implement it accordingly. According to the content disclosed in this specification, the scope of the patent application and the drawings, anyone familiar with the relevant technology can easily understand the relevant purposes and advantages of the present invention.

A vending machine is an automated sales machine. Generally speaking, vending machines are usually used to sell various commodities, such as drinks, cigarettes, newspapers, magazines, etc. Vending machines are usually placed in public places, such as parks, shopping malls, airports, train stations, subway stations, schools, etc., for users to conveniently purchase various commodities. Many vending machines can also provide electronic payment systems and various smart functions. Therefore, vending machines have become an indispensable part of modern life, bringing convenience to people.

However, although existing vending machines can also be used to sell glasses, accessories, hats, earrings and other products, they cannot provide users with a try-on function, so they are still inconvenient to use.

According to an embodiment of the present invention, a smart vending machine with an augmented reality virtual try-on function is proposed, which includes a storage space, a touch display module, an image module, a processing module and a checkout module. The storage space stores a plurality of commodities. The touch display module displays a plurality of commodity models corresponding to the commodities, and receives a user's input command to select one of the commodities. The image module captures a first real-time image of the user. The processing module combines the user's selected commodity model with the first real-time image to generate a real-time try-on image. The checkout module receives the user's purchase instruction to perform a checkout procedure. The processing module removes the commodity corresponding to the user's selected commodity model from the storage space after the checkout procedure is completed.

In one embodiment, the touch display module receives the user's photo taking command, and the processing module generates a trial photo based on the photo taking command and the real-time trial wearing image.

In one embodiment, the touch display module receives a barcode generation instruction from the user, and the processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction.

In one embodiment, the barcode is a one-dimensional barcode, a two-dimensional barcode, or a three-dimensional barcode.

In one embodiment, the smart vending machine further includes an environmental sensing module and a display module. The environmental sensing module detects environmental information. The display module plays the video. The processing module adjusts the video according to the environmental information.

In one embodiment, the environment sensing module includes an environment light sensor, which generates an environment light sensing result as part of the environment information.

In one embodiment, the environment sensing module further includes a camera and an image recognition module. The camera captures the second real-time image. The image recognition module determines whether the second real-time image contains the target object and generates a recognition result as part of the environment information.

In one embodiment, the image recognition module determines whether the second real-time image contains a preset action and generates a recognition result as part of the environmental information.

In one embodiment, the processing module is a microcontroller, a central processing unit, a special application integrated circuit chip, or a field programmable logic gate array.

In one embodiment, the touch display module is a touch screen.

As mentioned above, the smart automatic vending machine with augmented reality virtual try-on function according to the embodiment of the present invention may have one or more of the following advantages:

(1) In one embodiment of the present invention, a smart vending machine has a touch display module, an image module, and a processing module. The touch display module can display product models corresponding to a plurality of products of the smart vending machine, and receive a user's input command to select one of the products. The processing module captures the user's first real-time image. The processing module combines the user's selected product model with the first real-time image to generate a real-time try-on image to provide an augmented reality virtual try-on function. Through the above-mentioned augmented reality virtual try-on function, the user can try on any product provided by the smart vending machine to decide whether to purchase the products. Therefore, the smart vending machine is more convenient to use and can better meet the needs of actual applications.

(2) In one embodiment of the present invention, the touch display module of the smart vending machine can receive the user's photo taking instruction to generate a trial photo, and receive the user's barcode generation instruction. The processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction. Therefore, the user can store the trial photo in his or her electronic device. Therefore, the use of the smart vending machine can be more user-friendly.

(3) In one embodiment of the present invention, the touch display module of the smart vending machine can receive the user's photo taking instruction to generate a trial photo, and receive the user's barcode generation instruction. The processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction. Therefore, the user can not only store the trial photo in his own electronic device, but also share the trial photo with others by sending the barcode to another user's electronic device to obtain other people's suggestions. Therefore, the smart vending machine can meet the needs of users.

(4) In one embodiment of the present invention, the smart vending machine has an environmental sensing module and a display module. The environmental sensing module detects environmental information, and the display module plays videos. The processing module can adjust the video according to the environmental information, so that the video played by the display module can change with the environmental information. The user can also interact with the smart vending machine through the above functions. Therefore, the smart vending machine can provide a better user experience.

(5) In one embodiment of the present invention, the design of the smart vending machine is simple, so the desired effect can be achieved without significantly increasing the cost.

1: Smart vending machine

11: Storage space

12: Touch display module

13: Image module

14: Processing module

15: Checkout module

2: Smart vending machine

21: Storage space

22: Touch display module

23: Image module

24: Processing module

25: Checkout module

26: Environmental perception module

261: Ambient light sensor

262:Camera

263: Image recognition module

27: Display module

FIG1 is a block diagram of a smart automatic vending machine with augmented reality virtual try-on function according to an embodiment of the present invention.

FIG2 is a block diagram of a smart automatic vending machine with augmented reality virtual try-on function according to another embodiment of the present invention.

The following will refer to the relevant drawings to illustrate the embodiment of the smart vending machine with augmented reality virtual try-on function according to the present invention. For the sake of clarity and convenience of the diagram description, the components in the diagram may be exaggerated or reduced in size and proportion. In the following description and/or claims, when it is mentioned that an element is "connected" or "coupled" to another element, it may be directly connected or coupled to the other element or there may be an intervening element; and when it is mentioned that an element is "directly connected" or "directly coupled" to another element, there is no intervening element, and other words used to describe the relationship between elements or layers should be interpreted in the same way. For ease of understanding, the same elements in the following embodiments are illustrated with the same symbols.

Please refer to Figure 1, which is a block diagram of a smart vending machine with augmented reality virtual try-on function according to an embodiment of the present invention. As shown in the figure, the smart vending machine 1 includes a storage space 11, a touch display module 12, an image module 13, a processing module 14 and a checkout module 15.

The storage space 11 is connected to the processing module 14 and stores a plurality of commodities. In one embodiment, the above commodities may be glasses, earrings, hats, tattoo stickers, hairpins, headwear, etc. In another embodiment, the above commodities may also be non-fungible tokens (NFT) or other various virtual assets. In one embodiment, the storage space 11 may be a container. In another embodiment, the storage space 11 may also be a memory or other similar components.

The touch display module 12 is connected to the processing module 14 and displays a plurality of product models corresponding to the products. A user who wants to purchase the above products through the smart vending machine 1 can operate the touch display module 12 to generate an input command. The touch display module 12 can receive the user's input command to select one of the products. In one embodiment, the touch display module 12 can be a touch screen. In another embodiment, the touch display module 12 can also be replaced by a combination of a screen and an input device (such as a mouse, keyboard, etc.), and the above combination can also provide touch and display functions.

The image module 13 is connected to the processing module 14 and captures the first real-time image of the user. Then, the processing module 14 can combine the product model with the user image according to the multiple positioning points of the selected product model corresponding to the user image in the first real-time image to generate a real-time trial image. For example, the processing module 14 can perform facial recognition on the user image in the first real-time image through facial recognition technology to obtain multiple facial feature points in the user image as the above-mentioned positioning points, and then combine the product model with the user image according to these positioning points to generate a real-time trial image. Therefore, the user can judge whether to purchase the product through the real-time trial image. In addition, the above-mentioned facial recognition technology can be used to combine various accessories with parts of the human body with many structural features (such as eyes, mouth, ears, etc.) for virtual trial wearing. Therefore, the intelligent vending machine 1 can sell a wider range of products. In one embodiment, the processing module 14 is a microcontroller (MCU), a central processing unit (CPU), an application-specific integrated circuit chip (ASIC), a field programmable gate array (FPGA) or other similar components.

If the user decides to purchase the product, the user can generate a purchase instruction by operating the touch display module 12. The touch display module 12 can receive the user's input instruction to select one of the products. The checkout module 15 is connected to the processing module 14 and receives the user's purchase instruction to perform the checkout procedure. The touch display module 12 can display a virtual checkout button, and the user can press the checkout button to display the payment interface. The user can choose to pay by credit card or use mobile payment software. Of course, the smart vending machine 1 can also provide a cash payment mechanism. The above payment mechanism should be well known to those with ordinary knowledge in this field, so it will not be elaborated here. Finally, after the checkout process is completed, the processing module 14 moves the product corresponding to the product model selected by the user from the storage space 11 to the pick-up port of the smart vending machine 1. The user can then take the product out of the pick-up port. Of course, if the product purchased by the user is a non-fungible token or other various virtual assets, the processing module 14 can transfer the product to the storage device specified by the user after the checkout process is completed.

In addition, the user can operate the touch display module 12 to generate a photo command. The touch display module 12 receives the user's photo command to generate a trial photo. The touch display module 12 can display a virtual photo button, and the user can generate the aforementioned photo command by pressing the photo button. Then, the processing module 14 can control the image module 13 to capture the aforementioned trial image according to the photo command to generate the trial photo. The user can download the trial photo from the smart vending machine 1 through an electronic device (such as a smart phone, a tablet computer). The user can decide whether to agree to store the trial photo in the memory of the smart vending machine 1. If the user agrees to store the trial photo (the facial features in the trial photo can be covered) in the memory of the smart vending machine 1 for other users to use as a reference for purchasing goods, the checkout module 15 can give a discount when performing the checkout process.

In addition, the user can operate the touch display module 12 to generate a barcode generation instruction. The touch display module 12 receives the user's barcode generation instruction. The touch display module 12 can display a virtual barcode generation button, and the user can generate the aforementioned barcode generation instruction by pressing the barcode generation button. Then, the processing module 14 can generate a barcode linked to the storage address of the trial photo according to the barcode generation instruction. The user can obtain this barcode from the smart vending machine 1 through an electronic device (such as a smart phone, tablet computer). Next, the user can send the barcode to another user's electronic device to share the trial photo with others through social software to obtain suggestions from others. Therefore, the smart vending machine 1 can indeed meet the needs of users. In one embodiment, the barcode is a one-dimensional barcode, a two-dimensional barcode, or a three-dimensional barcode. The touch display module 12 can also directly display a barcode for a specific event (such as a marathon race). The user can scan the barcode with his electronic device to obtain gifts or souvenirs (such as mineral water, pins, etc.) provided by the organizer from the smart vending machine 1.

As mentioned above, the smart vending machine 1 of this embodiment has a touch display module 12, an image module 13 and a processing module 14 to provide an augmented reality virtual try-on function. Through the above-mentioned augmented reality virtual try-on function, the user can try on any product provided by the smart vending machine 1 based on augmented reality technology, so that augmented reality technology can be effectively integrated with the vending machine. Therefore, the smart vending machine 1 is more convenient to use and can better meet the needs of actual applications.

Of course, this embodiment is only used for illustration and does not limit the scope of the invention. Equivalent modifications or changes made to the smart automatic vending machine with augmented reality virtual try-on function according to this embodiment should still be included in the patent scope of the invention.

It is worth mentioning that although existing vending machines can also be used to sell glasses, accessories, hats, earrings and other products, they cannot provide users with a try-on function, so they are still inconvenient to use. On the contrary, according to an embodiment of the present invention, the smart vending machine has a touch display module, an image module and a processing module. The touch display module can display product models corresponding to multiple products of the smart vending machine, and receive input instructions from the user to select one of the products. The processing module captures the user's first real-time image. The processing module combines the user's selected product model with the first real-time image to generate a real-time try-on image to provide an augmented reality virtual try-on function. Through the aforementioned augmented reality virtual try-on function, users can try on any product provided by the smart vending machine to decide whether to purchase it. Therefore, the smart vending machine is more convenient to use and can better meet the needs of actual applications.

In addition, according to an embodiment of the present invention, the touch display module of the smart vending machine can receive the user's photo taking instruction to generate a trial photo, and receive the user's barcode generation instruction. The processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction. Therefore, the user can store the trial photo in his or her electronic device. Therefore, the use of the smart vending machine can be more humane.

In addition, according to the embodiment of the present invention, the touch display module of the smart vending machine can receive the user's photo taking instruction to generate a trial photo, and receive the user's barcode generation instruction. The processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction. Therefore, the user can not only store the trial photo in his own electronic device, but also share the trial photo with others by transmitting the barcode to another user's electronic device to obtain other people's suggestions. Therefore, the smart vending machine can meet the needs of users.

Furthermore, according to the embodiment of the present invention, the design of the smart vending machine is simple, so the desired effect can be achieved without significantly increasing the cost. From the above, it can be seen that the smart vending machine according to the embodiment of the present invention can indeed achieve excellent technical effects.

Please refer to Figure 2, which is a block diagram of a smart vending machine with augmented reality virtual try-on function of another embodiment of the present invention. As shown in the figure, the smart vending machine 2 includes a storage space 21, a touch display module 22, an image module 23, a processing module 24 and a checkout module 25.

The above components are the same as those in the above embodiments, so they will not be described in detail here. Different from the above embodiments, the smart vending machine 2 of this embodiment further includes an environment sensing module 26 and a display module 27.

The environment sensing module 26 and the display module 27 are connected to the processing module 24. The environment sensing module 26 detects the environment information. The display module 27 plays the video. The processing module 24 adjusts the video played by the display module 27 according to the environment information. The environment sensing module 26 includes an environment light sensor 261, which can detect the surrounding environment to generate an environment light sensing result. The environment light sensing result can be used as a part of the environment information. For example, when the environment light sensing result detected by the environment light sensor 261 is greater than or equal to the threshold value, it indicates that the current time is daytime. Then, the processing module 24 adjusts the video played by the display module 27 according to the environment information so that the background of the video is daytime. On the contrary, when the ambient light sensing result detected by the ambient light sensor 261 is lower than the threshold value, it means that it is night time. Then, the processing module 24 adjusts the video played by the display module 27 according to the environmental information so that the background of the video is night time.

The environment sensing module 26 also includes a camera 262 and an image recognition module 263. The camera 262 captures the second real-time image. The image recognition module 263 determines whether the second real-time image contains a target object and generates a recognition result as part of the environment information. For example, the image recognition module 263 determines whether the second real-time image contains a person and determines the gender of the person to generate a recognition result. If the second real-time image does not contain a person, the display module 27 continues to play a preset video, and the content of the video can be designed according to actual needs. If the second real-time image includes a person, and the gender of the person is female, the processing module 24 adjusts the video played by the display module 27 according to the environmental information, so that the advertising content pushed by the video is products for women (such as cosmetics, skin care products, etc.). If the second real-time image includes a person, and the gender of the person is male, the processing module 24 adjusts the video played by the display module 27 according to the environmental information, so that the advertising content pushed by the video is products for men (such as razors, watches, etc.). The aforementioned advertising content can be obtained through big data analysis; that is, the processing module 24 can be connected to a remote database to obtain data that has undergone big data analysis, thereby obtaining suitable advertising content. In another embodiment, the above-mentioned target object can also be a specific posture or action. For example, the image recognition module 263 determines whether the second real-time image includes a clapping action. If the second real-time image includes a clapping action, the processing module 24 adjusts the video played by the display module 27 according to the environmental information so that the characters in the video look in the direction of the clapping action. In one embodiment, the image recognition module 263 is a microcontroller (MCU), a central processing unit (CPU), an application specific integrated circuit chip (ASIC), a field programmable logic gate array (FPGA) or other similar components. In another embodiment, the camera 262 may also have a sound detection function, and the image recognition module 263 may be replaced by a sound recognition module or have a sound recognition function at the same time. For example, the camera 262 captures the second real-time image and its sound. The image recognition module 263 determines whether the second real-time image contains the sound of clapping and generates a recognition result as part of the environmental information. If the second real-time image contains the sound of clapping, the processing module 24 adjusts the video played by the display module 27 according to the environmental information so that the mouth of the person in the video opens. Of course, the above is only an example. The processing module 24 adjusts the video played by the display module 27 in different ways according to the environmental information, and the present invention is not limited to this.

Of course, this embodiment is only used for illustration and not to limit the scope of the present invention. Equivalent modifications or changes made to the smart automatic vending machine with augmented reality virtual try-on function according to this embodiment should still be included in the patent scope of the present invention.

In summary, according to the embodiment of the present invention, the smart vending machine has a touch display module, an image module and a processing module. The touch display module can display product models corresponding to a plurality of products of the smart vending machine, and receive a user's input command to select one of the products. The processing module captures the user's first real-time image. The processing module combines the user's selected product model with the first real-time image to generate a real-time try-on image to provide an augmented reality virtual try-on function. Through the above-mentioned augmented reality virtual try-on function, the user can try on any product provided by the smart vending machine to decide whether to purchase these products. Therefore, the smart vending machine is more convenient to use and can better meet the needs of actual applications.

Furthermore, according to an embodiment of the present invention, the touch display module of the smart vending machine can receive a user's photo taking instruction to generate a trial photo, and receive a user's barcode generation instruction. The processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction. Therefore, the user can store the trial photo in his or her electronic device. Therefore, the use of the smart vending machine can be more humane.

In addition, according to the embodiment of the present invention, the touch display module of the smart vending machine can receive the user's photo taking instruction to generate a trial photo, and receive the user's barcode generation instruction. The processing module generates a barcode linked to the storage address of the trial photo according to the barcode generation instruction. Therefore, the user can not only store the trial photo in his own electronic device, but also share the trial photo with others by transmitting the barcode to another user's electronic device to obtain other people's suggestions. Therefore, the smart vending machine can meet the needs of users.

In addition, according to an embodiment of the present invention, the smart vending machine has an environmental sensing module and a display module. The environmental sensing module detects environmental information, and the display module plays videos. The processing module can adjust the video according to the environmental information, so that the video played by the display module can change with the environmental information, and the user can also interact with the smart vending machine through the above functions. Therefore, the smart vending machine can provide a better user experience.

Furthermore, according to the embodiment of the present invention, the design of the smart vending machine is simple, so the desired effect can be achieved without significantly increasing the cost.

The above description is for illustrative purposes only and is not intended to be limiting. Any other equivalent modifications or changes made to the invention without departing from the spirit and scope of the invention should be included in the appended claims.

1: Smart vending machine

11: Storage space

12: Touch display module

13: Image module

14: Processing module

15: Checkout module

Claims (10)

A smart automatic vending machine with an augmented reality virtual try-on function comprises: a storage space for storing a plurality of commodities; a touch display module for displaying a plurality of commodity models corresponding to the commodities and receiving an input command from a user to select one of the commodity models; an image module for capturing a first real-time image containing the user; a processing module for performing facial recognition on a user image in the first real-time image through facial recognition technology, so as to A plurality of facial feature points in the user image are obtained to obtain a plurality of positioning points, and then the product model selected by the user is combined with the first real-time image according to the corresponding parts of the positioning points to the product model selected by the user to generate a real-time try-on image; and a checkout module is used to receive a purchase instruction from the user to perform a checkout procedure; wherein the processing module is used to remove the product corresponding to the product model selected by the user from the storage space after the checkout procedure is completed. As described in claim 1, the smart vending machine with augmented reality virtual try-on function, wherein the touch display module is used to receive a photo taking instruction from the user, and the processing module generates a try-on photo based on the photo taking instruction and the real-time try-on image. As described in claim 2, the smart vending machine with augmented reality virtual try-on function, wherein the touch display module is used to receive a barcode generation instruction from the user, and the processing module is used to generate a barcode linked to the storage address of the try-on photo according to the barcode generation instruction. A smart vending machine with an augmented reality virtual try-on function as described in claim 3, wherein the barcode is a one-dimensional barcode, a two-dimensional barcode, or a three-dimensional barcode. The smart vending machine with augmented reality virtual try-on function as described in claim 1 further comprises an environment sensing module and a display module, wherein the environment sensing module is used to detect environment information, the display module is used to play a video, and the processing module is used to adjust the video according to the environment information. As described in claim 5, the smart automatic vending machine with augmented reality virtual try-on function, wherein the environment sensing module includes an environment light sensor, and the environment light sensor is used to generate an environment light sensing result as part of the environment information. As described in claim 5, the smart automatic vending machine with augmented reality virtual try-on function, wherein the environment sensing module further includes a camera and an image recognition module, the camera is used to capture a second real-time image, and the image recognition module determines whether the second real-time image contains a target object and generates a recognition result as part of the environmental information. As described in claim 5, the smart vending machine with augmented reality virtual try-on function, wherein the environment sensing module further includes a camera and an image recognition module, the camera is used to capture a second real-time image, and the image recognition module determines whether the second real-time image contains a preset action and generates a recognition result as part of the environmental information. As described in claim 1, the smart automatic vending machine with augmented reality virtual try-on function, wherein the processing module is a microcontroller, a central processing unit, a special application integrated circuit chip or a field programmable logic gate array. As described in claim 1, the smart vending machine with augmented reality virtual try-on function, wherein the touch display module is a touch screen.

Images