CN107796169A - Method for sharing intelligent refrigerator information - Google Patents

Abstract

The invention provides a kind of method for being used to share intelligent refrigerator information, including：The refrigerator represented the refrigeration chamber region of intelligent refrigerator and refrigerating-chamber door region is obtained to bat figure；In response to receiving the first user input, the icon for sharing passage is directed to display on bat figure in refrigerator；And one of described icon is clicked in response to user, share via the corresponding passage of sharing of the icon with being clicked on including refrigerator to bat figure and the page of comment information.

Description

Method for sharing smart refrigerator information

technical field

The present application relates to the field of smart home appliances, and in particular, relates to a method for sharing information of smart refrigerators.

Background technique

With the rapid development of Internet of Things technology and smart home, the Internet of Everything is the general trend. In recent years, although many household devices can be connected to the Internet by adding communication modules, the connection function is only the basic condition for the development of intelligence. Lots of room for improvement.

The main function of traditional refrigerators is food storage, but lacks the intelligent management function of food information. In the context of the Internet of Things, the smart refrigerators currently proposed by the industry mainly have smart functions that can be connected to the network where the home router is located, so that the refrigerator can store or sense information and interact with external networks or other devices. Compared with traditional refrigerators Only the information interaction function has been added, but it has not made important changes in other aspects. It is difficult to meet the needs of users for intelligent management of food information stored in the refrigerator, resulting in low user acceptance of smart refrigerators.

Therefore, in order to make the smart refrigerator closer to the user, change the single cold connection between equipment and equipment, equipment and people, meet the user's needs for the application scenario of refrigerator food information management, and make the smart refrigerator closer to the user, it is necessary to propose a method for The method of sharing the information of the smart refrigerator can make the smart refrigerator closer to the user and more intelligent.

Contents of the invention

Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below.

According to an exemplary embodiment of the present disclosure, there is provided a method for sharing information on a smart refrigerator, the method may include: acquiring a picture of a refrigerator showing a refrigerator compartment area and a refrigerator compartment door area of the smart refrigerator; responding to Receiving the first user input, displaying icons for sharing channels on the refrigerator pairing picture; and in response to the user clicking one of the icons, sharing the refrigerator pairing picture and comments via the sharing channel corresponding to the clicked icon information page.

Optionally, the sharing channel may include at least one of the following: a built-in interaction platform, an external social application platform, and email.

Optionally, the refrigerator pairing picture may be obtained through a camera arranged in the smart refrigerator.

Optionally, the method may further include: displaying a comment box in response to receiving user input on the sharing page; and displaying the comment on the refrigerator pairing picture when the user inputs a comment in the comment box.

Optionally, displaying the comment on the refrigerator pairing map may include: displaying the comment on the refrigerator pairing map at a position corresponding to the position where the user input on the sharing page is received.

Optionally, the method may further include: in response to the user clicking one of the icons, displaying an animation of reducing the copy of the refrigerator paired image and dropping the reduced copy of the refrigerator paired image into the icon.

Optionally, the method may further include: when acquiring a refrigerator pairing picture, sending the acquired refrigerator pairing picture to a cloud server; identifying food information in the refrigerator pairing picture via the cloud server; and The identification result of the server updates the food information.

Optionally, the food information may include at least one of the following: food name, food quantity, food storage time and food location.

Optionally, the method may further include: when the user is not in the inherent interaction platform and there is a new message, displaying prompt information for prompting that there is a new message on the icon corresponding to the inherent interaction platform; and when When the user is in the intrinsic interaction platform, the content of the page is refreshed in response to the user pulling down the page.

Optionally, the method may further include: when receiving user input on the shared page, determining whether the user input is the user's first operation on the shared page, and if it is determined that the user input is the user's For the first operation of the sharing page, an operation prompt is overlaid and displayed on the sharing page.

Description of drawings

The above and other aspects, features and advantages of exemplary embodiments of the present disclosure will be more clearly understood in conjunction with the accompanying drawings, in which:

1a and 1b show a front view and a side view of the structure of a smart refrigerator according to an exemplary embodiment of the present invention;

2 shows a flow chart of a method for sharing smart refrigerator information according to an exemplary embodiment of the present invention;

Figures 3a and 3b show schematic diagrams of operations for displaying icons for sharing channels;

Fig. 4 shows a schematic diagram of an operation for sharing a page including pictures of refrigerators and comment information;

Figures 5a and 5b show schematic diagrams for representing animations for sharing smart refrigerator information via selected sharing channels; and

6a to 6c show schematic diagrams of operations for inputting comments on a shared page.

Detailed ways

Example implementations of the invention are described below with reference to the accompanying drawings. The invention provides a method for sharing smart refrigerator information, which can make the smart refrigerator closer to the user, change the single cold connection between equipment and equipment, equipment and people, and meet the user's application scene needs for refrigerator food information management. Make smart refrigerators closer to users and more intelligent.

1a and 1b show a front view and a side view of a structure of a smart refrigerator according to an exemplary embodiment of the present invention.

As shown in FIG. 1a to FIG. 1b, as an embodiment, the storage space of the refrigerator body 10 (also referred to as the refrigerator compartment area) of the refrigerator includes a first compartment space 101, a second compartment space 102, a second compartment space There may be more or fewer three compartment spaces 103 and fourth compartment spaces 104, which are not limited in the present invention. The structure of the smart refrigerator of the present invention is described below by taking the refrigerated cabinet body of the refrigerator divided into three interlayer spaces as an example. In one embodiment, the camera group includes a first camera 1, a second camera 2, and a third camera 3 , the fourth camera 4 and the fifth camera 5, wherein the first camera 1 is arranged on the left inner wall of the first compartment space 101 near the top and at a position close to the outer opening, for obtaining the first compartment space 101 Storage image, that is, its camera direction is towards the storage area of the first compartment space 101; the second camera 2 is arranged on the left inner wall of the second compartment space 102 near the top and near the outer opening, for obtaining The storage image of the second compartment space 102, that is, its camera direction is towards the storage area of the second compartment space 102; the third camera 3 is arranged on the left inner wall of the third compartment space 103 near its top and close to the outer opening At the position of the mouth, it is used to acquire the storage image of the third compartment space 103, that is, the camera direction is towards the storage area of the third compartment space 103; the fourth camera 4 is preferably arranged in the refrigerator body 10 adjacent to the third compartment A compartment space 101 or a second compartment space 102 and a position close to the outer opening are used to obtain a storage image of the overall space inside the refrigerator door (also referred to as the refrigerator compartment door area) 20, that is, when the refrigerator door 20 When forming a predetermined opening angle with respect to the refrigerator body 10, the shooting angle of the fourth camera 4 is aimed at the storage area inside the refrigerator door 20; the fifth camera 5 is preferably arranged on the inside of the refrigerator door body 20 (more preferably arranged on on the top pocket on the inner side of the refrigerator), which is used to obtain the image of the overall storage in the refrigerator body including the three interlayer spaces, that is, when the refrigerator door 20 forms the above-mentioned predetermined opening angle relative to the refrigerator body 10, the fifth The camera direction of the camera 5 is towards the storage area of the overall compartment space of the refrigerator.

During use, when the storage status of the first compartment space 101 changes, corresponding images can be collected through the first camera 1, and when the storage status of the second compartment space 102 changes, the corresponding images can be collected through the second The camera 2 collects corresponding images, and when the storage state of the third compartment space changes, the corresponding image can be collected through the third camera 3, and when the storage state of any compartment space changes, it can also be detected through the fifth The camera 5 obtains the image of the whole interlayer space, so that the corresponding images of the storage state changes are obtained both microcosmically and macroscopically. The images from these two angles help the image recognition system in the cloud to identify the corresponding food information more accurately. In addition, when the storage state inside the refrigerator door 20 changes, the corresponding image can be obtained through the fourth camera 4. Since the storage inside the refrigerator door 20 is usually less, the image obtained in this way also helps the image recognition system in the cloud to identify The storage information on the inner side of the refrigerator door 20 is displayed.

It should be noted that the fourth camera 4 and the fifth camera 5 can be configured to act simultaneously when the refrigerator door 20 forms a predetermined angle relative to the refrigerator body 10, which helps to improve the consistency and accuracy of the overall image collection, And obtain as much image information as possible with as few cameras as possible. Preferably, the installation heights of the fourth camera 4 and the fifth camera 5 may be substantially the same.

In order to more effectively illustrate the realization process of the above situation, a specific embodiment will be further illustrated below: specifically, the refrigerator may also include a sensor group and a main control device, and the sensor group may include a hand detection sensor (such as an infrared sensor ), an angle sensor, a refrigerator door switch state detection device (the device can directly use the existing door switch detection device of the refrigerator), wherein the hand detection sensor is used to detect whether the user's hand stretches into the interlayer space, in one embodiment Among them, the hand sensor can be set at position 6 as shown in Figure 1a and Figure 1b, and the angle sensor can be set on the rotating shaft of the refrigerator door to detect the opening angle of the refrigerator door box to the refrigerator.

The main control device can include the following operations: identify the current corresponding state of the refrigerator; control the action of the camera, image acquisition and storage; realize network transmission, etc., and can also include the following functions: display in a graphical interface according to the feedback information of the cloud image recognition system The storage status in the refrigerator storage space provides users with voice control, alarms, warm reminders and other functions.

During use, the entire main control device can be powered by the refrigerator power supply unit, and various corresponding status information of the sensor group is transmitted to the main control device in real time. Knowing that the refrigerator door is opened and knowing the opening direction (closing direction) and angle of the refrigerator door, the user puts the apple in the first compartment space 101, and the main control device also knows this state. After the user places the apple, the main control device The device controls the action of the first camera 1 to obtain the storage image of the first compartment space 101. In addition, the user places eggs inside the refrigerator door 20, and then the user closes the refrigerator door 20. During the closing process, when the refrigerator door 20 When the angle relative to the refrigerator body 10 is a predetermined angle (such as 45°), the main control device controls the fourth camera 4 and the fifth camera 5 to act simultaneously to obtain the storage image of the entire space of the refrigerator body 10 and the inside of the refrigerator door 20 Storage image of the overall space.

During the predetermined period of time when the above-mentioned corresponding cameras operate, the main control device also collects the images obtained by each corresponding camera and stores them in a predetermined format (such as jpeg format). When the user closes the refrigerator door 20, the main control device will Three images (the microscopic image of the first compartment space 101, the overall image of the refrigerator body 10, and the overall image of the inside of the refrigerator door 20) obtained within one cycle (from opening the refrigerator door to closing the refrigerator door) are transmitted To the cloud image recognition system, the cloud image recognition system obtains the storage state of the first compartment space 101 and the storage state of the inner side of the refrigerator door 20 according to these images.

When the user takes out the food, the working situation of the main control device is similar to the above. If there are multiple compartments involved in the pick-and-place action, the number of images obtained will increase accordingly. In addition, if the user does not pick and place food in the refrigerator body 10 after opening the refrigerator, but only picks and places food inside the refrigerator door 20, at this time, the main control device does not control the corresponding camera to acquire microscopic images of the interlayer space , the images in the entire cycle are two storage images of the overall space; if the user only opens a small angle (can be preset), and neither picks and places in the refrigerator body 10 nor inside the refrigerator door 20 Pick-and-place actions (in this case, it is usually the case that the user manually checks the internal state of the refrigerator), at this time, there is no need to acquire any storage images during the entire cycle.

In addition, after the cloud image recognition system acquires the images (groups) of each cycle, it can process them in time to obtain the storage status information of the corresponding compartment space and the inner position of the refrigerator door 20, for example, it can be concluded that the first compartment space 101 has There are several apples, and there are several eggs on the inside of the refrigerator door 20. The cloud image recognition system feeds the recognized information back to the main control device, and the main control device presents the information to the user in a graphical way through its display module. The shelf life of the corresponding category reminds users to use it up in time. The information processed by the cloud image recognition system can also be sent to the user's terminal, so that the user can know the relevant status of the refrigerator in time and get relevant reminders; in addition, the cloud image recognition system can also directly forward the obtained images to the user Terminal, so that the user terminal can also view the storage status in the refrigerator more intuitively, and this can provide more effective assistance when the image recognition system is difficult to effectively recognize certain images.

Hereinafter, based on the structure of the smart refrigerator described above, a method for sharing smart refrigerator information according to an exemplary embodiment of the present invention is described.

Fig. 2 shows a flow chart of a method for sharing smart refrigerator information according to an exemplary embodiment of the present invention. Specifically, the method for sharing the information of the smart refrigerator includes: at step 210, acquiring a picture of the refrigerator that represents the refrigerating room area and the refrigerating room door area of the smart refrigerator. In one embodiment, the paired pictures of the refrigerators can be obtained through a camera arranged in the smart refrigerator (as shown in Fig. 1a and Fig. 1b). In addition, when obtaining the paired picture of the refrigerator, the obtained paired picture of the refrigerator can be sent to the cloud server; the food information in the paired picture of the refrigerator can be identified via the cloud server; and the food information can be updated according to the identification result of the cloud server . The food information includes at least one of the following: food name, food quantity, food storage time and food location.

Next, in step 220, in response to receiving the first user input, an icon for the sharing channel is displayed on the refrigerator pairing map. The sharing channel includes at least one of the following: a built-in interaction platform, an external social application platform and email. The inherent interaction platform refers to the interaction platform of the current application or device itself, and the external social application platform refers to the interaction platform developed by other applications or devices. For example, when it is received that the user clicks the share button or share icon, a translucent mask is displayed on the refrigerator photoshoot, and icons for the sharing channel are displayed under the mask, such as the inherent sharing platform of the current application, external social media, etc. Application platform (for example, WeChat, facebook, etc.) or email.

In step 230, in response to the user clicking one of the icons, the page including the picture of the refrigerator and the comment information is shared via the sharing channel corresponding to the clicked icon. In one embodiment, in response to a user clicking on one of the icons, an animation may also be displayed that shrinks the copy of the refrigerator image and drops the reduced copy of the refrigerator image into the icon to indicate that the image is being accessed via all of the icons. Use the above sharing channel to share photos and comments on refrigerators.

Alternatively, after sharing the refrigerator photo and comment information, in response to receiving user input on the shared page (i.e., the shared page), that is, when the user wants to comment on the refrigerator photo, A comment box can also be displayed. In addition, when the user inputs a comment in the comment box, the comment may be displayed on the refrigerator pairing picture. Specifically, the comment may be displayed at a position corresponding to the position where the user input on the sharing page is received on the refrigerator pairing map.

Specifically, after sharing the picture and comment information on the refrigerator, the user can also view other people's comments on the shared page or view the pages shared by others. In one embodiment, when the user is not in the inherent interactive platform and there is a new message (for example, a new comment or a new share), a prompt for prompting the existence of a new message is displayed on the icon corresponding to the inherent interactive platform information; and when the user is in the intrinsic interaction platform, in response to the user pulling down the page, refreshing the page content.

In addition, when receiving user input on the shared page, the method may further include determining whether the user input is the user's first operation on the shared page, and if it is determined that the user input is the user's operation on the shared page For the first operation, operation prompts may also be overlaid and displayed on the sharing page, so as to prompt the user how to operate.

3a to 6b show specific implementations of a method for sharing smart refrigerator information according to an exemplary embodiment of the present invention.

Fig. 3a and Fig. 3b show schematic diagrams of an operation of displaying an icon for a sharing channel on a refrigerator pairing map in response to receiving a first user input according to an exemplary embodiment of the present invention. As shown in FIG. 3 a , firstly, a paired image of the refrigerator is acquired, where the paired image of the refrigerator may include images of an inner chamber image and a side door image. Secondly, in response to receiving the first user input, for example, the user clicks on the sharing icon, and the icon for the sharing channel is displayed on the refrigerator pairing map. Specifically, as shown in Figure 3b, a mask can be displayed on the picture of the refrigerator, and icons for sharing channels, such as "everyone", "WeChat circle of friends" and "WeChat friends" can be displayed on the mask . "Everyone" represents the interaction platform of the current application or device itself, and "WeChat Moments" and "WeChat Friends" represent external social application platforms developed by other applications or devices.

FIG. 4 shows a schematic diagram of an operation of sharing a page including a photo of a refrigerator and comment information via a sharing channel corresponding to the clicked icon in response to the user clicking one of the icons. As shown in Figure 4, in response to the user clicking one of the icons of "Everyone", "WeChat Moments" and "WeChat Friends", the schematic diagram of the operation of sharing the page including the picture of the refrigerator and the comment information via the clicked sharing channel .

For example, when the user clicks to share to "everyone", as shown in Figures 5a and 5b, an animation that shrinks the copy of the picture taken by the refrigerator and falls into the icon of "everyone" can be displayed , in order to indicate that the photos and comments of the corresponding refrigerator pair have been shared with "everyone". Specifically, the copy of the refrigerator pairing picture changes from large to small, and quickly falls into the "everyone" icon, so that the refrigerator pairing pictures and comments can be shared in the publicity area for all refrigerator users to see and share Make a comment. That is to say, if you choose to share with "everyone", you can share my refrigerator pairing pictures and comments together to everyone's publicity area, so that all refrigerator users (or users who use this app) can see the shared refrigerator pairing photos and comment. It should be noted that the process of sharing smart refrigerator information is described above only by sharing refrigerator photos and comments to "everyone" as an example. However, the present invention is not limited to this, and smart refrigerators can be shared through external social application platforms or emails. information. In the case of sharing smart refrigerator information through an external social application platform or email, another user can access the sharing page through the external social application platform or email and make comments.

When making a comment, a comment box is displayed in response to receiving user input on the sharing page; and when the user inputs a comment in the comment box, the comment is displayed on the refrigerator photoshoot. Specifically, when a user input to the shared page is received (whether it is a user input made through an inherent interactive platform, a user input made through an external social application platform, or a user input made through an email sharing channel) , determining whether the user input is the user's first operation on the shared page. If it is determined that the user input is the user's first operation on the sharing page, overlaying and displaying an operation prompt on the sharing page. As shown in Figure 6a, when entering for the first time, the floating layer on the refrigerator map will give an operation prompt, and the user can click the cross or other places to close the floating layer. Next, when the user clicks on any position on the picture of the refrigerator pairing, a comment box may be displayed for the user to input comments, as shown in FIG. 6b. When the user inputs a comment in the comment box, the comment is displayed on the refrigerator pairing picture. Specifically, as shown in FIG. 6 c , the comment may be displayed at a position corresponding to the position where the user input on the sharing page is received on the refrigerator pairing picture.

In addition, if the user is not currently in our channel, whenever there is a new share or new comment, a small red dot will appear on the channel entrance icon to remind the user that there is a new message. When the user is in our channel, he usually does not actively refresh new content unless the user pulls down to refresh, thereby saving system resources and improving user experience.

In summary, by adopting the method for sharing smart refrigerator information in the exemplary embodiment of the present invention, the intelligent life application of smart refrigerators can be expanded, and the interaction between users and smart refrigerators is more convenient, humanized and intelligent. Effectively improve the user experience on smart refrigerators.

The above solution is only a specific implementation solution showing the concept of the present invention, and the present invention is not limited to the above implementation solution. Part of the processing in the above implementation solutions may be omitted or skipped without departing from the spirit and scope of the present invention.

The foregoing methods can be realized in the form of executable program commands by various computer means and recorded in a computer-readable recording medium. In this case, the computer-readable recording medium may include individual program commands, data files, data structures, or a combination thereof. Meanwhile, program commands recorded in the recording medium may be specially designed or configured for the present invention, or known to be applied by those skilled in the field of computer software. The computer-readable recording medium includes magnetic media such as hard disks, floppy disks, or magnetic tapes, optical media such as compact disk read-only memory (CD-ROM) or digital versatile disks (DVD), magneto-optical media such as magneto-optical floppy disks, and Hardware devices such as ROM, RAM, and flash memory that execute program commands. In addition, the program commands include machine language codes formed by a compiler and high-level languages executable by a computer by using an interpreter. The foregoing hardware devices can be configured to operate as at least one software module to perform the operations of the present invention, and the reverse operation is the same.

Although the operations of the methods herein are shown and described in a particular order, the order of the operations of each method may be changed such that certain operations may be performed in reverse order or such that certain operations may be performed at least in part concurrently with other operations. Furthermore, the present invention is not limited to the above-described exemplary embodiments, and it may include or omit one or more other components or operations without departing from the spirit and scope of the present disclosure.

The present invention has been illustrated above in conjunction with preferred embodiments of the present invention, but those skilled in the art will understand that various modifications, substitutions and changes can be made to the present invention without departing from the spirit and scope of the present invention. Accordingly, the invention should not be limited by the above-described embodiments, but by the appended claims and their equivalents.

Claims (10)

1. A method for sharing information on a smart refrigerator, comprising: Obtain a picture of the refrigerator that represents the refrigerated compartment area and the refrigerated compartment door area of the smart refrigerator; In response to receiving the first user input, displaying an icon for the sharing channel on the refrigerator pairing map; and In response to the user clicking one of the icons, the page including the picture of the refrigerator and the comment information is shared via the sharing channel corresponding to the clicked icon. 2. The method according to claim 1, wherein the sharing channel comprises at least one of the following: a built-in interaction platform, an external social application platform, and email. 3. The method according to claim 1, wherein the refrigerator matching picture is acquired through a camera arranged in the smart refrigerator. 4. The method of claim 1, wherein the method further comprises: displaying a comment box in response to receiving user input to the shared page; and When the user inputs a comment in the comment box, the comment is displayed on the refrigerator pairing picture. 5 . The method according to claim 4 , wherein displaying the comment on the refrigerator pairing map comprises: displaying the comment on the refrigerator pairing map at a location corresponding to a location where the user input on the sharing page is received. 6 . 6. The method according to claim 1, wherein the method further comprises: in response to a user clicking on one of the icons, displaying a reduced copy of the refrigerator pair map and dropping the reduced copy of the refrigerator pair map into the animation of the icon described above. 7. The method of claim 1, wherein the method further comprises: When obtaining the picture of the refrigerator, send the obtained picture of the refrigerator to the cloud server; Identifying the food information in the refrigerator pair photo through the cloud server; and According to the identification result of the cloud server, the food information is updated. 8. The method according to claim 7, wherein the food information includes at least one of the following: food name, food quantity, food storage time and food location. 9. The method according to claim 2, wherein the method further comprises: when the user is not in the inherent interaction platform and there is a new message, displaying a message for prompting that there is a new message on the icon corresponding to the inherent interaction platform the prompt information of the message; and When the user is in the intrinsic interaction platform, the content of the page is refreshed in response to the user pulling down the page. 10. The method according to claim 4, wherein the method further comprises: when receiving user input to the shared page, determining whether the user input is the user's first operation on the shared page, and If it is determined that the user input is the user's first operation on the sharing page, overlaying and displaying an operation prompt on the sharing page.