JP2018179500A - refrigerator - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a refrigerator which improves reliability of an imaging device and which can ensure long-time service life.SOLUTION: The refrigerator includes: a storage chamber formed inside a refrigerator body; a door for opening/closing the storage chamber; an indoor panel light for illuminating the inside of the storage chamber; a camera for imaging the inside of the storage chamber; a control part for controlling the camera; and a radio adapter 53 connected to the control part. The door is constituted by a first door 10-1 and a second door 10-2. The first door has a center pillar 11 arranged between the first door and the second door, and the second door has a camera. Thereby, an impact acting in the direction in which the center pillar rotating and operating in accordance with the opening/closing of the door closes is not applied to the camera provided on the other door. Thus, an impact influence of the center piller with respect to the camera is eliminated and reliability of the camera is enhanced, and also coordination with outside equipment becomes possible. Thus, the refrigerator has high usability.SELECTED DRAWING: Figure 8

Description

  BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a refrigerator used in a refrigerator system for photographing food in a storage and checking storage conditions with a display terminal or the like.

  In general, many refrigerator and refrigeration systems of this type have been proposed. For example, in the refrigerator and refrigeration system described in Patent Document 1, a small camera is provided in the storage, and the food storage condition in the storage photographed by the small camera is displayed via a display line such as a mobile phone via the Internet line. It is configured to be able to confirm.

  Also, Patent Document 2 discloses a refrigerator and a refrigeration system similar to Patent Document 1, and the apparatus described in Patent Document 1 captures the state of food in the storage with a small camera when the door of the refrigerator is closed. Configured to

  Furthermore, in addition to the configuration described in Patent Document 1, the refrigerator and the refrigeration system described in Patent Document 3 further provide a display terminal on the surface of the refrigerator, and this display terminal is a fixed terminal and refrigerator incorporated in the refrigerator surface. It consists of a display terminal such as a mobile phone that can be removed from the surface and carried around, and both terminals can display the food storage status in the storage taken with a small camera via an internet line on the display unit, Of course, it is configured to be able to know the food storage situation in the storage without opening the door of the refrigerator even at home.

Japanese Patent Application Laid-Open No. 2002-236798 JP 2007-46833 A JP 2002-81818 A

  As described above, many types of refrigerators of this type, that is, refrigerators that can photograph food in the storage and check the storage status with a display terminal or the like, and many refrigerator systems have been proposed, but are still put to practical use There is nothing done.

  Therefore, the inventors have made studies for practical use of the above-described refrigerator and its refrigerator system and conducted practical verification. As a result, it has been found that this type of refrigerator and its refrigerator system have many problems to be solved in putting them into practical use.

  One of them is the improvement of the reliability of the camera that shoots the food in the storage. That is, in the case of a French door type refrigerator, when the camera for photographing the inside of the storage of the refrigerator is provided on the inner surface of the door, the camera can be provided near the open end of the door and the inside of the storage can be photographed from the front substantially central part It is desirable to do so. At that time, the camera provided near the open end of the door is subjected to an impact every time the door is opened and closed, which makes it easy to break down. In addition, the door of the refrigerator of the French door type is provided with a center pillar for securing heat insulation between the open end of the other door and the open end of the other door to prevent cold air leakage. The center pillar rotates in conjunction with the opening and closing of the door. Then, in addition to the impact when the door is closed, an impact generated when the center pillar is rotated in the closing direction is also applied to the camera.

  Here, the impact due to the opening and closing of the door itself is absorbed by the door packing and the influence thereof is small, but the rotation operation of the center pillar is biased by a strong spring material and there is no absorbing member such as the door packing. When the camera is installed at the open end of the door, the impact of opening and closing the center pillar greatly affects the durability of the camera when the camera is installed at the open end of the door. Was found as a result of verification.

  The present invention has been made in view of these points, and provides a refrigerator in which the impact of the center pillar in a French door type refrigerator is eliminated to improve the reliability of a photographing device such as a camera.

  In order to achieve the above-mentioned object, the present invention comprises at least one storage, and a double door for closing the storage constituted by a first door and a second door, and the first door is provided with a center It is a refrigerator provided with a pillar and provided with a photographing device for photographing the inside of the storage of the storage in the second door, and provided in the storage of the storage based on the fact that the door of the door is opened. First control means for lighting the lighting device, second control means for causing the imaging device to perform imaging based on the fact that the door is closed, and imaging by the imaging device is completed And third control means for turning off the lighting device.

  ADVANTAGE OF THE INVENTION According to this invention, it can be set as the refrigerator which improved the reliability of the imaging device which image | photographs the inside of storage.

The perspective view of the refrigerator in the embodiment of the present invention Schematic cross section of the same refrigerator The perspective view which shows the inside when the storage door of the same refrigerator is opened (A) A perspective view in which the display terminal is integrally mounted on the same refrigerator, (b) a perspective view in which the display terminal is detachably mounted on the same refrigerator The mounting structural example of the display terminal used for the same refrigerator is shown, (a) is a sectional view at the time of attaching a display terminal integrally, (b) is a sectional view at the time of mounting a display terminal detachably. The example of display visual recognition structure of the display terminal used for the refrigerator is shown, (a) and (b) are schematic sectional drawings when the outer cover panel of a door is glass, (c) comprises the outer cover panel of a door with a magic mirror Outline cross section in the case of Longitudinal sectional view showing an example of camera attachment of the same refrigerator The example of camera attachment of the refrigerator is shown, (a) is a cross-sectional view of the refrigerator door part in the state which closed the door, (b) is a front view of the door inner surface side when the door is opened (A) (b) (c) Longitudinal sectional view showing another example of camera attachment example of the same refrigerator An explanatory view showing an example of a camera attached to the same refrigerator System configuration diagram of the refrigerator system in the same embodiment Block diagram showing the refrigerator configuration of the same refrigerator system Block diagram showing server configuration of same refrigerator system Flowchart showing shooting to data storage operation when the door of the same refrigerator system is closed Flow chart showing photographing-data storage operation at the time of cooling room cooling operation of the same refrigerator system Flowchart showing shooting to data storage operation when the door of the same refrigerator system is opened Flowchart showing another operation example of the photographing operation in FIGS. 14 to 16 Flow chart showing the case where the server apparatus performs data storage and combining operation in the same refrigerator system Flow chart showing a case where data storage and combining operation in the same refrigerator system are performed on the refrigerator side A flowchart showing a case where data storage and combining operation in the same refrigerator system are performed on the display terminal side Flow chart showing normal image data transmission and reception in the same refrigerator system Flow chart showing transmission and reception of image data when image data is stored in the display terminal in the same refrigerator system Flow chart showing the case where the individual image and the composite image are switched and transmitted / received in the same refrigerator system Flow chart showing image data transmission and reception at the time of prior transmission request in the same refrigerator system Front view of display terminal for explaining switching of transmission / reception route in the same refrigerator system Diagram for explaining the image composition processing in the same refrigerator system

  Hereinafter, specific and detailed embodiments of the present invention will be described. First, the main points of the embodiments of the present invention will be described.

  The embodiment of the refrigerator according to the present invention comprises a refrigerator body, a storage formed in the refrigerator body, a door for opening and closing the storage, a lighting device for illuminating the inside of the storage, and an imaging device for imaging the inside of the storage And a control unit for controlling the photographing apparatus, and a wireless adapter connected to the control unit, wherein the door comprises a first door and a second door, and the first The door has a center pillar arranged to insulate between the first door and the second door, and the second door has the photographing device.

  By this, the impact acting in the closing direction of the center pillar which rotates in conjunction with opening and closing of the door is not applied to the photographing device provided at the open end of the other door, and the center for the photographing device such as a camera After the impact of the pillar is eliminated to improve the reliability of the imaging device, cooperation with an external device becomes possible, and a highly usable refrigerator can be obtained.

  Further, the wireless adapter receives a signal transmitted from the router device and outputs the received signal to the control unit, so that the operation of the imaging device and the collection and processing of imaging data can be easily performed from the outside. It is possible to provide a convenient refrigerator.

  Hereinafter, Embodiment 1 of the present invention will be described using the drawings. The present invention is not limited to the following embodiments.

First Embodiment
<1. Configuration>
1-1. Configuration of refrigerator 1-1-1. Configuration of French Door Type Refrigerator A configuration example of the French door type refrigerator will be described first with reference to FIGS. 1 to 9.

  In FIGS. 1 to 3, the refrigerator main body 1 includes an outer case 2 made of metal (for example, iron plate) opened forward, an inner case 3 made of hard resin (for example, ABS), the outer case 2 and the inner case 3 And a heat insulating material 4 such as hard urethane foam filled with foam. The refrigerator body 1 has a plurality of storages partitioned therein. This storage is located from the upper part of the refrigerator main body 1 to the refrigerating chamber 5, the switching chamber 6 located below the refrigerating chamber 5, the ice chamber 7, the switching chamber 6 and the lower portion of the ice chamber 7 juxtaposed to the switching chamber 6. A freezer compartment 8 and a vegetable compartment 9 located below the freezer compartment 8 are provided. Further, the front of the refrigerator compartment 5 is closed freely by the double doors 10-1 and 10-2 and the front part of the switching compartment 6, the ice making compartment 7, the freezing compartment 8 and the vegetable compartment 9 is of the withdrawal type. The door 12a, 12b, 13, 14 (hereinafter referred to as a drawer type door) closes the door freely.

  There is a cooling chamber 16 on the back of the refrigerator main body 1, and a cooler 17 for generating cold air, a blower fan 18 for supplying cold air to each chamber, and a damper (air volume adjusting means) 22 for adjusting the air volume to the refrigerator compartment And are provided. Further, a compressor 19 is provided at the back of the top surface of the main body 1 of the refrigerator, and a condenser (not shown), a heat radiation pipe 20 for heat radiation, a capillary tube 21 and the cooler 17 described above are sequentially Refrigerant is sealed in the annularly connected refrigeration cycle so as to perform a cooling operation.

  Here, the respective doors 10-1 and 10-2 to 14 are filled with hard urethane foam as in the case of the refrigerator main body 1 to provide heat insulation, and the doors 10-1 and 10- of the storage 5 to be a refrigerator compartment. One of the two doors 10-1 is narrower in width than the other door 10-2, and a center pillar 11 for preventing cold air leakage is attached to the open end thereof. And in this refrigerator, the display terminal 15 is equipped in the front of the door 10-2 with another wide width. The display terminal 15 comprises a display unit such as a liquid crystal panel and a control unit for controlling the display unit as shown in FIG. 4 (a), and is integrally attached to the door 10 or as shown in FIG. 4 (b) The smartphone 10 is formed of a smartphone and a tablet PC, and the door 10 is detachable, and may be equipped with any method.

  5 (a) and 5 (b) show an example of the mounting configuration of the display terminal 15 to the door 10. FIG. 5 (a) shows the display terminal 15 when the display terminal 15 is integrally attached. It shows the case where it is detachably attached.

  5 (a) and 5 (b), the door 10 mainly includes a cover panel 10a facing the front side of the refrigerator, an inner plate 10b facing the inner side of the refrigerator, a cover panel 10a and an inner plate 10b and the heat insulating material 4 filled in between. The outer cover panel 10a is formed of a metallic member such as a color steel plate or a transparent member such as a glass plate, and the inner plate 10b is a synthetic resin member formed by vacuum molding. A raised wall portion 10b-1 is provided on the periphery of the inner side plate 10b so as to be protruded in the shape of a U when viewed from the inside of the storage. Further, as described above, for example, hard urethane foam is used for the heat insulating material 4.

  Moreover, in the door 10 of FIG. 5 (a) which integrated the display terminal 15, the resin-made storage frame 23 which covers the heat insulating material 4 continuously with the covering panel 10a is provided in the front side of the door 10. (If the cover panel 10a is a glass plate, it is integrally attached to the glass plate). The display terminal 15 is fixed to the storage frame 23 via the terminal holder 24. Further, a touch panel 25 is provided on the front side of the display terminal 15. A gap 26 is provided between the display terminal 15 and the touch panel 25 so that noise from the display terminal 15 does not cause the touch panel 25 to malfunction. The display terminal 15 and the touch panel 25 are fixed by attaching a frame 27 covering the outer peripheral edge thereof to the surface of the door 10. Moreover, since the heat insulating material 4 does not directly touch the display terminal 15 by providing the storage frame body 23, the display terminal 15 is exposed to high temperature or deformed when the heat insulating material 4 is foamed. And other problems can be prevented. On the other hand, in the door 10 of FIG. 5 (b) in which the display terminal 15 is detachable, a recess 28 is formed by providing the storage frame 23 on the front surface of the door 10, and the display terminal 15 is detached in this recess 28 Configured to

  6 (a), (b) and (c) show an example of the display see-through configuration of the door 10 and the display terminal 15, and FIGS. 6 (a) and 6 (b) show that the cover panel 10a of the door 10 is a glass plate In the case of 10a-1, FIG.3 (c) shows the case where the outer cover panel 10a of the door 10 is comprised by the magic mirror 10a-2.

  In FIG. 6A, a smoke sheet 29 is provided between the display terminal 15 embedded in the door 10 and the glass plate 10a-1 so that only the portion facing the display terminal 15 is transparent, and the display terminal 15 is Even when the display terminal 15 looks blackish, the glass sheet 10a-1 other than the display terminal 15 does not look blackish with the smoke sheet 29, and the boundary with the display terminal 15 does not stand out, so that the appearance can be maintained well. Further, in FIG. 6B, a transparent liquid crystal display unit is used as the display unit of the display terminal 15, and a smoke sheet 29a of a black whole is laid along the back surface of the transparent liquid crystal display unit. Can be made good. Furthermore, in FIG. 6C, the glass plate 10a-1 in FIGS. 6A and 6B is used as the magic mirror 10a-2 and the smoked sheet 29 is unnecessary, and in this case also, the appearance is maintained favorably. be able to. All show an example at the time of attaching display terminal 15 to door 10 in one. In addition, you may perform coating so that it may look dark on the back side of glass plate 10a-1 instead of the smoked sheet 29. FIG.

  7, 8 (a) and 8 (b) show an example of attachment of the camera and the interior lamp, which is the main part of the present invention, and FIG. 4 is a longitudinal sectional view of the refrigerator with the door closed. 8 (a) is a cross-sectional view showing the inside of the door in the refrigerator with the door closed, and FIG. 8 (b) is a front view of the inside of the door when the door is opened.

  In FIG. 7, FIG. 8 (a), (b), the shelf boards 30-1 to 30-4 are provided in the storage 5 of a refrigerator in upper and lower multiple steps. The shelf plates 30-1 to 30-4 are formed of a transparent material such as transparent synthetic resin or glass, except for the surrounding frame.

  A storage container 31 is provided below the lowermost shelf plate 30-4 so as to be freely drawn out. Although the shelf board 30-4 of the lowermost stage is fixed because it constitutes the upper surface of the storage container 31, the shelf boards 30-1 to 30-3 have side wall convex parts provided on both side wall parts of the storage 5, respectively. They are mounted on 32-1 to 32-4 and are detachable. In particular, the shelf plate 30-2 at the center among the shelf plates 30-1 to 30-3 excluding the lowermost shelf plate 30-4 is provided with a plurality of corresponding side wall convex portions 32-2 at different heights. The height of the shelf can be adjusted.

  Reference numerals 33-1 to 33-3 denote door pockets provided on the inner surface of the door 10 for opening and closing the opening of the storage 5, and are provided in a plurality of upper and lower stages. The door pockets 33-1 to 33-3 are also formed of a permeable material.

  Reference numerals 34-1 and 34-2 denote lighting devices as interior lighting lamps (hereinafter referred to as interior lighting lamps), and the front opening of the storage 5 ahead of the front ends of the shelf boards 30-1 to 30-4. It is provided on both side wall portions and the front opening upper wall surface portion. From the relationship of energy saving, the interior lamps 34-1 and 34-2 are provided with a substrate on which a plurality of LEDs are arranged, for example, vertically extending and covered with a translucent cover.

  35-1 and 35-2 are photographing devices (hereinafter referred to as a camera) such as a camera provided so as to be positioned on the front side of the storage 5 as well as the interior lighting lights 34-1 and 34-2. Although it is configured by a CCD camera, a CMOS camera or the like, and the type thereof is not particularly limited, it is preferable that it is resistant to condensation and the like.

  The cameras 35-1 and 35-2 are provided on the inner surface of the wide door 10-2 having no center pillar 11 among the doors 10-1 and 10-2 for the storage 5, It is provided in the vicinity of the open end of the door 10-2 and is set to be positioned substantially at the center of the refrigerator 51.

  In this embodiment, one camera 35-1 is attached in the vicinity of the lower surface of the upper door pocket 33-1 in the vicinity of the lower surface of the lower door pocket 33-3. It is attached. Here, the front-rear direction of the door pocket 33 is the vertical direction with respect to the surface formed by the inner side plate 10b of the door 10, and is the same direction as the front-rear direction of the storage 5 when the door 10 is closed. .

  Further, the upper camera 35-1 is provided substantially forward of the uppermost shelf plate 30-1, and the lower camera 35-2 is provided forward of the third shelf plate 30-3 in the figure. . In other words, any camera is not the shelf board 30-2 that can be placed on the plurality of side wall convex portions 32-2 provided on the premise of height adjustment, but a shelf that is detachable but is not premised on height adjustment It is provided to be positioned substantially in front of the plate 30-1 and the shelf plate 30-3.

  As described above, any one of the above cameras 35-1 and 35-2 is provided on the side of the door 10-2 where the center pillar 11 (see FIG. 3) is not provided, and is positioned approximately at the center of the refrigerator 51. And the front position from the front end of each of the shelf plates 30-1 to 30-4 as shown in FIG. 7, and as shown in FIG. Is located near the opposite open end side Y, that is, approximately at the center in the left-right direction of the refrigerator 51, so that almost the entire inside of the storage can be photographed with the two cameras 35-1 and 35-2. It is.

  The cameras 35-1 and 35-2 may be additionally provided with a dedicated camera 35-3 in the storage container as shown in FIG. 9 (a), or as shown in FIG. 9 (b), the lower camera 35. If it is set according to the form of the refrigerator to be installed, such as -2 movably provided up and down, or the lower camera 35-2 provided pivotably in the vertical direction as shown in FIG. Good.

  The interior lighting lamps 34-1 and 34-2 are provided at positions deeper than the cameras 35-1 and 35-2 as is apparent from FIG. It is provided so that the light of 2 may not directly enter the photographing part of the cameras 35-1 and 35-2.

  More specifically, as shown to Fig.8 (a), the imaging | photography part of camera 35-1 and 35-2 is the irradiation amount (maximum irradiation amount) of the irradiation direction of interior lighting 34-1 and 34-2. ), And in this example, it is provided outside the range of the irradiation angle of 60 degrees.

  In addition, although this does not show in figure, a light-shielding part is provided in the camera side of interior lighting 34-1, 34-2, or light sources, such as LED which comprises interior lighting 34-1 and 34-2, By making the configuration such as slanting back toward the rear, the lights of the interior lighting lamps 34-1 and 34-2 may not directly enter the photographing unit of the cameras 35-1 and 35-2. And may be appropriately selected in accordance with the installation conditions of the camera.

1-1-3. Camera Configuration FIG. 10 shows an example of a camera used for in-chamber imaging. It is most preferable that the cameras be provided at vertically separated positions as described in each of the above-mentioned examples for photographing inside the storage, but as shown in FIG. 10, storage may be performed even if the upper and lower cameras 35-1 and 35-2 are installed close to each other It was confirmed as a result of verification that the whole area of the inside can be photographed.

  Therefore, in such a case, it is considered that the cameras 35-1 and 35-2 are integrated to form the camera module 41. By modularizing in this manner, the installation can be simplified and the cost can be reduced. Also, it can be modularized by using a wide-angle lens such as a fisheye lens.

1-2. Overall Configuration of Refrigerator System Next, an overall refrigerator system using a refrigerator as described above will be described with reference to FIGS.

  FIG. 11 shows the entire configuration of a refrigerator system 50 using the above-described refrigerator. As shown in FIG. 11, the refrigerator system 50 is a system for confirming the food condition in the refrigerator 51 by the display terminal 15 and the like.

  The refrigerator system 50 includes a refrigerator 51 and a display terminal 15, and further includes a wireless adapter (communication device) 53, a gateway device (relay device) 54, a router device 55, the Internet 56, and a server device 57.

  The refrigerator 51 is disposed in the residence A of the user, and is disposed, for example, in a kitchen room in the residence A.

  The wireless adapter (communication device) 53 is electrically connected to a control unit, which will be described later, of the refrigerator 51, and is configured to communicate with the router device 55 via the gateway device (relay device) 54. The wireless adapter 53 receives the signal transmitted from the router device 55, and outputs the received signal to the control unit of the refrigerator 51. Based on this signal, the refrigerator 51 is configured to perform a corresponding operation.

  The wireless adapter 53 also acquires identification information (for example, serial number, model number, etc.) of the refrigerator 51, internal image data to be described later, etc. from the storage unit of the refrigerator 51, and the router via the gateway device (relay device) 54. It is configured to transmit to the device 55. The wireless adapter 53 may be integrally provided in the refrigerator 51 or may be configured to be removable.

  The wireless adapter 53 includes a "connect" button 53a. The “connect” button 53 a is for newly connecting with the gateway device (relay device) 54. When the “connect” button 53 a is operated by the user, the wireless adapter 53 is configured to acquire identification information (for example, a serial number or a model number) of the refrigerator 51 from the storage unit of the refrigerator 51.

  As described above, the display terminal 15 is, for example, a general-purpose portable terminal such as a smartphone and a tablet PC (personal computer), and can be detachably attached to the door 10 of the refrigerator 51 described above in the case of the present embodiment. , And has a function (means) for connecting to the Internet 56 and a function (means) for communicating with a gateway device 54 described later.

  The display terminal 15 (for example, a smart phone) is configured to connect to the Internet 56 via a telephone line network (for example, a 3G line network). Additionally or alternatively, for example, the display terminal 15 is configured to connect to the Internet 56 via a public wireless LAN by a Wi-Fi communication function.

  By connecting to the Internet 56, for example, the display terminal 15 is a program for acquiring image data of food in the refrigerator which is an object of the present invention and data for performing energy saving operation (for example, data such as the number of times of opening and closing of a door) Can be obtained from the homepage of the manufacturer of the refrigerator 51 via the Internet 56. By installing the acquired program on the display terminal 15 and activating the installed program, the display terminal 15 can acquire image data and the like of the food in the refrigerator. That is, the display terminal 15 can generate and transmit an operation signal for acquiring the image data of the refrigerator 51 by operating the operation screen of the display 15a. Details will be described later.

  The display terminal 15 is also connected to the router device 55 by general-purpose communication not via the Internet 56 such as Wi-Fi communication, Bluetooth (registered trademark) communication, infrared communication, etc., and the gateway device 54 via the router device 55. It is configured to communicate with. A device (for example, a Wi-Fi antenna or the like) for that purpose is incorporated in the display terminal 15.

  The gateway device (relay device) 54 is a device that relays communication between the wireless adapter 53 and the display terminal 15, and, for example, the wireless adapter 53 and the specified low power wireless special small frequency band (924.0 to 928.0 MHz To communicate using the signal of. The frequency band of communication between the gateway device 54 and the wireless adapter 53 is preferably a low frequency band which can reach a long distance, and is installed in the user's residence A where the refrigerator 51 is installed together with the router device 55.

  The gateway device 54 is also configured to establish communication connection with the display terminal 15 via the router device 55. That is, the gateway device 54 is configured such that communication (first communication) can be performed only via the router device 55 without passing through the display terminal 15 and the Internet 56.

  The gateway device 54 is further configured to be connectable to the Internet 56 via the router device 55. Thus, the gateway device 54 can communicate (second communication) with the display terminal 15 via the Internet 56 and the router device 55 and can also communicate with the server device 57.

  Therefore, the gateway device 54 communicates with the display terminal 15 not via the Internet 56 (ie, the first communication via only the router device 55) and via the Internet 56 (ie, via the Internet 56 and the router device 55). And the second communication) can be performed. The reason for this configuration will be described later.

  The server device 57 is prepared, for example, by the manufacturer of the refrigerator 51. The server device 57 manages information and the like necessary for access and authentication for the display terminal 15, the refrigerator 51, and the wireless adapter 53. For example, the server device 57 determines whether the identification information of the display terminal 15 included in the communication request signal matches the identification information of the display terminal 15 stored (registered) in association with the wireless adapter 53. Authenticate (determine). Then, the server device 57 authenticates the display terminal 15 to be accessed as a regular display terminal, and permits communication with the refrigerator 51 in the residence A, when the two match.

  Further, the server device 57 stores the image data of the food in the refrigerator transmitted from the refrigerator 51, the data for performing the energy saving operation, and the like. These data are transmitted to the display terminal 15 based on the data call signal from the display terminal 15. That is, the user can operate the display terminal 15 to display and check the food image data in the refrigerator on the display.

1-3. System Unit Configuration of Refrigerator FIG. 12 shows a system unit configuration of a refrigerator used for the above-described refrigeration system.

  12, the refrigerator 51 includes an interface (I / F) 58, a control unit 59, a storage unit 60, a door open / close detection unit 61, interior lighting lamps 34-1 and 34-2, and cameras 35-1 and 35. 2, a fan drive circuit 62, a compressor drive circuit 63, a blower fan 18, and a compressor 19 and receives power supply from an AC power supply 64 such as a commercial power supply in the residence A, for example.

  The interface (I / F) 58 exchanges data and the like between the wireless adapter 53 and the control unit 59 of the refrigerator 51.

  The control unit 59 controls the operation of the refrigerator. Further, the control unit 59 controls the cameras 35-1 and 35-2 and the in-compartment illumination lights 34-1 and 34-2 to photograph the food in the refrigerator, and temporarily stores the image data in the storage unit 60. It is stored and transmitted to the server device 57 of the Internet 56. Furthermore, if there is a request signal for prior transmission of image data from the display terminal 15 via the server device 57, it instructs the display terminal 15 to execute transmission via the server device 57 immediately after food imaging. The details will be described later.

  The storage unit 60 rewrites and stores, in addition to the identification code and the control program, the image data of the in-house food taken by the cameras 35-1 and 35-2 and the data for performing the energy saving operation.

  The internal lightings 34-1 and 34-2 are turned on / off controlled by the control unit 59 based on a signal from the door open / close detection unit 61, turned on when the door 10 is opened, and several seconds when the door 10 is closed. Turn off after a delay time of

  The cameras 35-1 and 35-2 are controlled by the control unit 59 based on a signal from the door open / close detection unit 61, and when the door 10 is closed, the camera captures images of food in the refrigerator. The details will be described later.

  The fan drive circuit 62 receives a control signal from the control unit 59 and controls driving of the rotation of the blower fan 18.

  The compressor drive circuit 63 receives a control signal from the control unit 59 and controls the driving of the compressor 19 such as the number of rotations.

  The blower fan 18 operates according to the control of the fan drive circuit 62 to generate an air flow for circulating cold air.

  The compressor 19 compresses a refrigerant (not shown) circulating in the refrigerator 51 according to the control of the compressor drive circuit 63.

1-4. Configuration of Server Device Next, a configuration example of the server device of the refrigerator system in the first embodiment will be described using FIG. Here, the configuration of the server device 57 in FIG. 11 is taken as an example.

  As shown in FIG. 13, the server device 57 includes a server interface 65, a server control unit 66, and a data storage unit 67.

  The server interface 65 is a communication unit that exchanges data etc. between the display terminal 15 and the router device 55 and the server device 57 via the Internet 56 under the control of the server control unit 66.

  The server control unit 66 controls the overall operation of the server device 57. The server control unit 66 also combines the image data of the food transmitted from the refrigerator 51 and stores it in the data storage unit 67, and when there is a signal of the advance transmission request of the image data from the display terminal 15, the data storage unit Every time the image data is transmitted from the refrigerator 51, the latest image data of the image data stored in 67 is transmitted to the display terminal 15, and the display terminal 15 is rewritten and updated. Of course, when the data call signal is transmitted from the display terminal 15 in a state where there is no signal of the advance transmission request of the image data, the latest image data stored in the data storage unit 67 is transmitted to the display terminal 15.

  The data storage unit 67 stores necessary data such as a management program and an application program for executing the refrigerator system. Furthermore, the data storage unit 67 rewrites and stores the latest data of the food image data transmitted from the refrigerator 51 under the control of the server control unit 66. The data storage unit 67 is configured of, for example, an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like.

  The server device 57 can be constructed as either a server constituted by a single large computer or a cloud type server constituted by a large number of computer groups.

<2. Operation>
Next, the operation of the refrigerator and the refrigeration system configured as described above will be described. In the following description, the same operations will be described with the same step numbers.

2-1. Food Shooting Operation 2-1-1. Photographing when the Door is Closed FIG. 14 is a flowchart showing an operation when photographing the food in the storage when the door 10 of the refrigerator 51 is closed.

  When the door 10 is opened to put food in and out (Y in step 1), the interior lighting lights 34-1 and 34-2 are turned on (step 2), and when the door 10 is closed (Y in step 3), Reduce the illuminance of the storage light 34-1, 34-2 (step 4), for a while, for example, after a few seconds have elapsed, activate the cameras 35-1, 35-2 to photograph the food in the storage (step 5) . Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerator 51 (step 6), and the interior lighting lamps 34-1 and 34-2 are turned off (step 7).

  Here, when photographing is performed with the illuminance of the in-chamber illumination lights 34-1 and 34-2 lowered at the time of photographing, it is preferable because the food can be clearly photographed. That is, when the food is photographed by lighting the interior lighting lights 34-1 and 34-2, the inner surface of the storage may be white, and the reflected light is strongly reflected to the food from the entire peripheral surface excluding the storage opening portion. (High intensity without splashing back into food), and the food becomes whitish, making it difficult to take clear pictures. However, if the illuminance of the interior lighting lights 34-1 and 34-2 is lowered as in the example described above, the influence of the reflected light from the inner surface of the storage can be significantly reduced, and a clear image can be taken. It will be.

2-1-2. Photographing at the Cold Room Cooling Operation FIG. 15 is a flow chart showing an operation at the time of photographing the food in the storage room at the cold room cooling time after the food in the refrigerator is put in and out.

  When the door 10 is opened to put food in and out (Y in step 1), the interior lights 34-1 and 34-2 are turned on (step 2), the door 10 is closed (Y in step 3), and the refrigerator compartment It is determined whether or not the cooling operation state of (step 8). If the blower fan 18 is ON, the damper 22 is open, and the refrigerator compartment is in the cooling operation, the illuminance of the interior lamps 34-1 and 34-2 is lowered as in the case of the door closing (step 4) And the cameras 35-1 and 35-2 are activated to photograph the food in the storage (step 5). Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerator 51 (step 6), and the interior lighting lamps 34-1 and 34-2 are turned off (step 7).

  Thus, even if condensation occurs due to the temperature difference between inside and outside the storage, for example, on the surface of the food newly put into the storage, this condensation is eliminated by the cooling operation by photographing during the cold storage cooling operation, It disappears. Therefore, imaging | photography by camera 35 -1, 35-2 is performed so clearly that the character currently described on the food packaging container can be read, and it is suitable.

  In the above operation, when the door 10 is closed (Y in step 1), the indoor lightings 34-1 and 34-2 are once turned off, and the indoor lightings 34-1 and 34 again before photographing. If the illumination is reduced by turning on the light by -2, it is possible to suppress wasteful consumption of power due to the in-chamber illumination lights 34-1 and 34-2 continuing to be turned on.

2-1-3. Photographing when the Door is Opened FIG. 16 is a flowchart showing the operation when photographing the food in the storage when the door 10 is opened by a predetermined angle, in the case of a single-sheet door.

  When the door 10 is opened to put food in and out (Y in step 1), the interior lighting lights 34-1 and 34-2 are turned on (step 2), and the opening angle of the door is a predetermined angle, for example, FIG. When the opening angle shown is 30 degrees (Y in step 10), the illuminance of the interior lighting lights 34-1 and 34-2 is lowered (step 4), and the cameras 35-1 and 35-2 are activated to store the storage area. Shoot the food inside (Step 5). Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerator 51 (step 6), and when the door is closed (Y in step 11), the interior lighting lights 34-1 and 34-2 are turned off (step 7) .

  If, as in this example, the door 10 is opened at a predetermined angle, as described above, the inside of the storage 5 can be photographed extensively, and the image becomes natural without discomfort. It is.

  In addition, when imaging | photography at the time of predetermined angle opening, imaging | photography will be performed at least 2 times or more at the time of door opening operation and door closing operation. At this time, by storing the image data (at the time of door closing operation) taken at the end in the operation time from one opening and closing of the door to the storage unit 60, the latest storage of food that has finished loading and unloading Food status can be taken.

  As a matter of course, in step 10 of detecting whether the opening angle of the door 10 reaches a predetermined angle, if the door 10 is closed before reaching the predetermined angle, the in-compartment lamp 34-1 , 34-2 will turn off and wait for the door 10 to be opened again.

  As described above, representative examples of the photographing operation have been described by way of example. However, in addition to the photographing operation, for example, photographing is performed when a predetermined time elapses after timed or last photographing, or when photographing is instructed from the display terminal 15 A shooting operation such as

2-1-4. Illumination at the time of photography As the food illumination at the time of photography, as already described in the above-mentioned FIG. 14, FIG. 15, FIG. Irradiate and shoot. Depending on the case, it may be considered that the illumination is lowered and photographed as lighting of only the indoor lighting 34-1 on both sides of the storage or the indoor lighting 34-2 on the upper surface of the storage. The reason for reducing the illuminance and shooting will be described later.

  Further, as another example of food irradiation at the time of photographing, the following may be considered. That is, FIG. 17 is a flowchart showing the state of turning on / off of the interior lighting lamps 34-1 and 34-2 at the time of photographing by the cameras 35-1 and 35-2, which is the above-mentioned FIG. 14, FIG. This corresponds to the operation of the broken line portion.

  The above-mentioned photographing in FIG. 14, FIG. 15, and FIG. 16 is an example in which the illumination is reduced after lighting the interior lighting lamps 34-1 and 34-2, and in this example, both sides of the storage are The food is irradiated and photographed in a state where only one side of the storage lighting 34-1 on both sides of the storage is turned on while the lighting of the storage lighting 34-1 on the surface is turned off. In this case, the in-chamber illumination light 34-2 on the upper surface of the storage may be turned on or off, but any one may be selected as appropriate so that the illuminance in the chamber becomes optimal for photographing.

  In FIG. 17, before starting photographing by the cameras 35-1 and 35-2, any one of the indoor lightings 34-1 on both sides of the storage, which are already on, for example, the right internal lighting is turned off ( Step 12) Photographs (step 13) and stores the food irradiated with the left in-box illumination light (step 14). Thereafter, the right in-box lamp is turned on (step 15), and then the left in-box lamp is turned off (step 16), and the food in the state of being illuminated with the right in-box lamp is photographed (step 17) ). The image data is stored (step 18), and the right internal lamp is turned off (step 19). As described above, the image data stored by irradiating the food from one side and storing it is combined into one image and stored.

  As described above, the reason why the interior lightings 34-1 and 34-2 are lit one by one to photograph the food and combine them into one is as follows. That is, as described above, shooting is performed by reducing the illuminance of the interior lighting lamps 34-1 and 34-2 at the time of shooting, but if the illuminance reduction is too large, the image becomes dark and lacks clarity There is also a limit to the decrease in illuminance. Therefore, although the illuminance is maintained to some extent, the influence of the reflected light may remain even if the illuminance is small if the volume inside the storage is small. However, as described in this example, if the left and right ones of the in-chamber illumination light 34-1 are turned on to photograph the food, the influence of the reflected light can be reduced, and the in-chamber illumination light 34-1 turns on. You can shoot with the appropriate brightness on the side you are using. Therefore, if a combination process is performed to combine the left and right images of food taken at this appropriate brightness, the entire image becomes clear, which is preferable.

2-2. Storage and Combining of Images Next, storage and combining of image data captured by the above-described operations will be described.

FIG. 18 shows a case where image data is stored and combined by the server device 57, and when the inside of the storage is photographed by the operation shown in FIG. 14 to FIG. 16 including FIG. The refrigerator 51 is connected to the Internet 56 from the wireless adapter 53 through the gateway device 54 and the router device 55 (step 20), and the individual image data captured and stored by each camera is connected to the server device 57 connected to the Internet 56. Send (step 21). The image data transmitted via the Internet 56 is subjected to combining processing (step 22) for combining the individual image data by the server control unit 66 of the server device 57. The image data subjected to the combining process is stored in the data storage unit 67 of the server device 57 (step 23).

  As in this example, by combining the image by the server device 57 and storing and storing it, the load on the control unit 59 and the storage unit 60 on the refrigerator side can be reduced, and the Internet compatible refrigerator can be made inexpensively. Can be provided.

19 shows the case where image data is stored and combined on the refrigerator side, and the inside of the storage is photographed by the operation shown in FIG. 14 to FIG. 16 including FIG. The control unit 59 of the refrigerator 51 takes out the individual image data from each camera stored in the storage unit 60, combines them, and combines them (step 24). The combined image data is stored (step 25), the refrigerator 51 is connected to the Internet 56 from the wireless adapter 53 via the gateway device 54 and the router device 55 (step 20), and the stored image data is connected to the Internet 56 It transmits to the server device 57 (step 21). The composite image data transmitted via the Internet 56 is stored in the data storage unit 67 of the server device 57 (step 23).

  In this example, the load on the control unit 59 and the storage unit 60 on the refrigerator side increases, but image data can be transmitted to and received from the display terminal 15 without the intervention of the data storage unit 67 of the server device 57. Can be

2-2-3. FIG. 20 shows a case where image data is stored and combined on the display terminal 15 side, and when the inside of the storage is photographed by the operation shown in FIG. 14 to FIG. 16 including FIG. Connects to the Internet 56 from the wireless adapter 53 via the gateway device 54 and the router device 55 (step 20), and transmits the image data to the display terminal 15 instead of the server (step 26). The image data transmitted via the Internet 56 is subjected to combining processing (step 27) for combining the image data by the display terminal 15. The composited image data is stored in the data storage unit of the display terminal 15 (step 28).

  Also in the case of this example, although the load on the display terminal 15 increases, the load on the control unit 59 on the refrigerator side and the storage unit 60 can be reduced, and the Internet compatible refrigerator can be provided at low cost.

  As mentioned above, although a typical thing was illustrated and explained about transmission of image data, and composition operation, the preservation and composition part must not necessarily be performed in the same part, for example, server apparatus 57, for example, refrigerator 51 The image data may be synthesized in accordance with the above, and the image data may be stored in the server device 57, etc. according to the system.

2-3. Normal Transmission and Reception of Image Data 2-3-1. Transmission / reception of image data stored in server or refrigerator FIG. 21 is a flowchart showing transmission / reception between the server device 57 or the refrigerator 51 and the display terminal 15, showing transmission / reception of image data stored in the server device 57 or the refrigerator 51. is there.

First, the user presses a server connection button (not shown) displayed on the display of the display terminal 15 at, for example, a shopping destination, and makes a read request for image data stored in the data storage unit 67 of the server device 57 ( Step 31). It is detected whether the image data has been fetched from the server device 57 (step 32), and if the image data is not transferred, the display terminal 15 is connected to the Internet 56 (step 33). The image data stored in the data storage unit 67 of the server device 57 or the storage unit 60 of the refrigerator is taken out (step 34), and the image data is sent via the Internet 56 to the display terminal 15 such as a smartphone which is the data caller (Step 35). It is detected whether the image data has been taken in from the server device 57 (step 32), and when the image data is taken in, the image data is output to the display of the display terminal 15 (step 36).
Thereafter, it is detected whether or not the enlargement button (not shown) displayed on the display of the display terminal 15 is pressed (step 37), and when it is detected that the enlargement button is pressed, Image data is enlarged by 1.1 times or more by digital conversion to create image data. The enlarged image data is output to the display of the display terminal 15 (step 36).

  Thereafter, it is detected whether the ten key button (not shown) displayed on the display is pressed (step 38), and when it is detected that the ten key button is pressed, the enlarged image data in the storage output to the display is displayed. Image data of a portion designated by the ten key button is output to the display (step 36). Further, it is detected whether the ten key button has been pressed (step 38). Exit if not detected.

  The enlargement button and the ten-key button for displaying image data of a predetermined location may be a method of sliding the surface of the display with a finger, and with such a configuration, usability is improved.

  As described above, according to this refrigerator system, the contents of the refrigerator 51 can be confirmed at a glance at the shopper, and it is possible to prevent forgetting to buy, and it is possible to eliminate the waste of purchasing extra food. . In addition, in the case of a dual-working family, it is possible to check the inside of the storage 5 of the refrigerator 51 just before leaving home and purchase food and the like on the way home, thereby shortening the time for the user.

  Also, by displaying an image on an enlarged display terminal 15 such as the display terminal 15 by making the enlarged display and the predetermined location display possible, foodstuffs which are difficult to be confirmed by the small display terminal 15 can be assuredly displayed. I can see it.

2-3-2. Transmission and Reception of Image Data Stored on Display Terminal FIG. 22 shows the case where image data has already been stored and stored on the display terminal 15. In this case, as described in FIG. 24, the image data is transmitted to the display terminal 15 and stored, and a request for reading the image data is made (step 31), and the image data is fetched from the storage unit of the display terminal 15. The image data is output to the display of the display terminal 15 (step 36). The subsequent enlargement display operation and local display are as described in FIG.

2-3-3. Switched Reception of Image Data The images captured by the cameras 35-1 and 35-2 are captured images of the individual cameras 35-1 and 35-2 (upper half or lower half in the storage) and the respective captured images. An example is shown in which a combined image combined (combined image from the top to the bottom in the storage) is stored and stored, and these images can be switched, transmitted and received, and displayed on the display terminal 15.

  FIG. 23 is a flowchart showing the operation in such a case.

  First, the user presses an individual image / synthetic image call-in button (not shown) displayed on the display of the display terminal 15 (step 41), and calls an image of either the individual image or the synthetic image (step 42). ). Thereafter, either the image data of the individual image or the composite image is fetched according to the flow shown in FIG. 25 or 26, and displayed on the display of the display terminal 15.

  If it is possible to switch the image to be displayed on the display terminal 15 to either an individual image or a composite image as in this example, usually the situation of food in the storage can be confirmed at a glance by displaying the composite image. If the food is difficult to distinguish due to being in the corner of the storage, etc., it can be reliably discriminated by switching to an individual image and the usability can be improved.

2-4. Transmission / reception at the time of prior transmission request of image data etc. FIG. 24 shows a flowchart when there is a prior transmission request of an image from the display terminal 15.

  First, the user operates the display terminal 15 to request the advance request signal (step 51). The server device 57 or the refrigerator 51 receives the request signal (step 52), reads and transmits the image data (individual image data or composite image data, the same applies hereinafter) stored in the data storage unit 67 or the storage unit 60 (step 53). The display terminal 15 detects whether the image data has been fetched from the server device 57 or the refrigerator 51 (step 54), and if the image data is not transmitted, the display terminal 15 is connected to the Internet 56 (step 55). The server device 57 takes out the image data stored in the refrigerator 51 (step 56), and transmits the image data to the display terminal 15 via the Internet 56 (step 57). It is detected whether the image data has been fetched from the server device 57 (step 54), and when the image data is detected, the process waits until the image data is called (N at step 58). If the image data is called (Y at step 58), the image data is output to the display of the display terminal 15 (step 59).

  As a result, when image data is requested by the display terminal 15, even when access to the server device 57 is concentrated and transmission of the image data from the server device 57 is delayed, the image data is requested in real time simultaneously with the image data request. Can be displayed on the display to confirm the image. Therefore, it is possible to avoid waiting for display of image data at the shopper, and to shorten the shopping time.

  In addition, if there is a request for prior transmission of an image from the display terminal 15, the server device 57 is set to transmit image data transmitted each time the door 10 of the refrigerator 51 is closed to the display terminal 15. If the user who holds the image data is set to be left when the image data is transmitted, it can be known each time the door is opened or closed. Therefore, for example, when the number of times of door opening and closing is increased and the power consumption is likely to be increased, the user can call home and talk to children, etc. to refrain from using the refrigerator 51. Convenience also improves.

2-5. Switching of Transmission and Reception Routes of Image Data etc. FIG. 25 shows a display displayed when a communication channel of the display terminal 15 is selected. Although the flow of transmission and reception of image data is as described above, the route of communication is changed to speed up the acquisition of image data.

  Specifically, it is possible to select whether the user directly performs the display terminal 15 with the gateway device 54 via the router device 55 or with the server device 57 via the Internet 56.

  In FIG. 25, 70 and 71 are selection buttons for the communication path displayed on the display of the display terminal 15, and 70 is a “direct” selection for connecting the display terminal 15 directly to the refrigerator 51 via the router 55 and the gateway 54. A button 71 is a "server" selection button connected to the server device 57 or the refrigerator 51 via the Internet 56. 72 and 73 are data selection buttons of data to be called, 72 is image data of food, 73 is a button of energy saving related data such as the number of times of door opening and closing. 74 is a transmission button.

When the “direct” selection button 70 selects this, the display terminal 15 is set to “direct” communication. When the user touches the send button 74 in a state in which “direct” communication is set, the image data request signal of the display terminal 15 is directly transmitted from the display terminal 15 to the gateway device (relay device) 54 via the router device 55. Will be sent. The gateway device 54 transmits the received data request signal to the wireless adapter 53 of the refrigerator 51. When the wireless adapter 53 receives the image data request signal, the wireless adapter 53 transmits the signal to the control unit 59 of the refrigerator 51. When receiving the image data request signal, the control unit 59 of the refrigerator 51 reads the image data stored in the storage unit 60, and transmits the image data to the display terminal 15 via the wireless adapter 53 and the router device 55.

  Therefore, when the user is located in the residence A as shown by the broken line in FIG. 11, in a broad sense, when the display terminal 15 exists at a position where it can directly communicate with the router 55, the display terminal 15 is the router 55. The image data can be directly obtained from the storage unit 60 of the refrigerator 51 through communication with the gateway device 54 via the

  Thus, when a delay occurs in the transmission response of the image data in response to the user's operation to the display terminal 15 due to congestion of the line due to the concentration of access to the Internet 56, the user By switching to the “direct” communication, image data can be acquired without receiving congestion on the Internet 56 line. Therefore, the user can display the image on the display of the display terminal 15 in real time without waiting time, and can confirm the food condition in the storage 5.

  On the other hand, as shown by the solid line in FIG. 11, when the user is located outside the residence A, in a broad sense, when the display terminal 15 exists at a position where direct communication with the router 55 can not be performed, the user selects the "server" selection button By touching 71, the display terminal 15 communicates with the server device 57 via the Internet 56, and reads the image data of the refrigerator 51. That is, when the user is outside the residence A, if the "server" selection button 71 is touched to set the "server" communication, the image data of the refrigerator is acquired by the display terminal 15 even if it is at a remote place. You can know the storage situation of the.

  Thus, in the refrigerator system in this embodiment, the user can select either "direct" communication or "server" communication, and if the user is in residence A, the user may select "direct". By selecting the communication, the user can view the image in a comfortable state without being affected by the congestion of the internet connection.

  As mentioned above, although the specific structure was illustrated and the refrigerator and refrigerator system of this invention were demonstrated, this invention is not limited to the said structure.

  For example, although the gateway device 54 is illustrated in the communication path between the display terminal 15 and the wireless adapter 53 of the refrigerator 51 and the Internet 56 in the above embodiment, the gateway device 54 is not necessarily required. It may be configured to communicate directly with the display terminal 15 and the wireless adapter 53 of the refrigerator 51, and the Internet 56, thereby simplifying the system configuration.

  In the above embodiment, when the user is outside the residence A, the image data is acquired from the server device 57. However, without the server device 57, the display terminal 15 can use the Internet 56, the router device 55, and the gateway device. The image data stored in the storage unit 60 of the refrigerator 51 may be directly taken in from the refrigerator 51 by communicating with the communication unit 54. In this case and when performing "direct" communication, it is preferable to perform image combining processing in the storage unit 60 of the refrigerator 51 and to transmit the image data after this combining processing.

  Furthermore, in this embodiment, an example is shown in which the “direct” selection button 70 and the “server” selection button 71 are displayed on the display of the display terminal 15 and the user selects “direct” communication and “server” communication. However, this may have the function of automatically switching to “direct” communication when the display terminal 15 catches the radio wave of the router device 55 so that “direct” communication may be automatically selected, which is convenient. It can be improved.

<3. Action effect>
As described above, the refrigerator and the refrigerator system according to the embodiment of the present invention perform various effects as described with the specific configuration, but the refrigerator which is the gist of the present invention, that is, the center pillar of the French door By providing the camera at the door open end opposite to the door, it is possible to improve the reliability of the imaging device for imaging the inside of the storage and to provide a refrigerator that can withstand long-term use.

  That is, the imaging device provided at the open end of the door applies an impact acting in the closing direction of the center pillar that rotates in conjunction with opening and closing of the door to the imaging device provided at the open end of the other door. As a result, the impact of the center pillar on an imaging device such as a camera can be eliminated to improve the reliability of the imaging device, and a highly reliable refrigerator that can endure long-term use can be obtained.

  In addition, by providing a camera at the door open end opposite to the door having the center pillar of the French door, the influence of the noise by the heater in the center pillar is reduced, thereby preventing the malfunction of the camera and reducing the noise. The wiring configuration for removing can be simplified.

  Moreover, in the refrigerator of this embodiment, the cameras 35-1 and 35-2 capture the food in the storage 5 from the front side of the storage 5, but at this time the storage lights 34-1 and 34-2 are also stored. It is provided on the front side of 5 and irradiates the food in the storage 5 from the same front side as the photographing direction by the cameras 35-1 and 35-2. Therefore, the photographed image has no darkness and difficulty as seen in the case where the indoor lightings 34-1 and 34-2 are provided on the back wall of the storage 5, and becomes a clear image. In addition, it is not necessary to require the server device 57 to perform image processing to brighten and sharpen a captured image.

  Further, since the cameras 35-1 and 35-2 and the indoor lighting lamps 34-1 and 34-2 are provided on the front side of the front end of the shelf boards 30-1 to 30-4, The images in the storage 5 taken by the cameras 35-1 and 35-2 are the same as when the user opens the door 10 of the refrigerator 51 and actually looks at it. Therefore, when the user tries to display the image data on the display terminal 15, it is possible to confirm the food condition in the storage 5 without having any sense of incongruity. Moreover, since the interior lighting lamps 34-1 and 34-2 illuminate the food on the shelf board from the front end front of the shelf boards 30-1 to 30-4, they are mounted on the front end portions of the shelf boards 30-1 to 30-4. Foods placed can also be photographed brightly and clearly.

  Further, since the cameras 35-1 and 35-2 are provided on the inner surface of the door 10 of the refrigerator 51 so as to be located substantially at the center of the right and left sides of the storage 5, they are photographed by the cameras 35-1 and 35-2. The user can open the door 10 of the refrigerator 51 and make it look closer to the state in which the user actually views the image. In addition, the distance between the cameras 35-1 and 35-2 and the food on the shelf can be increased to capture a wide range in the storage 5, and the display status of a wider range of food can be displayed. It becomes possible to confirm at 15. Furthermore, for the topmost part of the storage 5 which is relatively difficult to show when the cameras 35-1 and 35-2 are provided on the inner surface of the door, a compressor 19 is provided in this example so that the topmost part protrudes forward. Therefore, this part can also be photographed with certainty, and the compressor 19 is provided in the upper part of the main body to improve the storage volume of the lower part of the main body, and the photographing by the cameras 35-1 and 35-2 should be good. Can.

  In addition, since the cameras 35-1 and 35-2 are provided so as to be located substantially at the center of the door pockets 33-1 and 33-2 on the inner surface of the door in the front-rear direction, not only food in the storage 5 but also door pockets A part of food stored in 33-1, 33-2 such as a milk pack can also be photographed. Since the user stores it by himself, even if only a part of it is shown, he can recognize what it is. Therefore, it is possible to photograph almost all the food in the storage.

  Further, as shown in FIG. 9A, if the camera 14-3 dedicated to the storage container is provided, the food in the storage container 31 can be clearly photographed. Furthermore, as shown in FIG. 9 (b), the camera 35-2 can be moved up and down, or as shown in FIG. 9 (c), the food in the storage container 31 is also two cameras. It is possible to shoot efficiently with a small number of cameras.

  On the other hand, the interior lighting lamps 34-1 and 34-2 are provided at positions behind the cameras 35-1 and 35-2 as is apparent from FIG. 7, and the interior lighting lamps 34-1 and 34-2 are provided. Light of the interior illumination lights 34-1 and 34-2 enter the cameras 35-1 and 35-2 so that they do not directly enter the imaging units of the cameras 35-1 and 35-2. It is possible to prevent the deterioration of the images of the cameras 35-1 and 35-2, and always obtain a good image. This means that a light shielding portion is provided on the camera side of the interior lighting lamps 35-1 and 35-2, or the light sources such as LEDs constituting the interior lighting lamps 34-1 and 34-2 are inclined obliquely backward. Similar effects can be obtained by adopting a configuration such as arranging.

  Further, the illumination in the storage 34-1 and 34-2 has an illuminance in the storage of 150 lux to 200 lux, and when photographing with the illuminance as it is, the food becomes whitish as described in the photographing operation of FIG. It will be difficult to identify the subject. Therefore, in this embodiment, it is configured to lower the illuminance and shoot. Thereby, even a CCD camera or a CMOS camera enables clear photography with appropriate brightness. The illuminance of the interior lamps 34-1 and 34-2 is controlled by the server control unit 66 so that the illuminance is lower than normal only when the door 10 is closed or the door 10 is opened and photographed. By such control, it is possible to make clear photographing possible while keeping the illumination as usual so as to make the inside of the storage easy to view in the normal state where the photographing is not performed. The decrease in the illuminance may be caused, for example, by turning off part of the interior lighting lamps 34-1 and 34-2 of either or both of the interior lighting lamps 34-1 and 34-2, or both interior lighting There are various considerations, such as lowering the illuminance of the lights 34-1 and 34-2, which may be selected as appropriate.

  Moreover, the image in the storage 5 image | photographed with said camera 35-1, 35-2 transmits the image of each camera 35-1, 35-2 to the server apparatus 57, and the server apparatus 57, or the refrigerator 51, or Although combining processing and combining are performed in the display terminal 15, in this embodiment, the above-described combining processing of images is facilitated.

  That is, the cameras 35-1 and 35-2 are the inner surface of the door corresponding to the front ends of the shelf plates 30-1 to 30-4, and in this example, the upper shelf plate 30-1 and the third shelf plate 30-. Since the camera 35-1 and 35-2 are provided on the inner surface portion of the door corresponding to the front end of 3, the center of the shelf plates 30-1 and 30-3 whose line Z in FIG. Will be taken as.

  Therefore, the image data in the storage 5 captured by the two cameras 35-1 and 35-2 can be combined and processed by the shelf plate 30-2 where the boundary line is formed. That is, as shown in the "photographed raw image" of FIG. 30, the shelf board 30-2 is common to each of the upper and lower images, and the curvature of the "photographed raw image" is corrected to "after the curvature correction processing" If the common shelf board 30-2 transferred to the upper and lower images is made to coincide with the image, then the photographed image of the entire storage will be obtained. As a result, it is not necessary to perform extremely difficult correction processing in which each food placed on the shelf during image combining processing is aligned and combined for each food, and image combining processing is easy. Become. Therefore, the processing program for image combination can be simplified, and the server device 57 for image combination processing, the refrigerator 51, or the control portion of the display terminal 15 also needs a large capacity. Can contribute to speeding up of processing speed.

  Further, since the two cameras 35-1 and 35-2 are provided at substantially the front positions of the shelf board 30-1 and the shelf board 30-3 which can not be adjusted in height, the height adjustable shelf board 30- Even when the height 2 is changed, the image combining process can be easily performed by adjusting the range of the combining process according to the height of the shelf plate 30-2 at the time of the image combining process.

  The present invention can improve the reliability of a photographing device for photographing the inside of a storage, and can provide a highly reliable refrigerator that can endure long-term use. Apply to refrigerators in chain stores such as convenience stores (in the present invention, it also includes a freezer), the convenience store headquarters checks the food situation in the refrigerator of each convenience store, and the food is delivered automatically Also, it can be applied for business use in which food, goods, etc. in a refrigerator installed in each facility such as a factory or a research laboratory are confirmed by a material department and automatically delivered.

1 refrigerator main body 2 outer box 3 inner box 4 heat insulating material 5 storage (cold storage room)
6 Switching Room 7 Ice Making Room 8 Freezing Room 9 Vegetable Room 10 Door 10a Cover Panel 10a-1 Glass Plate 10a-2 Magic Mirror 10b Inner Plate 10b-1, 10b-2 Raised Wall 11 Center Pillar 12a, 12b, 13, 14 drawer type door 15 display terminal 15a display 16 cooling room 17 cooler 18 air blower fan 19 compressor 20 heat radiation pipe 21 capillary tube 22 damper 23 storage frame 24 terminal holder 25 touch panel 26 gap 27 frame 28 recess 29, 29a smoked sheet 30-1 to 30-4 Shelf plate 31 Storage container 32-1 to 32-4 Side wall convex portion 33-1 to 33-8 Door pocket 34-1 and 34-2 Interior lamp (illumination device)
35-1, 35-2, 35-3 Camera (shooting device)
41 Camera Module 50 Refrigerator System 51 Refrigerator 53 Wireless Adapter (Communication Device)
53a "Connect" button 54 Gateway device (relay device)
55 router device 56 Internet 57 server device 58 interface (I / F)
59 Controller (control unit)
60 storage unit 61 door open / close detection unit 62 fan drive circuit 63 compressor drive circuit 64 AC power supply 65 server interface 66 server control unit 67 data storage unit 70 "direct" selection button 71 "server" selection button 72 image data selection button 73 energy saving Related data selection button 74 Send button A

In order to achieve the above-mentioned object, the present invention comprises at least one storage, and a double door for closing the storage constituted by a first door and a second door, and the first door is provided with a center It is a refrigerator provided with a pillar and provided with a photographing device for photographing the inside of the storage of the storage in the second door, and provided in the storage of the storage based on the fact that the door of the door is opened. First control means for lighting the lighting device, second control means for causing the imaging device to perform imaging based on the fact that the door is closed, and imaging by the imaging device is completed in particular on the basis, and a third control means for turning off the lighting device, maintains the state imaging by the imaging device from at least the double doors door is closed until the completion, the lighting device that illuminates There as configuration.

Claims (8)

The first door is provided with a center pillar, and the second door is provided with at least one storage and a double door for closing the storage constituted by a first door and a second door. A refrigerator provided with a photographing device for photographing the inside of the storage, the lighting device provided in the storage of the storage being turned on based on the fact that the door is open And the second control means for causing the photographing device to execute photographing based on the closing of the door and the lighting device is turned off based on the completion of photographing by the photographing device. And third control means for The second control means causes the photographing device to execute photographing after lowering the illuminance of the lighting device to be lower than the illuminance when the double door is opened. The refrigerator described in. The refrigerator according to claim 1, wherein the lighting device is provided on a top surface of the storage. The refrigerator according to claim 1, wherein the lighting device is provided on a side wall of the storage. The refrigerator according to claim 1, wherein the lighting device is provided on a top surface of the storage and a side wall of the storage. The refrigerator according to any one of claims 1 to 5, further comprising a wireless communication unit that transmits an image captured by the imaging device to the outside. The refrigerator according to claim 6, wherein the wireless communication unit transmits an image captured by the imaging device to the outside after the lighting device is turned off. The first door is provided with a center pillar, and the second door is provided with at least one storage and a double door for closing the storage constituted by a first door and a second door. A control method executed by a refrigerator provided with a photographing device for photographing the inside of the storage of the storage, the lighting device being provided in the storage of the storage based on the fact that the open door is opened On the basis of the first control step of turning on the light, the second control step of causing the photographing device to execute photographing based on the fact that the door is closed, and the fact that photographing by the photographing device is completed, And D. a control step of turning off the lighting device.

Images