KR20190039023A - dish washer - Google Patents

Abstract

The present invention relates to a storage object detecting apparatus for taking a stored object stored in a movable storage section and a storage section and obtaining storage information including at least one of the position, size and quantity of the stored object based on the picked- And is useful as a detection method. Further, the present invention proposes a dishwasher capable of determining at least a storage area of a tableware stored in a tableware storage basket. Since the number of the feature points can be estimated at least at the position of the basket, even when the detection display is provided as a feature point separately from the structure normally provided in the basket, it is not necessary to install a large number of detection displays, thereby improving the beauty of the dishwasher. Further, since the configuration normally provided in the basket can be used as a feature point, it is not necessary to separately install a detection display, so that the beauty of the dishwasher can be improved.

Description

dish washer

The present invention relates to a dishwasher including a basket position estimating device, a stored object detecting device and a stored object detecting method.

Patent Document 1 (U.S. Patent No. 8696827) discloses an image pickup apparatus that photographs a stored object stored in a movable storage section and a storage section, and stores the received storage information including the position of the object stored in the storage section, A water detecting device is disclosed. In this stored-object detecting apparatus, a position display is provided for each predetermined area on the side of the storage section, and the position of the stored object placed in the storage section of the spot taken on the shot image is specified based on the position display included in the shot image .

Further, in the conventional dishwasher, after a predetermined amount of washing water is supplied, the water temperature is raised until the predetermined water temperature is reached by the heating means, the amount of the tableware is judged from the time required for the water temperature rise at that time, The washing operation and the rinsing operation to be performed later are controlled optimally according to the amount of tableware (see, for example, Patent Document 2 (Japanese Unexamined Patent Publication No. 10-014849)).

Further, the weight sensor senses the amount of the tableware stored in the tableware storage basket, and the degree of dirtiness of the tableware is detected by the degree of dirtiness of the washing water, thereby optimally controlling the washing operation and the rinsing operation thereafter (See, for example, Patent Document 3 (Japanese Patent Application Laid-Open No. 04-312434)).

However, the stored object detecting device disclosed in Patent Document 1 has a structure in which the position indication is provided for each predetermined area in the side portion of the storage portion, so the appearance of the storage portion is bad. In addition, since the position in the storage portion of the spot on the captured image must be specified by the accuracy in accordance with the interval of the position display, the accuracy of the stored information obtained can not be sufficiently increased.

In the dishwasher disclosed in Patent Document 2, since the time required for raising the water temperature greatly varies depending on the material and shape of the tableware to be cleaned and the temperature of the tableware when the dishware is received in the dishwasher, it is difficult to accurately determine the amount of tableware .

Also in the dishwasher disclosed in Patent Document 3, it is not possible to determine the correct amount of tableware due to the material, the shape of the tableware to be cleaned, and the measurement accuracy of the weight sensor. In addition, even if the tableware is housed in a part of the tableware storage basket, it can not be detected, and the entire area of the tableware storage basket must be cleaned irrespective of the amount of the tableware to be judged, .

In order to solve the above-described problems, one aspect of the present invention aims to improve the appearance of the storage portion on which the basket position estimating device is mounted, and also, in the stored-matter detecting device and the stored- A second object of the present invention is to provide a dish washer capable of detecting at least a storage area of a tableware housed in a tableware storage basket with high accuracy and determining the accuracy of storage information obtained, This is the third purpose.

In addition, the present invention does not necessarily satisfy the above three purposes at the same time.

To this end, the dishwasher according to one aspect of the present invention includes a washing tub; A storage unit installed in the washing tank and storing dishes; A photographing unit for photographing a tableware housed in the storage unit; And a processor for detecting a feature point from the image photographed by the photographing section and detecting the position of the storage section according to the detected feature point to detect the position of the table.

The processor detects storage information including at least one of the position, size and quantity of the tableware based on the image photographed by the photographing section.

The feature point is a position recognition mark provided in the storage portion, and the position recognition mark is composed of a character, a symbol, a saturation, a brightness or a pattern, or a combination thereof.

The storage portion is provided in the cleaning tank so as to be drawn out through the opening of the cleaning tank, and the photographing portion is installed around the opening portion of the cleaning tank to photograph the portion drawn out from the cleaning tank.

The dishwasher according to one aspect of the present invention further includes a door for opening and closing the opening portion, wherein the door is provided with a position identifying pattern, and the processor detects the position identifying pattern from the image photographed by the photographing portion , And detects the placement area in which the tableware is housed using the pattern for position identification.

The photographing section photographs the storage section for each drawing position of the storage section, and the processor selects the last image necessary for detecting the tableware from the plurality of images picked up from the picked-up section, At least one of the shape of the tableware and the type of tableware is detected.

The dishwasher according to one aspect of the present invention further includes a cleaning unit for cleaning the tableware, and the processor controls the cleaning unit to selectively clean the area where the tableware is disposed.

The processor adjusts the cleaning time to selectively clean the area in which the tableware is disposed.

The photographing section includes a camera, an area sensor or a line sensor.

According to another aspect of the present invention, there is provided a dishwasher including: a washing tub; A receiving portion movably installed in the washing tub and accommodating the dishes; A photographing unit for photographing a tableware housed in the storage unit; And a processor for detecting at least one of the position, size and quantity of the tableware based on the image photographed by the photographing section, wherein the storage section is provided with a feature point for position recognition, And detects a position of the tableware by recognizing the position of the storage portion according to the detected characteristic points.

One or more minutiae are displayed in the storage section. The processor detects a predetermined display from the photographed image, recognizes the position of the storage section based on the position of the display, Information.

The processor detects the display based on at least one of the outline of the displayed display, the color, the character and the graphic.

According to another aspect of the present invention, there is provided a dishwasher including: a washing tub having an opening; A storage unit installed in the cleaning tank so as to be drawn out through the opening, And a processor for measuring a draw-out amount drawn out of the storage section from the cleaning tank and detecting the position of the storage section according to the measured draw-out amount.

The processor includes a distance image sensor, a winder, a weight sensor or a camera.

The dishwasher according to another aspect of the present invention further includes a photographing section photographing the shape of the storage section, wherein the processor compares the photographed image with a previously stored image, Size and quantity of storage information.

According to the proposed basket position estimating apparatus, since the number of feature points can be estimated at least at the position of the basket, even when a detection display is provided as a feature point separately from a structure normally installed in a basket, The beauty of the washing machine can be improved. Further, since the configuration normally provided in the basket can be used as a feature point, it is not necessary to separately install a detection display, so that the beauty of the dishwasher can be improved.

According to the proposed stored-matter detecting device and the stored-object detecting method, since the position in the storage portion can be specified at least at the position where the number of displays is recorded in the detection image, the detection display is displayed separately from the structure normally installed in the storage portion It is possible to reduce the number of displays as compared with the case where the display is provided for each area as in Patent Document 1. [ Therefore, the appearance of the receiving portion can be improved. Further, since the configuration normally provided in the storage portion can be used as a display, there is no need to separately install a detection display, so that the appearance of the storage portion can be improved. In addition, since the position of the storage portion at the position where the number of displays is at least recorded in the detection image can be specified with high accuracy, the accuracy of the storage information obtained can be improved without deteriorating the appearance of the storage portion.

Further, according to the proposed dishwasher, at least the storage area of the tableware housed in the tableware storage basket can be sensed with high precision.

1 is a block diagram showing a configuration of a basket position estimating apparatus according to a first embodiment of the present invention.
2 is a schematic perspective view of a dishwasher provided with a basket position estimating apparatus according to a first embodiment of the present invention in a state in which a door is opened and a part of a lower basket is drawn out.
3 is a schematic perspective view showing the bottom basket shown in Fig.
4 is an operation flowchart showing a basket position estimation method using the basket position estimation apparatus according to the first embodiment of the present invention.
5 is a plan view showing an identification pattern to be applied to the handle of the lower basket.
Fig. 6 is a plan view showing the verification pattern of Fig. 5. Fig.
7 is a schematic plan view showing characteristic points defined by a display in the lower basket.
Fig. 8 is a schematic plan view showing other minutiae defined as indicia in the lower basket. Fig.
Fig. 9 is a sectional view of a dishwasher provided with a stored object detecting device according to a third embodiment of the present invention in a state in which the door is closed;
Fig. 10 is a view showing a state in which the lower basket is pulled out by opening the door of Fig. 9. Fig.
11 is an explanatory view showing a captured image in a state in which the lower basket is pulled out by opening the door.
Fig. 12 is a view showing a state in which the door of Fig. 11 is opened and a part of the lower basket is taken out.
13 is a flowchart showing the operation of the dishwasher provided with the stored-matter detecting device according to the third embodiment of the present invention.
14 is a schematic plan view of a storage compartment provided with a stored-matter detection device according to a fourth embodiment of the present invention.
Fig. 15 is a view corresponding to Fig. 2 according to a fifth embodiment of the present invention.
Fig. 16 is an explanatory diagram showing an area taken on the picked-up image of the stored-object detecting device according to the sixth embodiment of the present invention in a state in which the entire bottom basket is taken out.
Fig. 17 is a view showing a state in which a part of the lower basket is taken out in Fig. 16. Fig.
Fig. 18 is an explanatory diagram showing an area taken on a picked-up image of the stored-object detecting device according to the seventh embodiment of the present invention in a state in which the entire bottom basket is taken out.
Fig. 19 is a view showing a state in which a part of the lower basket is taken out in Fig. 18;
20 is a plan view showing an example of a recognition mark.
Fig. 21 is a virtual diagram of a straight line component extracted from the recognition mark in Fig.
Fig. 22 is a virtual diagram obtained by extracting a linear component from a recognition mark when a transparent tableware is housed. Fig.
23 is a cross-sectional view of the dish washer according to the eighth embodiment of the present invention in the front-rear direction.
24 is a sectional view of the dish washer according to the eighth embodiment of the present invention in a state in which the door is opened in the front-rear direction.
25 is a plan view showing a recognition mark capable of easily determining that a tableware is housed in a tableware storage basket in an dishwasher according to an eighth embodiment of the present invention.
26 is a perspective view showing a state in which tableware is housed in a drawn-out table storage basket in the dish washer according to the eighth embodiment of the present invention.
27 is a perspective view showing a state in which the dishwasher baskets of Fig. 26 are started to be received in the washing tub.
28 is a developed view showing a state in which each image of Fig. 26 and Fig. 27 is developed as a plan view.
Fig. 29 is an operation flow chart for explaining the operation of the dish washer according to the eighth embodiment of the present invention. Fig.
30 is an operation flow chart showing the operation of the dish washer according to the ninth embodiment of the present invention.
31 is an operation flowchart showing the operation of the dish washer according to the tenth embodiment of the present invention.

The embodiments described in the present specification and the configurations shown in the drawings are preferred examples of the disclosed invention, and various modifications may be made at the time of filing of the present application to replace the embodiments and drawings of the present specification.

Also, the terms used herein are used to illustrate the embodiments and are not intended to limit and / or limit the disclosed invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as " comprise ", " comprise ", or "have ", when used in this specification, designate the presence of stated features, integers, Steps, operations, components, parts, or combinations thereof, whether or not explicitly described herein, whether in the art,

It is also to be understood that terms including ordinals such as " first ", "second ", and the like used herein may be used to describe various elements, but the elements are not limited by the terms, It is used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The term "and / or" includes any combination of a plurality of related listed items or any of a plurality of related listed items.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The above-mentioned Patent Document 1 discloses a method of photographing a position display provided for each predetermined area of a side portion of a rack as a basket position estimation method of a dishwasher. However, in Patent Document 1, since the position indication is provided for each area of the side portion of the rack, the appearance is bad.

Therefore, in the first embodiment and the second embodiment of the present invention, the appearance of the dishwasher is improved while the basket position estimation device is mounted.

(First Embodiment)

First, a first embodiment of the present invention will be described.

Fig. 1 is a block diagram showing a configuration of a basket position estimating apparatus according to a first embodiment of the present invention. Fig. 2 is a view showing a basket position estimating apparatus according to a first embodiment of the present invention in a state in which a door is opened, 3 is a schematic perspective view showing a bottom basket shown in Fig. 2. Fig. 3 is a schematic perspective view of a dishwasher having a position estimating device.

1, the basket position estimating apparatus 1 according to the first embodiment of the present invention is installed in a dishwasher as an example and includes a camera 3 as a visible light photographing unit, a minutiae point detecting unit 5, (7).

The basket position estimating apparatus 1 according to the first embodiment of the present invention can be mounted on the dishwasher 101, for example, as shown in Fig.

2, the dishwasher 101 is provided with a box-like cleaning tank 103 having a rectangular opening 103a in a plan view at a front end (left side in FIG. 2). The washing tub 103 has a top surface portion 103b, a bottom surface portion 103c, a back surface portion 103d opposed to the opening portion 103a and a pair of side surface portions 103e opposed horizontally with the opening portion 103a therebetween Have. A substantially rectangular plate-shaped door 104 is connected to the hinge portion 104a at its lower end portion in the lower edge portion of the opening portion 103a of the washing tub 103 to open and close the opening portion 103a. As shown in Fig.

The upper baskets 105 and the lower baskets 107 are all spaced apart from each other in the washing tub 103 so that they can be drawn out toward the opening 103a of the washing tub 103.

A visible light camera 119 is provided at the center of the opposite side of the both side portions 103e on the front side end surface of the upper side upper surface portion 103b of the opening portion 103a of the cleaning tank 103, As shown in Fig. The position and direction of the visible light camera 119 (or the camera 3 in Fig. 1) are set so that the whole of the lower basket 107 taken out to the drawing position and the tableware housed in the lower basket 107 can be photographed. Therefore, the basket position estimating apparatus 1 according to the first embodiment can be provided at a position where the visible light camera 119 is disposed and at a rear portion thereof.

Here, the lower baskets 107 are formed by crossing linear materials. In the lower baskets 107, for example, as shown in the handle 108 of Fig. 3, .

The detailed configuration of FIG. 2 will be described in the third embodiment to be described later.

Hereinafter, a basket position estimation method using the basket position estimation apparatus 1 according to the first embodiment of the present invention will be described with reference to FIG.

4 is an operation flowchart showing a basket position estimation method using the basket position estimation apparatus according to the first embodiment of the present invention.

First, when the power source of the basket position estimating apparatus 1 is turned on, the camera 3 (see FIG. 1) takes visible light for a predetermined place including the entire moving region of the lower basket 107.

Subsequently, the minutia detection unit 5 detects the thumb 108 of the lower basket 107 as a minutia based on the color of the grip 108 preset from the image photographed by the camera 3 (S101). Specifically, if there is an area in the image that includes pixels equal to or close to the color of the preset knob 108 at a predetermined ratio or more, it is detected as a feature point (S102).

Subsequently, the position estimating unit 7 estimates the position of the lower basket 107 of the dishwasher 101 based on the positions (S103, S104) in the image of the minutiae detected by the minutiae detecting unit 5 S105).

The feature point detection unit 5 and the position estimation unit 7 are realized by an arithmetic processing unit such as a CPU (Central Processing Unit).

More specifically, first, the camera 3 photographs a specific place including the entire moving region of the lower basket 107. At this time, since the camera 3 photographs the predetermined position, it is possible to accurately estimate the position of the lower basket 107 based on the position of the handle 108 in the captured image. Then, the minutia detection unit 5 detects the finger 108 as a minutia based on the color of the knob 108 preset from the image photographed by the camera 3.

Subsequently, the position estimating section 7 estimates the position of the lower basket 107 of the dishwasher 101 based on the position of the minutiae detected by the minutiae detecting section 5 in the image.

Therefore, according to the first embodiment, since a handle normally provided in the basket is used as a feature point, it is not necessary to separately provide a detection display, so that the beauty of the dishwasher 101 can be improved.

Further, when the mounting position of the tableware can be specified according to the position of the basket, it is possible to reduce the time and energy required for cleaning by limiting the cleaning range based on the estimated position of the basket.

 (Second Embodiment)

Hereinafter, a second embodiment of the present invention will be described.

In the second embodiment, a detection display unit is provided as a display in a basket. Therefore, the minutia detection unit 5 detects the thumb and the detection display unit as two minutiae points based on the picked-up color of the basket and the color of the detection display unit set in advance from the image photographed by the camera 3, The reliability of the two minutiae points is determined based on the position in the image of the two minutiae. When it is determined that the reliability of both minutiae points is low, the minutiae point detecting section 5 does not output the detected positions of the minutiae points to the position estimating section 7, and the camera 3 performs the photographing again. On the other hand, when the minutia detection unit 5 determines that the reliability of both minutiae is high, the position estimator 7 estimates the position of the basket of the dishwasher based on the positions of the detected minutiae in the image. The reliability of both minutiae points is determined to be high when the positional relationship between the detected position of the knob in the image and the detected position of the display unit in the image is a predetermined positional relationship, It is determined that it is low.

Other configurations and operations are the same as those of the first embodiment, and a detailed description thereof will be omitted.

Therefore, according to the second embodiment, the position of the basket can be estimated with high accuracy by using a plurality of feature points.

(Other Modifications)

Fig. 5 is a plan view showing an identification pattern to be applied to the handle of the lower basket, and Fig. 6 is a plan view showing the verification pattern of Fig.

In the first and second embodiments of the present invention, the feature point detection unit 5 detects the grip or the detection display unit from an image based on a preset color, but the present invention is not limited to this, .

For example, as shown in Fig. 5, a characteristic display may be taken by the camera 3, for example, an identification pattern 150 having a checkered pattern. With this configuration, the position of the basket may be estimated by collating with the check pattern 151 shown in Fig. 6 and sensing the position of the handle.

Further, it may be determined that the knob is detected only when the result of the verification is, for example, two or more in the horizontal direction.

5, it may be determined that the knob is detected only when, for example, two or more verification results are arranged in the vertical direction. It is also possible to further improve the detection accuracy of the knob by adding, as a detection condition, a condition that matches the shape of the knob, such as a combination thereof and a combination of colors different from those of the surroundings.

In the first and second embodiments, a knob or a display portion to be displayed on the basket is provided as a minutiae, but may be a line-shaped crossing portion constituting the lower basket 107. [ This will be described with reference to FIGS. 7 and 8. FIG.

FIG. 7 is a schematic plan view showing characteristic points defined by a display in a lower basket, and FIG. 8 is a schematic plan view showing other characteristic points defined by a display in a lower basket.

In Fig. 7, the characteristic points are at least one intersection 107x at the bottom 107b of the bottom basket 107, and in Fig. 8, the characteristic points are at least one intersection 107c in the peripheral wall 107c of the bottom basket 107 The position 107x may be used. As a result, the intersection 107x, which is normally installed in the lower basket 107, can be used as a feature point. For example, it may be determined that the bottom basket 107 is detected only when two or more consecutive intersections are arranged in the vertical direction. Further, it may be determined that the bottom basket 107 is detected only when two or more consecutive intersecting points are arranged in the lateral direction. Further, the state in which the crossing portion 107x is covered by the shape of the basket or the object stored in the basket, such as a combination of these or a change in the quantity condition, is changed. In addition, the position and the number of intersection points 107x as detection conditions can be easily changed. Further, the detection accuracy of the basket can be improved by using the combination of the color and the shape of the handle as the detection condition. This eliminates the necessity of separately installing a detection display, so that the appearance of the dishwasher 101 can be improved.

In the first and second embodiments of the present invention, one or two minutiae points are provided, but three or more minutiae points may be provided.

A variety of methods for detecting the position of a tableware storage basket (for example, a bottom basket) in the washing tub 103 including the door 104 on the door 104, A modified example will be described.

First, a time of flight (TOF) sensor is disposed on a wall surface (door-facing surface) facing the door 104 in the washing tank 103. On the other hand, a reflection plate capable of reflecting the outgoing light from the TOF sensor is provided at the portion of the lower baskets 107 opposed to the washing tub 103. It is possible to calculate the position of the lower baskets 107, that is, the amount of the lower baskets 107 taken out from the washing tub 103 by measuring the distance to the reflector by the TOF sensor.

Contrary to this, the TOF sensor may be provided in the lower basket 107 opposite to the washing tub 103, and the reflecting plate may be provided on the door facing surface of the washing tub 103. [ In this case, the TOF sensor provided in the lower basket 107 is supplied with electric power by wire, wireless, battery or the like. In the case of adopting a power supply method by wire or wireless, a communication means is required.

Secondly, a winder may be provided on the door-facing surface of the washing tub 103, and the other end of the string provided with a force to be wound on the winder may be connected to the lower basket 107. In the case of this configuration, for example, the number of revolutions of the winding machine can be measured to calculate the position of the lower basket 107, that is, the withdrawal amount of the lower basket 107 from the washing tub 103, .

Instead of using the number of revolutions of the winding machine for measuring the amount of drawing out of the string, a scale may be provided on the string itself, and the scale may be read by, for example, an image processing sensor.

Thirdly, in the case where the wheel is provided on the bottom of the lower basket 107, a rotation measurement system (rotation speed sensor) may be provided on the wheel. From this rotation number, the withdrawal amount of the lower baskets 107 from the washing tub 103 can be calculated. Further, the power supply to the rotation measuring instrument is performed by wire, wireless, or battery, and notification of the calculation result to the dishwasher 101 can be performed by wire or wireless communication.

Fourth, a plurality of weight sensors may be laid on the entire surface of the lower basket 107 on the inner surface (upper surface when opened) of the door 104. In this case, the position of the weight sensor that senses the weight at the position farthest from the washing tub 103 can be calculated as the amount of the bottom basket 107 taken out from the washing tub 103.

Fifth, a plurality of switches may be laid on the entire surface in the running area of the lower basket 107 on the inner surface (upper surface when opened) of the door 104. The switch at this time may be a switch that is conducted when it is pressed by the bottom contact portion (including the case of the wheel) of the lower basket 107, for example. In this case as well, it is possible to calculate the position of the conductive switch at the position most remote from the cleaning tank 103 as the amount of the bottom basket 107 discharged from the cleaning tank 103.

Sixth, the position where the user holds the lower basket 107 and the position where the lower basket 107 is held are sensed by image recognition of the hand (finger) from the sensed image, and the amount of drawing out the lower basket 107 of the lower basket 107 from the washing tub 103 .

Seventh, the wire frame of the lower basket 107 itself can be sensed from the picked-up image as image recognition, and the amount of wire drawn from the washing tub 103 in the lower basket 107 can be calculated from the detected position of the wire frame . In this case, the lower baskets 107 are arranged in the peripheral wall 107c on the side of the door 104 in the specified position, for example, the lower baskets 107, or on the door of the washing tub 103 in the lower baskets 107 And a peripheral wall portion 107c on the opposite surface side.

 (Third Embodiment)

Hereinafter, a third embodiment of the present invention will be described.

9 is a cross-sectional view of a dishwasher provided with a stored-object detecting device according to a third embodiment of the present invention in a state in which the door is closed, Fig. 10 is a view showing a state in which the lower- Fig. 11 is an explanatory view showing a picked-up image in a state in which the entire bottom basket is drawn out by opening the door, and Fig. 12 is a view showing a state in which a door is opened to draw out a part of the bottom basket.

In Figs. 9 and 10, the same portions as in Fig. 2 are denoted by the same reference numerals and the same names.

Figs. 9, 10 and 2 show the dishwasher 101. Fig.

Hereinafter, the drawing direction of the dishwasher 101 is referred to as the front side. The dishwasher 101 includes a washing tub 103 as a substantially rectangular parallelepiped-shaped storage unit having a box-shaped opening 103a in a rectangular shape when seen in a plan view.

The washing tub 103 includes a top surface 103b, a bottom surface 103c, a back surface 103d opposed to the opening 103a, and a pair of side surfaces 103e opposed horizontally with the opening 103a interposed therebetween. . A substantially rectangular plate-like door 104 is connected to the hinge portion 104a at its lower end portion on the lower edge of the opening 103a of the washing tub 103, As shown in Fig. The back surface of the door 104 is made of stainless steel.

As shown in Figs. 11 and 12, near the end on the hinge (rotation axis) 104a side of the rear surface of the door 104, the recognition mark 104b is extended in the direction opposite to the side surface 103e Respectively.

In the third embodiment of the present invention, the recognition mark 104b is formed by, for example, a pattern in which triangles painted with gaps are stacked in three stages and arranged in the direction opposite to the side portion 103e. Here, each of the apexes of the plurality of triangles faces the end side of the hinge portion (pivot axis) 104a. The recognition mark 104b is not limited to a pattern in which figures are combined, but may be formed by characters (kanji, hiragana, katakana, various alphabets, etc.), symbols, color saturation or brightness, or a combination thereof.

A pair of guide rails 103f extending in the opening direction (drawing direction) of the opening portion 103a are provided on the inner surface of both side portions 103e of the washing tub 103 at intervals in the vertical direction. An upper basket 105 is slidably provided in the front-rear direction on both upper guide rails 103f. Wheels 105a are provided on both sides of the side portion 103e of the upper basket 105 in the direction opposite to each other and these wheels 105a are coupled to the guide rails 103f in a rotatable state. Likewise, the lower baskets 107 as a storage portion are provided in the lower side guide rails 103f so as to be slidable in the front-rear direction. Wheels 107a are provided on opposite sides of the side portions 103e of the lower basket 107 and these wheels 107a can be coupled to the guide rails 103f in a rotatable state.

The upper baskets 105 and the lower baskets 107 are provided with rectangular bottom portions 105b and 107b and rectangular annular peripheral wall portions 105c and 107c protruding from the entire periphery of the bottom portions 105b and 107b, Like shape in cross-section.

As shown in Figs. 11 and 12, on the front side (drawing-out side) peripheral wall portion 107c of the lower baskets 107, sheets (hereinafter referred to as " 107d are provided so as to face the face on the identification pattern PA side toward the back (semi-extraction direction). In addition, the identification pattern PA is not limited to a pattern in which graphics are combined as in the recognition mark 104b, but may be configured by characters, symbols, color saturation or brightness, or a combination thereof.

The upper baskets 105 and the lower baskets 107 are located at the withdrawal position where the entirety of the upper baskets 105 and the lower baskets 107 are drawn out to the outside of the washing tub 103 through the openings 103a, , And the whole is located at an operating position accommodated outside the washing tub 103.

Between the operation position of the upper baskets 105 and the operation position of the lower baskets 107 in the inside of the washing tub 103 is provided a plurality of downward rotations for spraying water (washing water or rinsing water) The nozzles 108a and 108b are disposed.

A plurality of upper rotary nozzles 109 for spraying water downward are arranged above the operation position of the upper basket 105 inside the washing tub 103. [

A hollow fixed nozzle 110 extending in the direction opposite to the both side portions 103e is disposed near the bottom of the washing tank 103, that is, the lower rear end of the operation position of the lower basket 107, A plurality of injection holes (not shown) for spraying water horizontally toward the front are formed at intervals in the longitudinal direction of the fixed nozzle 110. [

A support rail 111 extending in the front-rear direction is disposed at a substantially central portion of the bottom of the cleaning tank 103, that is, in the opposite direction of both side portions 3e below the operation position of the lower basket 107 . The support rail 111 slidably supports an elongated slide member 112 extending in the direction opposite to the both side surfaces 103e from below.

The slide member 112 is formed with a collision surface (not shown) that collides water sprayed from the fixed nozzle 110 and changes the direction of the water upward. Although not shown, the slide member 112 is connected to the belt, and when the pulley on the rear side is rotated by the operation of the motor, the belt runs to slide the slide member 112 along the support rail 111. [ Therefore, a driving mechanism is constituted by a belt, a pulley and a motor.

An outlet port (not shown) is formed in the bottom surface portion 103c of the washing tub 103. A tank 113 for storing water flowing out from the inside of the washing tub 103 through an outlet port is provided below the outlet port, A pump 115 for circulating the water stored in the lower rotary nozzles 108a and 108b toward the lower rotary nozzles 108a and 108b, the upper rotary nozzle 109 and the fixed nozzle 110 is disposed.

When water is sprayed horizontally forward from each injection hole of the fixed nozzle 110 by driving the pump 115 of the dishwasher 101 configured as described above, Collides with the collision surface of the dishwasher 112 and is scattered upward to wash the dishware accommodated in the lower basket 107. At this time, when the motor is operated in a state in which the injection of water by the fixed nozzle 110 is continued, the slide member 112 slides in the forward and backward direction along the support rail 111, The water in the upper space is evenly distributed.

A visible light camera 119 as a photographing unit is provided at an opening in the upper portion of the opening 103a of the washing tub 103, that is, at the front side end face of the upper face 103b in the direction opposite to the both side faces 103e 103a in the direction of opening. The position and direction of the visible light camera 119 are set so that the entire bottom basket 107 positioned at the draw position and the tableware as the stored object stored in the bottom basket 107 can be photographed. Specifically, the lens of the visible light camera 119 is disposed so as to face the outside of the washing tub 103.

A microcomputer 121 as a control means is incorporated in the upper surface portion 103b of the washing tub 103 slightly behind the visible light camera 119. [ The microcomputer 121 is configured to obtain storage information including at least one of the position, the size, and the quantity of the tableware in the lower basket 107 based on the photographed image P1 photographed by the visible light camera 119 .

The visible-light camera 119 and the microcomputer 121 constitute the stored-object detecting device 123 according to the third embodiment of the present invention.

In the dishwasher 101 configured as described above, in the process of pushing the lower baskets 107 from the state where the lower baskets 107 are drawn out to the front side of the washing tub 103 to the operation position, the position, size, The storage information including at least one of the storage information. This will be described with reference to FIG.

13 is a flowchart showing the operation of the dishwasher provided with the stored-matter detecting device according to the third embodiment of the present invention.

When power is supplied to the dishwasher 101, the visible light camera 119 starts shooting at ten paces in one second, for example. In step S201, the microcomputer 121 continues monitoring until the door 104 is opened. When the door 104 is opened, the process advances to step S202 to wait until the lower baskets 107 are taken out of the washing tub 103.

When the lower baskets 107 are taken out of the washing tub 103, the microcomputer 121 stores the dishes in the lower baskets 107 at appropriate positions and transfers the lower baskets 107 to the washing tub 103, And waits until the movement for accommodating it is started.

Subsequently, in step S203, when the microcomputer 121 recognizes the start of movement of the lower basket 107, the process advances to the next step S204, and from the photographed images P1 photographed by the visible light camera 119, And detects a discrimination pattern PA attached to a predetermined detected image P2 constituting a part of the photographed image P1 on the basis of the position of the discrimination pattern PA in each photographed image P1 And specifies the position in the lower basket 107 of the taken position. Since the detected image P2 is a specific area of the photographed image P1, information indicating the position of the lower baskets 107, such as the drawing amount of the lower baskets 107 at the time of photographing the photographed image P1, P2 in the lower basket 107 of the position of the spot. In the third embodiment of the present invention, the detection of the identification pattern PA is performed based on a figure included in the identification pattern PA.

However, detection may be performed on the basis of the outline, color, or characters included in the identification pattern PA, depending on the type of the identification pattern PA, and the appearance, color, May be based on a plurality of figures. 11 and 12, the detection image P2 is a portion on which the recognition mark 104b is formed and constitutes the vicinity of the side edge of the cleaning tank 103 of the photographed image P1. More specifically, the detected image P2 is set so as to be contained in the portion closest to the washing tub 103 side when the photographed image P1 is divided into four in the drawing direction. For example, when the position in the lower basket 107 of a portion of the detected image P2 that is photographed by the photographed image P1 shown in Fig. 12 is greater than the distance d1 corresponding to d1 of the sheet 107d (identification pattern PA) As shown in Fig.

The position in the lower basket 107 where the detected image P2 is recorded by the photographed image P1 in Fig. 12 is shifted rearward by a distance corresponding to d2 from the sheet 107d (discrimination pattern PA) Can be specified. The distance between the portion of the detected image P2 and the sheet 107d is obtained by correcting the distance in the captured image P1 based on the position and angle of the visible light camera 119.

The microcomputer 121 stores the detected image P2 in correspondence with the position in the lower basket 107 of the spot on the detected image P2. When a common detected image P2 is already stored at the corresponding position, the newly obtained detected image P2 is overwritten.

In step S204, the lower basket 107 is repeated until it is received in the operating position of the washing tub 103. [ That is, the microcomputer 121 repeats the step S204 for a plurality of photographed images P1 in which the positions of the lower baskets 107 are different.

In the next step S205, when the lower baskets 107 are accommodated in the predetermined operation positions, the flow advances to step S206.

In step S206, the microcomputer 121 specifies, as an arrangement area of the tableware, an area in which it is not possible to identify the recognition mark 104b in each of the detected images P2 stored in step S204. The microcomputer 121 calculates the positions of the tableware in the plurality of detected images P2 and the position in the lower basket 107 of the position detected in each of the detected images P2 (the position specified in step S204) The storage information including at least one of the position, the size, and the quantity of the tableware in the basket 107 is obtained. When the detected image P2 of a partial area of the lower baskets 107 can not be obtained in step S204 due to some circumstances, the detected image P2 is obtained based on the arrangement area of the tableware in the obtained detected image P2, The size, the quantity, and the like of the utensils in the area where the utensil can not be obtained. At this time, the color, the type, the material, and the like of the tableware housed in the lower basket 107 may be specified based on the detected images P2.

Then, in step S207, the microcomputer 121 controls the drive mechanism according to the storage information obtained in step S206, thereby controlling the driving mechanism of the slide member 112 at the time of spraying water by the fixed nozzle 110, Control the position. For example, it is possible to efficiently clean the tableware by controlling the time when the slide member 112 is located below the placement area of the tableware to be longer than the time when the slide member 112 is located below the area where the tableware is not disposed . Thus, the cleaning time can be shortened.

According to the third embodiment of the present invention, it is possible to specify the position in the lower basket 107 where the number of indications is recorded at least on the detected image P2, It can be limited to only one place of the basket 107. [ Therefore, as compared with the case where display is provided for each area as in Patent Document 1, the number of displays is smaller and the appearance of the lower basket 107 is better.

In addition, since the position of the position where the identification pattern PA is placed at least at the position where the detection image P2 is recorded on the detection image P2 can be specified with high accuracy, the appearance of the bottom basket 107 is deteriorated The precision of the obtained storage information can be enhanced.

Since the detected image P2 is a part of the photographed image P1, the amount of incident light of the entire photographed image P1 and the amount of incident light of the entire photographed image P1, as compared with the case where the detected image P2 is the entire photographed image P1, The influence of the deviation of the angle is reduced, and the reliability of the obtained storage information can be increased.

Since the portion of the captured image P1 in which the vicinity of the visible light camera 119 is taken is the detected image P2, the tableware housed in the position corresponding to the detected image P2 in the lower basket 107 is different from the tableware It is possible to prevent the light from being imprinted on the detected image P2. Therefore, the reliability of the obtained storage information can be enhanced.

The lens of the visible light camera 119 is disposed so as to face the outside of the washing tub 103 so as to obtain storage information based on the taken image P1 of the portion of the lower basket 107 drawn out to the outside of the washing tub 103 It is possible to prevent the water, steam and detergent in the washing tub 103 from adversely affecting the lens.

 (Fourth Embodiment)

Hereinafter, a fourth embodiment of the present invention will be described.

Fig. 14 is a schematic plan view of a storage compartment provided with a stored-item detection device according to a fourth embodiment of the present invention, and shows a storage compartment 125 provided with a stored-item detection device 123. Fig.

In Fig. 14, the storage compartment 125 is provided with a storage body 127 as a substantially rectangular parallelepiped-shaped storage portion having a box-shaped opening 127a in a rectangular shape in plan view at the front end.

A door 129 serving as a display for opening and closing the opening 127a is provided in the left edge portion (lower edge portion) of the opening 127a of the storage body 127 via a hinge portion (not shown) And is rotatably connected in the left-right direction.

On the rear surface of the door 129, a rotary tray 131 accommodated in the storage body 127 is provided with a storage surface for storing the stored object upward.

Therefore, the door 129 and the rotary tray 131 constitute a receiving portion.

The visible light camera 119 is disposed so as to photograph the entire moving range of the door 129 and the detected image P2 is stored in the storage body 101 in the photographed image P1 (the image of the area surrounded by the dotted line in Fig. 14) (A portion enclosed by a dot-dashed line in Fig. 14) around the opening 127a of the light-emitting diodes 127. As shown in Fig. The microcomputer 121 detects the door 129 from the photographed image P1 and specifies the position in the rotary tray 131 at the spot on the detected image P2. Subsequently, on the basis of the position of the stored object in the detected image P2 and the position in the rotated tray 131 of the spot on the detected image P2, the storage information including at least one of the position, .

Other configurations and operations are the same as those of the third embodiment, and a detailed description thereof will be omitted.

As described above, according to the fourth embodiment of the present invention, the aesthetic appearance of the door 129 and the rotary tray 131 can be improved as in the third embodiment.

(Fifth Embodiment)

Hereinafter, a fifth embodiment of the present invention will be described.

Fig. 15 is a view corresponding to Fig. 2 in accordance with a fifth embodiment of the present invention, showing a dishwasher 101 provided with a stored object detecting device 123. Fig.

In Fig. 15, the recognition mark 104b is attached to two areas spaced apart in the drawing direction from the back surface of the door 104. Fig.

In step S204 of Fig. 13, the microcomputer 121 detects two detected images P2, that is, different parts of the captured image P1, which constitute a part corresponding to each recognition mark 104b of the captured image P1 The positions in the lower baskets 107 of the positions of the two detected images P2 constituting the position detecting unit are specified.

13, the storage information described above is obtained based on the position of the tableware in the two detected images P2 and the position specified in step S204 for the two detected images P2. The two detected images P2 constituting the different parts of the photographed image P1 are approximated to the two images from the other viewpoints and the two detected images P2 are regarded as images from different viewpoints, Dimensional information such as height, direction, sharpness, etc., can be included in the storage information.

The other configurations and operations are the same as those of the third embodiment, and a detailed description thereof will be omitted.

As described above, according to the fifth embodiment of the present invention, since three-dimensional information of tableware can be obtained without installing a plurality of visible light cameras 119, compared with the case where a plurality of visible light cameras 119 are provided, Cost can be reduced.

 (Sixth Embodiment)

Hereinafter, a sixth embodiment of the present invention will be described.

Fig. 16 is an explanatory view showing an area taken on the picked-up image of the stored object detecting device according to the sixth embodiment of the present invention in a state in which the entire bottom basket is taken out. Fig. Fig.

In the dishwasher 101 provided with the stored object detecting device 123 according to the sixth embodiment of the present invention, painting in a color different from that of the other portion is applied to one end portion in the left-right direction of the lower basket 107, Out direction) and the painted portion constitutes the identification pattern PA as a display.

The microcomputer 121 determines whether the identification pattern PA is located at the upper end or the lower end of each photographed image P1 (the position of the identification pattern PA) On the basis of the length (amount) of the identification pattern PA in the lower frame 107 of the detected image P2.

In Fig. 16 and Fig. 17, R1 and R2, in which the area to be photographed on the photographed image P1 is represented by R2, And the length of the identification pattern PA in the photographed image P1 becomes the length corresponding to L1. 17, the identification pattern PA is printed on the lower end of the photographed image P1, and the length of the identification pattern PA in the photographed image P1 becomes the length corresponding to L2.

The other configurations and operations are the same as those of the third embodiment, and a detailed description thereof will be omitted.

(Seventh Embodiment)

Hereinafter, a seventh embodiment of the present invention will be described.

Fig. 18 is an explanatory view showing an area taken on the photographed image of the stored matter detection device according to the seventh embodiment of the present invention in a state in which the entire lower basket is taken out, Fig. Fig.

In the dishwasher 101 equipped with the stored object detecting device 123 according to the seventh embodiment of the present invention, a mark MA as a plurality of displays is provided at one end in the lateral direction of the lower basket 107, Out direction) at an equal interval.

In step S204 of Fig. 13, the microcomputer 121 determines whether the mark MA is located at the upper end or the lower end of each photographed image P1 (the position of the mark MA) The position in the lower basket 107 of the position on the detected image P2 is specified based on the number of marks MA.

18 and 19, R1 and R2 represent the area of the photographed image P1. In the state of Fig. 18, the mark MA is located at the upper end of the photographed image P1 And the number of marks MA in the photographed image P1 is five. 19, the mark MA is placed on the lower end of the photographed image P1, and the number of marks MA in the photographed image P1 is two.

The other configurations and operations are the same as those of the third embodiment, and a detailed description thereof will be omitted.

Although the two detection images P2 constituting the different parts of the photographed image P1 are used in the above-described fifth embodiment, three or more detected images P2 ) May be used.

In the third and fifth embodiments described above, the identification pattern PA of the lower basket 107 is displayed. However, in the case where the handle is provided for catching with the hand, for example, when the handle is moved to the lower basket 107, The handle may be displayed. This eliminates the need for a separate display for detection, so that the appearance of the lower baskets 107 can be improved.

In the third and fifth to seventh embodiments described above, the visible light camera 119 is provided on the upper peripheral edge of the opening 103a of the washing tub 103. However, It is possible to take a picture of the display of the washing tub 107 and to arrange it at another position as long as it is not affected by water, steam and detergent in the washing tub 103. [

In the third to seventh embodiments described above, the detected image P2 is a part of the photographed image P1, but may be all of them.

In the third to seventh embodiments, the present invention is applied to the dishwasher 101 or the storage box 125, but the present invention is also applicable to a desk or a warehouse that accommodates a movable storage unit. In this case, the obtained storage information can be used for inventory management or valuables management. Further, the present invention can be applied to a refrigerator having a drawer. In this case, the obtained storage information can be used for adjustment of cooling effect or food management.

Hereinafter, various modifications of the method of detecting the position of the tableware storage basket when the identification pattern PA is not provided in the tableware storage basket (lower basket 107) will be described.

First, a TOF (distance image) sensor is disposed on a wall surface (door-facing surface) facing the door 104 in the washing tank 103. On the other hand, a reflection plate capable of reflecting the outgoing light from the TOF sensor is provided at the portion of the lower baskets 107 opposed to the washing tub 103. It is possible to calculate the position of the lower baskets 107, that is, the amount of the lower baskets 107 taken out from the washing tub 103 by measuring the distance to the reflector by the TOF sensor.

Second, a winder may be provided on the door-facing surface of the washing tub 103, and the other end of the string to which the force to be wound on the winder is to be wound may be connected to the lower basket 107. In the case of this configuration, the position of the lower baskets 107, that is, the amount of the lower baskets 107 taken out from the washing tub 103 can be calculated from the number of revolutions of the winder or the amount of draw of the strings.

Alternatively, a scale may be provided on the string itself, and the scale may be read by, for example, an image processing sensor.

Thirdly, a plurality of regions coated with different colors toward the drawing direction may be formed on substantially the entire surface of the bottom portion 107b in the draw-out direction of the bottom portion 107b. When the lower baskets 107 are photographed by, for example, the visible light camera 119, it is possible to estimate the amount of the bottom basket 107 from the washing tub 103 from the region photographing position of a specific color.

Fourth, the direction of the mesh of the bottom portion 107b of the bottom basket 107 or the method of weaving may be different in a plurality of kinds along the drawing direction so as to be distinguishable by visible light. When the lower baskets 107 are photographed by the visible light camera 119, the amount of the bottom basket 107 from the washing tub 103 can be estimated from the photographing position of a specific area such as a mesh.

Fifth, a planar shape (outer shape) of the lower baskets 107 may be formed in different shapes along the drawing direction. For example, with respect to the peripheral wall portion 107c in the pull-out direction in the lower baskets 107, a region formed in a wavy shape (concavo-convex shape) and a region formed in a straight line in a plan view are mixed, From the washing tub 103 of the lower baskets 107 can be estimated.

Sixth, a plurality of markers extending in the drawing direction may be laid on the bottom 107b of the bottom basket 107. [ The plurality of markers may be disposed at intervals, for example, in an island shape. Further, the arrangement direction is not limited to the direction parallel to the pull-out direction when viewed from the plane, but may be a diagonal direction of the lower baskets 107.

 When the lower baskets 107 are photographed by, for example, the visible light camera 119, the drawing amount of the lower baskets 107 from the washing tub 103 can be estimated from the photographing positions of the specific markers. In addition, each marker may have its own planar shape or its own color.

Next, various modifications of the method of detecting an object, for example, a tableware, in a rectangular detection image P2, which is an image sensing area of the recognition mark 104b, will be described with reference to Figs. 20 to 22. Fig.

Fig. 20 is a plan view showing an example of a recognition mark, Fig. 21 is a virtual diagram obtained by extracting a linear component from the recognition mark in Fig. 20, and Fig. 22 is a graph showing a straight line component from a recognition mark when transparent dishes are stored The extracted virtual figure.

First, as the recognition mark 104b, a mark including a linear component may be used. In this case, a mark including a plurality of intersecting straight line components is preferable. For example, as shown in Fig. 20, when a so-called " scale-like " shape constituting a plurality of regular hexagons with a plurality of equilateral triangles is adopted as the recognition mark 104b, It is possible to extract a linear component as shown in Fig.

Here, as shown in Fig. 22, when distortion occurs in the straight line component in a part of the area 300 in the sensing area, it is detected and estimated that a transparent tableware is stored in the area 300 .

Secondly, the recognition mark 104b may be provided not only at the lower end of the inner surface of the door 104 but also at the bottom surface 103c of the washing tub 103. [ This makes it possible to use a mark having a good imaging state for detection of tableware, thereby improving the detection accuracy.

Third, a light emitting body may be used for the recognition mark 104b itself. It is possible to detect that a tableware or the like is housed in an area darker than the brightness of the recognition mark 104b itself in the detected image P2. As the light emitting body, for example, an LED (light emitting diode) element, a sheet-shaped phosphorescent member, a strong reflection member, or the like can be used.

Next, various modified examples of the method of detecting the items stored in the rectangular detection image P2, for example, tableware, when the recognition mark 104b is not provided will be described.

First, the position of the lower basket 107 may be estimated, and the shape of the lower basket 107 may be specified from the estimated position of the basket. In this case, it is preferable that the plane shape (outer shape) of the lower baskets 107 is different along the drawing direction. If the planar shape of the image of the basket at the specified position is different from that of the initial state in which the tableware is not stored, it is possible to detect that the tableware is housed.

Second, the position of the bottom basket 107 is estimated, and the shape of the background of the estimated position (inner surface of the door 104) is specified. It is possible to detect that the tableware is stored if the background image of the specified shape is different from the image in the initial state in which the tableware is not stored.

Third, if there is a difference between the image of the background (the inner surface of the door 104) and the image when the lower baskets 107 pass over the background, it is possible to detect that the tableware has been stored.

Fourth, the bottom basket 107 may be painted with a specific color. The number of pixels of a specific color component is recorded as an initial value from the image in the initial state in which no tableware is stored and the tableware is stored by measuring the variation (decrease or increase) in the number of pixels of a specific color component Can be detected.

Fifth, a plurality of rectangular images, for example, a plurality of detected images P2, may be acquired for each of the fetch positions in advance with respect to the lower basket 107. It is possible to detect that the tableware has been stored when the images of the rectangle taken during the detecting operation of the tableware are compared with the images of the corresponding rectangle acquired in advance and a difference is generated between the compared images.

Sixth, the empty bottom basket 107 may be photographed and linear components of the wire (wire) constituting the lower basket 107 may be extracted from the image. The position of the lower baskets 107 can be estimated on the basis of the linear component of the extracted initial state. Further, it is possible to detect that the tableware is housed in the area where the straight line component of the wire is broken in the image taken during the detection operation of the tableware.

The seventh preliminary empty baskets 107 may be photographed and the intersections of the wire rods constituting the lower baskets 107 may be extracted from the images. The position of the lower baskets 107 can be estimated based on the intersections of the extracted initial states. Further, it is possible to detect that the tableware is housed in the area where the intersection of the wires is obscured, that is, in the area not present, in the image taken during the detection operation of the tableware.

Eighth, the bottom basket 107 may be three-dimensionally modeled using one or a plurality of cameras (visible light camera 119). In this case, it is also possible to detect three-dimensional modeling of an image photographed during the detection operation of the tableware and, if there are three-dimensional reconstructed space coordinates other than the spatial coordinates of the bottom basket 107 itself, .

Ninthly, an image of a specific pattern may be irradiated toward the bottom basket 107 from the photographing direction of the preliminary light camera 119. A specific pattern is, for example, a pattern including a plurality of straight lines parallel to each other, or a pattern in which a plurality of straight lines intersecting each other cross each other. When the reflected light of this pattern is photographed by the visible light camera 119 and the pattern shift or distortion occurs in the image, it is possible to detect that the tableware is housed.

The coloring matter or the paint which can be cleaned by the dishwashing detergent may be colored by the automatic spraying by the dishwasher 101 or the spraying by the user for each tableware to be cleaned stored in the tenth and lower baskets 107. Thereafter, the coloring pigment or the like colored in each of the tableware is detected by the visible light camera 119, and the position where the tableware in the bottom basket 107 is housed can be detected.

It may be determined that the movement of the user's fingertip stops momentarily in the bottom basket 107 or above and that the returned position is the position where the tableware is housed. In this case, it is also necessary to determine whether or not the tableware housed from the returned position has been removed.

 (Eighth embodiment)

Hereinafter, an eighth embodiment of the present invention will be described with reference to Figs. 23 and 24. Fig.

Fig. 23 is a cross-sectional view of the dish washer according to the eighth embodiment of the present invention, and Fig. 24 is a sectional view of the dish washer according to the eighth embodiment of the present invention in a state in which the door is opened in the front-rear direction.

23 and 24 show sectional configurations in the front-rear direction of the dishwasher 201 according to the eighth embodiment of the present invention.

Hereinafter, the drawing direction of the dishwasher 201 is referred to as the front side. The dishwasher 201 has a substantially rectangular parallelepiped shape and is provided with a cleaning tank 203 having a cavity having an opening for carrying in and carrying out the tableware on the front side thereof. A door 204 capable of opening and closing the washing tub 203 is provided in the opening.

23 and 24, the washing tub 203 is provided therein with a dish top upper basket 205 (hereinafter referred to as an 'upper basket') for accommodating dishes and a lower table bottom basket 207 (Hereinafter referred to as " lower basket ").

Between the upper basket 205 and the lower basket 207, a plurality of lower rotary nozzles 208a, 208b for spraying water (washing water or rinse water) upwardly and downwardly are rotatably arranged.

A plurality of upper rotary nozzles 209 for spraying water downward are rotatably disposed above the upper basket 205.

In the vicinity of the lower rear end of the lower basket 207, a hollow fixing nozzle 209 as a washing section extending in the width direction of the washing tub 203 is disposed.

The fixed nozzle 210 is provided with a plurality of spray holes horizontally spaced in the width direction of the washing tub 203 for spraying water horizontally toward the front.

Further, a rail 211 extending in the front-rear direction is provided substantially at the center in the lower width direction of the lower basket 207.

The rail 211 slidably supports an elongated slide member 212 extending in the width direction as a cleaning portion from below.

The slide member 212 is formed with a collision surface over the entire length so that the sprayed water from the fixed nozzle 210 collides to change the traveling direction of the water upward.

Although not shown, the slide member 212 is connected to the belt. When the pulley on the rear side is rotated by the operation of the motor, the slide member 212 slides along the rail 211 as the belt runs. Therefore, the driving mechanism can be constituted by the belt, the pulley and the motor.

23, a tank 213 connected to the bottom surface 203a for storing water and a pump 215 for discharging the water stored in the tank 213 are disposed on the bottom surface 203a of the washing tank 203 .

The pump 215 circulates the water in the tank 213 to the lower rotary nozzles 208a and 208b, the upper rotary nozzle 209 and the fixed nozzle 210, respectively.

When the water is sprayed horizontally forward from each injection hole of the fixed nozzle 210 by driving the pump 215 of the dishwasher 201 constructed as described above, Collides with the impact surface of the slide member 212 and splashes upward like fractions to clean the tableware accommodated in the lower basket 207. At this time, when the motor is operated in a state in which the injection of the water by the fixed nozzle 210 is continued, the slide member 212 slides in the forward and backward directions along the rail 211, Spraying into space becomes evenly distributed.

 (Detection method of tableware)

Hereinafter, a method of detecting a tableware in an eighth embodiment of the present invention will be described with reference to Figs. 25 to 28. Fig.

Fig. 25 is a plan view showing a recognition mark capable of easily determining that a tableware is housed in a dishwasher baskets in an dishwasher according to an eighth embodiment of the present invention, Fig. 26 is a plan view showing an eighth embodiment Fig. 27 is a perspective view showing a state in which the dishwasher baskets of Fig. 26 are started to be accommodated in the washing tub, Fig. 28 is a perspective view of the dishwasher, And the image of Fig. 27 are developed as a plan view. Fig.

The dishwasher 201 according to the eighth embodiment of the present invention recognizes the presence or absence of tableware stored in the lower basket 207 as well as the storage position of the tableware housed in the lower basket 207, And selectively rinses and rinses the arrangement area based on the position of the recognized tableware.

23 and 24, the dishwasher 201 according to the eighth embodiment of the present invention is provided on the front side (concretely, on the door side) of the ceiling surface of the washing tub 203 And a camera 219 serving as detecting means for detecting the tableware.

The camera 219 is not limited to a camera that responds to visible light, and may be, for example, an area sensor responsive to infrared light.

In the eighth embodiment of the present invention, the camera 219 is disposed on the upper side of the recognition mark 220 disposed on the lower side of the lower basket 207, rather than directly detecting the tableware stored in the lower basket 207, The user may have a configuration for photographing the recognition mark 220 together with a tableware passing through the recognition mark.

Specifically, the recognition mark 220 is displayed on the area of at least the end of the door 204 on the side of the washing tub 203, for example, in a state where the door 204 is opened in at least the lower region of the door 204 Respectively.

In the eighth embodiment of the present invention, as shown in Fig. 25, for example, a plurality of triangles, each of which is painted tightly, are stacked in three stages in the recognition mark 220 and arranged in the entire width direction of the washing tank 203 It has one pattern. Here, each of the vertices of the plurality of triangles faces upward (forward) when the door 204 is opened upward.

Further, the recognition mark 220 is not limited to a plurality of triangular arrangement patterns, and may be another arrangement pattern of figures.

In addition, it is not limited to a combination pattern of figures, but may be composed of characters (kanji, hiragana, katakana, various alphabets, etc.), symbols, color saturation or brightness, or combinations thereof.

The image image (image data) captured by the camera 219 is subjected to predetermined processing in the processor 221 including, for example, an MPU (microprocessor unit). The operation of the dishwasher 201 including the processor 221 can be controlled from the upper end portion of the front surface of the washing tub 203 or the control portion 223 provided on the upper side of the upper portion of the door 204. [

26 shows an image image taken by the camera 219 according to the eighth embodiment of the present invention.

26, the lower basket 207 is drawn over the door 204, and the dishes 230, 231 before the washing are sprinkled in the lower basket 207.

In the present embodiment, for example, an identification pattern 207a having a checkered pattern is provided on the side of the front side in the lower basket 207. This identification pattern 207a is provided in the lower basket 207 so that the position of the end farthest from the camera 219 in the wire-shaped lower basket 207, that is, the position on the front side (outer side) of the lower basket 207 Can be detected easily. Similarly to the recognition mark 220, the identification pattern 207a is not limited to a pattern in which figures are combined, but may be formed by characters, symbols, color saturation or brightness, or a combination thereof.

In Fig. 26, the distance between the identification pattern 207a and the recognition mark 220 is d1.

The detection and determination of the tableware in the image image is performed in the first detection area 241 shown in Fig.

27 shows a state in which the lower basket 207 has a distance d2 (d1 > d2) between the identification pattern 207a and the recognition mark 220 as a result that a part of the rear side of the washing tank (not shown) FIG.

In this case as well, detection and determination of tableware in the image image is performed in the second detection area 242 shown in Fig.

As described above, in the present embodiment, it is possible to calculate which part of the lower stage basket 207 the captured range (area) is photographed by always photographing the identification pattern 207a as each image image.

Here, for example, sequential images are introduced (recorded) at 10 timings in one second.

Fig. 28 shows a state in which each image of Fig. 26 and Fig. 27 is developed in a plan view.

28, the distances d1 and d2 developed in the plan view correspond to distances from the camera 219 and distances between the imaging section of the camera 219 and the identification pattern 207a in the lower basket 207 of the door 204 And is calibrated by an angle.

Since the corrected distance d1, that is, the depth dimension of the lower basket 207, is already known, the average moving speed can be calculated from the time until the movement of the lower basket 207 starts and is received in the washing tub 203. [ This average moving speed is varied according to the completion of the user's pressing operation.

In this case, since 10 images are recorded every second for each image, one image can be used as a counter of 0.1 second unit. It is also possible to detect the distance d2 from the moving speed and the counter value.

Further, when the receiving operation of the lower basket 207 to the washing tub 203 is stopped halfway, and further once it is taken out and thereafter the receiving operation is resumed, the overlapping portion of the image image is deleted.

If a continuous image exists in the image, it may be generated by complementing the image before and after the image.

27, a part of the tableware 231, here a part of the frying pan, is covered on the recognition mark 220 in the second detection area 242, That is, the entire shape of the mark. Therefore, it is possible to specify the arrangement area in which the tableware is housed in the area of the distance d2 after correction from the identification pattern 207a in the lower basket 207, which is the drawing amount of the lower basket 207.

In this manner, when the bottom basket 207 is received, the range required for cleaning and rinsing in the bottom basket 207 can be calculated by performing continuous shooting by the camera 219. [

 (Operation of dishwasher)

The operation of the dishwasher 201 according to the eighth embodiment of the present invention will now be described with reference to Fig.

Fig. 29 is an operation flow chart for explaining the operation of the dish washer according to the eighth embodiment of the present invention. Fig.

29, when power is supplied to the dishwasher 201, monitoring is continued until the door 204 is opened in step S301. When the door 204 is opened, the process proceeds to step S302 and waits until the lower basket 207 is drawn out from the washing tub 203 onto the door 204. [

When the lower basket 207 is taken out of the washing tub 203, the process goes to step S303 where the tableware is housed in the lower basket 207 at an arbitrary position and the movement of the lower basket 207 to the washing tub 203 Is started.

The upper basket 205 is taken out (or back) before (or behind) the lower basket 207 so that the upper basket 205 is housed in the upper basket 205 The operation order of the dishwasher 201 is not affected.

The operation from the step S302 to the step S303 is as follows. The user opens the door 204 of the dishwasher 201, draws at least the lower basket 207, stores the dishes in the lower basket 207 taken out, And corresponds to a series of operations of receiving the lower basket 207 again at the operation position.

Subsequently, in step S303, when the start of movement for accommodating the lower basket 207 is detected, the processor 221 proceeds to the next step S304 and, as shown in Fig. 26, the processor 221 is installed on the inner surface of the door 204 The photographing of the bottom basket 207 is started including the recognition mark 220 serving as the background.

Here, as described above, the moving time t and the position information x corresponding to the time t are calculated from the start time of the photographing in the rear (depth direction) of the lower basket 207, And determines the position on the lower basket 207 of each image image photographed using the image. This photographing step S304 is performed until the lower basket 207 is accommodated in the predetermined cleaning position of the washing tub 203. [

In the next step S305, when the lower basket 207 is accommodated in the predetermined cleaning position (operation position), the flow proceeds to step S306.

In step S306, it is determined whether the photographed image includes a predetermined number of images from the correspondence between the photographing time and the number of photographs, and whether the photographing condition satisfies a predetermined condition. For example, if the shooting time is 3 seconds, the number of shots is 30, which is a predetermined number. If such a condition is satisfied, then in the next step S307, the processor 221 judges that there is a tableware in a part where the recognition mark 220 in the detection area of the photographed image can not be discriminated. The tableware determination area at this time is the first detection area 241 and the second detection area 242 shown in Fig. 28 and the like. This determination operation is performed over the whole of the bottom basket 207.

At this time, the processor 221 judges, as the determination of the tableware, the amount of tableware, the shape of the tableware (including the direction in which the tableware is placed (vertical / horizontal)) and the type do. Here, the type of the tableware (material) refers to a porcelain, a resin tableware, a glass tableware, or the like. When the glassware is judged to be a glassware, for example, the glassware can be controlled to lower the water temperature.

Further, the processor 221 controls the slide member 212 which is the cleaning member in accordance with the determination result. That is, the processor 221 adjusts the operation time by selecting the cleaning range in correspondence with the placement area of each tableware. At this time, when it is judged that the amount of the inserted tableware is relatively small, the amount of cleaning detergent and the amount of water for rinsing may be adjusted.

On the other hand, if the number of captured images and its state do not satisfy the predetermined condition in step S306, the flow advances to the next step S308. In this step S308, the image of only the presence or absence of the tableware, that is, the placement position of the tableware with high accuracy is insufficient in the entire lower basket 207 to be detected. In this case, the detection condition is changed and the detection is performed. For example, it is determined that the tableware is stored in the area where the image is insufficient, and thereafter, the predetermined operation control is performed. Accordingly, it is possible to prevent the problem that the tableware is not sufficiently cleaned.

Then, in the next step S309, the washing operation, the rinsing operation and the drying operation are sequentially performed in accordance with the operation conditions set in the step S307 or S308, and the operation is terminated.

As a modification of the operation flow chart, it may be defined that the lower basket 207 is not a tableware in advance, regardless of whether or not the recognition mark 220 is detected for a specific region. Specifically, for example, it is defined that the wheels provided on both side portions of the lower basket 207 are not dishes. In this way, the information processing amount required for determination of tableware can be reduced.

 (First Modification: Arrangement Position of Recognition Mark)

Hereinafter, a first modification of the present invention will be described.

In the eighth embodiment, the recognition mark 220 is provided at the lower end of the inner surface of the door 204 for opening and closing the washing tub 203, and when the entirety of the lower basket 207 is moved to the operation position A camera 219 serving as an image pickup unit photographs a plurality of lower baskets 207 and recognition marks 220 to determine presence or absence of tableware stored in the lower baskets 207. When it is determined that there is a tableware, An example of identifying the position (placement area), the amount thereof, the shape thereof, and the type (material) thereof has been described.

In this manner, the recognition mark 220 may be provided on the entire inner surface of the door 204, instead of being provided on a part of the inner surface of the door 204.

In this way, the presence / absence, position, shape, and type (material) of the tableware housed in the entire lower basket 207 are determined with only one taken image of the lower basket 207 and the recognition mark 220 It is also possible.

Therefore, the range in which the recognition mark 220 is provided on the washing tub 203 and the number of images to be photographed are not limited.

(Second Modification: Recognition of a Storage Basket)

Hereinafter, a second modification of the present invention will be described.

In the eighth embodiment, the depth of the bottom basket 207 is calculated by using the information of the moving time t in the depth direction of the bottom basket 207 and the position (x) corresponding to the time t, And the position x in the direction of the arrow X is detected. However, the position of the lower basket 207 can be detected by a distance sensor such as an optical or magnetic sensor.

In the eighth embodiment, in order to facilitate recognition of the front end portion in the lower end basket 207, an identification pattern 207a is provided at the front end portion of the lower end basket 207. [ The identification pattern 207a arranged in the lower basket 207 is an example, and it is not necessarily required to be provided.

It is possible to determine the distance (position) from the front end portion to at least one of both side portions of the lower basket 207, for example, in place of the front end portion identification pattern 207a of the lower basket 207 A symbol (index) or the like may be arranged.

(Variation 3: selective cleaning)

Hereinafter, a third modification of the present invention will be described.

In the eighth embodiment, as the cleaning unit capable of selectively cleaning the placement area of the tableware housed in the lower basket 207, there is provided a cleaning unit that is freely slidable on the rail 211, The slide member 212 is used and the jetted water ejected from the plurality of fixed nozzles 210 is brought into contact with the oblique impact surface of the slide member 212. However, the present invention is not limited thereto.

For example, a plurality of nozzles provided in the fixed nozzle 210 may be independently opened and closed, and the injection amount may be controllable. Thus, the processor 221 can change the cleaning range or optimally control the cleaning time based on the determination result of the presence, position, and shape of the tableware housed in the lower basket 207.

(Fourth Modification: Detecting device of tableware: with recognition mark)

Hereinafter, a fourth modification of the present invention will be described.

In the eighth embodiment, the camera 219, which is an area sensor, is used as a device for photographing the lower basket 207 and the recognition mark 220 serving as the background of the lower basket 207. However, May be used.

(Fifth Modification: Detecting device of tableware: No recognition mark)

Hereinafter, a fifth modified example of the present invention will be described.

In the eighth embodiment, the recognition mark 220 serving as the background is provided in the detection portion of the lower basket 207, but the recognition mark 220 is not necessarily provided.

A plurality of light emitting diodes (LEDs), which are light emitting (emitting) means, for example, instead of the camera 219, in the width direction of the washing tub 203 To be installed.

Instead of the recognition mark 220, a plurality of CMOS (Complementary Metal-Oxide Semiconductor) sensors, which are light receiving (receiving) means, are arranged to face the plurality of LEDs, respectively. At this time, the LED and CMOS sensor do not necessarily have to be installed one by one.

With this configuration, if there is a CMOS sensor that does not receive the light emitted from the LED, it is determined that there is a tableware thereon.

(Sixth Modification: Detecting device of tableware: No recognition mark)

Hereinafter, a sixth modification of the present invention will be described.

In the sixth modified example, instead of the recognition mark 220, a distance sensor (proximity sensor) configured as one device is used instead of the CMOS sensor, which is the light emitting means and the LED used as the detecting means used in the fifth modified example, ). The distance sensor is not limited to light (an electromagnetic wave including visible light), and may be an ultrasonic wave, as is well known in the art.

In the case of this configuration, at least one distance sensor may be disposed in place of the camera 219 disposed on the front side of the ceiling surface of the cleaning tank 203.

In the case of the fourth, fifth, and sixth modifications described above, the distance sensor described in the second modified example can be used for recognizing the position of the lower basket 207.

Each of the above-described modifications includes the eighth embodiment, and can be combined with each other within a range in which no physical contradiction occurs.

As described above, according to the eighth embodiment, the slide member 212, which is a cleaning unit, is controlled according to the arrangement area of the tableware, the amount and the shape thereof, which is photographed and determined by the camera 219 as the image- It is possible to perform the energy saving operation by controlling the washing range so as not to wash the area not accommodated therein, and the operation time can be shortened.

In the eighth embodiment, a predetermined recognition mark 220 is provided at a lower portion of the lower basket 207 and at a part of the background of the image as the background of the image, and the movement time in the depth direction of the lower basket 207 t and the position x corresponding to the movement time t are used. Thus, the position, amount, shape, and type (material) of the tableware housed in the lower basket 207 can be detected with high accuracy from the image capturing state of the recognition mark 220 in a plurality of captured images.

In the eighth embodiment, it is determined that there is a tableware in a portion where the recognition mark 220 can not be discriminated from the photographed image. As a result, contamination or fogging of the camera 219 may occur, water vapor may come into contact therewith, contaminants may adhere to the surface of the recognition mark 220, or the camera 219 and the lower basket 207, It is judged that there is a tableware even when correct detection can not be performed due to being covered by a user's hand or a shield between the mark 220 and control is performed to clean the area. Thus, it is possible to prevent the dishware that is not cleaned by the erroneous detection from remaining.

Also, in the eighth embodiment, minutiae (identification patterns 207a) serving as the display described in the first and second embodiments are installed in the tableware storage basket as a method of detecting the position of the tableware storage basket (lower basket 207) It is possible to apply the first to seventh variations, which is a modification of the first embodiment.

 (Ninth embodiment)

Hereinafter, a ninth embodiment of the operation by the dish washer of the present invention will be described with reference to Fig. Also in the ninth embodiment, the configuration of the dishwasher 201 is the same as that of the eighth embodiment.

30 is an operation flow chart showing the operation of the dish washer according to the ninth embodiment of the present invention.

30, when the dishwasher 201 starts to operate, the door 204 is opened, and then the lower basket 207 is taken out, and the lower basket 207 is taken out by the user, And the operation for receiving the lower basket 207 in which the tableware is housed is started is the same as that in the first embodiment, and a description thereof will be omitted.

When the movement of the lower basket 207 to the washing tub 203 is started, the processor 221 determines whether or not the lower basket 207 has been moved to the lower basket (step S402), including the recognition mark 220, which is a background provided on the inner surface of the door 204 207). The image of the captured image is captured by using the moving time t in the rear (depth direction) of the lower basket 207 and the position information (x) corresponding to the moving time t, Lt; RTI ID = 0.0 > 207 < / RTI >

This photographing step S404 is performed until the lower basket 207 is accommodated in the predetermined cleaning position of the washing tub 203. [

In the next step S405, it is determined whether there is an image in which the captured image overlaps with the positional information. If there is an image in which the positional information is duplicated, the flow advances to the next step S406.

In step S406, out of the images in which the positional information is duplicated, the old image in front of the photographed time is deleted, and a new image whose shooting time is behind is applied. This series of photographing is repeated from step S404 until the bottom basket 207 is housed in the operating position in step S407.

When the lower basket 207 is received at the cleaning position (operation position) in step S407, the flow advances to step S408.

In step S408, it is determined whether or not the number of images photographed and the photographing state satisfy a predetermined condition. If the condition is satisfied, the process proceeds to step S409.

In step S409, the processor 221 determines that there is a tableware in a portion where the recognition mark 220 can not be discriminated in the detection area of each photographed image.

Further, the processor 221 determines the amount of the tableware, the shape (accommodated direction), and the type (material) in addition to the placement area of the tableware throughout the entire lower basket 207.

The processor 221 controls the slide member 212, which is a cleaning unit, in accordance with the determination result to change the cleaning range and to control the operation time.

On the other hand, if the number of images photographed and its state do not satisfy the predetermined condition in step S408, the flow advances to the next step S410.

In step S410, the determination condition is changed to detect the presence or absence of the tableware in the entire lower basket 207 to be detected, that is, only the image for determining the placement position of the tableware with high accuracy is insufficient. For example, it is determined that the tableware is stored in the area where the image is insufficient, and thereafter, the predetermined operation control is performed.

That is, in accordance with the operation conditions set in step S409 or S410, the cleaning operation, rinsing operation, and drying operation are sequentially performed in the next step S411, and the operation is terminated.

As described above, according to the ninth embodiment, not only an effect equivalent to that of the eighth embodiment can be obtained, but also, in the case where there is an image in which the photographed image and its positional information overlap, , The image whose photographing time is older is deleted, and the photographing time is applied to the new image. Accordingly, when the user holds the dishes in the lower basket 207 and returns the lower basket 207 back to the front side when the lower basket 207 is received in the operating position, Even when the lower basket 207 is moved irregularly, the latest image necessary for detecting the tableware is selected from the plurality of captured images, and from the state of the recognition mark 220 in the plurality of captured images, The arrangement area of the tableware housed in the basket 207, its amount, its shape, and its type (material) can be detected with high accuracy.

Also, in the ninth embodiment, minutiae (identification patterns 207a) serving as the display described in the first and second embodiments are installed in the dishwashing basket as a method of detecting the position of the tableware storage basket (lower basket 207) It is possible to apply the first to seventh variations, which is a modification of the first embodiment.

 (Tenth Embodiment)

Hereinafter, a tenth embodiment of the operation of the dishwasher of the present invention will be described with reference to Fig. In the tenth embodiment, the configuration of the dishwasher 201 is the same as that of the eighth embodiment. In addition, the recognition mark 220 used as the background of the photographing is composed of an arrangement (pattern) of regular figures as shown in Fig.

31 is an operation flowchart showing the operation of the dish washer according to the tenth embodiment of the present invention.

31, when the dishwasher 201 starts to operate, the door 204 is opened, then the lower basket 207 is taken out, and the lower basket 207 is taken out by the user, And the operation until the movement for receiving the lower basket 207 containing the tableware is started is the same as that in the eighth embodiment, and the description thereof will be omitted.

When the movement of the lower basket 207 in the washing tub 203 is started, the processor 221 includes the recognition mark 220 as a background provided on the inner surface of the door 204 in step S504, The photographing of the camera 207 is started. The image of the captured image is captured by using the moving time t in the rear (depth direction) of the lower basket 207 and the position information (x) corresponding to the moving time t, Lt; RTI ID = 0.0 > 207 < / RTI > The photographing step S504 is performed until the lower basket 207 is accommodated in the predetermined cleaning position of the washing tub 203. [

In the next step S505, when the lower basket 207 is received at the cleaning position (operation position), the flow advances to step S506.

In step S506, it is determined whether or not the number of captured images and the shooting condition satisfy predetermined conditions. If the condition is satisfied, the process proceeds to step S507.

In step S507, it is determined that there is a tableware in a portion where the recognition mark 220 can not be discriminated in the detection area of each photographed image. At this time, the processor 221 determines the amount of the tableware, the shape (accommodated direction), and the type (material) in addition to the placement area of the tableware over the entire lower basket 207.

Subsequently, in step S509, it is determined whether or not an irregular region exists in the array of the photographed recognition marks 220. [ That is, it is determined that the recognition mark 220 is not completely hidden from the object, but the presence of a distorted pattern exists in the recognition mark 220. [

If there is an irregular region in the arrangement of the recognition marks 220, it is determined in the next step S510 that there is a table for an area determined to have an irregular region in the arrangement of the recognition marks 220. [

Further, the placement area, amount, shape (direction of housed) and type (material) of the tableware housed in the entire lower basket 207 are judged again.

Based on the determination result, the processor 221 controls the fixed nozzle 212 to change the cleaning range to a required area to adjust the operation time.

On the other hand, when there is no irregular area in the arrangement of the recognition marks 220, the process proceeds to step S511 such as cleaning by the content set in step S507.

If it is determined in step S506 that the number of captured images and the captured state do not satisfy the predetermined condition, the flow advances to step S508.

In step S508, the determination condition is changed in accordance with the lack of the image of only the presence or absence of the tableware, that is, the placement position of the tableware with high accuracy, in the entire lower basket 207 to be detected. For example, it is determined that the tableware is stored in the area where the image is insufficient, and thereafter, the predetermined operation control is performed.

That is, in accordance with any one of the operating conditions set in steps S507, S508, or S510, the cleaning operation, the rinsing operation, and the drying operation are sequentially performed in the next step S511, and the operation is terminated.

As described above, according to the tenth embodiment, not only an effect equivalent to that of the eighth embodiment can be obtained, but also a recognition mark 220 having a regular arrangement is provided in a part of the background of the lower basket 207, The lower basket 207 and the recognition mark 220 are photographed and the presence or absence of an irregular region in the arrangement of the recognition marks 220 in the photographed image is determined. At this time, when an irregular region is included in the arrangement of the recognition marks 220, it is determined that there is a tableware in the irregular region.

Accordingly, when a tableware made of glass, for example, a glass cup, and a transparent and light-permeable material is housed in the lower basket 207, the transparent tableware The arrangement of the recognition marks 220, which is the background of the recognition marks 220, becomes irregular. Even when a tableware accommodated in the lower basket 207 transmits light through detection of such an irregular arrangement, the position, amount, shape, and type (material) of the tableware can be detected with high accuracy.

The camera 219, which is an image capturing unit, is not limited to visible light, and may be an infrared camera.

As a modification of the tenth embodiment, the presence or absence of at least a tableware may be detected on the detected region according to the number of recognition marks 220 detected per unit area. Accordingly, even if the tableware is a transparent material through which light such as glass is transmitted, the tableware of a transparent material such as glass can be detected per unit area, so that the detection accuracy of the glassware can be increased.

Further, since the processing amount per information processing amount can be reduced by detecting every unit area, the MPU or CPU to be mounted needs to have a minimum capacity, and the manufacturing cost can be reduced.

Also, in each of the above-described embodiments and modified examples, if the washing unit has a configuration capable of selectively spraying the water flow to the tableware storage area of the upper basket 205, The present invention can be applied not only to the upper basket 205 but also to the upper basket 205.

Also, in the above-described first to seventh embodiments, if the cleaning section has a configuration capable of selectively spraying the water flow to the tableware storage area of the upper basket, the present invention can be applied not only to the lower basket but also to the upper basket can do.

Also, in the tenth embodiment, minutiae (identification pattern 207a) serving as the display described in the first and second embodiments are provided in the dishwashing basket as a method of detecting the position of the tableware storage basket (lower basket 207) It is possible to apply the first to seventh variations, which is a modification of the first embodiment.

It is needless to say that the present invention is not limited to the above-described embodiments, and that the configurations described in the embodiments may be combined, and that various modifications may be made without departing from the spirit of the present invention.

As described above, according to the present invention, there is provided a portable information recording apparatus which photographs a stored object stored in a movable storage section and a storage section, obtains storage information including at least one of the position, size and quantity of the stored object, And is useful as a detection device and a method for detecting a stored object. It is also useful as a dishwasher capable of determining at least a storage area of a tableware stored in a tableware storage basket.

Claims (18)

Washing tub;
A receiving unit installed in the washing tub and containing dishes;
A photographing unit photographing the tableware stored in the storage unit;
And a processor for detecting a feature point from the image photographed by the photographing section and recognizing the position of the storage section according to the detected feature point to detect the position of the tableware. The method according to claim 1,
The processor comprising:
And detecting storage information including at least one of a position, a size, and a quantity of the tableware based on the image photographed by the photographing unit. The method according to claim 1,
The feature point may be,
And a position recognizing mark provided in the receiving portion. The method of claim 3,
The position recognition mark may include:
A character, a symbol, a saturation, a brightness or a pattern, or a combination thereof. The method according to claim 1,
Wherein,
A cleaning tank provided in the cleaning tank so as to be drawn out through an opening of the cleaning tank,
Wherein,
Wherein the storage portion is installed around the opening of the washing tub so as to photograph a portion drawn out from the washing tub. 6. The method of claim 5,
And a door for opening and closing the opening,
In the door,
A pattern for position identification is provided,
The processor comprising:
Wherein the position identifying pattern is detected from the image photographed by the photographing section and the placement area containing the tableware is detected using the position identifying pattern. The method according to claim 6,
Wherein,
The photographing is carried out for each drawing position of the storage portion,
The processor comprising:
A tableware for detecting the arrangement area of the tableware, the amount of the tableware, the shape of the tableware and the type of the tableware from the state of the position identifying pattern, from among the plurality of images photographed, syringe. 8. The method of claim 7,
And a washing unit for washing the tableware,
The processor comprising:
And controls the washing unit to selectively wash the area where the tableware is disposed. 9. The method of claim 8,
The processor comprising:
Wherein the washing time is adjusted so as to selectively wash the area where the tableware is disposed. 6. The method of claim 5,
Wherein,
A dishwasher comprising a camera, an area sensor or a line sensor. Washing tub;
A receiving unit movably installed in the washing tub and containing dishes;
A photographing unit photographing the tableware stored in the storage unit;
And a processor for detecting at least one storage information of the position, size and quantity of the tableware based on the image photographed by the photographing unit,
In the storage portion,
Feature points for position recognition are provided,
The processor comprising:
Wherein the detecting unit detects the characteristic points from the image photographed by the photographing unit and recognizes the position of the receiving unit according to the detected characteristic points to detect the position of the tableware. 12. The method of claim 11,
The feature point may be,
Wherein at least one display is provided in the receiving portion,
The processor comprising:
A predetermined display is detected from the photographed image, the position of the storage unit is recognized based on the position of the display, and the storage information is detected based on the position of the recognized storage unit. 13. The method of claim 12,
The processor comprising:
Wherein said display is detected on the basis of at least one of an appearance, a color, a character and a graphic form of a preset display. 12. The method of claim 11,
Wherein,
A washing tub disposed inside the washing tub to be drawn out through an opening of the washing tub,
Wherein,
Wherein the storage portion is installed around the opening of the washing tub so as to photograph a portion drawn out from the washing tub. 15. The method of claim 14,
And a door for opening and closing the opening,
In the door,
A pattern for position identification is provided,
The processor comprising:
Wherein the position identifying pattern is detected from the image photographed by the photographing section and the placement area containing the tableware is detected using the position identifying pattern. A washing tub having an opening;
A receiving portion installed in the washing tub so as to be drawn out through the opening portion and accommodating dishes;
And a processor for measuring a draw-out amount drawn out from the washing tank by the storage section and detecting the position of the storage section in accordance with the measured draw-out amount. 17. The method of claim 16,
The processor comprising:
A dishwasher including a distance image sensor, a winder, a weight sensor or a camera. 17. The method of claim 16,
And a photographing unit photographing the shape of the storage unit,
The processor comprising:
Compares the photographed image with a previously stored image, and detects at least one of the position, size, and quantity of the tableware according to the comparison result.

Images