[go: up one dir, main page]

WO2019160211A1 - Micro-onde, dispositif d'affichage, et système de cuisson les comprenant - Google Patents

Micro-onde, dispositif d'affichage, et système de cuisson les comprenant Download PDF

Info

Publication number
WO2019160211A1
WO2019160211A1 PCT/KR2018/009674 KR2018009674W WO2019160211A1 WO 2019160211 A1 WO2019160211 A1 WO 2019160211A1 KR 2018009674 W KR2018009674 W KR 2018009674W WO 2019160211 A1 WO2019160211 A1 WO 2019160211A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
microwave
camera
display device
cooktop
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2018/009674
Other languages
English (en)
Inventor
Jae-Hoon Cha
Hyeong-Jin Jang
Dong-Hyun Sohn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to EP18906262.3A priority Critical patent/EP3701770A4/fr
Priority to CN201880086587.9A priority patent/CN111615864B/zh
Publication of WO2019160211A1 publication Critical patent/WO2019160211A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2823—Reporting information sensed by appliance or service execution status of appliance services in a home automation network
    • H04L12/2827—Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality
    • H04L12/2829—Reporting to a device within the home network; wherein the reception of the information reported automatically triggers the execution of a home appliance functionality involving user profiles according to which the execution of a home appliance functionality is automatically triggered
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/46—Interconnection of networks
    • H04L12/4604—LAN interconnection over a backbone network, e.g. Internet, Frame Relay
    • H04L12/462—LAN interconnection over a bridge based backbone
    • H04L12/4625—Single bridge functionality, e.g. connection of two networks over a single bridge
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B1/00—Details of electric heating devices
    • H05B1/02—Automatic switching arrangements specially adapted to apparatus ; Control of heating devices
    • H05B1/0227—Applications
    • H05B1/0252—Domestic applications
    • H05B1/0258—For cooking
    • H05B1/0261—For cooking of food
    • H05B1/0266—Cooktops
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/02—Induction heating
    • H05B6/06—Control, e.g. of temperature, of power
    • H05B6/062—Control, e.g. of temperature, of power for cooking plates or the like
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/642—Cooling of the microwave components and related air circulation systems
    • H05B6/6423—Cooling of the microwave components and related air circulation systems wherein the microwave oven air circulation system is also used as air extracting hood
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/6426—Aspects relating to the exterior of the microwave heating apparatus, e.g. metal casing, power cord
    • H05B6/6429—Aspects relating to mounting assemblies of wall-mounted microwave ovens
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/6435—Aspects relating to the user interface of the microwave heating apparatus
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/6447—Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/6447—Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors
    • H05B6/645—Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors using temperature sensors
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/6447—Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors
    • H05B6/6461—Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors using fire or fume sensors
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/66—Circuits
    • H05B6/668—Microwave heating devices connected to a telecommunication network
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/80—Apparatus for specific applications
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B2213/00—Aspects relating both to resistive heating and to induction heating, covered by H05B3/00 and H05B6/00
    • H05B2213/06—Cook-top or cookware capable of communicating with each other

Definitions

  • Apparatuses and methods consistent with exemplary embodiments of the present disclosure relate to a microwave, a display device, and a cooking system including the microwave and the display device and, more particularly, to a microwave which provides an image photographed by a camera, a display device, and a cooking system including the camera and the display device.
  • the cooktop may be implemented solely by an electric range or a gas range, which heats a cooking object in a cooking container through at least one heater, or may be implemented as an oven range which includes an oven underneath the cooktop.
  • the over-the-range is a microwave installed in an upper direction of the cooktop, and refers to a cooking appliance that heats the cooking object contained in the cooking container using the property of the microwave.
  • a user may feel a high degree of fatigue because the user needs to constantly check, nearby the cooking object, the overheating or overcooking of the cooking object.
  • the present disclosure includes one or more exemplary embodiments that may address and/or solve the above-mentioned needs, and it is an object of the one or more exemplary embodiments of the present disclosure to provide a microwave, a display device, and a cooking system including the same which can identify overheating or overcooking of a cooking object without continuously checking the cooking object in the vicinity of the cooking object.
  • a cooking system includes a microwave configured to, according to a user command, generate a first image by photographing a cooktop located below the microwave through a first camera or generate a second image by photographing an inside of the microwave through a second camera, and transmit at least one of the first image and the second image to a display device; and a display device configured to receive at least one of a first image and a second image from the microwave and display the received image.
  • the display device may, in response to receiving of a user input, transmit a control command for controlling at least one of the microwave and the cooktop to the microwave, and wherein the microwave may receive the control command from the display device and control operations of at least one of the microwave and the cooktop according to the received control command.
  • the first camera may photograph a first cooking container positioned on the cooktop from a first photographing direction
  • the second camera may photograph a second cooking container positioned inside the microwave in a second photographing direction
  • the microwave may modify the first image which photographs the first cooking container in the first photographing direction and the second image which photographs the second cooking container in the second photographing direction to images corresponding to a third photographing direction
  • the third photographing direction may correspond to a vertical direction of the cooking container.
  • the display device may, while a content is being displayed, when a user input to display at least one image out of the first image and the second image is received, receive at least one image out of the first image and the second image from the microwave, overlap the received image with the content, and display the same.
  • the display device may, when a user input to change at least one of a size and a position of the displayed image is received, change at least one of a size and a position of the displayed image according to the user input.
  • the microwave may, based on the first image and the second image, identify a degree of bubble generation in a cooking container located inside the microwave or a cooking container positioned on the cooktop, transmit a notification message indicating a degree of the identified bubbles to the display device, wherein the display device may display the notification message received from the microwave.
  • the microwave may, based on the first image and the second image, identify a degree of smoke generation in a cooking container positioned inside the microwave or in a cooking container positioned on the cooktop, transmit a notification message indicating a degree of the identified generation of smoke, and when a degree of generation of the smoke is greater than or equal to a predetermined threshold value, stop driving of the electronic unit or drive a hood of the microwave, wherein the display device may display a notification message received from the microwave.
  • the microwave may identify a degree of blur of at least one image out of the first image and the second image, and identify a camera that photographs an image of which the identified degree of blur is greater than or equal to a preset threshold value out of the first camera and the second camera, and operate a fan which is provided in a vicinity of the identified camera.
  • a microwave includes an electronic unit; a first camera; a communicator; and a processor configured to, according to a user command, control the communicator to generate a first image by photographing a cooktop positioned below the microwave through the first camera and transmit the first image to a display device.
  • the microwave may further include a second camera, wherein the processor may control the communicator to generate a second image by photographing an inside of the microwave through the second camera and transmit the second image to a display device.
  • the processor may receive a control command to control at least one of the microwave and the cooktop from the display device and control operations of at least one of the microwave and the cooktop according to the received control command.
  • the first camera may be disposed at a specific position of the microwave to photograph a cooking container positioned on the cooktop in a diagonal direction
  • the second camera is disposed at a specific position of the microwave to photograph a cooking container positioned inside the microwave in a diagonal direction
  • the processor may modify an image which photographs the cooking container in the diagonal direction by the first camera and the second camera and transmit the modified image to the display device, and the modified image may correspond to an image photographed the cooking container in a vertical direction.
  • the processor may, based on the first image and the second image, identify a degree of bubble generation in a cooking container located inside the microwave or a cooking container positioned on the cooktop and transmit a notification message indicating a degree of the identified bubbles to the display device.
  • the processor may, based on the first image and the second image, identifies a degree of smoke generation in a cooking container positioned inside the microwave or in a cooking container positioned on the cooktop, transmit a notification message indicating a degree of the identified generation of smoke, and when a degree of generation of the smoke is greater than or equal to a predetermined threshold value, stop driving of the electronic unit or drives a hood of the microwave.
  • the processor may identify a degree of blur of at least one image out of the first image and the second image, and identify a camera that photographs an image of which the identified degree of blur is greater than or equal to a preset threshold value out of the first camera and the second camera, and operate a fan which is provided in a vicinity of the identified camera.
  • a display device includes a display; a communicator; and a processor which receives, through the communicator, at least one of a first image that photographs a cooktop located below the microwave and a second image that photographs inside the microwave and displays the received image on the display.
  • the processor may transmit a control command to control at least one of the microwave and the cooktop to the microwave, in response to receiving of a user input.
  • the processor may, while a content is being displayed, when a user input to display at least one image out of the first image and the second image is received, receive at least one image out of the first image and the second image from the microwave, overlap the received image with the content, and display the same.
  • the processor may, when a user input to change at least one of a size and a position of the displayed image is received, change at least one of a size and a position of the displayed image according to the user input.
  • a controlling method includes generating a first image by photographing a cooktop located below the microwave through a first camera according to a user command and transmitting the first image to a display device.
  • the controlling method of the microwave may further include generating a second image by photographing an inside of the microwave through the second camera according to a user command and the transmitting may transmit the first and second images to the display device.
  • a controlling method of a display device may include receiving at least one of a first image which is generated by photographing a cooktop positioned below the microwave and a second image which is generated by photographing an inside of the microwave and displaying the received image.
  • the user can continuously check the cooking object even when the user leaves the kitchen, thereby reducing fatigue from the cooking process. Further, since the microwave and cooktop device can be controlled remotely a space other than the kitchen, user convenience can be increased.
  • FIG. 1 illustrates a cooking system according to embodiments of the present disclosure
  • FIG. 2 illustrates a block diagram of a microwave according to embodiments of the present disclosure
  • FIGS. 3A to 3B illustrate a camera provided in the microwave according to embodiments of the present disclosure
  • FIG. 4 illustrates an image displayed on a display device according to embodiments of the present disclosure
  • FIG. 5 illustrates an exemplary embodiment of identifying bubbles generated from the cooking container by the microwave according to embodiments of the present disclosure
  • FIG. 6 illustrates an exemplary embodiment of identifying smoke generated from the cooking container by the microwave according to embodiments of the present disclosure
  • FIG. 7 illustrates an exemplary embodiment of preventing steam on a camera by the microwave according to embodiments of the present disclosure
  • FIG. 8 illustrates an exemplary embodiment of removing a foreign substance by the microwave according to embodiments of the present disclosure
  • FIG. 9 illustrates a block diagram of a display device according to embodiments of the present disclosure.
  • FIGS. 10A to 10E illustrate an exemplary embodiment of displaying an image to photograph an inside of the microwave by the display device and / or an image to photograph a cooktop according to embodiments of the present disclosure
  • FIG. 11 illustrates an exemplary embodiment of displaying an image photographed through a camera along with a content by the display device according to embodiments of the present disclosure
  • FIGS. 12A to 12C illustrate exemplary embodiments of editing an image photographed by a camera which is displayed on the display device according to embodiments of the present disclosure
  • FIGS. 13A to 13C illustrate exemplary embodiments of implementing a display device as a user terminal device according to embodiments of the present disclosure
  • FIGS. 14A and 14B illustrate a way that a microwave performs communication according to embodiments of the present disclosure
  • FIG. 15 illustrates a detailed block diagram of a microwave according to embodiments of the present disclosure
  • FIGS. 16A and 16B illustrate a structure of a microwave according to embodiments of the present disclosure
  • FIG. 17 illustrates a flowchart to describe operations of a microwave according to embodiments of the present disclosure.
  • FIG. 18 illustrates a flowchart to describe operations of a display device according to embodiments of the present disclosure.
  • FIGS. 1 through 18, discussed below, and the various embodiments used to describe the principles of the present disclosure in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged system or device.
  • FIG. 1 illustrates a cooking system according to embodiments of the present disclosure.
  • a cooking system may include a microwave 100 and a display device 200.
  • the microwave 100 may be implemented as an over-the-range (OTR), which is a microwave installed on a cooktop, and the display device 200 may be implemented as a smart TV.
  • OTR over-the-range
  • the display device 200 can be implemented as various electronic devices having a display such as a smart phone, a tablet, a PC, a notebook, and the like.
  • the microwave 100 and the display device 200 may perform communication to transceive various data.
  • the microwave 100 may communicate with the display device 200 to transmit at least one of the first and second images to the display device 200.
  • the first image may be an image of a cooktop located below the microwave 100
  • the second image may be an image of the inside of the microwave 100.
  • the microwave 100 may include at least one of a first camera and a second camera.
  • the first camera may be a camera for photographing the cooktop located below the microwave 100
  • the second camera may be a camera for photographing the inside of the microwave 100.
  • the display device 200 can display an image received from the microwave 100.
  • the received image may be a first image and / or a second image.
  • the user can confirm whether the cooking object is overheated or overcooked through the display device 200 without continuously checking the cooking object in the vicinity of the cooking object.
  • FIG. 2 illustrates a block diagram of a microwave according to embodiments of the present disclosure.
  • FIGS. 3A to 3B will be referred to.
  • the microwave 100 includes a first camera 110, a communicator 130, and a processor 140, and may further include a second camera 120.
  • the first camera 110 can take a picture of the cooktop located below the microwave 100. To this end, the first camera 110 may be provided at a position where the cooktop located below the microwave 100 can be photographed.
  • the first camera 110 may be provided in one area of the lower surface of the microwave 100.
  • an area where the first camera 110 is located is merely exemplary, and the first camera 110 may be located at various positions such as a central area of the lower surface of the microwave 100 for photographing a cooktop positioned at a lower surface of the microwave 100.
  • the second camera 120 can photograph the inside of the microwave 100. To this end, the second camera 120 may be provided at a position where the inside of the microwave 100 can be photographed.
  • the second camera 120 may be provided in one area of the ceilings inside the microwave 100.
  • the area where the second camera 120 is positioned is merely an example, and the second camera can be provided at various positions such as a central area of the ceilings inside the microwave 100 for photographing the inside of the microwave 100.
  • the communicator 130 may communicate with various types of external devices according to various communication types.
  • the communicator 130 may communicate with the display device 200 and may transmit at least one of the first and second images to the display device 200.
  • the first image is an image of a cooktop located below the microwave 100 through the first camera 110
  • the second image is an image of the inside of the microwave 100 through the second camera 120.
  • the communicator 130 may communicate with the display device 200 to receive a control command from the display device 200 to control at least one of the microwave 100 and the cooktop.
  • the control command may be a command to control the power on / off of the microwave 100, the cooking time or the power on / off of the cooktop, the heat temperature control of the heater of the cooktop and the like.
  • the communicator 130 may communicate with the cooktop so as to transmit a control command to the cooktop.
  • the control command may be a control command received from the display device 200 described above.
  • the control command may be a command to control power on / off of the cooktop, temperature control of the heater of the cooktop, and the like.
  • the communicator 130 may include wireless communication chips such as Wi-Fi chip, a Bluetooth chip, and the like.
  • the microwave 100 may further include an electronic unit ⁇ (not shown).
  • Various electric components such as a magnetron and a high-voltage transformer for oscillating a microwave to cook a cooking object inside the microwave 100 may be installed in the electronic unit.
  • the processor 140 controls the overall operation of the microwave 100.
  • the processor 140 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP).
  • CPU central processing unit
  • AP application processor
  • CP communication processor
  • the processor 140 may control the communicator 130 to transmit at least one of the first and second images to the display device 200.
  • the first image is an image of a cooktop located below the microwave 100 photographed through the first camera 110
  • the second image is an image of the inside of the microwave 100 photographed through the second camera 120.
  • the processor 140 may generate a first image through the first camera, and transmit the generated first image to the display device 200.
  • the processor 140 may generate a second image through the second camera and transmit the generated second image to the display device 200.
  • the processor 140 may generate the first image through the first camera and the second image from the second camera, and transmit the generated first image and the second image to the display device 200.
  • the processor 140 may receive a control command from the display device 200 to control at least one of the microwave 100 and the cooktop.
  • the control command may be a command to control the power on / off of the microwave 100, the cooking time or the power on / off of the cooktop, the heat temperature control of the heater of the cooktop, and the like.
  • the processor 140 may control the function of the microwave 100 according to the received control command. For example, when the control command is a command to turn off the power of the microwave 100, the processor 140 may turn off the power of the microwave 100 based on the control command.
  • the processor 140 may transmit the received control command to the cooktop if the control command received from the display device 200 is a control command for controlling the cooktop. For example, if the control command is a command to turn off the cooktop, the processor 140 may transmit the received control command to the cooktop. Thereafter, the cooktop can control the function of the cooktop based on the control command received from the microwave 100. In the present embodiment, the cooktop can power off the cooktop based on the received control command.
  • the user can continuously check the cooking object in the vicinity of the cooking object without a need to keep checking the cooking object.
  • the user can control at least one of the microwave 100 and the cooktop remotely, without having to move near the cooking object and thus, user convenience can be increased.
  • FIG. 4 illustrates an image displayed on a display device according to embodiments of the present disclosure.
  • the first camera 110 of the microwave 100 may be provided in one area of the lower surface of the microwave 100 as shown in FIG. 3A. That is, the first camera 110 may be disposed at a specific position of the microwave 100 to photograph the cooking container placed on the cooktop in a diagonal direction.
  • the second camera 120 of the microwave 100 may be provided in one of the ceilings inside the microwave 100, as shown in FIG. 3B. That is, the second camera 120 may be disposed at a specific position of the microwave 100 to photograph the cooking container located inside the microwave 100 in a diagonal direction.
  • a lens of the camera can be protected from steam and so on which is generated from cooking.
  • the microwave 100 may modify the image 410 photographed in the diagonal direction and transmit the modified image 410 to the display device 200.
  • the modified image may correspond to the image 420 in which the cooking container is photographed in the vertical direction as shown in FIG. 4.
  • the processor 140 may utilize an internal image of the pre-stored microwave 100 and an image of the cooktop or may use an outline detection algorithm.
  • the processor 140 may compare the pre-stored image of the cooktop with the first image photographed through the first camera 110, and identify an image matching the cooktop in the rectangular shape in the first image.
  • the processor 140 may modify the first image to correspond to the image photographed in the vertical direction by modifying the first image so as to correspond to the image photographed in a direction perpendicular to the cooktop of the rectangular shape.
  • the processor 140 may compare the pre-stored internal image of the microwave 100 with a second image photographed through the second camera 120 and identify an image matching the circular disc in the microwave 100 in the second image.
  • the processor 140 may modify the second image to correspond to the image photographed in the vertical direction by modifying the second image to correspond to the image photographed in the direction perpendicular to the round disc.
  • the processor 140 may identify the edge of the cooktop on the first image or identify the round disc on the second image through an outline algorithm, and then, as described above, the first and second images can be modified to correspond to the image photographed from a vertical direction to the cooking container.
  • the user has the effect of confirming the entire cooking object contained in the cooking container through the display device 200.
  • the processor 140 may generate an image excluding the heater on which the cooking container is not mounted.
  • the processor 140 may compare the pre-stored heater image with the image photographed by the first camera 110 to identify an area matching the pre-stored heater image.
  • the matching area is an area where the cooking container is not positioned
  • the non-matching area is an area where the cooking container is positioned.
  • the processor 140 crops the identified area, thereby generating an image excluding the heater where the cooking container is not positioned.
  • FIG. 5 illustrates an exemplary embodiment of identifying bubbles generated from the cooking container by the microwave according to embodiments of the present disclosure.
  • the processor 140 may acquire an image photographed through the camera (S510).
  • the image may be a first image which photographs a cooktop positioned at a lower side of the microwave 100 through the first camera 110 and a second image which photographs an inside the microwave 110 through the second camera 120.
  • the processor 140 may operate the water boiling verification algorithm (S520).
  • the water boiling verification algorithm may be a bubble generation detection algorithm.
  • the processor 140 can identify (S530) that the water is boiling when it is identified that the bubbles having a predetermined threshold value or more have been generated in the image through the bubble generation detection algorithm.
  • the processor 140 may transmit a notification message indicating the degree of occurrence of bubbles, that is, a notification message indicating that water is boiling, to the display device 200 (S540).
  • the user can recognize the boiling water of the cooking container without continuously checking the cooking object in the vicinity of the cooking container.
  • the processor 140 may identify that, if the change in the RGB value of the specific pixel is equal to or more than A, water is boiling.
  • the processor 140 may also use artificial intelligence techniques to identify boiling water. Artificial intelligence technology is a technology that a computer machine that realizes a human level intelligence learns and determines for itself, and a recognition rate improves as it is used.
  • the processor 140 may identify the user through a deep learning using an algorithm that self-categorizes / learns the characteristics of the input data.
  • the processor 140 can learn that bubbles have generated when the degree of generation of water vapor in the image photographed using a camera is a first level, and when the degree of occurrence of water vapor is a second level in which steam is generated more than as in the first level, and if a level of vapor generation is a third level, it can be learned that much bubbles are generated. After repeating such learning, the processor 140 can recognize that water is boiling when the degree of generation of water vapor is in the third level.
  • the processor 140 may control the microwave 100 to heat the cooking object contained in the cooking container inside the microwave 100, if the water boiling of the cooking container on the cooktop is identified. Specifically, the processor 140 may control the microwave 100 to heat the cooking object contained in the cooking container inside the microwave 100 for a predetermined time when water boiling of the cooking container on the cooktop is identified.
  • the predetermined time can be set variously by the user, such as one minute and three minutes, and so on.
  • the cooking object in the microwave 100 also begins to be heated, in order to complete cooking of the cooking object inside the microwave 100 at a time point similar to the cooking completion time of the cooking object on the cooktop.
  • FIG. 6 illustrates an exemplary embodiment of identifying smoke generated from the cooking container by the microwave according to embodiments of the present disclosure.
  • the processor 140 may acquire an image photographed through the camera (S610).
  • the image may be a first image which photographs an inside of the microwave 100 through the first camera and a second image which photographs a cooktop positioned at a lower side of the microwave 100 through the second camera 120.
  • the processor 140 may operate the smoke detection algorithm (S620).
  • the smoke detection algorithm may be an algorithm for determining whether smoke is generated or not, based on a change in the RGB value of a pixel included in the image.
  • the processor 140 can identify that a smoke is generated when a pixel having an identical R, G, or B value exists in the image, and if the pixel having an identical R, G, and B is more than a predetermined number, it can be identified that a large amount of smoke has been generated.
  • the processor 140 may transmit a notification message indicating the degree of occurrence of the identified smoke to the display device 200 (S640).
  • the processor 140 may operate the hood of the microwave if the degree of smoke generation is identified as being above a predetermined threshold value.
  • the hood may be provided in connection with the microwave 100.
  • the processor 140 may terminate the operation of the device corresponding to the detected smoke image if the degree of smoke generation is greater than or equal to a predetermined threshold value and lasts for a preset time period. For example, if it is identified in the first image that smoke is generated continuously, the operation of the heater of the cooktop can be terminated, and if it is identified in the second image that smoke is generated continuously, the operation of the microwave 100 can be terminated.
  • a user may recognize that smoke is generated from the cooking container, without a necessity to check the cooking object continuously in the vicinity of the cooking container.
  • the processor 140 may terminate the operation of the device corresponding to the detected smoke image if the degree of smoke generation is greater than or equal to a predetermined threshold value and lasts for a preset time period. For example, if it is identified that the first image is generated by continuing the smoke, the operation of the heater of the cooktop is terminated, and if the second image is identified as being generated continuously, the operation of the microwave 100 is terminated. Accordingly, the user can recognize occurrence of smoke in the cooking container without continuously checking the cooking object near the cooking container. In addition, even if the user does not recognize the occurrence of smoke, it is possible to prevent damage due to smoke generation by automatically operating the hood or terminating the operation of the heater when a large amount of smoke is generated.
  • the generation and degree of smoke in the cooking container through the smoke detection algorithm, and the generation and the degree of generation of smoke can be identified by various methods.
  • smoke may be detected by a smoke detection sensor (not shown).
  • the smoke can be identified using artificial intelligence technology as described above.
  • FIG. 7 illustrates an exemplary embodiment of preventing steam on a camera by the microwave according to embodiments of the present disclosure.
  • the processor 140 may acquire an image photographed through the camera (S710).
  • the image may be a first image which photographs a cooktop positioned in a lower side of the microwave 100 through the first camera 110 or a second image which photographs an inside of the microwave 100 through the second camera 120.
  • the processor 140 may identify whether at least one of the first and second cameras is fogged (S720). Specifically, the processor may identify the degree of blur of at least one of the first and second images, and identify the camera that photographs the image whose blur level is equal to or greater than a predetermined threshold value via a fogged camera (S730).
  • the processor 140 may drive a blower provided in the vicinity to the identified camera (S740).
  • the blower may be a fan. Depending on the operation of the blower, it is possible to remove the fog from the camera.
  • the processor 140 may stop the operation of the blower (S750).
  • the microwave 100 may provide an image where an object is photographed clearly.
  • FIG. 8 illustrates an exemplary embodiment of removing a foreign substance by the microwave according to embodiments of the present disclosure.
  • the processor 140 may obtain an image photographed by a camera (S810).
  • the image can be a first image which photographs a cooktop positioned at a lower side of the microwave 100 through the first camera 110 or a second image which photographs an inside of the microwave 100 through the second camera 120.
  • the processor 140 may operate the foreign substance confirmation algorithm (S820). Specifically, if the pixel value change of the image currently photographed through the camera and the image photographed immediately before is greater than a preset value, the processor 140 can identify that the camera is stained with the foreign substance (S830). Particularly, the processor 140 can identify that the foreign substance is attached to the camera when the pixel whose pixel value change is equal to or greater than a predetermined value is concentrated in a specific region of the image.
  • the processor 140 may check whether the identified foreign substance lasts for a preset time or longer (S840). This is to distinguish between the foreign substance and the cooking container, or the foreign substance and the cooking object. If the identified foreign substance persists for a preset time period, the processor 140 may transmit a notification message, to the display device, indicating the presence of the foreign substance (S850).
  • FIG. 9 illustrates a block diagram of a display device according to embodiments of the present disclosure.
  • a display device 200 may include a display 210, a communicator 220, and a processor 230.
  • the display 210 may display various images.
  • an image is a concept that includes still images and moving images.
  • the display 210 may display a broadcast image and a multimedia content image.
  • the display 210 may display at least one image from among the first image which photographs a cooktop positioned at a lower side of the microwave 100 and the second image which photographs an inside of the microwave 100.
  • the display 210 may display at least one of the first image which photographs a cooktop positioned at a lower side of the microwave 100 and the second image which photographs an inside of the microwave 100, along with the broadcast video and multimedia content, etc.
  • the display 210 may display a UI for receiving a control command for controlling at least one of the microwave 100 and the cooktop.
  • the display 210 may be implemented as various types of displays such as a liquid crystal display panel (LCD), a light emitting diode (LED), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), and digital light processing (DLP).
  • LCD liquid crystal display panel
  • LED light emitting diode
  • OLED organic light emitting diode
  • LCD liquid crystal on silicon
  • DLP digital light processing
  • driving circuits which can be implemented such as a-si TFT, a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), a backlight unit, and the like that can included.
  • the communicator 220 can perform communication with various types of external devices according to various types of communication methods.
  • the communicator 220 may communicate with the microwave 100 to receive at least one of the first and second images from the microwave 100.
  • the first image is an image of a cooktop located below the microwave 100 through the first camera 110
  • the second image is an image captured by the microwave 100 through the second camera 120.
  • the communicator 220 may communicate with the microwave 100 and transmit a control command to control at least one of the first and second images from the microwave 100.
  • the control command can be a command to set power on / off, cooking time, power on / off of a cooktop, or control temperature of the heater of the cooktop.
  • the communicator 220 may communicate with the cooktop and directly transmit the control command to the cooktop.
  • the control command may be a command for controlling the power on / off of the cooktop, the temperature control of the heater of the cooktop, and the like.
  • the communicator 220 may include a wireless communication chip such as a Wi-Fi chip and a Bluetooth chip.
  • the processor 230 controls the overall operation of the display device 200.
  • the processor 230 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP).
  • CPU central processing unit
  • AP application processor
  • CP communication processor
  • the processor 230 may receive at least one of the first and second images from the microwave 100 through the communicator 220.
  • the first image may be an image of a cooktop located below the microwave 100
  • the second image may be an image of the inside of the microwave 100.
  • the processor 230 may transmit a signal requesting a first image to the microwave 100 based on a user input, and may receive a first image from the microwave 100.
  • the processor 230 may transmit a signal requesting a second image to the microwave 100 based on a user input, and may receive a second image from the microwave 100.
  • the processor 230 may also transmit the first and second images to the microwave 100 based on user input and receive the first and second images from the microwave 100.
  • the processor 230 may then send a control command for controlling at least one of the microwave 100 and the cooktop from the microwave 100 based on user input.
  • the control command may be a command for controlling the power on / off of the microwave 100, setting the cooking period or power on / off of the cooktop, and controlling the heat temperature of the heater of the cooktop.
  • the processor 230 may also send a control command to the cooktop directly to control the cooktop based on user input.
  • the control command may be a command for controlling the power on / off of the cooktop, the heat temperature of the cooktop, and the like.
  • the user can continuously check the cooking object even in the area outside the kitchen.
  • the over-the-range or the heater of the cooktop can be controlled near the display device 200 without having to control the over-the-range or the heater of the cooktop near the cooking object, user convenience can be increased.
  • FIGS. 10A to 10E illustrate an exemplary embodiment of displaying an image to photograph an inside of the microwave by the display device and / or an image to photograph a cooktop according to embodiments of the present disclosure.
  • microwave 100 is implemented as an over-the-range (OTR) for convenience of explanation.
  • OTR over-the-range
  • the processor 230 may display various application menus.
  • the processor 230 may display various application menus, such as a video application, a photo application, an SNS application, etc., including an OTR camera application.
  • the processor 230 may display a message indicating that a communication connection with the OTR is being performed, as shown in FIG. 10B.
  • the user input may be performed in various ways such as an operation of touching the OTR camera application on the display of the display device 200 or an operation of selecting the OTR camera application via the remote control device.
  • the display device 200 may further include a remote control receiver.
  • the processor 230 can perform a communication connection with the OTR. This is for taking into account of security concerns. Specifically, it is intended to prevent a display device in another house from making a communication connection with the OTR in the user's house to operate the camera of the OTR.
  • activating the communicator of the OTR can be performed only when the display device 200 and the OTR are communicatively connected initially. That is, the processor 230 performs a communication connection with the OTR through such an operation, and can immediately perform a communication connection with the OTR when the OTR camera application is selected according to user input.
  • FIG. 10C it is illustrated that the communicator of the OTR is activated through a button provided in the OTR, but this is only an embodiment.
  • the communicator of the OTR may be activated via the remote control device.
  • the processor 230 may display a UI requesting to select a camera of the OTR.
  • the UI of camera 1 is a UI for selecting a first camera for photographing the cooktop located below the microwave 100
  • the UI of camera 2 is for selecting a second camera for photographing the inside of the microwave 100
  • the UIs of camera 1 & 2 may be a UI for selecting both the first and second cameras.
  • the processor 230 can display the image photographed by the selected camera.
  • the processor 230 may display the image of the cooktop located below the microwave 100 through the first camera, and when the UI of camera 2 is selected, the image of the inside of the microwave 100 photographed through the second image may be displayed.
  • the UIs of camera 1 & 2 are selected, both the image of the cooktop positioned below the microwave 100 which is photographed through the first camera and the image of the inside of the microwave 100 photographed by the second camera can be displayed.
  • the processor 230 can display an image of the cooktop located below the microwave 100 as shown in FIG. 10E.
  • FIG. 11 illustrates an exemplary embodiment of displaying an image photographed through a camera along with a content by the display device according to embodiments of the present disclosure.
  • the processor 230 may display various contents such as a broadcast image and a multimedia content image on the display 210.
  • the processor 230 may receive at least one of the first and second images from the OTR and can overlap and display the received image on the content.
  • the degree of overlapping can be set differently according to user setting.
  • the processor 230 may display a UI requesting to select at least one of first camera and the second camera.
  • the processor 230 may transmit a signal requesting an image photographed by the first camera to the OTR, and transmit an image photographed by the first camera to the OTR, and receive and display the image photographed by the first camera from the OTR.
  • the processor 230 can transmit a signal requesting an image photographed by the second camera to the OTR, receive and display the image photographed by the second camera from the OTR, and when the first and second cameras are selected, the processor 230 may transmit a signal requesting an image photographed by the first and second cameras to the OTR, and transmit an image photographed by the first and second cameras to the OTR; and can receive and display the image photographed by the first camera and the second camera from the OTR.
  • receiving the user input by the operation of pressing the OTR button of the above-described remote control device is merely an embodiment, and the user input may be received by the operation of touching the display 210 of the display device 200.
  • FIGS. 12A to 12C illustrate exemplary embodiments of editing an image photographed by a camera which is displayed on the display device according to embodiments of the present disclosure.
  • the processor 230 may edit the image photographed by the camera displayed on the display 210 according to the user input.
  • the processor 230 may change at least one of a size and a position of the displayed image according to the user input.
  • the processor 230 can move the photographed image according to a drag operation.
  • the processor 230 may change the size of the photographed image according to the dragging operation.
  • the processor 230 may change the size of the photographed image to correspond to the entire screen size of the display 210.
  • the touch and drag operation, the double touch operation, and the like can be performed in various ways.
  • a touch-drag operation, a double-touch operation, and the like can be performed through a touch pad provided in the remote control device, and a touch-and-drag operation, a double-touch operation, or the like may be performed through the display 210 of the display device 200.
  • editing of the image may be performed on each of the first and second images. Specifically, when one of the first and second images is selected and the drag operation is input to the selected image in a state where the first and second images are displayed, the processor 230 may move only the selected image to another position or display the same after magnifying the image.
  • FIGS. 13A to 13C illustrate exemplary embodiments of implementing a display device as a user terminal device according to embodiments of the present disclosure.
  • the processor 230 may display various application menus.
  • the processor 230 may display various application menus, including an OTR camera application, such as a refrigerator application, a TV application, a washing machine application, and the like.
  • the processor 230 may display a message indicating that a communication connection with the OTR is being performed, as shown in FIG. 13B.
  • the user input may be received by an operation in which the user touches the OTR camera application on the display of the display device 200.
  • the processor 230 can perform a communication connection with the OTR as shown in FIG. 13C. This takes into account security concerns. Specifically, it is intended to prevent a user terminal of another user from making a communication connection with the OTR in the user's house and operating the camera of the OTR.
  • activating the communicator of the OTR can be performed only when the display device 200 and the OTR are communicatively connected initially. That is, the processor 230 may perform a communication connection with the OTR through such an operation, and can immediately perform a communication connection with the OTR when the OTR camera application is selected according to user input.
  • the communicator of the OTR is activated through the button provided in the OTR, but this is only an embodiment.
  • the communicator of the OTR may be activated via the remote control device.
  • the processor 230 may display a UI requesting to select a camera of the OTR.
  • the UI of Camera 1 is a UI for selecting a first camera for photographing the cooktop located below the microwave 100
  • the UI for camera 2 is for selecting a second camera for photographing the inside of the microwave 100
  • the UIs of camera 1 and camera 2 may be UIs for selecting both the first and second cameras.
  • the processor 230 may, when a camera is selected through the displayed UI, display an image which is photographed by the selected camera.
  • the processor 230 displays the photographed image of the cooktop located below the microwave 100 through the first camera.
  • the processor 230 may display both the image which photographs the inside of the microwave 100 through the first camera and the image which photographs the cooktop which is located below the microwave 100 through the second camera.
  • the processor 230 may display an image which photographs the cooktop located below the microwave 100 as illustrated in FIG. 13E.
  • FIGS. 14A and 14B illustrate a way that a microwave performs communication according to embodiments of the present disclosure.
  • the microwave 100 can perform communication with the display device 200.
  • the display device 200 may be at least one of a user terminal device and an image providing device.
  • the microwave 100 may be connected to a wireless router using Wi-Fi communication and may perform communication with the display device 200 which is connected to the wireless router via Wi-Fi communication.
  • the microwave 100 can perform direct communication with the display device 200 without passing through the wireless router.
  • the microwave 100 can communicate with the server via a wireless router. Accordingly, the microwave 100 can be provided with additional services such as an upgrade service of the microwave 100 from the server.
  • the microwave 100 may be provided with a service provided by a server from a user terminal device that performs communication with the server.
  • the user terminal device may receive a file for the additional service of the microwave 100 to the server and transmit it to the microwave 100 via Wi-Fi communication.
  • the microwave 100 can perform communication with the cooktop device.
  • the cooktop device can communicate with the display device 200 and the server in the same manner as the microwave 100 performs communication as in FIG. 14A.
  • the cooktop device can transmit a signal received from an external device such as the display device 200 and a server to the microwave 100 through a wired or wireless communication method and conversely transmit a signal received from the microwave 100 to an external device such as the display device 200 and the server.
  • the wireless communication method may be a variety of methods such as a Wi-Fi method and a Bluetooth method.
  • FIG. 15 illustrates a detailed block diagram of a microwave according to embodiments of the present disclosure.
  • a microwave 100' may include a first camera 110, a second camera 120, a communicator 130, a processor 140, a storage 150, a sensor 155, a display 160, a speaker 165, a light emitting unit 170, a first fan 175, a second fan 180, and a vent 185.
  • a first camera 110 a second camera 120
  • a communicator 130 a processor 140
  • a storage 150 a sensor 155
  • a display 160 a speaker 165
  • a light emitting unit 170 a first fan 175, a second fan 180, and a vent 185.
  • the storage 150 may store commands or data related to components of the microwave 100' and an operating system (OS) for controlling the overall operation of the components of the microwave 100'.
  • OS operating system
  • the processor 140 can control a plurality of hardware or software components of the microwave 100' using various commands or data stored in the storage 150, and load commands or data received from at least one of other components to a nonvolatile memory, and store various data in the non-volatile memory.
  • the storage 150 may store at least one of the image generated by the first camera and the image generated by the second camera according to an embodiment of the present invention.
  • the processor 140 controls overall operations of the microwave 100'.
  • the processor 140 includes a RAM 141, a ROM 142, a CPU 143, first to nth interfaces 144-1 to 144-n, and a bus 145.
  • the RAM 141, the ROM 142, the CPU 143, the first to nth interfaces 144-1 to 145-n, etc. may be connected to each other via the bus 145.
  • the first to nth interfaces 144-1 to 145-n are connected to the various components described above.
  • One of the interfaces may be a network interface connected to an external device via a network.
  • the CPU 143 accesses the storage 150 and performs booting using the O / S stored in the storage 150.
  • the CPU 143 can perform various operations using various programs, contents and data stored in the storage 150.
  • the RAM 141 stores a command set for booting the system and the like.
  • the CPU 143 copies the O / S stored in the storage 150 to the RAM 141 according to the command stored in the ROM 142, executes O / S to boot the system.
  • the CPU 143 copies various programs stored in the storage 150 to the RAM 141, executes the program copied to the RAM 141, and performs various operations.
  • the sensor 155 may include at least one of a temperature sensing sensor and a smoke sensing sensor.
  • the temperature sensing sensor may include a sensor for sensing the temperature inside the microwave 100' and a sensor for sensing the temperature of the cooking container on the cooktop.
  • the smoke sensing sensor can sense smoke generated in the cooking container inside the microwave 100' or the cooking container on the cooktop.
  • the display 160 may display various screens. For example, the display 160 may display a UI indicating that the microwave 100' is communicating with the display device 200, and may display an image of the inside of the microwave 100'. Further, the display 160 may display an image of the cooking container on the cooktop.
  • the display 160 may be implemented as a touch screen to receive user input.
  • the user input may include a user input for transmitting at least one of the first and second images to the display device 200 while at least one of the first and second images is displayed on the display 160.
  • the speaker 165 may output sound. In one embodiment, when the smoke or the like is generated over a predetermined threshold value, the speaker 165 may output a warning sound indicating that smoke is being generated.
  • the light emitting unit 170 may be provided near the camera.
  • the light emitting unit 170 may be provided on at least one of the left and right sides of the first and second cameras, respectively.
  • the light emitting unit 170 may be turned on when the brightness around the camera is equal to or less than a preset threshold value.
  • a first fan 175 can be provided near the first camera 110, and a second fan 180 may be provided near the second camera.
  • each fan can remove steam on the camera in the vicinity.
  • a vent 185 may suck at least one of steam or odor generated from the cooking object.
  • the microwave 100' may further include an electromagnetic wave generation unit for heating a cooking container inside the microwave 100' and a duct for discharging smoke generated during cooking and sucked smoke to outside.
  • FIGS. 16A and 16B illustrate a structure of a microwave according to embodiments of the present disclosure.
  • FIG.16A is a bottom view of the microwave 100.
  • the vent 185 and the first camera 110 may be provided on a lower surface of the microwave 100.
  • the vent is a device for sucking steam, smoke or odor generated in a cooking object, and the microwave 100 can suck up steam, smoke, or an odor through the vent 185.
  • the vent 185 is provided at the center of the lower surface of the microwave 100, and the first camera 110 may be disposed in the rear area of the vent 185 in the lower surface of the microwave 100.
  • the first camera 110 may be provided at various positions where the cooktop of the microwave 100 can be photographed.
  • the first camera 110 may be provided at the center of the lower surface of the microwave 100.
  • the vent 185 may be provided in at least one of the side areas of the first camera 110, that is, the front, back, left, and right areas of the first camera 110.
  • FIG. 16B is a view to illustrate a left side or right side of the microwave 100.
  • the first camera 110 for photographing the inside of the microwave 100 may be provided in one of the upper surfaces of the microwave 100.
  • an area where the first camera 110 is merely exemplary and the first camera may be provided at various positions that can photograph the inside of the microwave 100, such as the center of the upper surfaces of the microwave 100, or the like.
  • the second camera 120 for photographing the cooktop located below the microwave 100 may be provided in one of the lower surfaces of the microwave 100 as shown in FIG. 16B.
  • FIG. 17 illustrates a flowchart to describe operations of a microwave according to embodiments of the present disclosure.
  • the microwave may generate a first image by photographing the inside of the microwave through the first camera according to a user command or generate a second image by displaying a cooktop located below the microwave through the second camera (S1710).
  • the user command may be input to a display device that performs communication with the microwave.
  • the microwave can receive a signal requesting at least one of the first and second images from the display device and generate at least one of the first and second images based on the received signal.
  • the microwave may have a separate button, and may generate at least one of the first and second images according to a user command input to the button.
  • the microwave may transmit at least one of the first and second images to the display device (S1720).
  • the display device can display at least one of the first and second images, and the user can continuously check the cooking object even in an area outside the kitchen.
  • FIG. 18 illustrate a flowchart to describe the operation of the display device according to embodiments of the present disclosure.
  • the display device may receive at least one of the first image generated by photographing the inside of the microwave from the microwave and the second image generated by photographing the cooktop located below the microwave (S1810).
  • the display device may transmit a signal requesting the first image to the microwave based on user input, and may receive the first image from the microwave.
  • the display device may transmit a signal requesting a second image to the microwave based on user input and receive a second image from the microwave.
  • the display device may transmit the first and second images to the microwave based on the user input, and receive the first and second images from the microwave.
  • the display device may display the received image (S1810).
  • the user can continuously check the cooking object even in an area outside the kitchen.
  • the methods according to various embodiments of the present invention described above can be implemented in the form of software or application that can be installed in an existing microwave.
  • the methods according to various embodiments of the present invention described above can be implemented by a software upgrade, or a hardware upgrade, for an existing microwave.
  • the various embodiments of the present invention described above can be performed through an embedded server provided in the microwave, or a server outside the microwave.
  • a non-transitory computer readable medium may be provided in which a program for sequentially performing the method of controlling a microwave according to the present invention is stored.
  • the non-transitory computer-recordable medium is not a medium configured to temporarily store data such as a register, a cache, or a memory but an apparatus-readable medium configured to semi-permanently store data.
  • the above-described various applications or programs may be stored in the non-transitory apparatus-readable medium such as a compact disc (CD), a digital versatile disc (DVD), a hard disc, a Blu-ray disc, a universal serial bus (USB), a memory card, or a read only memory (ROM), and provided therein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Food Science & Technology (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Electric Ovens (AREA)
  • Electric Stoves And Ranges (AREA)

Abstract

La présente invention concerne un système de cuisson. Le système de cuisson comprend un micro-onde et un dispositif d'affichage. Le micro-onde est configuré pour, en réponse à une commande d'utilisateur reçue, générer une première image par photographie d'une table de cuisson située en dessous du micro-onde par l'intermédiaire d'une première caméra ou générer une seconde image par photographie d'une partie intérieure du micro-onde par l'intermédiaire d'une seconde caméra. Le micro-onde est également configuré pour transmettre la première image et/ou la seconde image au dispositif d'affichage. Le dispositif d'affichage est configuré pour recevoir la première image et/ou la seconde image du micro-onde et afficher la ou les images reçues.
PCT/KR2018/009674 2018-02-19 2018-08-22 Micro-onde, dispositif d'affichage, et système de cuisson les comprenant Ceased WO2019160211A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP18906262.3A EP3701770A4 (fr) 2018-02-19 2018-08-22 Micro-onde, dispositif d'affichage, et système de cuisson les comprenant
CN201880086587.9A CN111615864B (zh) 2018-02-19 2018-08-22 微波炉、显示设备和包括微波炉和显示设备的烹饪系统

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2018-0019314 2018-02-19
KR1020180019314A KR102506666B1 (ko) 2018-02-19 2018-02-19 전자 레인지, 디스플레이 장치 및 이를 포함하는 조리 시스템

Publications (1)

Publication Number Publication Date
WO2019160211A1 true WO2019160211A1 (fr) 2019-08-22

Family

ID=67616520

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/009674 Ceased WO2019160211A1 (fr) 2018-02-19 2018-08-22 Micro-onde, dispositif d'affichage, et système de cuisson les comprenant

Country Status (5)

Country Link
US (2) US20190261459A1 (fr)
EP (1) EP3701770A4 (fr)
KR (1) KR102506666B1 (fr)
CN (1) CN111615864B (fr)
WO (1) WO2019160211A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11127267B2 (en) 2019-10-11 2021-09-21 Murat Yalcin Smart fire detection system

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD916772S1 (en) * 2018-07-10 2021-04-20 Brava Home, Inc. Display screen or portion thereof with graphical user interface
US20210035462A1 (en) * 2019-08-01 2021-02-04 Haier Us Appliance Solutions, Inc. Methods of remote user engagement and instructional cooking demonstrations
US11112121B2 (en) * 2019-10-04 2021-09-07 Haier Us Appliance Solutions, Inc. Cooking engagement system with automatic cooktop monitoring
KR102866312B1 (ko) 2020-03-16 2025-10-01 엘지전자 주식회사 후드겸용 전자레인지
US11983643B2 (en) * 2020-11-11 2024-05-14 Haier Us Appliance Solutions, Inc. Cooking result inference system
KR20220153891A (ko) * 2021-05-12 2022-11-21 엘지전자 주식회사 후드 겸용 조리기기
CN113892826B (zh) * 2021-09-27 2024-03-12 广东美的厨房电器制造有限公司 烹饪设备、图像处理方法、图像处理装置和可读存储介质
KR20240023855A (ko) * 2022-08-16 2024-02-23 삼성전자주식회사 조리 기기 및 조리 기기의 제어 방법
US12277782B2 (en) 2023-02-01 2025-04-15 Lg Electronics Inc. Artificial intelligence device and operating method thereof
WO2024232456A1 (fr) * 2023-05-10 2024-11-14 엘지전자 주식회사 Dispositif de commande, appareil de cuisson le comprenant, et procédé de commande associé

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150289324A1 (en) 2014-04-07 2015-10-08 Mark Braxton Rober Microwave oven with thermal imaging temperature display and control
US20150286891A1 (en) * 2014-04-08 2015-10-08 General Electric Company Systems and methods for boil detection
WO2015179031A1 (fr) * 2014-05-21 2015-11-26 Qualcomm Incorporated Instructions de déclenchement sur un dispositif cible en réponse à des notifications d'événements diffusées
US20170367151A1 (en) * 2016-06-15 2017-12-21 Panasonic Intellectual Property Management Co., Ltd. Cooking support method and cooking support system
KR20180015926A (ko) * 2016-08-04 2018-02-14 엘지전자 주식회사 조리기기 및 그 제어방법

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110254939A1 (en) * 2010-04-16 2011-10-20 Tatiana Pavlovna Kadantseva Detecting User Input Provided To A Projected User Interface
CN105453131B (zh) * 2012-04-27 2019-04-12 奥多比公司 图像的自动调整
CN104797885B (zh) * 2013-10-24 2017-06-06 松下知识产权经营株式会社 加热烹调器、烹调系统、运算装置及烹调支援方法
US9720567B2 (en) * 2014-02-17 2017-08-01 Microsoft Technology Licensing, Llc Multitasking and full screen menu contexts
US9412048B2 (en) * 2014-04-21 2016-08-09 Haier Us Appliance Solutions, Inc. Systems and methods for cookware detection
DE102014220273A1 (de) * 2014-10-07 2016-04-07 BSH Hausgeräte GmbH Bestimmen einer Temperatur mittels eines Infrarotsensors
JP6427766B2 (ja) * 2015-06-11 2018-11-28 パナソニックＩｐマネジメント株式会社 画像と調理情報を関連付ける制御方法、装置及びプログラム
US10354364B2 (en) * 2015-09-14 2019-07-16 Intel Corporation Automatic perspective control using vanishing points
US20170105572A1 (en) * 2015-10-14 2017-04-20 Geniuss Inc. Advertising on an oven's video display
KR102446811B1 (ko) * 2016-02-19 2022-09-23 삼성전자주식회사 복수의 디바이스들로부터 수집된 데이터 통합 및 제공 방법 및 이를 구현한 전자 장치
US11255663B2 (en) * 2016-03-04 2022-02-22 May Patents Ltd. Method and apparatus for cooperative usage of multiple distance meters
US10366469B2 (en) * 2016-06-28 2019-07-30 Abbyy Production Llc Method and system that efficiently prepares text images for optical-character recognition

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150289324A1 (en) 2014-04-07 2015-10-08 Mark Braxton Rober Microwave oven with thermal imaging temperature display and control
WO2015157229A1 (fr) * 2014-04-07 2015-10-15 Rober Mark Braxton Four à micro-ondes avec affichage et commande de température d'imagerie thermique
US20150286891A1 (en) * 2014-04-08 2015-10-08 General Electric Company Systems and methods for boil detection
WO2015179031A1 (fr) * 2014-05-21 2015-11-26 Qualcomm Incorporated Instructions de déclenchement sur un dispositif cible en réponse à des notifications d'événements diffusées
US20170367151A1 (en) * 2016-06-15 2017-12-21 Panasonic Intellectual Property Management Co., Ltd. Cooking support method and cooking support system
KR20180015926A (ko) * 2016-08-04 2018-02-14 엘지전자 주식회사 조리기기 및 그 제어방법

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3701770A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11127267B2 (en) 2019-10-11 2021-09-21 Murat Yalcin Smart fire detection system

Also Published As

Publication number Publication date
EP3701770A4 (fr) 2021-03-10
US20190261459A1 (en) 2019-08-22
CN111615864B (zh) 2022-08-12
EP3701770A1 (fr) 2020-09-02
US20240147579A1 (en) 2024-05-02
KR20230037524A (ko) 2023-03-16
KR20190099642A (ko) 2019-08-28
CN111615864A (zh) 2020-09-01
KR102506666B1 (ko) 2023-03-07

Similar Documents

Publication Publication Date Title
WO2019160211A1 (fr) Micro-onde, dispositif d'affichage, et système de cuisson les comprenant
WO2019004570A1 (fr) Hotte de cuisine et procédé de commande de hotte de ladite cuisine
WO2018062900A1 (fr) Dispositif d'affichage
WO2018070716A1 (fr) Dispositif électronique ayant une pluralité de modes de détection d'empreinte digitale et son procédé de commande
WO2016167620A1 (fr) Appareil et procédé destinés à la fourniture d'informations par l'intermédiaire d'une partie d'affichage
WO2014171682A1 (fr) Appareil d'affichage, et ses procede et appareil de reglage et de commande
WO2015016516A1 (fr) Procédé et dispositif de gestion d'une fenêtre à onglets indiquant un groupe d'applications contenant des applications hétérogènes
WO2021071179A1 (fr) Appareil et procédé de fourniture d'éclairage de caméra dans un dispositif électronique
WO2018026059A1 (fr) Terminal mobile et son procédé de commande
WO2015182966A1 (fr) Procédé de commande de dispositif d'affichage et dispositif électronique
WO2018016731A1 (fr) Dispositif électronique et son procédé de commande
WO2017010628A1 (fr) Procédé et appareil photographique destinés à commander une fonction sur la base d'un geste d'utilisateur
WO2016114442A1 (fr) Procédé pour la connexion automatique d'une communication à courte portée entre deux dispositifs et appareil prévu à cet effet
WO2016013906A1 (fr) Appareil électronique pour exécuter une machine virtuelle et procédé pour exécuter une machine virtuelle
WO2014007425A1 (fr) Dispositif d'affichage comprenant un écran tactile et son procédé de commande
WO2017146491A1 (fr) Dispositif électronique et son procédé de commande
WO2018113187A1 (fr) Procédé de commande d'affichage et dispositif d'affichage
WO2016021984A1 (fr) Dispositif électronique et procédé pour traiter une entrée de lettre dans le dispositif électronique
WO2020022737A1 (fr) Appareil électronique et procédé de commande associé
WO2016085256A1 (fr) Dispositif électronique pour gérer l'utilisation de données provenant d'un autre dispositif électronique et procédé de commande associé
WO2016047976A1 (fr) Appareil et procédé pour identifier un objet
EP3295363A1 (fr) Dispositif terminal et procédé de protection d'informations correspondant
WO2019194423A1 (fr) Appareil électronique et son procédé de fonctionnement
WO2017069503A1 (fr) Appareil électronique et son procédé de commande
WO2019061328A1 (fr) Procédé et dispositif de commande de terminal de photographie, et support de stockage lisible par ordinateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18906262

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018906262

Country of ref document: EP

Effective date: 20200528

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: 2018906262

Country of ref document: EP