CN111984838A - A method of displaying devices, servers, refrigerators, and recommended recipes - Google Patents

Abstract

The present application relates to the field of communications technologies, and in particular, to a display device, a server, a refrigerator, and a method for recommending recipes. The problems of checking of the recommended recipes, inconvenience in operation and low accuracy of the recommended recipes can be solved to a certain extent. The display device includes: a display screen configured to display a user interface; a first controller configured to: in response to the operation of a user on a recommended recipe application program, determining recommended recipe data which can be provided by a server according to main food materials in user refrigerator storage food materials, wherein the user refrigerator storage food materials comprise the main food materials and auxiliary food materials; and controlling the user interface to display a recommended recipe operation interface containing a control according to the recommended recipe data, wherein the control is used for skipping to a recommended recipe detail interface after receiving confirmation operation of the user.

Description

A method of displaying devices, servers, refrigerators, and recommended recipes

technical field

The present application relates to the field of communication technologies, and in particular, to a display device, a server, a refrigerator and a method for recommending recipes.

Background technique

With the popularization of AIOT (Artificial Intelligence Internet of Things), traditional home appliances also have the function of smart devices. Recipe recommendation based on the ingredients in the refrigerator is more and more popular among users.

In the implementation of some recommended recipes, usually the smart refrigerator first identifies all the ingredients stored in it, then generates various popular recipes containing the identified ingredients, and finally displays the popular recipes on the display screen of the refrigerator.

However, when there are main ingredients such as vegetables and meat and auxiliary ingredients such as onion, ginger and garlic in the storage room of the refrigerator, recommended recipes based on the auxiliary ingredients such as onion, ginger and garlic are often generated. , the recommended recipe accuracy is low.

SUMMARY OF THE INVENTION

In order to solve the problem of low accuracy of recommended recipes, the present application provides a display device, a server, a refrigerator and a method for recommended recipes.

The embodiments of the present application are implemented as follows:

A first aspect of the embodiments of the present application provides a display device, including: a display screen, configured to display a user interface; and a first controller, configured to: in response to a user's operation on a recommended recipe application, according to the user The main ingredients in the ingredients stored in the refrigerator determine the recommended recipe data that the server can provide, and the ingredients stored in the user's refrigerator include main ingredients and auxiliary ingredients; control the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data, so The above controls are used to jump to the recommended recipe details interface after receiving the user's confirmation operation.

A second aspect of the embodiments of the present application provides a server, including: a media repository for storing recipe data corresponding to ingredients; a second controller, configured to: receive a recommendation request sent from a display device, Query the recommended recipe data that can be provided in the database according to the main ingredients of the ingredients stored in the user's refrigerator, and the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; send the recommended recipe data to the display. equipment.

A third aspect of the embodiments of the present application provides a method for recommending recipes, the method includes: after a recipe recommendation application is started, sending a first recommendation request to the server, where the first recommendation request is used to make the server feedback Recommended recipe data determined according to the main ingredients in the ingredients stored in the user's refrigerator; a recommended recipe operation interface including controls is displayed on the user interface according to the recommended recipe data, and the controls are used to jump to after receiving the user's confirmation operation. Recommended recipe details interface.

A fourth aspect of the embodiments of the present application provides a method for recommending recipes, the method includes: receiving a recommendation request sent from a display device, querying available recommended recipe data according to the main ingredients in the ingredients stored in the refrigerator of the user, and the The ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; and the recommended recipe data is sent to the display device.

A fifth aspect of the embodiments of the present application provides a refrigerator, including: a camera configured to capture an internal image of the refrigerator; a display screen configured to display a user interface; and a third controller configured to: The ingredients stored in the user's refrigerator obtained according to the internal image of the refrigerator collected by the camera are sent to the server, and the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients; in response to the user's operation on the recommended recipe application, according to the The main ingredients in the ingredients stored in the user's refrigerator determine the recommended recipe data that can be provided by the server; control the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data, and the controls are used to receive the user's confirmation operation. After that, jump to the recommended recipe details interface.

Beneficial effects of the present application: by constructing main ingredients and auxiliary ingredients, it is possible to avoid generating recommended recipe data based on auxiliary ingredients such as onion, ginger and garlic; further by constructing a first recommendation request, it is possible to automatically obtain recommended recipe data after the application is started; Constructing the first set of ingredients and the second recommendation request can generate more accurate recommended recipe data for the ingredients selected by the user; further, by constructing a list of side dishes, the shelf life of ingredients can be managed; further by constructing a purchase control, the recommended recipe data can be realized In the purchase of Chinese ingredients, the main ingredients and auxiliary ingredients in the user's refrigerator can be distinguished, and the recommended recipe data generated based on the main ingredients can be used to improve the accuracy of recipe recommendation.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the accompanying drawings used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device according to an embodiment;

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the embodiment;

FIG. 3 exemplarily shows a block diagram of the hardware configuration of the control device 100 according to the embodiment;

FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to the embodiment;

FIG. 5a exemplarily shows a schematic diagram of the software configuration in the display device 200 according to the embodiment;

FIG. 5b exemplarily shows a schematic diagram of the configuration of the application in the display device 200 according to the embodiment;

FIG. 6A shows a UI schematic diagram of a TV application according to an embodiment of the present application;

FIG. 6B shows a UI schematic diagram of the display device recommended recipe data according to an embodiment of the present application;

FIG. 6C shows a UI schematic diagram of a display device recommending recipe data according to another embodiment of the present application;

FIG. 6D shows a schematic diagram of a recommended recipe data operation interface according to an embodiment of the present application;

FIG. 7 shows a schematic flowchart of a method for recommending recipes according to an embodiment of the present application;

FIG. 8 shows a schematic flowchart of a method for recommending recipes according to another embodiment of the present application;

FIG. 9A shows a schematic side view of the appearance of a refrigerator according to an embodiment of the present application;

FIG. 9B shows a schematic front view of a refrigerator according to an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, , the described exemplary embodiments are only a part of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application. In addition, although the disclosures in this application are presented in terms of one or several exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete technical solution individually.

It should be understood that the terms "first", "second", "third", etc. in the description and claims of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that data so used may be interchanged under appropriate circumstances, eg, can be implemented according to an order other than those presented in the illustrations or descriptions of the embodiments of the present application.

Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover but not exclusively include, for example, a product or device incorporating a series of components is not necessarily limited to those explicitly listed, but may include No other components are expressly listed or inherent to these products or devices.

As used in this application, the term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software code capable of performing the function associated with that element.

Reference throughout this specification to "embodiments," "some embodiments," "one embodiment," or "an embodiment," etc., means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one in the examples. Thus, appearances of the phrases "in multiple embodiments," "in some embodiments," "in at least another embodiment," or "in an embodiment" and the like throughout this specification are not necessarily all referring to the same Example. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. Thus, without limitation, a particular feature, structure or characteristic illustrated or described in connection with one embodiment may be combined in whole or in part with the feature, structure or characteristic of one or more other embodiments. Such modifications and variations are intended to be included within the scope of this application.

The term "remote control," as used in this application, refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

As used in this application, the term "gesture" refers to a user's behavior that is used to express an expected thought, action, purpose/or result through a change of hand shape or movement of the user's hand.

FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .

Wherein, the control apparatus 100 can control the display device 200 by a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., by wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the display device 200, and realize connection communication through a network communication protocol, so as to realize the purpose of one-to-one control operation and data communication. For example, a control command protocol can be established between the mobile terminal 300 and the display device 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.

As also shown in FIG. 1 , the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . For example, the display device 200 interacts by sending and receiving information, and electronic program guide (EPG), receiving software program updates, or accessing a remotely stored digital media library. The server 400 may be in one group, or in multiple groups, or in one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 400 .

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

The display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and the like.

FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the exemplary embodiment. As shown in FIG. 2, the display device 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, Display 280, audio output 270, memory 290, power supply, infrared receiver.

The display 280 is used for receiving the image signal input from the video processor 260-1, and performing components for displaying video content and images and a menu manipulation interface. The display 280 includes a display screen component for presenting a picture, and a driving component for driving image display. Display video content, which can come from broadcast television content or various broadcast signals that can be received through wired or wireless communication protocols. Alternatively, various image contents sent from the network server side can be displayed and received from the network communication protocol.

At the same time, the display 280 simultaneously displays a user-manipulated UI interface generated in the display device 200 and used to control the display device 200 .

And, depending on the type of the display 280, a driving component for driving the display is also included. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

The communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communication interface 230 may be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 and other network communication protocol chips or a near field communication protocol chip, and an infrared receiver (not shown in the figure).

The display device 200 may establish control signal and data signal transmission and reception with an external control device or a content providing device through the communication interface 230 . And, an infrared receiver, an interface device that can be used to receive infrared control signals of the control device 100 (eg, an infrared remote control, etc.).

The detector 240 is used by the display device 200 to collect external environment or external interaction signals. The detector 240 includes a light receiver 242, a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.

It also includes an image collector 241, such as a camera, a camera, etc., which can be used to collect external environment scenes, as well as to collect user attributes or interactive gestures with users, can adaptively change display parameters, and can also recognize user gestures to achieve and The function of interaction between users.

In some other exemplary embodiments, the detector 240 may also be a temperature sensor, for example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the display device 200 can be adjusted to display a relatively cool color temperature of the image, or when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color of the image.

In some other exemplary embodiments, the detector 240 can also be a sound collector, such as a microphone, which can be used to receive the user's voice, including the voice signal of the user's control instruction to control the display device 200, or to collect ambient sounds and use the In order to identify the type of the environmental scene, the display device 200 can adaptively adapt to the environmental noise.

The input/output interface 250 is used for data transmission between the control display device 200 of the controller 210 and other external devices. Such as receiving video signals and audio signals from external devices, or data such as command instructions.

The input/output interface 250 may include, but is not limited to, the following: a high-definition multimedia interface HDMI interface 251, an analog or data high-definition component input interface 253, a composite video input interface 252, a USB input interface 254, an RGB port (not shown in the figure) out) and any one or more interfaces.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned multiple interfaces.

The tuner and demodulator 220 receives broadcast and television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, frequency mixing, and resonance, and demodulates the frequency of the television channel selected by the user from multiple wireless or wired broadcast and television signals. TV audio and video signals carried in the TV, as well as EPG data signals.

Tuner demodulator 220, which can be selected by the user and controlled by controller 210, is responsive to the television signal frequency selected by the user and the television signal carried by that frequency.

The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals, etc.; Modulation can be simulated. Depending on the type of received TV signal, analog signals and digital signals are available.

In some other exemplary embodiments, the tuner 220 may also be in an external device, such as an external set-top box or the like. In this way, the set-top box outputs the television audio and video signals after modulation and demodulation, and is input into the display device 200 through the input/output interface 250 .

The video processor 260-1 is used to perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis and other video processing according to the standard codec protocol of the received external video signal, The signal for display or playback on the directly displayable device 200 is available.

Exemplarily, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used for demultiplexing the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

The image synthesizing module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator according to the user's input or itself, and the zoomed video image, so as to generate an image signal that can be displayed.

The frame rate conversion module is used to convert the input video frame rate, such as converting 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The usual format is implemented by means of frame insertion.

The display formatting module is used for converting the received frame rate into the video output signal, and changing the signal to conform to the display format signal, such as outputting the RGB data signal.

The audio processor 260-2 is used for receiving external audio signals, decompressing and decoding according to the standard codec protocol of the input signal, and performing noise reduction, digital-to-analog conversion, and amplification processing, etc., to obtain a result that can be played in the speaker sound signal.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated into one or more chips together with the controller 210.

The audio output 272, under the control of the controller 210, receives the sound signal output by the audio processor 260-2, such as: the speaker 272, and in addition to the speaker 272 carried by the display device 200 itself, can be output to the output device of the external device. An external audio output terminal 274, such as an external audio interface or an earphone interface, etc.

As for the power supply, under the control of the controller 210 , the power input from the external power supply provides power supply support for the display device 200 . The power supply may include a built-in power supply circuit installed inside the display device 200 , or may be an external power supply installed in the display device 200 , and a power interface that provides an external power supply in the display device 200 .

The user input interface is used for receiving user input signals, and then sending the received user input signals to the controller 210 . The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 210 .

In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

The controller 210 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory 290 .

As shown in FIG. 2, the controller 210 includes a RAM 213 and a ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, such as a first interface 218-1 to an nth interface 218-n, and a communication bus. Among them, the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected through a bus.

The ROM 213 is used to store various system startup instructions. For example, when the power-on signal is received, the display device 200 starts to power on, and the CPU processor 212 executes the system startup command in the ROM to copy the operating system stored in the memory 290 to the RAM 213 to start the operating system. After the startup of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM 213, and then starts to run and activate the various application programs.

The graphics processor 216 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and so on. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, generating various objects obtained based on the arithmetic unit, and displaying the result of rendering on the display 280 .

CPU processor 212 for executing operating system and application program instructions stored in memory 290 . And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.

In some exemplary embodiments, CPU processor 212 may include multiple processors. The plurality of processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode. Multiple or one sub-processors for an operation in states such as standby mode.

The controller 210 may control the overall operation of the display apparatus 100 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object can be any one of the optional objects, such as a hyperlink or an icon. Operations related to the selected object, such as displaying operations linked to hyperlinked pages, documents, images, etc., or executing operations corresponding to the icon. The user command for selecting the UI object may be an input command through various input devices (eg, a mouse, a keyboard, a touchpad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes storing various software modules for driving the display device 200 . For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Among them, the basic module is used for the signal communication between various hardwares in the postpartum care display device 200 and the bottom software module that sends processing and control signals to the upper layer module. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage.

For example, the speech recognition module includes a speech analysis module and a speech instruction database module. The display control module is a module used to control the display 280 to display image content, and can be used to play information such as multimedia image content and UI interface. Communication module, a module for control and data communication with external devices. The browser module is a module for performing data communication between browsing servers. Service modules are used to provide various services and modules including various applications.

At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focal objects.

FIG. 3 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in FIG. 3 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .

The control device 100 is configured to control the display device 200 , and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 . For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1 , the mobile terminal 300 or other intelligent electronic device can perform a similar function of controlling the device 100 after installing an application for operating the display device 200 . For example, the user can install the application, various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other intelligent electronic devices, so as to realize the function of controlling the physical keys of the device 100 .

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation among the internal components and the external and internal data processing functions.

The communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110 . For example, the received user input signal is sent to the display device 200 . The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip, a Bluetooth module, and an NFC module.

The user input/output interface 140, wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a key 144. For example, the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200.

The output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it can be an infrared interface or a radio frequency interface. For example, when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 through the infrared sending module. For another example, when a radio frequency signal interface is used, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmission terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The communication interface 130 is configured in the control device 100, such as: WiFi, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WiFi protocol, or Bluetooth protocol, or NFC protocol encoding.

The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller 110 . The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110 . Can battery and related control circuit.

FIG. 4 exemplarily shows a schematic diagram of the functional configuration of the display device 200 according to an exemplary embodiment. As shown in FIG. 4 , the memory 290 is used to store the operating system, application programs, content, and user data, etc., under the control of the controller 210 , to perform system operations that drive the display device 200 and respond to various operations of the user. Memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically used to store the running programs that drive the controller 210 in the display device 200, and to store various application programs built in the display device 200, various application programs downloaded by the user from the external device, and various graphic user programs related to the application. interface, as well as various objects related to the graphical user interface, user data information, and various internal data supporting the application. The memory 290 is used to store system software such as OS kernel, middleware, and applications, as well as input video data and audio data, and other user data.

The memory 290 is specifically used to store drivers and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input/output interface of the detector 240.

In some embodiments, memory 290 may store software and/or programs representing an operating system (OS) including, for example, a kernel, middleware, application programming interfaces (APIs) and/or applications. Illustratively, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, APIs, or applications), and the kernel may provide interfaces to allow middleware and APIs, or applications, to access the controller , to control or manage system resources.

Exemplarily, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, a light receiving module module 2909, power control module 2910, operating system 2911, and other applications 2912, browser modules, and the like. The controller 210 executes various software programs in the memory 290, such as: broadcast TV signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Other applications such as identification function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.

FIG. 5a exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.

As shown in Figure 5a, the operating system 2911, including execution operating software for handling various basic system services and for performing hardware-related tasks, acts as an intermediary for data processing done between applications and hardware components. In some embodiments, a portion of the operating system kernel may contain a set of software to manage hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, a portion of the operating system kernel may contain one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. Drivers may contain code to operate video, audio and/or other multimedia components. Examples include display, camera, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of the displayed content thereof.

The communication module 2911-2 is used to connect with other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide an object for displaying a user interface so that each application program can access it, which can realize user operability.

Control application 2911-4 for controllable process management, including runtime applications and the like.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912. In some embodiments, it is implemented in the operating system 2911 and in the application program 2912 on the one hand, and is used to monitor various user input events , will refer to the handlers that implement one or more sets of predefined operations in response to the recognition results of various events or sub-events according to various events.

Among them, the event monitoring module 2914-1 is used to monitor user input interface input events or sub-events.

The event identification module 2914-1 is used to input the definitions of various events to various user input interfaces, identify various events or sub-events, and transmit them to the processing program for executing its corresponding one or more groups .

The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of the external control device (eg, the control device 100 , etc.). Such as: various sub-events of voice input, gesture input of gesture recognition, and sub-events of remote key command input of control devices, etc. Exemplarily, one or more sub-events in the remote control include various forms, including but not limited to one or a combination of key press up/down/left/right/, confirm key, key press and so on. And non-physical button operations, such as move, hold, release and other operations.

The interface layout manager 2913 directly or indirectly receives and monitors each user input event or sub-event from the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size or position, level, etc. of the interface perform various operations related to the interface layout.

As shown in FIG. 5b, the application layer 2912 contains various applications that may also be executed on the display device 200. The applications may include, but are not limited to, one or more applications, such as: a live TV application, a video-on-demand application, a media center application, an application center, a game application, and the like.

Live TV app that can provide live TV from different sources. For example, a live TV application may provide a TV signal using input from cable, over-the-air, satellite services, or other types of live TV services. And, the live TV application may display the video of the live TV signal on the display device 200 .

Video-on-demand application that can provide video from different storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. For example, video-on-demand can come from the server side of cloud storage, from local hard disk storage containing existing video programs.

A media center application that can provide a variety of multimedia content playback applications. For example, a media center may provide services other than live TV or video-on-demand, where users can access various images or audio through a media center application.

The application center can provide storage of various applications. An application can be a game, an application, or some other application that is related to a computer system or other device but can be run on a Smart TV. The application center can obtain these applications from various sources, store them in local storage, and then run them on the display device 200 .

The embodiments of the present application can be applied to various types of household appliances (including but not limited to: display devices, smart TVs, set-top boxes, refrigerators, microwave ovens, ovens, and other household appliances including display screens). The following will take a smart TV as an example to illustrate the technical solution for implementing the relevant UI for recommending recipes.

FIG. 6A shows a schematic diagram of a UI of a TV application according to an embodiment of the present application.

The figure shows the application UI interface of the TV displayed on the display screen. For example, the application UI interface includes 4 applications installed on the TV, namely news headlines, theater on-demand, recommended recipes, and K songs. Different applications, or other function buttons can be selected by moving the focus on the display using a controller such as a remote control.

In some embodiments, the TV display screen is configured to display other interactive controls while displaying the application UI interface, and the interactive controls may include, for example, TV homepage controls, search controls, message button controls, mailbox controls, browsing Controls, Favorites Controls, Signal Bar Controls, etc.

In order to improve the convenience and visualization of the TV UI, in some embodiments, the first controller included in the display device in the embodiments of the present application controls the TV UI in response to the operation of the interactive control. For example, when a user clicks a search control through a controller such as a remote control, the search UI can be displayed on top of other UIs, that is, the UI of the application component that controls the mapping of the interactive control can be enlarged, or run and displayed in full screen.

In some embodiments, the interactive controls are also operable via sensors, which may be, but are not limited to, acoustic input sensors, such as microphones, that can detect voice commands that include an indication of the desired interactive control. For example, a user may identify a desired interactive control, such as a recommended recipe control, using a "recommended recipe" or any other suitable identification, and may also describe the desired action to be performed in relation to the desired interactive control. The first controller may recognize the voice command and submit data characterizing the interaction to the UI or its processing component or engine.

In some embodiments, the user can control the focus of the display screen through the remote control, select the recommended recipe application, so that its icon is highlighted on the user interface of the TV display screen; then by clicking on the highlighted icon, the user can achieve Open the icon-mapped application.

It should be noted that the icons and texts of the UI interface in the embodiments of the present application are only used as examples to illustrate the technical solution of recommended recipes. The icons and texts of the UI interface in the accompanying drawings can also be implemented as other contents, which are not described in the accompanying drawings of the present application. specific restrictions.

FIG. 6B shows a UI schematic diagram of a display device recommending recipe data according to an embodiment of the present application.

The display device provided by the present application includes a display screen, and the display screen is used to display a user interface, and the user interface can provide interactive functions for the user. different functions. In some embodiments, the display screen of the display device may be implemented as the display 280 of the drawings.

The display device provided by the present application further includes a first controller, the first controller controls the user interface to display a recommended recipe operation interface including controls according to the determined recommended recipe data, and the controls are used for after receiving the user's confirmation operation to jump to the recommended recipe details interface.

The following will describe the technical solution for implementing the recommended recipe by the display device provided by the present application.

When the user starts the recommended recipe application, the first controller of the display device, in response to the user's operation on the recommended recipe application, determines the recommended recipe data that can be provided by the server according to the main ingredients in the ingredients stored in the user's refrigerator, the user's refrigerator stores The ingredients include main ingredients and auxiliary ingredients.

In some embodiments, the server provided by the present application includes a second controller, and the second controller identifies the user's refrigerator storage ingredients sent from the refrigerator as main ingredients and auxiliary ingredients.

Wherein, the auxiliary ingredients may be implemented as green onions, and/or ginger, and/or garlic, and the main ingredients are the ingredients stored in the user's refrigerator other than the auxiliary ingredients. For example, when the smart refrigerator recognizes that the stored ingredients include: fish, beef, tomato, green pepper, onion, ginger, and garlic, the server provided in this application determines the onion, ginger, and garlic as auxiliary ingredients; , tomatoes, and green peppers are determined as the main ingredients.

The smart refrigerator can automatically identify the ingredients stored in the user's refrigerator, and upload the identified ingredients to the server provided in this application. When accessing the server, the recommended recipe application in the display device provided by the present application can read the stored ingredients in the user's refrigerator that have been saved by the server. It should be noted that the main ingredients and auxiliary ingredients can be preset according to actual conditions, and the specific contents thereof are not limited in this application.

In some embodiments, the foodstuffs stored in the user's refrigerator include the names of the foodstuffs, the length of time for which each foodstuffs are stored, and the like. In practical applications, the information on the ingredients in the refrigerator can be obtained through the refrigerator. For example, the server provided in this application can send a query request to the user's refrigerator in a wired or wireless manner. After receiving the query request sent by the server, the refrigerator can scan the ingredients on the The information of the ingredients stored in the refrigerator is obtained by means of the RFID tag of the refrigerator, and the information of the ingredients is fed back to the server in a wired or wireless manner.

In some embodiments, the refrigerator can obtain the information of the stored food in real time through the following methods. First, the controller of the refrigerator acquires an image of the storage room, and processes the image of the storage room to obtain the grid position; then, the refrigerator acquires the user's hand trajectory, and selects the corresponding fitting trajectory based on the movement trend of the hand trajectory , the fitting trajectory is the hand trajectory at the time of item access; according to the fitting trajectory and grid position, the item access position is calculated and obtained, so that the storage or retrieval of ingredients in the refrigerator can be monitored in real time, and the user's refrigerator storage can be obtained. Detailed information of the ingredients, such as the location of the ingredients in the refrigerator, the storage time, the remaining days of the shelf life, etc.; finally, the refrigerator uploads the ingredients stored in the user's refrigerator to the server provided in this application.

In some embodiments, the recommended recipe data includes attribute information of the recipe, wherein the attribute information of the recipe includes main ingredients required by the recipe, dish taste, cooking method, suitable crowd, suitable scene, cuisine, dish, efficacy, and Properties elements such as required kitchen tools. In practical applications, the recipes and the attribute information of the recipes are associated and stored in the media resource library of the server provided by this application, so that they can be accessed and used.

In some embodiments, the server provided by this application includes a media repository, where the media repository is used to store recipe data corresponding to ingredients. For example, a media library of the server has a built-in dictionary of correspondence between ingredients and recipes, and the dictionary contains the names of all known ingredients and the correspondence between ingredients and all recipes containing the ingredients. After obtaining the ingredient information of all the ingredients in the refrigerator, the recipe corresponding to the ingredient name is obtained from the dictionary according to the name of the ingredient in the ingredient information. The recipe corresponding to each ingredient name may be one or several.

For example, assuming that the ingredients in the refrigerator include onions and cucumbers, the corresponding recipes for onions and cucumbers can be obtained through the above dictionary lookup. Further, after the recipes corresponding to the onions and the cucumbers are obtained, the recommended recipe data is obtained by obtaining the union between the recipes corresponding to the onions and the recipes corresponding to the cucumbers.

In some embodiments, the first controller, in response to the user's operation on the recommended recipe application, determining the recommended recipe data that can be provided by the server according to the main ingredients in the ingredients stored in the user's refrigerator includes, the first controller in response to the The startup confirmation operation of the recommended recipe application sends a first recommendation request to the server, and the first recommendation request is used to make the server feed back the determined recommended recipe data, and the recommended recipe data is determined by the server according to the identified recipe data. The main ingredient in the ingredients stored in the user's refrigerator is determined; then, the first controller receives the recommended recipe data sent by the server.

When the display device starts the recommended recipe application, the first controller will send a first recommendation request to the server to obtain recommended recipe data. That is, the server determines the recommended recipe data that can be provided to the display device according to the main ingredients in the user's refrigerator stored ingredients uploaded by the user's refrigerator. It should be noted that in the process of generating the recommended recipe data, the second controller of the server stores the user's refrigerator storage. The auxiliary ingredients in the ingredients are filtered out, that is, the onion, ginger, and garlic in the above-mentioned embodiment are filtered out, so that the server can generate recommended recipe data based on the main ingredients that are more in line with the user's needs, and can avoid the server from generating the onion, ginger, and garlic based on the auxiliary ingredients. Recommended recipes, but the main ingredients required in the recommended recipes are not stored in the user's refrigerator.

Continuing to refer to FIG. 6B , after determining the recommended recipe data that the server can provide, the first controller of the display device controls the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data, the controls are used for receiving user After confirming the operation, jump to the recommended recipe details interface.

The second controller of the server receives the recommendation request sent from the display device, and queries the available recommended recipe data in the media repository according to the main ingredients of the ingredients stored in the user's refrigerator, and the ingredients stored in the user's refrigerator are stored by the server Identify the main ingredient or auxiliary ingredient; and send the recommended recipe data to the display device.

For example, the second controller of the server receives the first recommendation request sent from the display device, and the first recommendation request indicates that the display device is turned on and online, that is, it can be considered that as long as the display device starts the recommended recipe application, the server will receive The first recommendation request sent by the display device is displayed; then the second controller determines the available recommended recipe data in the media repository according to the received main ingredient query in the ingredients stored in the user's refrigerator, and sends the recommended recipe data to the display screen.

In some embodiments, the user's smart refrigerator reports the information of the ingredients stored in the user's refrigerator to the server in the cloud, and the second controller of the server or the recommended recipe business system will regularly query every day to determine the main ingredient information of the current refrigerator, and according to the The main ingredient information is queried to determine the recommended recipe data, and the recommended recipe data is saved. When the recommended recipe application of the display device requests the recommended recipe data, the saved recommended recipe data is sent to the display device to improve the response speed.

In some embodiments, the first controller controlling the user interface to display the recommended recipe operation interface including controls according to the recommended recipe data includes, the first controller includes the first recommended recipe data and the second recommended recipe data when the received recommended recipe data includes the first recommended recipe data and the second recommendation. When the recipe data is used, a mapping relationship is constructed according to the preset matching characteristics of different users bound by the display device and the recipes in the recommended recipe data, a user list is generated based on the mapping relationship, and a focus position in the user list is generated according to the The user at the location controls the second recommendation window to display the recommended recipe data mapped by the user, wherein the user list and the second recommendation window are simultaneously displayed in the user interface.

As shown in FIG. 6B , when the recommended recipe data generated by the server includes the first recommended recipe data and the second recommended recipe data, that is, when it includes multiple recommended recipe data, the first controller can determine the data of different users bound to the display device according to the The preset matching features and the recipes in the recommended recipe data build a mapping relationship, and a user list is generated based on the mapping relationship, that is, the multiple recipes produced are classified according to different user preset matching features, and the recommended recipes are more Targeted to improve the fit of user needs.

For example, the user list in the figure includes 3 users: father, mother, Dabao Dabaoda, among which,

The preset matching features of the user's father are: taste: spicy, fresh; others: reduce blood lipids;

The preset matching features of the user's mother are: taste: sour; others: early pregnancy;

The preset matching features of user Dabao Dabaoda are: taste: sweet; others: protect eyesight.

The first controller controls the left side of the user interface to display the user list, and controls the right side of the user interface to generate a second recommendation window; the user's father is the focus position in the user list, and the first controller controls the second recommendation window The window displays the recommended recipe data mapped by the user's father, including pickled fish, Mapo tofu, and couple's lung slices.

That is, the first controller of the display device uses the recipes in the recommended recipe data determined by the server that are spicy, fresh, and have the function of lowering blood lipids as the mapped recommended recipe data of the user's father. By operating the user list, the recommended recipe data of the corresponding user can be displayed in the second recommendation window.

In some embodiments, the first controller controlling the user interface to display the recommended recipe operation interface including controls according to the recommended recipe data includes: when the received recommended recipe data only includes the first recommended recipe data, the first controller: The first recommendation window is controlled to display the first recommended recipe data.

In some embodiments, a mapping relationship is constructed according to the preset matching features of different users bound to the display device and the recipes in the recommended recipe data, wherein the preset matching features can also be preset from the following perspectives.

For example, the crowd is roughly divided into infants, children, adults, the elderly, pregnant women, college entrance examination people, etc.; the scenes are divided into breakfast, lunch, dinner and supper, etc.; the recipes are divided into Hunan cuisine, Sichuan cuisine, Shandong cuisine, etc. according to geographical areas; recipes Varieties are divided into meat dishes, vegetarian dishes, soups, desserts, snacks, steamed dishes, boiled dishes, stir-fried dishes, etc.; efficacy is divided into blood, calcium, iron, blood pressure, blood lipid lowering, etc.; taste preferences can include sour, spicy, bitter, sweet , salty, sour, fresh, etc.; cooking methods can be divided into steaming, stir-frying, frying, baking, etc.

FIG. 6D shows a schematic diagram of a recommended recipe data operation interface according to an embodiment of the present application.

In some embodiments, the first controller of the display device controls the user interface to display, according to the recommended recipe data, a recommended recipe operation interface including controls for jumping to the recommended recipe details interface after receiving the user's confirmation operation , wherein the recommended recipe operation interface includes a purchase control, and the purchase control is used to jump to the purchase operation interface of the ingredients corresponding to the recommended recipe after receiving the user's confirmation operation.

In the recommended recipe operation interface including donuts, after the user clicks the donut poster control, the first controller controls the donut poster control to jump to the operation interface of the recipe, including the name, picture, and introduction of the recipe , materials, and a production method, wherein the production method may include graphic tutorials or video tutorials; the operation interface further includes a purchase control, and the user can jump to the recommendation by operating the purchase control. The recipe corresponds to the purchase operation interface of the ingredients, and users can purchase various materials needed to make donuts online.

In some embodiments, the recommended recipe operation interface displayed on the user interface includes a plurality of recipes, the recipes include a poster control, and the poster control is displayed as a picture corresponding to the recipe; and the server is the poster control when sending the recommended recipe data A URL or ID is preset, so that after the user clicks the poster control, the user interface is loaded as the recommended recipe details interface. In some embodiments, the server includes the recommended recipe details of the recipe when sending the recommended recipe data. After the user clicks the poster control, the user interface loads the recommended recipe details interface according to the recommended recipe details. FIG. 6C shows a UI schematic diagram of a display device recommending recipe data according to another embodiment of the present application.

In some embodiments, the first controller of the display device, in response to the user's operation on the recommended recipe application, determining the recommended recipe data that the server can provide according to the main ingredients in the ingredients stored in the user's refrigerator includes, the first controller responding Constructing a first set of ingredients based on the user's selection of ingredients stored in the user's refrigerator; sending a second recommendation request to the server, where the second recommendation request includes the first set of ingredients, and the second recommendation request is used to make The server determines recommended recipe data that can be provided by the server according to the main ingredient in the first ingredient set; and receives the recommended recipe data sent from the server.

The first controller displays the user's refrigerator storage ingredients received by the server from the refrigerator on the user interface. Based on the user's operation of the focus in the user interface, the first controller selects and confirms that at least one ingredient constitutes the first ingredient set, and reports to the server. sending a second recommendation request containing the first set of ingredients;

The second controller of the server receives a second recommendation request including the first ingredient set sent from the display device, and queries the media library included in the server according to the main ingredient in the first ingredient set in the second recommendation request Determining the available recommended recipe data and sending the recommended recipe data to the display device.

The first controller of the display device receives recommended recipe data fed back from the server, where the recommended recipe data is generated based on the main ingredient in the first ingredient set selected by the user. Thereby, the scope of the recommended recipe data can be narrowed, so that the recommended recipe data is more suitable for the user's needs.

In some embodiments, the first controller controls the first set of ingredients selected by the user to be less than 3 kinds of ingredients, and the server performs matching according to the main ingredients in the first set of ingredients, constructs recommended recipe data for the recipe with the highest matching degree and Give feedback.

In some embodiments, the first controller of the display device constructing the first set of ingredients in response to the user's selection of ingredients stored in the user's refrigerator includes, the first controller displaying, on the user interface, a set of ingredients generated according to the ingredients stored in the user's refrigerator A side dish list, where the ingredients included in the side dish list are arranged in ascending order according to the remaining days of the shelf life; in response to a user's selection operation on the ingredients in the side dish list, a first ingredient set is constructed.

In the smart side dish user interface shown in FIG. 6C , the side dish list generated by the first controller includes all the ingredients stored in the user's refrigerator, and the figure shows the name, picture, and remaining days of the shelf life of each ingredient. For example, the list of side dishes in the figure includes apples, broccoli, grapes, carrots, cabbage, ham, strawberries, watermelon, milk, bread, soy milk, fruit juice, red wine, shrimp, cherries, cakes, etc.

The first controller arranges the ingredients according to the remaining days of the shelf life of the ingredients in the side dish list from small to large, and the smaller the remaining days of the shelf life, the higher the order, so as to prompt the user to select and use the ingredients that are close to the shelf life to avoid waste. , to improve the fit of the recommended recipes to user needs and practicability.

In some embodiments, the first controller generates a progress bar for the ingredients according to the remaining days in the shelf life of the ingredients, and displays the progress bar of the ingredients whose remaining days in the shelf life is less than or equal to a preset threshold as a high brightness or a preset color to remind the user to quickly Use ingredients.

Based on the introduction of the technical solution for realizing the recommended recipe data by the display device and the description of the drawings, the present application also provides a method for recommending recipes on the display device side.

FIG. 7 shows a schematic flowchart of a method for recommending recipes according to an embodiment of the present application.

In step 701, after the recommended recipe application is started, a first recommendation request is sent to the server, and the first recommendation request is used to make the server feed back recommended recipe data determined according to the main ingredients in the ingredients stored in the user's refrigerator.

In step 702, a recommended recipe operation interface including controls is displayed on the user interface according to the recommended recipe data, and the controls are used to jump to the recommended recipe details interface after receiving the user's confirmation operation.

The specific operation of implementing the recommended recipe by the display device has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.

In some embodiments, after the recommended recipe application is started, the method further includes: sending a second recommendation request to the server, where the second recommendation request includes a first set of ingredients selected and constructed by the user for the ingredients stored in the refrigerator of the user, The second recommendation request is used to enable the server to determine recommended recipe data that can be provided by the server according to the main ingredient in the first ingredient set; and to receive the recommended recipe data sent from the server. The specific operation of implementing the recommended recipe by the display device has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.

Based on the introduction of the technical solution for realizing the recommended recipe data by the display device and the server and the description of the drawings, the present application also provides a method for recommending recipes on the server side.

FIG. 8 shows a schematic flowchart of a method for recommending recipes according to another embodiment of the present application.

In step 801, a recommendation request sent from a display device is received, and recommended recipe data that can be provided is queried according to the main ingredients in the user's refrigerator storage ingredients, and the user's refrigerator storage ingredients are identified by the server as main ingredients or auxiliary ingredients ;

In step 802, the recommended recipe data is sent to the display device.

The specific operation of implementing the recommended recipe by the server has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.

In some embodiments, receiving a recommendation request sent from a display device, and querying the available recommended recipe data according to the main ingredients in the ingredients stored in the refrigerator of the user includes: receiving a second recommendation including a first set of ingredients sent from the display device request, determine the recommended recipe data that can be provided according to the main ingredient in the first ingredient set in the second recommendation request; and send the recommended recipe data to the display device. The specific operation of implementing the recommended recipe by the server has been described in detail in the introduction of the technical solution for implementing the recommended recipe on the TV side above, and will not be repeated here.

FIG. 9A shows a schematic side view of the appearance of a refrigerator according to an embodiment of the present application.

As shown in the figure, FIG. 9A also shows a refrigerator provided by the present application, including a camera (not shown in the figure), a display screen and a third controller (not shown in the figure).

The refrigerator in the figure is a 4-door refrigerator, and its camera is arranged inside the refrigerator, and is configured to capture the internal images of the refrigerator, for example, to acquire the images of the refrigerator compartment and freezer compartment inside the refrigerator, and send them to the third controller for use. Identify ingredients and generate recommended recipe data.

The display screen, which is configured to display the user interface, is usually provided on the outside of the door panel of the refrigerator compartment.

In some embodiments, the third controller is configured to send the user's refrigerator storage ingredients obtained according to the image of the interior of the refrigerator captured by the camera to the server, where the user's refrigerator storage ingredients are identified by the server as main ingredients or auxiliary ingredients In response to the user's operation on the recommended recipe application, determine the recommended recipe data that the server can provide according to the main ingredients in the stored ingredients in the user's refrigerator; control the user interface to display the recommended recipe operation including controls according to the recommended recipe data interface, the control is used to jump to the recommended recipe details interface after receiving the user's confirmation operation. The position diagram of the recommended recipe operation interface is shown in FIG. 9B . The specific operation of the third controller, camera, and display screen in the refrigerator to implement recommended recipes is similar to the implementation of recommended recipes on the TV side, which has been described in detail in the introduction of the technical solutions for the implementation of recommended recipes on the TV and server sides above. Repeat.

The beneficial effects of the embodiments of the present application are that, by constructing main ingredients and auxiliary ingredients, it is possible to avoid generating recommended recipe data based on auxiliary ingredients such as onion, ginger, and garlic; further, by constructing a first recommendation request, it is possible to automatically obtain recommended recipe data after the application is started. ; Further by constructing the first ingredient set and the second recommendation request, more accurate recommended recipe data can be generated for the ingredients selected by the user; further by constructing the side dish list, the management of the shelf life of the ingredients can be realized; further by constructing the purchase control, it can be realized The purchase of ingredients in the recommended recipe data realizes the distinction between main ingredients and auxiliary ingredients in the user's refrigerator, and the recommended recipe data generated based on the main ingredients improves the accuracy of recipe recommendation.

Furthermore, those skilled in the art will appreciate that aspects of this application may be illustrated and described in several patentable categories or situations, including any new and useful process, machine, product, or combination of matter, or combinations of them. of any new and useful improvements. Accordingly, various aspects of the present application may be performed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software may be referred to as a "data block", "controller", "engine", "unit", "component" or "system". Furthermore, aspects of the present application may be embodied as a computer product comprising computer readable program code embodied in one or more computer readable media.

A computer storage medium may contain a propagated data signal with the computer program code embodied therein, for example, on baseband or as part of a carrier wave. The propagating signal may take a variety of manifestations, including electromagnetic, optical, etc., or a suitable combination. Computer storage media can be any computer-readable media other than computer-readable storage media that can communicate, propagate, or transmit a program for use by coupling to an instruction execution system, apparatus, or device. Program code on a computer storage medium may be transmitted over any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or a combination of any of the foregoing.

The computer program coding required for the operation of the various parts of this application may be written in any one or more programming languages, including object-oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python etc., conventional procedural programming languages such as C language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby and Groovy, or other programming languages, etc. The program code may run entirely on the user's computer, or as a stand-alone software package on the user's computer, or partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter case, the remote computer may be connected to the user's computer through any network, such as a local area network (LAN) or wide area network (WAN), or to an external computer (eg, through the Internet), or in a cloud computing environment, or as a service Use eg software as a service (SaaS).

Furthermore, unless explicitly stated in the claims, the order of processing elements and sequences described in the present application, the use of numbers and letters, or the use of other names are not intended to limit the order of the procedures and methods of the present application. While the foregoing disclosure discusses by way of various examples some embodiments of the invention presently believed to be useful, it is to be understood that such details are for purposes of illustration only and that the appended claims are not limited to the disclosed embodiments, but rather The requirements are intended to cover all modifications and equivalent combinations falling within the spirit and scope of the embodiments of the present application. For example, although the system components described above may be implemented by hardware devices, they may also be implemented by software-only solutions, such as installing the described systems on existing servers or mobile devices.

Similarly, it should be noted that, in order to simplify the expressions disclosed in the present application and thus help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of the present application, various features are sometimes combined into one embodiment, in the drawings or descriptions thereof. However, this method of disclosure does not imply that the subject matter of the application requires more features than those mentioned in the claims. Indeed, there are fewer features of an embodiment than all of the features of a single embodiment disclosed above.

Each patent, patent application, patent application publication, and other material, such as article, book, specification, publication, document, etc., cited in this application is hereby incorporated by reference in its entirety. Application history documents that are inconsistent with or conflict with the content of this application are excluded, as are documents (currently or hereafter appended to this application) that limit the broadest scope of the claims of this application. It should be noted that, if there is any inconsistency or conflict between the descriptions, definitions and/or terms used in the attached materials of this application and the content of this application, the descriptions, definitions and/or terms used in this application shall prevail .

Claims (13)

1. A display device, characterized in that, comprising: a display screen configured to display a user interface; The first controller, configured as: In response to the user's operation on the recommended recipe application, the recommended recipe data that can be provided by the server is determined according to main ingredients in the ingredients stored in the user's refrigerator, where the ingredients stored in the user's refrigerator include main ingredients and auxiliary ingredients; The user interface is controlled to display a recommended recipe operation interface including controls according to the recommended recipe data, and the controls are used to jump to the recommended recipe details interface after receiving a user's confirmation operation. 2 . The display device according to claim 1 , wherein, in response to the user's operation on the recommended recipe application, the first controller determines, according to the main ingredients in the ingredients stored in the user's refrigerator, the recommended recipe data that can be provided by the server comprising: 2 . , the first controller In response to the start-up confirmation operation of the recommended recipe application, a first recommendation request is sent to the server, and the first recommendation request is used to cause the server to feed back the determined recommended recipe data, the recommended recipe data from the The server determines according to the identified main ingredients in the user's refrigerator storage ingredients; Receive the recommended recipe data sent by the server. 3 . The display device according to claim 1 , wherein, in response to the user's operation on the recommended recipe application, the first controller determines the recommended recipe data that can be provided by the server according to the main ingredients in the ingredients stored in the user's refrigerator, comprising: 3 . , the first controller constructing a first set of ingredients in response to a user's selection of ingredients to be stored in the user's refrigerator; Sending a second recommendation request to the server, where the second recommendation request includes the first ingredient set, and the second recommendation request is used to enable the server to determine the first ingredient set according to the main ingredient in the first ingredient set Recommended recipe data that the server can provide; The recommended recipe data sent from the server is received. 4. The display device of claim 3, wherein the first controller constructing the first set of ingredients in response to a user's selection of ingredients to be stored in the user's refrigerator comprises: the first controller displaying, on the user interface, a side dish list generated according to the ingredients stored in the user's refrigerator, and the ingredients included in the side dish list are arranged in ascending order according to the remaining days in the shelf life; In response to a user's selection operation on the ingredients in the side dish list, a first ingredient set is constructed. 5 . The display device according to claim 1 , wherein the first controller controlling the user interface to display a recommended recipe operation interface including controls according to the recommended recipe data comprises: the first controller 5 . When the received recommended recipe data only includes the first recommended recipe data, controlling the first recommendation window to display the first recommended recipe data; When the received recommended recipe data includes the first recommended recipe data and the second recommended recipe data, a mapping relationship is constructed according to the preset matching features of different users bound to the display device and the recipes in the recommended recipe data, based on The mapping relationship generates a user list, and controls the second recommendation window to display the recommended recipe data mapped by the user according to the user at the focus position in the user list, wherein the user list and the second recommendation window are simultaneously appears in the user interface. 6. A server, characterized in that, comprising: The media database is used to save the recipe data corresponding to the ingredients; The second controller, configured as: Receive a recommendation request sent from a display device, and query the available recommended recipe data in the media repository according to the main ingredients of the ingredients stored in the user's refrigerator, and the ingredients stored in the user's refrigerator are identified by the server as main ingredients or auxiliary ingredients. Ingredients; The recommended recipe data is sent to the display device. 7 . The server according to claim 6 , wherein the second controller receives a recommendation request sent from a display device, and in the media repository, inquires about the main ingredients that can be provided according to the main ingredients of ingredients stored in the user’s refrigerator. 8 . The recommended recipe data includes, the second controller Receive a first recommendation request sent from a display device, and determine available recommended recipe data in the media repository according to the main ingredient in the ingredients stored in the user's refrigerator, where the first recommendation request indicates that the display device is turned on Go online; send the recommended recipe data to the display device. 8 . The server according to claim 7 , wherein the second controller receives a recommendation request sent from a display device, and inquires about the available food items in the media repository according to the main ingredients of the ingredients stored in the user’s refrigerator. 9 . The recommended recipe data includes, the second controller Receive a second recommendation request including a first ingredient set sent from a display device, and query and determine available recommended recipe data in the media repository according to the main ingredient in the first ingredient set in the second recommendation request ; The recommended recipe data is sent to the display device. 9. A method for recommending a recipe, the method comprising: After the recommended recipe application is started, a first recommendation request is sent to the server, and the first recommendation request is used to make the server feed back recommended recipe data determined according to the main ingredients in the ingredients stored in the user's refrigerator; A recommended recipe operation interface including controls is displayed on the user interface according to the recommended recipe data, and the controls are used to jump to the recommended recipe details interface after receiving the user's confirmation operation. 10. The method for recommending recipes according to claim 9, characterized in that, after the recommending recipe application program is started, the method further comprises: Send a second recommendation request to the server, where the second recommendation request includes a first set of ingredients selected and constructed by the user for the ingredients stored in the user's refrigerator, and the second recommendation request is used to make the server according to the first The main ingredient in the ingredient set determines the recommended recipe data that the server can provide; The recommended recipe data sent from the server is received. 11. A method for recommending recipes, the method comprising: Receive a recommendation request sent from a display device, and query the available recommended recipe data according to the main ingredient in the ingredients stored in the user's refrigerator, and the ingredients stored in the user's refrigerator are identified by the server as the main ingredient or the auxiliary ingredient; The recommended recipe data is sent to the display device. 12 . The method for recommending recipes according to claim 11 , wherein receiving a recommendation request sent from a display device, and querying the available recommended recipe data according to the main ingredients in the ingredients stored in the refrigerator of the user comprises: 12 . receiving a second recommendation request including a first ingredient set sent from a display device, and determining available recommended recipe data according to the main ingredient in the first ingredient set in the second recommendation request; The recommended recipe data is sent to the display device. 13. A refrigerator, characterized in that, comprising: a camera configured to capture internal images of the refrigerator; a display screen configured to display a user interface; A third controller, configured as: Sending the user's refrigerator storage ingredients obtained according to the interior image of the refrigerator collected by the camera to the server, and the user's refrigerator storage ingredients are identified by the server as main ingredients or auxiliary ingredients; In response to the user's operation on the recommended recipe application, determining the recommended recipe data that the server can provide according to the main ingredients in the ingredients stored in the user's refrigerator; The user interface is controlled to display a recommended recipe operation interface including controls according to the recommended recipe data, and the controls are used to jump to the recommended recipe details interface after receiving a user's confirmation operation.

Images