CN118733917A - A display device and a user scene creation method - Google Patents

Abstract

Some embodiments of the present application provide a display device and a user scenario creation method, wherein the display device records a first voice instruction input by a user based on a first preset time range and a second preset time range to obtain a first instruction set and a second instruction set. The first instruction set is a subset of the second instruction set, and the first preset time range is smaller than the second preset time range. By obtaining the number of occurrences of the first instruction set in the second instruction set and combining it with a scenario threshold, a target instruction set can be created based on the first instruction set. When the user inputs a second voice instruction, the target instruction set can be searched based on the second voice instruction, and a recommendation page can be displayed to display the target instruction set that has a mapping relationship with the second voice instruction. The display device generates and recommends user scenarios by collecting user behavior data, which helps to simplify the user operation process.

Description

A display device and a user scene creation method

Technical Field

The present application relates to the technical field of display devices, and in particular to a display device and a user scene creation method.

Background Art

When users need to start multiple smart home appliances, they need to send control instructions to the target devices one by one to start and control the smart home appliances to perform the target operations. However, the process of users starting smart home appliances one by one is cumbersome, resulting in a long operation time and affecting the user experience.

Artificial Intelligence of Things (AIOT) can be applied to the field of multi-device control, such as smart home appliance control. Furthermore, AIOT can be combined to integrate the control instructions of multiple devices into user scenarios, so that users can start smart home appliances to perform target operations by calling user scenarios.

Users can create user scenarios based on their usage habits. User scenarios contain multiple control instructions for controlling smart home appliances to perform target operations. When users need to control the operation of multiple smart home appliances, they only need to call user scenarios to start multiple smart home appliances. This method simplifies the operation process when users start smart home appliances, but it takes a lot of time for users to create user scenarios. In addition, during a long usage cycle, users are prone to forgetting the user scenarios they have created, resulting in repeated creation of user scenarios, which in turn increases the operational burden.

Summary of the invention

In some embodiments of the present application, a display device and a user scene creation method are provided to solve the problem of difficulty in creating user scenes.

In a first aspect, some embodiments of the present application provide a display device, including: a display, a communication device, and a controller.

The display is configured to display a user interface; the communication device is configured to establish a communication connection with a smart home appliance; and the controller is configured to:

Based on a first preset time range and a second preset time range, a first voice command input by a user is recorded to obtain a first command set and a second command set; the first command set is a subset of the second command set; the first preset time range is smaller than the second preset time range; the voice command is used to control a target device to perform a target operation; the target device includes the display device and/or the smart home appliance;

Obtaining the number of occurrences of the first instruction set in the second instruction set;

If the number of occurrences is greater than or equal to the scene threshold, creating a target instruction set based on the first instruction set;

In response to a second voice instruction input by a user, the display is controlled to display a recommendation page, wherein the recommendation page includes a target instruction set having a mapping relationship with the second voice instruction.

In some feasible embodiments, the controller records the first voice instruction input by the user based on the first preset time range and the second preset time range to obtain the first instruction set and the second instruction set, and is configured as follows:

Normalizing and processing the first voice instruction according to the semantic model to obtain a first device instruction;

A first instruction set is created based on the first device instruction; the first instruction set includes at least one of the first device instructions.

In some feasible embodiments, the controller obtains the number of occurrences of the first instruction set in the second instruction set, and when the number of occurrences is greater than a scene threshold, creates a target instruction set based on the first instruction set, and is configured as follows:

Controlling the display to display a first recommendation page, where the first recommendation page includes a first device instruction included in the first instruction set and scene creation recommendation information;

In response to a confirmation creation instruction input by a user, creating a target instruction set according to the first instruction set;

A set name is set for the target instruction set according to the first device instruction included in the target instruction set.

In some feasible embodiments, the controller is further configured to:

In response to a second voice instruction input by a user, normalize and process the second voice instruction according to the semantic model to obtain a second device instruction;

Searching for a target instruction set according to the second device instruction;

If the target instruction set includes the second device instruction, controlling the display to display a second recommendation page; the second recommendation page includes the target instruction set;

In response to the power-on instruction input by the user, based on the target instruction set, the target device is controlled to perform a target operation, and a voice recommendation instruction of the target instruction set is played.

In some feasible embodiments, after executing the search for the target instruction set according to the second device instruction, the controller is further configured to:

Get the number of searched target instruction sets;

If at least 2 target instruction sets are searched, the display is controlled to display a second recommendation page, which includes recommendation information of at least 2 target instruction sets, and the recommendation information of at least 2 target instruction sets is displayed according to time sequence and scene capacity sequence.

In some feasible embodiments, the controller controls the display to display the second recommendation page, and is further configured to:

Obtaining a time tag of the target instruction set;

Sort the target instruction set according to the time label to obtain a first scene sequence;

Obtaining the capacity of the target instruction set;

Sort the first scene sequence according to the capacity to obtain a second scene sequence;

Based on the arrangement order of the target instruction sets in the second scene sequence, the display order of the recommendation information of at least two target instruction sets in the recommendation page is set.

In some feasible embodiments, the controller is further configured to:

In response to a third voice instruction input by a user, searching for a target instruction set according to the third voice instruction;

When the target instruction set is searched, controlling the display to display a second recommendation page, the second recommendation page including the target instruction set;

In response to the power-on instruction input by the user, the target device is controlled to perform a target operation based on the target instruction set.

In some feasible embodiments, the controller executes based on the target instruction set to control the target device to perform a target operation, and is configured to:

According to the target instruction set, acquiring execution range information of the target device, and acquiring expected execution information of a first device instruction in the target instruction set;

If the execution scope information includes the expected execution information, controlling the target device to execute the target operation based on the first device instruction;

If the execution scope information does not include the expected execution information, a third recommendation page is generated, and the third recommendation page includes supplementary information; the supplementary information is used to prompt the user to control other target devices to perform target operations.

In some feasible embodiments, when searching for the target instruction set, the controller controls the display to display the second recommendation page, and is configured to:

Extracting keywords from the target instruction set;

Generate personalized recommendation information based on the keyword, and control the display to display the personalized recommendation information in the second recommendation page.

In a second aspect, the present application provides a user scenario creation method, comprising:

Based on a first preset time range and a second preset time range, a first voice command input by a user is recorded to obtain a first command set and a second command set; the first command set is a subset of the second command set; the first preset time range is smaller than the second preset time range; the voice command is used to control a target device to perform a target operation; the target device includes a display device and/or a smart home appliance;

Obtaining the number of occurrences of the first instruction set in the second instruction set;

If the number of occurrences is greater than the scene threshold, creating a target instruction set based on the first instruction set;

In response to a second voice instruction input by a user, a recommendation page is displayed, wherein the recommendation page includes a target instruction set having a mapping relationship with the second voice instruction.

It can be seen from the above technical content that the present application provides a display device and a user scenario creation method. The display device records the first voice instruction input by the user based on the first preset time range and the second preset time range to obtain a first instruction set and a second instruction set. The first instruction set is a subset of the second instruction set, and the first preset time range is smaller than the second preset time range. By obtaining the number of occurrences of the first instruction set in the second instruction set and combining the scene threshold, a target instruction set can be created based on the first instruction set. When the user inputs the second voice instruction, the target instruction set can be searched according to the second voice instruction, and a recommendation page can be displayed to display the target instruction set that has a mapping relationship with the second voice instruction. The display device generates and recommends user scenarios by collecting user behavior data, which is conducive to simplifying the user operation process.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

FIG1 is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

FIG2 is a schematic diagram of a hardware configuration of a display device provided in some embodiments of the present application;

FIG3 is a schematic diagram of software configuration of a display device provided in some embodiments of the present application;

FIG4 is a schematic diagram of communication connection between a display device and a smart home appliance provided in some embodiments of the present application;

FIG5 is a flow chart of a display device according to some embodiments of the present application creating and starting a user scene according to a voice command input by a user;

FIG6 is a schematic diagram of a first recommendation page provided in an embodiment of the present application;

FIG7 is a schematic diagram of a second recommendation page provided in an embodiment of the present application;

FIG8 is a schematic diagram of a second recommendation page when multiple user scenarios are searched according to an embodiment of the present application;

9 is a flow chart showing a display device according to an embodiment of the present application determining whether a target device can execute a device instruction;

FIG10 is a schematic diagram of a third recommendation page provided in an embodiment of the present application;

FIG. 11 is a schematic diagram of a second recommendation page including personalized recommendation content provided in an embodiment of the present application.

DETAILED DESCRIPTION

The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and/or software code that is capable of performing the functions associated with that element.

In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

FIG1 is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. As shown in FIG1, a user can operate a display device 200 through touch operation, a mobile terminal 300, and a control device 100. The control device 100 is used to receive an operation instruction input by a user and convert the operation instruction into a control instruction that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a handle, etc.

The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

1 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN) and other networks.

The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function of a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

FIG. 2 is a hardware configuration block diagram of the display device 200 in FIG. 1 provided in some embodiments of the present application.

In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input/output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

In some embodiments, the user input interface 280 may be used to receive instructions from a user.

In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for a display device.

The operating system can be divided into different modules or levels according to the functions implemented. For example, as shown in Figure 3, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications layer) (referred to as "application layer"), the application framework layer (Application Framework layer) (referred to as "framework layer"), the system library layer and the kernel layer.

In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Applications can access system resources and obtain system services during execution through the API interface.

As shown in FIG3 , the application framework layer in the embodiment of the present application includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C/C++ instruction library, to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as shown in FIG3 , a hardware driver can be configured in the kernel layer, and the driver included in the kernel layer can be at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver, etc.

It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device 200 and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

In some embodiments, the user interface may include a media playback interface, and the user may send a playback instruction to the display device 200 through the control device 100 to control the display device 200 to play or display the corresponding media data, so that the user can watch various media programs through the display device 200.

The media data may include various types, such as video data, audio data, text data, etc. When the display device 200 plays the media data, the display 260 may be controlled to display the playing screen of the media data. If the media data also includes audio data corresponding to the playing screen, the display device 200 may also synchronously play the audio data through the audio output device 270.

As shown in Figure 4, the display device 200 and the smart home appliance can establish a communication connection based on a local area network (LAN), a wireless local area network (WLAN), and other connection methods. Therefore, when a user uses a smart home appliance, the user can issue a control instruction to the smart home appliance based on the display device 200, so that the smart home appliance performs the target operation according to the control instruction.

In some usage scenarios, users will continuously issue control instructions to multiple smart home appliances to start multiple smart home appliances. However, the process of starting smart home appliances one by one is cumbersome and inefficient, so users can create user scenarios in advance based on their personal usage habits. In this way, users can replace the operation method of issuing multiple smart home appliance control instructions with the operation method of triggering user scenarios, thereby simplifying the operation control process of smart home appliances.

However, when a user creates a user scene, it is necessary to bind the control instructions of multiple smart home appliances to create the user scene, which will increase the user's operation steps in the user scene creation stage, making the user scene creation process cumbersome. In addition, when the user uses the display device 200 and smart home appliances for a long time, some of the user scenes that have been created will be forgotten, and the scene will be repeatedly created, resulting in cumbersome operations and a waste of some storage resources. In addition, in the scene where guests or relatives visit, it will be difficult to start the user scene because the user scene is not clear.

In order to solve the above problems, as shown in FIG5 , some embodiments of the present application provide a display device, which includes a display 260, a communication device 220, and a controller 250. The display 260 is configured to display a user interface, and the communication device is configured to establish a communication connection with a smart home appliance. The controller 250 is configured to:

S100: Based on a first preset time range and a second preset time range, a first voice command input by a user is recorded to obtain a first command set and a second command set.

In some embodiments, the first voice command refers to a command input by the user for controlling the display device 200 or a smart home appliance. The first preset time range and the second preset time range are the periods for the controller 250 to collect user behavior data through the detector 230. The first instruction set includes the user behavior data collected by the detector 230 within the first preset time range. For example, within 2 minutes, the user issues instructions such as "start the TV", "adjust the air conditioner to 24°C", and "turn on the background light". The detector 230 can create and save the first instruction set based on "start the TV", "adjust the air conditioner to 24°C", and "turn on the background light".

The second instruction set includes user behavior data collected by the detector 230 within the second preset time range. The first preset time range is smaller than the second preset time range, so the first instruction set can be a subset of the second instruction set. In this way, the target instruction set can be determined by combining the time dimension and screening the number of occurrences of the first instruction set in the second instruction set.

The user can start the display device 200 or the smart home appliance through the first voice command. And the display device 200 will record the first voice command through the detector 230, and create a first command set based on the first voice command. Among them, the process of creating the first command set can be performed in the cloud, that is, after the display device collects the first voice command through the detector 230, it uploads the first voice command to the cloud, and the cloud creates the first command set according to the first voice command. When the display device 200 needs the first command set, the cloud will transmit the data packet of the first command set back to the display device 200. It can be understood that when the hardware resources of the display device 200 are sufficient, the operations performed in the cloud can also be completed independently by the display device 200.

S200: Obtain the number of occurrences of the first instruction set in the second instruction set.

In some embodiments, the user inputs the first voice command periodically. For example, after the user just returns home, he/she will perform a series of operations such as turning on the lights, starting the TV, and starting the air conditioner in a short period of time. Therefore, the detector 230 can collect the user's behavior data (first voice command) within the first preset time range to form a first command set. The first command set can represent the user's behavior habits within the first preset time range.

The second preset time range is greater than the first preset time range, so the first instruction set can be screened based on the second preset time range. The second preset time range can be in days, for example, 3 days. The controller 250 controls the detector 230 to collect user data within 3 days to obtain the second instruction set. It should be noted that the second instruction set contains multiple subsets, and the first instruction set is a subset in the second instruction set. In this way, it is possible to determine whether the first instruction set is the user's behavioral habits by judging the number of the first instruction set contained in the second instruction set. Therefore, by setting the first preset time range and the second preset time range, the user's behavioral habits can be counted and screened, thereby improving the adaptability of the instruction set to the user's behavioral habits.

S300: If the number of occurrences is greater than or equal to the scene threshold, creating a target instruction set based on the first instruction set.

In some embodiments, the scene threshold can be set according to actual conditions. For example, when the second preset time range is 3 days, the scene threshold is set to 3. In this way, when the number of occurrences of the first instruction set is searched in the second instruction set to be 3, the target instruction set can be created according to the first instruction set. The target instruction set includes multiple control instructions, and when the user calls the target instruction set, the target instruction set is called by any control instruction included in the target instruction set to simplify the user's operation process.

S400: In response to a second voice instruction input by a user, controlling the display to display a recommendation page, wherein the recommendation page includes a target instruction set having a mapping relationship with the second voice instruction.

The second voice command may also refer to a voice command input by the user to the display device 200 when starting the display device 200 or the smart home appliance. The first voice command and the second voice command are only used to distinguish the technical contents of creating a target command set and calling a target command set in the embodiment of the present application, and do not limit the voice command.

In some embodiments, when the controller 250 receives the second voice command, it can control the display 260 to display the recommendation page. As shown in Figure 7, the recommendation page includes a set of target instructions that have a mapping relationship with the second voice command, such as "start the TV" and "adjust the air conditioner to 24°C". The recommendation page can also include prompt information, such as "Are you sure you want to start the current scene?". In this way, after the display 260 displays the recommendation page, the user can determine to start the current scene according to the prompt information. In addition, the prompt information can not only be displayed in the form of text on the recommendation page, but also be broadcast in the form of voice to prompt the user.

In some embodiments, the voice command input by the user will change, but the semantics represented by the voice command is the same, such as "turn on the air conditioner" and "start the air conditioner". Both voice commands are used to indicate that the user wants to use the air conditioner, but the user's words are different. Therefore, when the controller 250 receives the voice command, it is necessary to normalize the voice command to convert the voice command into a machine-executable language, and summarize and organize the voice command according to semantics. The controller 250 records the first voice command input by the user based on the first preset time range and the second preset time range, obtains the first command set and the second command set, and is configured as follows:

The first voice instruction is normalized according to the semantic model to obtain a first device instruction. A first instruction set is created based on the first device instruction.

In some embodiments, the semantic model may be a model preset on the display device 200 or in the cloud. Using the semantic model, the voice command may be normalized to convert the first voice command into a machine-recognizable first device command. In the normalization process, the first voice command is also split to obtain the language components in the first voice command. For example, "air conditioning temperature 28 degrees" can be split into "air conditioning temperature adjustment +28°C" after splitting.

It is understandable that after the controller 250 converts the first voice command into the first device command according to the semantic model, the first command set can be created according to the first device command. Moreover, when the controller 250 receives the voice command input by the user, it converts the voice command into the device command according to the semantic model, and then searches for the command set according to the device command.

Normalizing voice commands can improve the recognition ability of voice commands and reduce the usage of storage resources through normalization. In addition, by refining the language components in voice commands, the refinement of command sets can be improved, which can support scene judgment requirements. For example, whether the target device has sufficient execution capabilities to execute the control requirements represented by the voice command.

In some embodiments, when creating a target instruction set, the controller 250 may directly create the target instruction set when the number of occurrences of the first instruction set in the second instruction set is greater than or equal to the scene threshold. It is also possible to display a recommendation page to the user during the operation phase of the display device 200 to confirm with the user whether to create the target instruction set. That is, when creating a target instruction set, the controller 250 is configured to:

The display is controlled to display a first recommendation page. In response to a confirmation creation instruction input by a user, a target instruction set is created according to the first instruction set. A set name is set for the target instruction set according to the first device instruction included in the target instruction set.

As shown in FIG6 , in some embodiments, the first recommendation page includes the first device instruction included in the first instruction set and the scene creation recommendation information. Among them, the first recommendation page is a recommendation page used to interact with the user to confirm whether to create the target instruction set. The first recommendation page displays the text information corresponding to the first device instruction. For example, after "turn on the air conditioner" and "start the air conditioner" are normalized as the first device instruction, the instructions such as "turn on the air conditioner" and "start the air conditioner" in the first recommendation page all display "turn on the air conditioner".

The first recommendation page also includes scene creation recommendation information. The scene creation recommendation information includes creation confirmation information displayed to the user, such as "Do you want to create the following scene for you?" In the first area to which the creation confirmation information belongs, all instructions in the first instruction set can also be displayed, such as "Turn on the air conditioner in the living room, the air conditioner temperature is 24 degrees, and the upper and lower sweeping wind is turned on." In this way, the user can clearly understand the first device instructions contained in the current first instruction set, and then determine whether to call the target instruction set to start the corresponding scene according to actual needs.

In some other embodiments, the first recommendation page also includes semantic recommendation information, which is information generated according to the semantics of the first device instruction in the target instruction set displayed on the first recommendation page. For example, if the first device instruction is to turn on the air conditioner at 24°C, the semantic recommendation information may be "What is the temperature in xx city today?".

As shown in Figure 6, the scenario creation recommendation information can be displayed in the middle of the first recommendation page as the display subject in the first recommendation page for easy viewing by users. The semantic recommendation information can be displayed at the bottom of the first recommendation page as personalized recommendation content, thereby enriching the content of the first recommendation page and enhancing the user experience.

It is understandable that after seeing the scene creation recommendation information displayed on the first recommendation page, the user can enter a confirmation creation instruction to enable the controller 250 to create a target instruction set according to the first instruction set, and the target instruction set can be used to characterize the user scene. Among them, the way to enter the confirmation creation instruction includes but is not limited to voice, touch, gesture, and remote control. In this way, when the controller 250 receives the confirmation creation instruction, it creates a target instruction set according to the first instruction set.

In some embodiments, the controller 250 or the cloud can set a scene name for the target instruction set according to the semantics of the first device instruction in the first instruction set. For example, the first instruction set includes first device instructions such as "turn on the air conditioner", "air conditioner temperature 24 degrees", "turn on up and down sweeping", etc. In this way, the name can be set to "air conditioner start scene" according to the first device instruction.

In other embodiments, the first device instruction in the first instruction set can be used to control different smart home appliances, such as "turn on the living room light", "turn on the TV", and "start the air conditioner". The controller 250 or the cloud can combine the voice of the first device instruction and the time node corresponding to the first instruction set to set the scene name "home scene" for the target instruction set. In this way, when the user triggers the user scene, the controller 250 can control the display 260 to display the scene name-the text of the device instructions contained in the scene so that the user can know the scene content more clearly.

In some embodiments, when the controller 250 receives a user's voice command, it screens the created target command set and recommends the target command set to the user, so that when the user issues a single voice command, multiple smart home appliances can be started. The controller 250 is also configured to:

In response to a second voice instruction input by a user, the second voice instruction is normalized and processed according to a semantic model to obtain a second device instruction. A target instruction set is searched according to the second device instruction. If the target instruction set includes the second device instruction, the display is controlled to display a second recommendation page; the second recommendation page includes the target instruction set.

In response to the power-on instruction input by the user, based on the target instruction set, the target device is controlled to perform a target operation, and a voice recommendation instruction of the target instruction set is played.

The second voice command and the first command are both commands used by the user to control the display device 200 or the smart home appliance. In some embodiments, after the cloud has created the target command set, the controller 250 can send the second voice command to the cloud when receiving the second voice command, and the cloud normalizes the second voice command to obtain the second device command. Then, the cloud can search for the created target command set according to the second device command, and transmit the searched target command set back to the display device 200, so that the display 260 displays the searched target command set on the recommendation page.

As shown in Figure 7, after receiving the target instruction set data transmitted back from the cloud, the controller 250 can control the display 260 to display the second recommendation page. The second recommendation page includes scene startup recommendation information, which may include the text of the device instruction in the searched target instruction set, and the prompt word "Do you want to execute the living room cooling scene for you". The user can select the scene they want to start based on the scene startup recommendation information. That is, the user can input a power-on instruction, such as "start the living room cooling scene", to control the air conditioner through the display device 200 to perform the target operation according to the device identification instruction contained in the living room cooling scene.

In some embodiments, when the controller 250 starts the target device according to the power-on instruction, it will also synchronously control the player or other components with voice playback function to play the voice recommendation instruction to indicate that the power-on instruction has been executed, such as "the living room cooling scene is starting". In addition, the actions that need to be performed for the living room cooling scene will be displayed on the second recommendation page, such as "turn on the living room air conditioner" and "turn on the upper and lower sweeping wind". In this way, the user can be fully prompted with the execution progress of the current user scene. In addition, semantic recommendation information can also be displayed at the bottom of the second recommendation page to make personalized recommendations to the user.

When the controller 250 searches for a target instruction set according to a voice instruction input by a user, there are situations where no target instruction set is found, one target instruction set is found, or at least two target instruction sets are found. When no target instruction set is found, the controller 250 can convert the voice instruction into a device instruction, and then drive the target device to perform the target operation indicated by the voice instruction according to the device instruction.

When one target instruction set is searched, it can be displayed on the second recommendation page. As shown in FIG8 , when at least two target instruction sets are searched, the target instruction sets need to be sorted and displayed on the second recommendation page according to the sorting result. That is, the controller 250 is further configured as:

The number of the searched target instruction sets is obtained. If at least two target instruction sets are searched, the display is controlled to display a second recommendation page. The recommendation information of at least two target instruction sets is displayed according to the time sequence and the scene capacity sequence.

In some embodiments, when the controller 250 searches for three target instruction sets according to the voice command input by the user, it can control the display 260 to display the second recommendation page, and display the scene names, device instruction texts, semantic recommendation information and other texts and graphic contents of the three target instruction sets on the second recommendation page. The arrangement order of the three target instruction sets and the time order corresponding to the target instruction sets are related to the scene capacity.

In some embodiments, when the controller 250 controls the detector 230 to collect the user's behavior data and create a target instruction set, it can set a time tag for the target instruction set according to the time when the behavior data was collected. Then, the user scene can be subdivided by the time tag. For example, the controller 250 will set a time tag for the behavior data collected by the detector 230 from 18:00 to 18:05 in the evening, and will also set a time tag when creating the target instruction set. In this way, the time dimension is combined when creating the target instruction set, and when the controller 250 receives the user's voice command, it can also search and recommend user scenes in combination with the time dimension. In this way, when the voice command input by the user is relatively simple, the user scene can also be searched and recommended in combination with the time dimension.

In some embodiments, the scenario capacity refers to the number of device instructions included in the target instruction set. When performing user scenario recommendations, the controller 250 may prioritize the push of target instruction sets with smaller scenario capacities. This can improve the fit between the recommended target instruction set and the user's intention.

In some embodiments, when the controller 250 displays the user scenarios through the second recommendation page, it can adjust the number of user scenarios displayed in the second recommendation page in combination with the number of user scenarios to be displayed and the page size of the second recommendation page. In addition, based on sorting the user scenarios in combination with the scenario capacity and the time sequence, the fit between the user scenarios displayed in the second recommendation page and the user's intention can be improved.

In some embodiments, when the controller 250 controls the display 260 to display the second recommendation page, the controller 250 may sort the target instruction set based on the time sequence and the scene capacity. The controller 250 is configured to:

Obtain a time tag of the target instruction set. Sort the target instruction set according to the time tag to obtain a first scene sequence. Obtain a capacity of the target instruction set. Sort the first scene sequence according to the capacity to obtain a second scene sequence. Based on the arrangement order of the target scenes in the second scene sequence, set the display order of the recommendation information of at least two target scenes in the recommendation page.

In some embodiments, the controller 250 can obtain the time tag of the searched target instruction set and the time when the current user issued the voice command, and sort the target instruction set according to the time sequence. For example, the target instruction set whose time represented by the time tag is close to the current time is preferentially recommended, that is, the target instruction set is sorted according to the time tag to obtain the first scene sequence. In this way, the recommended target instruction set can be closer to the actual needs of the user.

After sorting the target instruction set according to the time sequence, the target instruction set can also be sorted in combination with the scene capacity. For example, the target instruction set with a small scene capacity is preferentially recommended. It can be understood that when sorting the target instruction set based on the scene capacity, the sorting is performed on the basis of the first scene sequence to obtain the second scene sequence. The controller 250 can set the display order of the target instruction set in the second recommendation page according to the order of the target instruction set in the second scene sequence.

Therefore, the controller 250 can filter the target instruction sets based on time sequence and scene capacity, so as to give priority to recommending target instruction sets that are highly consistent with the user's actual needs when there are many searched target instruction sets and it is not appropriate to display all of them.

As shown in Figure 8, in some embodiments, the second recommendation page displays not only the scene name of the user scene, but also the text of the device command included in the user scene. When the user inputs a voice command, the controller 250 can search for the user scene and make recommendations based on the device command associated with the voice command.

In some other embodiments, the controller 250 may also search for user scenarios and make recommendations based on the scenario names input by the user. The controller 250 is further configured to:

In response to a third voice command input by a user, a target command set is searched according to the third voice command. When the target command set is searched, the display is controlled to display a second recommendation page, the second recommendation page includes the target command set. In response to a power-on command input by the user, the target device is controlled to perform a target operation based on the target command set.

It is understandable that the second recommendation page includes the text of the device instructions in the target instruction set and the scene name corresponding to the target instruction set. The third voice instruction refers to a voice instruction containing a scene name, such as "start the living room cooling scene". After receiving the third voice instruction, the controller 250 searches for the user scene (target instruction set) according to the scene name. And after searching for the user scene, the control display 260 displays the second recommendation page and displays the text of the device instruction, the scene name, the prompt information and other contents on the second recommendation page.

In other embodiments, because the scene names are similar, the controller 250 will also display the relevant content of multiple user scenes on the second recommendation page. And in the scene creation stage, if there are identical or similar scenes, special characters can be added to the scene names to distinguish different scenes.

It should be noted that, in the process of searching for user scenarios according to scenario names, the controller 250 can control the display 260 to display a transition screen, or control the display 260 to display a blank recommendation page and display a transition screen based on the blank recommendation page.

After seeing the second recommendation page, the user can input a power-on instruction to enable the controller 250 to start the device instructions in the target instruction set. The input method of the power-on instruction can also be displayed on the second recommendation page, such as "Please press the xx key to confirm the start of the xx scene", "Please enter to confirm the start of xxx to start the xxx scene". Alternatively, the user scene that the user wants to start can be confirmed by identifying keywords in the user's voice instruction, such as "Confirm the start" and "Start immediately". In this way, the controller 250 can determine the target instruction set selected by the user according to the power-on instruction input by the user, and control the target device to perform the target operation according to the device instructions in the target instruction set.

In some embodiments, there may be multiple target devices of the same type, such as a living room air conditioner and a bedroom air conditioner. For target devices set at different locations, the execution capabilities of the target devices may be different. The controller 250 may obtain the execution capabilities of the target device when controlling the target device to perform the target operation. The controller 250 is configured to:

According to the target scenario, the execution scope information of the target device is obtained, and the expected execution information of the first device instruction in the target instruction set is obtained. If the execution scope information includes the expected execution information, the target device is controlled to perform a target operation based on the first device instruction. If the execution scope information does not include the expected execution information, a third recommendation page is generated, and the third recommendation page includes supplementary information.

As shown in FIG9 , the controller 250 can determine whether the target device can execute the current first device instruction based on the expected execution information of the first device instruction and the execution range information of the target device. For example, the first device instruction is "air conditioning temperature 15 degrees", and the minimum cooling temperature of the bedroom air conditioner is 18 degrees. After obtaining the expected execution information and the execution range information, the controller 250 can determine that the bedroom air conditioner cannot execute the first device instruction. At this time, the controller 250 controls the display 260 to generate a third recommendation page and displays supplementary information on the third recommendation page.

As shown in Figure 10, the supplementary information can be used to prompt the user to control other target devices to perform the target operation, such as "The minimum cooling temperature of the bedroom air conditioner is 18 degrees, please use the living room air conditioner." It can be understood that the supplementary information can include primary supplementary information and secondary supplementary information. That is, prompting the user that "The minimum cooling temperature of the bedroom air conditioner is 18 degrees, please use the living room air conditioner" is the primary supplementary information, and the user can be prompted to use other target devices through the primary supplementary information. The secondary supplementary information can be a prompt information with a caring component, such as "The air conditioning temperature is too low is not good for the body." The primary supplementary information and the secondary supplementary information can be arranged in order and displayed on the third recommendation page. By obtaining the execution capability of the target device, the controller 250 can avoid the problem that the target device cannot execute the device instruction but has no response, and the user waits for a long time, thereby improving the user experience.

As shown in FIG11 , personalized recommendation information is also displayed in the recommendation page to meet the needs of the user. Personalized recommendation information can be displayed on the second recommendation page to assist the user in starting the user scenario in combination with the needs and recommendation information. The controller 250 is configured to:

Extracting keywords from the target instruction set, generating personalized recommendation information based on the keywords, and controlling the display to display the personalized recommendation information in the second recommendation page.

In some embodiments, the controller 250 generates personalized recommendation information based on the keywords in the first device instruction. For example, the controller 250 can generate personalized recommendation information based on the semantics represented by the keywords. For example, if the keywords in the first device instruction are all related to temperature, the personalized recommendation information can be today's temperature.

In other embodiments, the personalized recommendation information may include primary personalized recommendation information and secondary personalized recommendation information. And when there is enough display space, the personalized recommendation information may include multi-level personalized recommendation information. For example, when the controller 250 displays today's temperature on the second recommendation page, it may also recommend recommended travel locations and recommended travel outfits to the user through the secondary personalized recommendation information. In this way, in the process of displaying the second recommendation page, it can not only assist the user in selecting the current scene, but also play a role of prompting and recommending when the user performs other actions.

In some embodiments of the present application, a user scenario creation method is provided, comprising:

Based on a first preset time range and a second preset time range, a first voice command input by a user is recorded to obtain a first command set and a second command set; the first command set is a subset of the second command set; the first preset time range is smaller than the second preset time range; the voice command is used to control a target device to perform a target operation; the target device includes a display device and/or a smart home appliance;

Obtaining the number of occurrences of the first instruction set in the second instruction set;

If the number of occurrences is greater than the scene threshold, creating a target instruction set based on the first instruction set;

In response to a second voice instruction input by a user, a recommendation page is displayed, wherein the recommendation page includes a target instruction set having a mapping relationship with the second voice instruction.

It can be seen from the above technical content that the present application provides a display device and a user scenario creation method. The display device records the first voice instruction input by the user based on the first preset time range and the second preset time range to obtain a first instruction set and a second instruction set. The first instruction set is a subset of the second instruction set, and the first preset time range is smaller than the second preset time range. By obtaining the number of occurrences of the first instruction set in the second instruction set and combining the scene threshold, a target instruction set can be created based on the first instruction set. When the user inputs the second voice instruction, the target instruction set can be searched according to the second voice instruction, and a recommendation page can be displayed to display the target instruction set that has a mapping relationship with the second voice instruction. The display device generates and recommends user scenarios by collecting user behavior data, which helps to simplify the user operation process.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims (10)

1. A display device, characterized by comprising:

A display configured to display a user interface;

a communication device configured to establish a communication connection with the smart home device;

a controller configured to:

Recording a first voice instruction input by a user based on a first preset time range and a second preset time range to obtain a first instruction set and a second instruction set; the first instruction set is a subset of the second instruction set; the first preset time range is smaller than the second preset time range; the voice instruction is used for controlling the target equipment to execute target operation; the target device comprises the display device and/or the intelligent household appliance;

Acquiring the occurrence times of the first instruction set in the second instruction set;

If the occurrence number is greater than or equal to a scene threshold, creating a target instruction set based on the first instruction set;

And responding to a second voice instruction input by a user, and controlling the display to display a recommended page, wherein the recommended page comprises a target instruction set with a mapping relation with the second voice instruction.

2. The display device of claim 1, wherein the controller records a first voice command input by a user based on a first preset time range and a second preset time range, and obtains a first command set and a second command set, and is configured to:

normalizing the first voice instruction according to a semantic model to obtain a first equipment instruction;

Creating a first set of instructions based on the first device instructions; the first set of instructions includes at least 1 of the first device instructions.

3. The display device of claim 2, wherein the controller obtains a number of occurrences of the first set of instructions in the second set of instructions, creates a target set of instructions based on the first set of instructions when the number of occurrences is greater than a scene threshold, configured to:

Controlling the display to display a first recommended page, wherein the first recommended page comprises a first equipment instruction and scene creation recommended information contained in the first instruction set;

Responding to a confirmation creation instruction input by a user, and creating a target instruction set according to the first instruction set;

And setting a set name for the target instruction set according to a first device instruction contained in the target instruction set.

4. The display device of claim 1, wherein the controller is further configured to:

Responding to a second voice instruction input by a user, and normalizing the second voice instruction according to a semantic model to obtain a second equipment instruction;

searching a target instruction set according to the second equipment instruction;

if the target instruction set comprises the second device instruction, controlling the display to display a second recommended page; the second recommended page includes the target instruction set;

and responding to the starting instruction input by the user, controlling the target equipment to execute target operation based on the target instruction set, and playing the voice recommendation instruction of the target instruction set.

5. The display device of claim 4, wherein the controller, upon executing the search for the target instruction set according to the second device instruction, is further configured to:

Acquiring the number of the searched target instruction sets;

and if at least 2 target instruction sets are searched, controlling the display to display a second recommended page, wherein the second recommended page comprises recommended information of the at least 2 target instruction sets, and the recommended information of the at least 2 target instruction sets is displayed according to the time sequence and the scene capacity sequence.

6. The display device of claim 5, wherein the controller executing controls the display to display a second recommended page is further configured to:

acquiring a time tag of the target instruction set;

sequencing the target instruction set according to the time tag to obtain a first scene sequence;

Acquiring the capacity of the target instruction set;

sequencing the first scene sequence according to the capacity to obtain a second scene sequence;

and setting the display sequence of recommendation information of at least 2 target instruction sets in the recommendation page based on the arrangement sequence of the target instruction sets in the second scene sequence.

7. The display device of claim 1, wherein the controller is further configured to:

responding to a third voice instruction input by a user, and searching a target instruction set according to the third voice instruction;

when the target instruction set is searched, controlling the display to display a second recommended page, wherein the second recommended page comprises the target instruction set;

and responding to the starting instruction input by the user, and controlling the target equipment to execute target operation based on the target instruction set.

8. The display device of claim 7, wherein the controller execution controls the target device to perform a target operation based on the target instruction set, configured to:

Acquiring execution range information of the target equipment according to the target instruction set, and acquiring expected execution information of a first equipment instruction in the target instruction set;

if the execution range information comprises the expected execution information, controlling the target equipment to execute target operation based on the first equipment instruction;

If the execution range information does not include the expected execution information, generating a third recommended page, wherein the third recommended page includes supplementary information; the supplementary information is used for prompting a user to control other target devices to execute target operation.

9. The display device of claim 8, wherein the controller, when searching for the target instruction set, controls the display to display a second recommended page configured to:

extracting keywords in the target instruction set;

and generating personalized recommendation information based on the keywords, and controlling the display to display the personalized recommendation information in the second recommendation page.

10. A user scene creation method, comprising:

Recording a first voice instruction input by a user based on a first preset time range and a second preset time range to obtain a first instruction set and a second instruction set; the first instruction set is a subset of the second instruction set; the first preset time range is smaller than the second preset time range; the voice instruction is used for controlling the target equipment to execute target operation; the target equipment comprises display equipment and/or intelligent household electrical appliance equipment;

Acquiring the occurrence times of the first instruction set in the second instruction set;

If the occurrence number is greater than a scene threshold, creating a target instruction set based on the first instruction set;

and responding to a second voice instruction input by a user, displaying a recommended page, wherein the recommended page comprises a target instruction set with a mapping relation with the second voice instruction.