CN113495711B - Display apparatus and display method - Google Patents

Abstract

The present application discloses a display device and a display method. When the display displays a screen saver, it receives a voice command input by the user; when the voice command matches a preset command, it maintains the display of the screen saver screen, and A feedback message corresponding to the voice command is displayed above the screen saver screen; when the voice command does not match the preset command, the display of the screen saver screen is canceled, and then the shortcut operation of the display device is realized in the screen saver state.

Description

Display device and display method

technical field

The present application relates to the technical field of the Internet, and in particular to a display device and a display method.

Background technique

Currently, a display device can provide a user with playback images such as audio, video, and pictures. In practical applications, if the display device does not play video or does not receive user input for a long time, that is, the display device displays the same picture for a long time, which will cause the aging of the display screen and shorten its service life.

In order to prolong the service life of the monitor screen, a screen saver application (or screen saver application) can be installed on the display device. When the monitor displays the same screen for a certain period of time, the screen application will be displayed on the top layer of the currently presented user interface. Multimedia screen saver files, so that the display screen enters the screen saver state, and then achieves the purpose of protecting the screen.

In related technologies, when a user input is received in the screen saver state, the screen saver state will exit immediately.

Contents of the invention

The present application provides a display device and a voice command processing method to realize shortcut operations on the display device in a screen saver state.

In a first aspect, the present application provides a display device, including:

A monitor, used for displaying a save screen;

A user interface, configured to receive a voice command input by a user;

controller for:

When the display screen saves the screen, receiving a voice command input by the user;

When the voice command matches the preset command, maintain the display of the screen saver screen, and display a feedback message corresponding to the voice command above the screen saver screen;

When the voice instruction does not match the preset instruction, cancel the display of the screen saver.

In a second aspect, the present application provides a display device, including:

A monitor, used for displaying a save screen;

A user interface, configured to receive a voice command input by a user;

controller for:

receiving the first voice command input by the user;

When the display displays a screen saver screen and an interface prompt is displayed on the screen saver screen, in response to the received first voice command, the display of the screen saver screen is maintained, and the screen saver screen and the first screen saver screen are displayed above the screen saver screen. A feedback message corresponding to a voice command, the first voice command corresponding to the interface prompt;

When the display screen saver screen and the screen saver screen does not display the interface prompt, in response to the received first voice command, cancel the display of the screen saver screen, and display the interface before the screen saver screen or display the second An interface corresponding to a voice command.

In a third aspect, the present application provides a display device, including:

The monitor is configured to present a screen saver image when the monitor enters a screen saver state;

A user interface, configured to receive voice instructions from the user;

controller for:

When receiving the voice command input by the user in the screen saver state, maintain the screen saver state, and obtain the semantic analysis result of the voice command;

judging whether the voice command is a preset command indicating participation in network activities according to the semantic analysis result;

When the voice instruction is the preset instruction, send a participation request requesting to participate in the network activity to the server, and display the received participation result while maintaining the screen saver state, wherein the participation request Used to make the server return the participation result;

When the voice instruction is not the preset instruction, exit the screen saver state.

In a fourth aspect, the present application provides a display method applied to a display device, the method comprising:

When the display screen saves the screen, receive the voice command input by the user;

When the voice command matches the preset command, maintain the display of the screen saver screen, and display a feedback message corresponding to the voice command above the screen saver screen;

When the voice instruction does not match the preset instruction, cancel the display of the screen saver.

In a fifth aspect, the present application provides a display method applied to a display device, the method comprising:

A display method applied to a display device, characterized in that the method includes:

receiving the first voice command input by the user;

When the screen saver screen is displayed and an interface prompt is displayed on the screen saver screen, in response to the received first voice instruction, the display of the screen saver screen is maintained, and the screen saver screen is displayed above the screen saver screen together with the first A feedback message corresponding to a voice command, the first voice command corresponding to the interface prompt;

When the screen saver screen is displayed and the interface prompt is not displayed on the screen saver screen, in response to the received first voice command, cancel the display of the screen saver screen, and display the interface before the screen saver screen or display the first The interface corresponding to the voice command.

In a sixth aspect, the present application provides a display method applied to a display device, the method comprising:

When receiving the voice command input by the user in the screen saver state, maintain the screen saver state, and obtain the semantic analysis result of the voice command;

When receiving the voice command input by the user in the screen saver state, maintain the screen saver state, and obtain the semantic analysis result of the voice command;

judging whether the voice command is a preset command indicating participation in network activities according to the semantic analysis result;

When the voice instruction is the preset instruction, send a participation request requesting to participate in the network activity to the server, and display the received participation result while maintaining the screen saver state, the participation request is used for causing the server to return the participation result;

When the voice instruction is not the preset instruction, exit the screen saver state.

In the embodiment of the present application, when the display screen saves the screen, the voice command input by the user is received; when the voice command matches the preset command, the screen saver state is maintained, and the screen saver screen is displayed on the screen. Feedback message corresponding to the voice command; when the voice command does not match the preset command, exit the screen saver state, and display the operation result corresponding to the voice command on the user interface, and then realize the screen saver state. Display shortcuts for the device.

Description of drawings

In order to illustrate the technical solution of the present application more clearly, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, on the premise of not paying creative labor, Additional drawings can also be derived from these drawings.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device according to an embodiment;

FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to an embodiment;

FIG. 3 exemplarily shows a hardware configuration block diagram of the control device 100 according to the embodiment;

FIG. 4 exemplarily shows a schematic diagram of a functional configuration of a display device 200 according to an embodiment;

FIG. 5 exemplarily shows a schematic diagram of software configuration in the display device 200 according to the embodiment;

FIG. 6 exemplarily shows a schematic configuration diagram of an application program in the display device 200 according to an embodiment;

FIG. 7 exemplarily shows a schematic diagram of a user interface in a display device 200 according to an embodiment;

Figure 8a exemplarily shows a program screen presented by a display device display;

Figure 8b exemplarily shows a user interface presented by a display device display;

Fig. 9 exemplarily shows a picture of a screen saver file presented by a display device display;

Fig. 10 exemplarily shows the voice search interface presented by the display of the display device;

FIG. 11 exemplarily shows a user interface presented by a display device display;

FIG. 12 exemplarily shows a user interface presented by a display of a display device;

FIG. 13 exemplarily shows a user interface presented by a display of a display device;

Fig. 14 exemplarily shows a picture of a screen saver file presented by a display device display;

Fig. 15 exemplarily shows a picture of a screen saver file presented by a display device display;

Figure 16 exemplarily shows a flow chart of the display method;

Figure 17 exemplarily shows a flow chart of the display method;

FIG. 18 exemplarily shows a picture of a screen saver file presented by a display device.

Detailed ways

In order to make the purposes, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the exemplary embodiments of the present application. , the described exemplary embodiments are only some of the embodiments of the present application, but not all of the embodiments.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application. In addition, although the disclosures in this application are described according to one or several examples, it should be understood that each aspect of these disclosures can also independently constitute a complete technical solution.

It should be understood that the terms "first", "second", and "third" in the description and claims of this application and the above drawings are used to distinguish similar objects, and not necessarily used to describe a specific order or priority. It should be understood that the data used in this way can be interchanged under appropriate circumstances, for example, it can be implemented in an order other than those given in the illustrations or descriptions of the embodiments of the present application.

Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device comprising a series of components is not necessarily limited to those components explicitly listed, but may include other components not expressly listed or inherent in these products or equipment.

The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and/or software codes capable of performing the functions associated with the element.

The term "remote controller" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually control the electronic device wirelessly within a relatively short distance. Infrared rays and/or radio frequency (RF) signals and/or Bluetooth are generally used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example: a hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in this application refers to a user's behavior for expressing expected ideas, actions, goals and/or results through changes in hand shapes or hand movements.

Fig. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control device according to an embodiment. As shown in FIG. 1 , a user may operate the display device 200 through the mobile terminal 300 and the control device 100 .

Wherein, the control device 100 can control the display device 200 by a remote control, including infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc., through wireless or other wired methods. The user can control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices can also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

For example, the mobile terminal 300 can install software applications with the display device 200, realize connection and communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, it is possible to use the mobile terminal 300 to establish a control instruction protocol with the display device 200 , to synchronize the remote control keyboard to the mobile terminal 300 , and to control the display device 200 by controlling the user interface on the mobile terminal 300 . The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to realize a synchronous display function.

As also shown in FIG. 1 , the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . For example, display device 200 interacts with an Electronic Program Guide (EPG) by sending and receiving messages, receiving software program updates, or accessing a remotely stored digital media library. The servers 400 may be in one group or in multiple groups, and may be one or more types of servers. Other network service contents such as video on demand and advertisement service are provided through the server 400 .

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited, and those skilled in the art can understand that the display device 200 can be changed in performance and configuration as required.

In addition to providing the TV function of broadcasting reception, the display device 200 may also provide an intelligent network TV function providing computer support functions. Examples include, IPTV, SmartTV, Internet Protocol Television (IPTV), and the like.

FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to an exemplary embodiment. As shown in Figure 2, the display device 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, At least one of a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

The display 280 is used to receive an image signal input from the video processor 260-1, and display video content and images and a component of a menu manipulation interface. The display 280 includes a display screen component for presenting pictures, and a driving component for driving image display. Display video content, which can be from broadcast TV content, or various broadcast signals that can be received through wired or wireless communication protocols. Alternatively, various image contents received from the network server can be displayed through the network communication protocol.

At the same time, the display 280 simultaneously displays the user manipulation UI interface generated in the display device 200 and used for controlling the display device 200 .

And, according to different types of the display 280, it also includes a driving component for driving display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

The communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communication interface 230 can be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 and other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).

The display device 200 can send and receive control signals and data signals with an external control device or content providing device through the communication interface 230 . And, the infrared receiver is an interface that can be used to receive infrared control signals from the control device 100 (such as: an infrared remote controller, etc.).

The detector 240 is used by the display device 200 to collect signals from the external environment or interact with the outside. The detector 240 includes a light receiver 242, which is a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.

And include an image collector 241, such as a camera, a video camera, etc., which can be used to collect external environmental scenes, as well as to collect user attributes or interactive gestures with users, and can adaptively change display parameters, and can also recognize user gestures, so as to achieve communication with users. The function of interaction between users.

In some other exemplary embodiments, the detector 240 may also be a temperature sensor, for example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. For example, in an environment with a relatively high temperature, the display device 200 can be adjusted to display an image with a cooler tone, or in an environment with a relatively low temperature, the display device 200 can be adjusted to display an image with a warmer tone.

In some other exemplary embodiments, the detector 240 may also be a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or collect environmental sound, and use In order to identify the type of environmental scene, the display device 200 can adaptively adapt to the environmental noise.

The input/output interface 250 controls data transmission between the display device 200 and other external devices under the control of the controller 210 . Such as receiving video signals and audio signals from external devices, or data such as command instructions.

Wherein, the input/output interface 250 may include, but not limited to, the following: high-definition multimedia interface HDMI interface 251, analog or data high-definition component input interface 253, composite video input interface 252, USB input interface 254, RGB port (not shown in the figure) out) and so on for one or more interfaces.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned multiple interfaces.

The tuner demodulator 220 receives broadcast TV signals through wired or wireless reception, can perform modulation and demodulation processing such as amplification, frequency mixing and resonance, and demodulates the frequency of the TV channel selected by the user from multiple wireless or cable broadcast TV signals The TV audio and video signals carried in it, as well as the EPG data signal.

The tuner demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the frequency of the TV signal selected by the user and the TV signal carried by the frequency.

The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting formats, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals, etc.; and according to different modulation types, it can be digitally modulated, or Modulation methods can be simulated. Depending on the type of TV signal received, analog and digital signals can be used.

In some other exemplary embodiments, the tuner-demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals after modulation and demodulation, and inputs them into the display device 200 through the input/output interface 250 .

The video processor 260-1 is used to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, A signal directly available for display or playback on the display device 200 is available.

Exemplarily, the video processor 260-1 includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Wherein, the demultiplexing module is used for demultiplexing the input audio and video data streams, such as inputting MPEG-2, the demultiplexing module demultiplexes them into video signals and audio signals and the like.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the graphic generator with the zoomed video image according to the GUI signal input by the user or generated by itself, so as to generate an image signal available for display.

The frame rate conversion module is used for converting the input video frame rate, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate, and the usual format is realized by frame interpolation.

The display formatting module is used to convert the received frame rate to the video output signal, and change the signal to conform to the display format signal, such as outputting RGB data signal.

The audio processor 260-2 is used to receive an external audio signal, perform decompression and decoding according to the standard codec protocol of the input signal, and perform processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain audio signals that can be played in the speaker. sound signal.

In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 260 - 1 and the audio processor 260 - 2 may be separate chips, or may be integrated with the controller 210 into one or more chips.

The audio output 272 receives the sound signal output by the audio processor 260-2 under the control of the controller 210, such as the speaker 272, and can be output to the generating device of the external device except the speaker 272 carried by the display device 200 itself. An external audio output terminal 274, such as an external audio interface or an earphone interface.

The power supply, under the control of the controller 210 , provides power supply support for the display device 200 with the power input from the external power supply. The power supply may include a built-in power circuit installed inside the display device 200 , or may be an external power supply installed on the display device 200 , and a power interface provided in the display device 200 for external power supply.

The user input interface is configured to receive user input signals, and then send the received user input signals to the controller 210 . The user input signal can be a remote control signal received through an infrared receiver, and various user control signals can be received through a network communication module.

For example, the user inputs a user command through the remote control 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 210 .

In some embodiments, the user may input user commands through a graphical user interface (GUI) displayed on the display 280, and the user input interface receives user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

The controller 210 controls the work of the display device 200 and responds to user operations through various software control programs stored in the memory 290 .

As shown in FIG. 2, the controller 210 includes a RAM 213 and a ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, such as a first interface 218-1 to an nth interface 218-n, and a communication bus. Wherein, RAM213, ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected through a bus.

ROM213 is used to store various system startup instructions. For example, when receiving the power-on signal, the power supply of the display device 200 starts to start, and the CPU processor 212 executes the system startup command in the ROM, and copies the operating system stored in the memory 290 to the RAM 213, so that the operating system starts running. After the operating system is started, the CPU processor 212 copies various application programs in the memory 290 to the RAM 213, and then starts running various application programs.

The graphics processor 216 is used to generate various graphic objects, such as icons, operation menus, and user input instructions to display graphics. It includes an arithmetic unit, which performs calculations by receiving various interactive instructions input by users, and displays various objects according to display attributes. And a renderer is included to generate various objects obtained based on the computing unit, and the rendering result is displayed on the display 280 .

The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290 . And execute various applications, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include multiple processors. Multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power mode, and/or display images in the normal mode. Multiple or one sub-processor for an operation in a state such as standby mode.

The controller 210 may control overall operations of the display device 100 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein, the object may be any one of optional objects, such as a hyperlink or an icon. Operations related to the selected object, for example: displaying operations connected to hyperlink pages, documents, images, etc., or executing operations corresponding to the icon. The user command for selecting a UI object may be a command input through various input means (eg, mouse, keyboard, touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes storing various software modules for driving the display device 200 . For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Among them, the basic module is used for signal communication between various hardware in the postpartum care display device 200 and a bottom software module for sending processing and control signals to the upper module. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage.

For example: the voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the display 280 to display image content, and can be used for playing information such as multimedia image content and UI interface. Communication module, a module used for control and data communication with external devices. Browser module, a module for performing data communication between browsing servers. The service module is used to provide various services and modules including various application programs.

At the same time, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, visual effect diagrams of focus objects, and the like.

Fig. 3 exemplarily shows a configuration block diagram of the control device 100 according to the exemplary embodiment. As shown in FIG. 3 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .

The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions recognizable and respondable by the display device 200 , and play an intermediary role between the user and the display device 200 . For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the operation of channel addition and subtraction.

In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user requirements.

In some embodiments, as shown in FIG. 1 , a mobile terminal 300 or other smart electronic device can perform a similar function of controlling the device 100 after installing an application for manipulating the display device 200 . For example, the user can control the function of the physical keys of the device 100 by installing the application and various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other intelligent electronic devices.

The controller 110 includes a processor 112 and a RAM 113 and a ROM 114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100 , as well as the communication and cooperation between internal components and external and internal data processing functions.

The communication interface 130 realizes communication of control signals and data signals with the display device 200 under the control of the controller 110 . For example: sending the received user input signal to the display device 200 . The communication interface 130 may include at least one of other near-field communication modules such as a WiFi chip, a Bluetooth module, and an NFC module.

A user input/output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a key 144 . For example, the user can realize the user command input function through actions such as voice, touch, gesture, and press, and the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200 .

The output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it may be an infrared interface or a radio frequency interface. For example, when using an infrared signal interface, user input commands need to be converted into infrared control signals according to the infrared control protocol, and sent to the display device 200 through the infrared sending module. Another example: in the radio frequency signal interface, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The communication interface 130 is configured in the control device 100, such as WiFi, Bluetooth, NFC and other modules, which can send user input instructions to the display device 200 through WiFi protocol, or Bluetooth protocol, or NFC protocol encoding.

The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller 110 . The memory 190 can store various control signal instructions input by the user.

The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller 110 . Can be battery and related control circuit.

FIG. 4 exemplarily shows a schematic diagram of a functional configuration of a display device 200 according to an exemplary embodiment. As shown in FIG. 4 , the memory 290 is used to store the operating system, application programs, content and user data, etc., and is executed to drive the system operation of the display device 200 and respond to various operations of the user under the control of the controller 210 . Memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically used to store and drive the running program of the controller 210 in the display device 200, and to store various application programs built in the display device 200, various application programs downloaded by users from external devices, and various graphical user programs related to the applications. Interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used for storing system software such as OS kernel, middleware, and applications, as well as storing input video data and audio data, and other user data.

The memory 290 is specifically used to store drivers and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input/output interface of the detector 240.

In some embodiments, memory 290 may store software and/or programs, and software programs representing an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs) and/or application programs. Exemplarily, the kernel can control or manage system resources, or functions implemented by other programs (such as the middleware, API or application program), and the kernel can provide interfaces to allow the middleware and API, or applications to access the controller , to control or manage system resources.

The exemplary memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command identification module 2907, a communication control module 2908, and a light receiving module 2909, a power control module 2910, an operating system 2911, and at least one of other application programs 2912, a browser module, and the like. By running various software programs in the memory 290, the controller 210 performs functions such as: broadcast TV signal reception demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Other applications such as identification function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.

FIG. 5 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.

As shown in FIG. 5, the operating system 2911, including execution operating software for processing various basic system services and for implementing hardware-related tasks, acts as an intermediary for data processing done between application programs and hardware components. In some embodiments, part of the operating system kernel may include a series of software for managing hardware resources of the display device and providing services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and a device driver may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. Drivers may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used for modifying or accessing the application program, so as to realize the accessibility of the application program and the operability of its displayed content.

The communication module 2911-2 is used for connecting with other peripherals via relevant communication interfaces and communication networks.

The user interface module 2911-3 is configured to provide objects displaying a user interface for each application program to be accessible, so as to realize user operability.

The control application program 2911-4 is used for controllable process management, including runtime application programs and the like.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application program 2912. In some embodiments, it can be implemented in the operating system 2911 and in the application program 2912 on the one hand, and is used to monitor various user input events , which will implement one or more sets of predefined operations according to the recognition results of various events or sub-events.

Among them, the event monitoring module 2914-1 is used to monitor user input interface input events or sub-events.

The event identification module 2914-1 is used for inputting the definitions of various events to various user input interfaces, identifying various events or sub-events, and transmitting them to processing for executing their corresponding one or more groups of processing programs .

Wherein, an event or a sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (eg, the control device 100 , etc.). Such as: various sub-events of voice input, gesture input of gesture recognition, and sub-events of remote control key command input of control equipment, etc. Exemplarily, one or more sub-events in the remote controller include multiple forms, including but not limited to one or a combination of key presses up/down/left and right/, confirm key, and key presses. And operations of non-physical buttons, such as moving, pressing, releasing, etc.

The interface layout manager 2913 directly or indirectly receives user input events or sub-events monitored by the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container Various operations related to the interface layout such as the size or position, hierarchy, etc.

As shown in FIG. 6 , the application layer 2912 contains various applications that are also executable on the display device 200 . The application program may include but not limited to one or more application programs, such as: at least one of a live TV application program, a video-on-demand application program, a media center application program, an application program center, and a game application program.

Live TV app that provides live TV from different sources. For example, a live TV application may provide a TV signal using input from cable TV, over-the-air broadcast, satellite service, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200 .

A video-on-demand application that can provide videos from different storage sources. Unlike live TV applications, video on demand provides video displays from some stored source. For example, video on demand can come from a server side of cloud storage, from local hard disk storage containing stored video programs.

The media center application program can provide an application program for playing various multimedia contents. For example, a media center may provide a service for users to access a variety of images or audio through a media center application, as opposed to live TV or video-on-demand.

The application program center can provide and store various application programs. The application program may be a game, an application program, or some other application programs related to the computer system or other devices but capable of running on the smart TV. The application center can obtain these applications from different sources, store them in local storage, and then run them on the display device 200 .

FIG. 7 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 7 , the user interface includes multiple view display areas, for example, a first view display area 201 and a play screen 202 , wherein the play screen includes the layout of one or more different items. And the user interface further includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.

It should be noted that the multiple view display areas may present display images of different levels. For example, the first view display area can present video chat item content, and the second view display area can present application layer item content (eg, webpage video, VOD display, application program screen, etc.).

Optionally, different view display areas have different priorities in presentation, and among view display areas with different priorities, the display priorities of the view display areas are different. For example, the priority of the system layer is higher than that of the application layer. When the user uses the acquisition selector and screen switching at the application layer, the screen display in the view display area of the system layer will not be blocked; and, according to the user's choice, the application layer will When the size and position of the view display area of the system layer are changed, the size and position of the view display area of the system layer are not affected.

Display images of the same level can also be presented. At this time, the selector can switch between the display area of the first view and the display area of the second view, and when the size and position of the display area of the first view change, the display area of the second view The size and position of the display area can be changed accordingly.

In some embodiments, any area in FIG. 7 may display a picture captured by a camera.

Fig. 8a is an exemplary program screen shown in the embodiment of the present application, and Fig. 8b is an exemplary user interface shown in the embodiment of the present application. When the monitor displays the same program picture or user interface for too long, it will cause aging of the screen, which is not conducive to its service life.

In order to prevent the monitor from displaying the same program picture or the same user interface for a long time, when the display time of the same playback picture reaches the preset value, the screen saver file picture will be presented on the monitor immediately, thereby achieving the purpose of protecting the screen.

With reference to Fig. 4, be stored with application program 3912 or application program 2912 on memory 390 or memory 290, this application program 3912 or application program 2912 comprise screen saver (screen saver, not shown in the figure), controller is by running screen saver application , timing the static time of the display screen (the time for displaying the same playing picture), when the static time reaches a preset value, read the screen saver file (such as a picture file) stored in the memory in advance, and read it by the video processor The screensaver file is processed to obtain an image signal for display, and the image signal is output to the monitor through the output interface, and then the screen of the saver file is displayed on the upper layer of the screen currently displayed on the monitor, that is, the screen saver screen.

In some embodiments, the screen saver refers to an image file displayed in a locked screen state (screen saver state), so as to avoid pixel attenuation caused by keeping the same content for a long time.

In some embodiments, the screen saver refers to an image file used for displaying on a display when a screen saver is running.

For example, a screen saver screen is displayed on the upper layer of the screen shown in FIG. 8a or 8b, and then the screen saver screen as shown in FIG. 9 is obtained. For ease of description, when the display shows the program picture or user interface as shown in Figure 8a or 8b, the display screen is in the non-screen saver state, and when the display shows the screen saver picture as shown in Figure 9, the display screen is in the screen saver state.

In some embodiments, when the screen of the display screen saver file (such as an image file) is in the screen saver state, the screen saver application is a foreground application running in the foreground.

Wherein, the foreground application may refer to an application that presents an interface displayed to the user. For example, if the interface displayed on the display is application A, then the application A is the foreground application. If the user triggers the application B through the remote control device at this time, the display If the interactive interface of application B is displayed, then application B is the foreground application. The switching of the foreground application may be that when the user is using the application A, the display device starts the application B automatically or under control, and the content displayed on the display switches from the interactive interface corresponding to the application A to the interactive interface corresponding to the application B.

When the display shows the screen saver picture shown in Figure 9, that is, when it is in the screen saver state, the user can input control commands to the controller by operating the control device 100, for example, the user can use the volume plus and minus keys, channel control keys, up and down /Down/Left/Right movement keys, voice input keys, menu keys, etc. input corresponding control commands, in response to part or all of the control commands input by the user, the controller will cancel the display of the screen saver file to exit the screen saver state, and then Return to display the interface as shown in Figure 8a or 8b.

In some embodiments, the controller exits the screen saver state in response to any control command input by the user, and at the same time, the controller executes the user by running other programs (such as application layer programs, middleware programs and/or kernel layer programs). Enter the corresponding operation.

For example, when the display shows the screen saver picture shown in Figure 9, the user can press the voice input button on the remote controller to input a voice command, and the controller responds to the voice command to cancel the screen saver file so that the screen exits the screen saver state, and control the display of the voice search interface as shown in Figure 10.

In some other embodiments, the controller presents a corresponding interface in response to the preset control command input by the user, for example, to enter the screen saver setting interface, the user can press the down direction key on the remote control to enter The control instruction of the picture, the controller responds to the control instruction, while maintaining the screen saver state, on the upper layer of the currently displayed screen saver screen, display the optional screen saver picture as shown in FIG. 11 . The controller exits the screen saver state in response to other control instructions input by the user except the preset control instructions.

It can be seen from the above example that when the display screen saver screen is displayed, if the user enters a user input command including a voice command through the user interface, the screen saver state will be triggered to exit, so that the user cannot continue to enjoy the screen saver screen. If you want to continue to enjoy the screen saver The screen needs to wait for a certain period of time, or perform some cumbersome operations.

In order to solve the above problems, in some embodiments of the present application, preset voice instructions (referred to as preset instructions) that do not need to exit the screen saver state are preset and stored in the voice recognition module or voice server. When the preset command is received in the screen saver state , the display device maintains the screen saver state, executes the corresponding operation of the preset command in the background, and displays the feedback message obtained by performing the operation on the screen saver screen, such as the Toast prompt shown in Figure 18 ("Congratulations, you have signed up for the event ""). Furthermore, the user can not only control the display device through voice input, realize quick operation of the display device, but also maintain the screen saver state without exiting, and continue to enjoy the screen saver screen.

In some embodiments, when the display shows the screen saver screen shown in FIG. The received voice command is sent to the voice server or the voice recognition module for analysis, and the semantic analysis result returned by the voice server or the voice recognition module is obtained. Then the controller judges whether the voice command matches the preset command by judging whether the voice analysis result matches the interface prompt corresponding to the preset command, and continues to maintain the display of the screen saver when the voice command matches the preset command , that is to maintain the screen saver state, and display the feedback message corresponding to the voice command in the form of a floating layer above the screen saver screen, and when the voice command does not match the preset command, cancel the display of the screen saver screen and exit the screen saver state , displaying an operation result corresponding to the voice command or a prompt indicating that the voice command cannot be recognized on the user interface. The technical solution of the present application will be described in detail below in combination with specific examples.

In some embodiments, on the user interface as shown in Figure 8b, interface elements for participating in/signing up for network activities can be displayed. Elements can be clickable controls used to trigger processing such as page jumps. For example, as shown in FIG. 12 , clickable controls for participating in the " ^3rd Anniversary Lucky Draw" are displayed on the user interface.

When the display shows the interface as shown in Figure 12, the user can click the above-mentioned control by operating the control device, and the controller jumps to the active page as shown in Figure 13 in response to the click input by the user. On the event page, the user operates the control device again and clicks the button "sign up for the event" on the event page for participating in the event, and the controller responds to the user input and requests the server to participate in the network event.

It can be seen from the above examples that if the user wants to participate in the network activities displayed on the screen saver interface, he needs to operate the control device multiple times, and needs to go through a process such as page jumps that cause the user to wait, which makes the registration process for network activities not fast enough. Conducive to user experience.

In order to solve the above problems, in some embodiments of the present application, voice instructions for instructing to participate in network activities can be used as the above-mentioned preset instructions without exiting the screen saver state, so that the user can input instructions for instructions by controlling the operating device The voice command to participate in network activities is sent to the controller, and the controller responds to the voice command, while maintaining the screen saver, sends a request to the server to participate in network activities, that is, executes the user's registration process, and then realizes voice shortcuts Sign up and display the received participation results while maintaining the screensaver status.

As described in the above examples, the preset instructions can have corresponding interface prompts, and these interface prompts can be displayed on the screen saver screen, so that when the display screen saves the screen, the user can input the corresponding prompts according to the interface prompts on it. default order. For example, in some embodiments, information related to network activities and interface prompts for participating in the network interaction can be displayed on the screen saver, and then the user can follow the prompts on the interface to input information for participating in the network. Active voice commands. For example, as shown in FIG. 14 , the screen saver screen displays "! Sign up for a lottery event for the 3rd anniversary of the party ^" by voice speaking. It should be noted that the interface prompt may be text included in the screen saver file, or text displayed in a transparent layer above the screen saver file.

In some embodiments, the interface prompt is an inherent part of the image file corresponding to the screen saver, that is, the image file with the interface prompt is a promotional poster specially made for the network activity, and the interface prompt is used as an image file. A part is displayed on the same layer as the screen saver screen with the image file.

In some embodiments, the interface prompt is a newly generated part on the screen saver screen according to publicity requirements, that is, the image file is a conventional screen saver picture, and when the image file is displayed, in response to the need to display an activity prompt, the controller controls The display draws a new floating layer above the layer where the image file is located to display the interface prompt, and the layer where the interface prompt is located is located above the layer where the image file is located. At this time, the interface prompt and the image file are used together as a screen saver to cycle Sexual display (that is, the interface prompts are switched along with the switching of image files). This setup helps improve the efficiency of the system by eliminating the need for a promotional poster made specifically for the network event.

From the above examples, it can be seen that if the display device receives a voice instruction for participating in network activities in the screensaver state, it can maintain the screensaver state without exiting, and perform the operation corresponding to the voice instruction in the background, so that the user can continue to enjoy The screen saver screen, and at the same time, you can know the operation result corresponding to the voice command, that is, the participation result indicating whether the activity is successful or not.

In some embodiments, the predetermined instruction may have a corresponding validity period, for example, the validity period of the voice instruction for participating in the network activity is the holding period of the network activity. Correspondingly, the interface prompts corresponding to the preset instructions are only displayed on the screensaver screen within the validity period. For example, during the holding of a network event, the interface prompts used to participate in the network interaction are displayed on the screen saver screen. , the screensaver file with this interface prompt will not be displayed. Wherein, the preset command corresponds to the interface prompt, and the validity period of the preset command is the validity period of the interface prompt. In specific implementation, it can be implemented by updating the screen saver file.

Based on the above embodiments, in some embodiments of the present application, if and only when the display screen saver screen and the interface prompt corresponding to the first voice command are displayed on the screen saver screen, in response to receiving the first voice command , maintain the display of the screen saver screen, and display the feedback message corresponding to the first voice command on the top of the screen saver screen, so as to ensure that the display device is only realized within the validity period of the interface prompt/first voice command (preset command) Shortcut operation prevents the user from misoperating the display device outside the validity period of the interface prompt/first voice command (preset command). For example, if and only when the display screen saver screen has an interface prompt for participating in network activities, in response to receiving a voice command for participating in network activities, the display of the screen saver screen is maintained, and the screen saver screen is displayed on the screen saver screen. Participation results are displayed.

Further, in the above embodiment, when the screen saver screen is displayed on the display screen and the interface prompt corresponding to the first voice command is not displayed on the screen saver screen, in response to receiving the first voice command, cancel the display of the screen saver screen to exit the screen saver state, and display the interface before entering the screensaver state or display the interface corresponding to the first voice command, so that it is possible to avoid misoperation of the display device outside the validity period of the interface prompt/preset command.

For example, the controller cancels the display of the screen saver in response to the received first voice command; when the operation corresponding to the first voice command is not recognized, displays the interface in front of the screen saver; When the operation corresponding to the first voice command is recognized, an interface corresponding to the first voice command is displayed.

As can be seen from the above examples, also in the screen saver state, when the displayed screen saver screen has an interface prompt or does not have an interface prompt, the controller will perform the same voice command (i.e. the first voice command) different responses. When there is an interface prompt on the screen saver screen, it means that within the validity period of the interface prompt, if the first voice command is received at this time, the display device will maintain the screen saver state and display the feedback message corresponding to the first voice command on the screen saver On the screen; when there is no interface prompt on the screen saver screen, it means that the validity period of the interface prompt is exceeded. At this time, if the first voice command is received, the display device will exit the screen saver state to display the interface before entering the screen saver state or An interface corresponding to the first voice command is displayed.

In some embodiments, the same voice command directly executes the operation corresponding to the voice command when the screen saver interface is not displayed. , and send the voice command to the server, the server returns the interface corresponding to the voice command to the display device, and the display device displays the corresponding interface according to the received interface information. The interface may be an activity interface as shown in FIG. 15 , and as shown in FIG. 15 , it is displayed on the activity page that the activity has ended.

In some other embodiments, the interface corresponding to the above-mentioned first voice command may be a voice search interface as shown in FIG. 10 . Certainly, other interfaces related to the first voice instruction similar to the page shown in FIG. 10 may also be used, which will not be listed in this application.

Referring to FIG. 5, the application program 3912 or the application program 2912 may also include a voice assistant application (not shown in the figure), and the controller completes the voice-based interaction between the display device and the user by running the voice assistant application, for example, presenting a presentation Voice search pages for users, etc.

In some embodiments, the present application provides a display method. The main application scenario of the method is a display device, such as a smart TV. The execution body of the method may be a controller of the display device, but is not limited thereto.

It should be noted that, in the embodiment of the present application, the voice instruction is received through the user input interface (218-1 and/or 218-n) shown in FIG. 2 .

Fig. 16 is a flow chart of a display method exemplarily shown in this application according to some embodiments. As shown in Fig. 16, the method may include:

Step 101. When the display is in a screen saver state, receive a voice command input by a user.

In some embodiments, receiving user input and sending voice instructions may be performed when the display is like a screen saver, or not when the display is like a screen saver. When the screen saver is displayed, the display performs the operations of the subsequent steps

Step 102, obtain the semantic analysis result of the voice command, judge whether the voice command matches the preset command according to the semantic analysis result; when the voice command matches the preset command, perform step 103, and When the voice instruction does not match the preset instruction, step 104 is performed.

In some embodiments, the controller needs to judge that the voice instruction matches the preset instruction, and this judgment may correspond to step 102-step 104, or may be other steps that can realize the matching judgment of the voice instruction and the preset instruction.

In some embodiments, the display device sends the voice command to the voice analysis server to obtain the corresponding semantic analysis result, or the display device analyzes the voice command through its own program to obtain the voice analysis result. Determine whether the voice instruction matches the preset instruction by judging whether the semantic analysis result matches the interface prompt corresponding to the preset instruction, and the interface prompt is displayed on the screen saver screen; if If the semantic analysis result matches the interface prompt corresponding to the preset instruction, the voice instruction matches the preset instruction; if the semantic analysis result matches the interface prompt corresponding to the preset instruction If they do not match, the voice instruction does not match the preset instruction.

Step 103, when the voice command matches the preset command, maintain the screen saver state, and display a feedback message corresponding to the voice command on the screen saver screen;

In some embodiments, maintaining the screen saver state is the display of the screen saver screen at the position. At this time, it may be the display of one screen saver screen at the position, or it may be the display of multiple screen saver screens, as long as the display device is in the screen saver state.

In some embodiments, the feedback message is displayed above the screen saver in the form of a floating layer.

In some embodiments, the screen saver when displaying the feedback message may be the same as or different from the screen saver when the voice command is received.

Step 104, when the voice command does not match the preset command, exit the screen saver state.

In some embodiments, exiting the screen saver state refers to canceling the presentation of the screen saver screen.

In some embodiments, after canceling the presentation of the screen saver, if there is an operation result corresponding to the voice command, the user interface displays the operation result corresponding to the voice command.

In some embodiments, after canceling the display of the screen saver screen, if there is no operation result corresponding to the voice command, the user interface before entering the screen saver state is displayed on the user interface, and a prompt that the voice command cannot be recognized is displayed.

In some embodiments, when the screen saver screen is not displayed on the display, in response to receiving a voice command input by the user, perform an operation corresponding to the voice command, for example, perform operations corresponding to the voice command, such as volume up, down, channel up, Subtraction operation etc. Or when the voice command is not recognized, a prompt indicating that the voice command cannot be recognized is displayed.

As can be seen from the embodiment shown in Figure 16, in some embodiments, the display method provided by the present application can not only enable the user to control the display device through voice input, realize the shortcut operation of the display device, but also maintain the screen saver state without exiting, and continue Enjoy the screen saver.

In some embodiments, the present application provides a display method. The main application scenario of the method is a display device, such as a smart TV. The execution body of the method may be a controller of the display device, but is not limited thereto.

It should be noted that, in the embodiment of the present application, the voice instruction is received through the user input interface (218-1 and/or 218-n) shown in FIG. 4 .

Fig. 17 is a flowchart of a display method exemplarily shown in some embodiments of the present application. As shown in Fig. 17, taking preset instructions to participate in network activities and giving a reminder of successful participation on the screen saver as an example, this method can include:

Step 201, displaying a program picture, a user interface or a picture of a screen saver file on a monitor.

As an example, the program picture is firstly displayed on the display, and of course the user interface may also be displayed, wherein the program picture is displayed on the Video layer, and the user interface is displayed on the OSD layer. When the time of the same program picture or the same user interface displayed on the display reaches the preset value, that is, when the static time of the display screen reaches the preset value, the screen of the saved file is displayed on the top layer of the OSD layer.

Step 202, receiving a voice command input by the user.

For example, the user can press the voice input key on the remote controller to input the voice command. For example, when the screen saver picture shown in Figure 14 is displayed on the display, the user presses the voice input key and speaks "the 3rd anniversary of the party ^" to sign up for the lottery and prompt on the screen saver picture.

For another example, the user presses the voice input key and says "what's the weather like today" to obtain the weather data provided by the display device and display the weather data interface.

For another example, if the command spoken by the user by pressing the voice input key is not recognized, the interface before the display screen saver is displayed.

Step 203, in response to receiving the voice command, determine whether the display screen is in a screen saver state. If it is in the screen saver state, execute step 204, and if it is not in the screen saver state, execute step 209.

In some possible implementation manners, by judging whether the foreground application is a screensaver application, it is judged whether the display screen is in a screensaver state. If the foreground application is a screensaver application, the display screen is in a screensaver state, and if the foreground application is not a screensaver application, the display screen is in a non-screensaver state.

Step 204, if the display screen is in the screen saver state, keep the screen saver state without exiting, and obtain the semantic analysis result of the voice command.

Step 205, judging whether the voice instruction is a preset instruction to participate in network activities according to the obtained voice analysis result.

Referring to FIG. 4 , the external command recognition module 2907 may include a voice recognition module 2907-2, and a voice database is stored in the voice recognition module 2907-2, and the above-mentioned preset commands for instructing to participate in network activities are pre-stored in the voice database. When the voice command input by the user is received in the screen saver state, the voice assistant application is invoked in the background, and the received voice command is transmitted to the voice recognition module. Match the received voice commands with the preset commands in the voice database through the voice recognition module, and return the matching result to the voice assistant application, so that the voice assistant application can perform different logic controls according to the specific matching results, for example, When it is determined through matching that the voice command input by the user corresponds to the preset command for prompting on the screen saver screen, execute the logic processing control or other corresponding processing logic for participating in network activities; otherwise, execute the voice command corresponding to the voice command Logical processing controls.

In some embodiments, it is determined whether the voice command input by the user is a preset command by performing semantic matching on the voice command and the preset command.

For example, when the semantic analysis result of the voice command matches the semantics of the interface prompt on the screen saver, it is determined that the voice command is a preset command indicating participation in network activities; when the semantic analysis result of the voice command matches the interface prompt on the screen saver When the semantics of the prompt words do not match, it is determined that the voice command is not a preset command indicating participation in network activities.

Step 206, when it is determined that the voice command is a preset command, process the voice command according to the network activity indicated by the voice command to participate in the network activity.

It should be noted that, according to different network activities instructed to participate, the processing of the voice instruction is performed differently.

For example, when the screen saver screen displays the "Ju ^** 3rd Anniversary" red envelope activity as shown in Figure 14, in response to the received voice instruction for indicating participation in the red envelope activity, by calling the service interface corresponding to the red envelope activity , sending a participation request to the server to request participation in the red envelope activity, the participation request including user information, such as a user ID. Receive the participation result returned by the server, such as the result indicating that the user has successfully participated or failed to participate.

Step 207, displaying text prompts including participation results on the upper layer of the screen saver file, and/or playing voice prompts corresponding to the participation results.

As an example, FIG. 18 shows a schematic diagram of displaying a Toast prompt containing participation results in a floating layer above the screen saver file, and the Toast prompt displays text: Congratulations, you have signed up for the event.

As an example, the participation result can also be voice broadcasted through the voice assistant application, for example, voice playback: Congratulations, you have signed up for the event.

In this way, the registration of network activities can be completed without the user operating the control device multiple times, and the user can continue to enjoy the screen saver images.

Step 208, when it is determined that the voice command is not a preset command, cancel the screen saver file to exit the screen saver state.

In some embodiments, when exiting the screen saver state, the display of the screen saver screen is canceled; and when the operation corresponding to the first voice command is not recognized, the interface in front of the screen saver screen is displayed; when the first voice is recognized When the corresponding operation is commanded, the interface corresponding to the first voice command is displayed.

Step 209, if the display screen is in a non-screen saver state, in response to receiving the voice command, perform an operation corresponding to the voice command.

In some embodiments, if the display screen does not display a saver screen, a normal voice processing flow is performed, and the operation corresponding to the voice command is performed

In some embodiments, when it is determined that the voice command is not a preset command, in response to receiving the voice command, the display of the screen saver screen is canceled and an operation corresponding to the voice command is performed.

For example, a voice search page as shown in FIG. 10 is presented.

As can be seen from the above embodiments, when receiving a voice command input by the user in the screen saver state, keep the screen saver state and not exit so that the user can continue to enjoy the screen saver screen, and at the same time obtain the semantic analysis result of the voice command; judge according to the semantic analysis result Whether the voice command is a preset command for participating in network activities; when it is determined that the voice command is a preset command, according to the network activities indicated by the voice command, the processing of the voice command is performed, and then the voice quick registration is realized. Network activities, without cumbersome user operations, and without user waiting, user-friendly experience.

In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, it may include some or all of the steps in each embodiment of the method provided by the present invention. When the present application When the provided controller of the display device runs the computer program instructions, the controller executes the steps described in the present application that the controller is configured for. The storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated: ROM) or a random access memory (English: random access memory, abbreviated: RAM), etc.

Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general-purpose hardware platform. Based on this understanding, the essence of the technical solutions in the embodiments of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.

For the same and similar parts among the various embodiments in this specification, refer to each other. In particular, as for the embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for relevant parts, please refer to the description in the method embodiments.

The embodiments of the present invention described above are not intended to limit the protection scope of the present invention.

Claims (15)

1. A display device, characterized in that, comprising: A monitor, used for displaying a save screen; A user interface, configured to receive a voice command input by a user; controller for: When the display shows a saver screen, a voice command input by the user is received, wherein the screen saver screen displays an interface prompt for prompting participation in network activities; When the voice command matches the preset command, the display of the screen saver screen is maintained, and a feedback message corresponding to the voice command is displayed above the screen saver screen, wherein the preset command is the same as the preset command. an instruction corresponding to the interface prompt, the feedback message is used to prompt the participation result of the network activity; When the voice command does not match the preset command, the display of the screen saver screen is cancelled, and an operation result corresponding to the voice command is displayed on the user interface, wherein the operation result and the participation result are different results. 2. The display device according to claim 1, characterized in that, after receiving the voice instruction input by the user, the controller is further configured to: Sending the voice command to a voice server, the voice server is used to analyze the voice command to obtain a semantic analysis result; receiving the semantic analysis result returned by the voice server; Whether the voice instruction matches the preset instruction is determined by judging whether the semantic analysis result matches the preset instruction. 3. The display device according to claim 2, wherein the controller is specifically used for: determining whether the voice instruction matches the preset instruction by judging whether the semantic analysis result matches the interface prompt corresponding to the preset instruction; Wherein, if the semantic analysis result matches the interface prompt corresponding to the preset instruction, the voice instruction matches the preset instruction; if the semantic analysis result matches the preset instruction If the interface prompts do not match, the voice instruction does not match the preset instruction. 4. The display device according to claim 1, wherein the controller is further used for: When the display does not display the screen saver image, in response to receiving a voice command input by the user, perform an operation corresponding to the voice command or give back a prompt that the voice command cannot be recognized. 5. A display device, characterized in that, comprising: A monitor, used for displaying a save screen; A user interface, configured to receive a voice command input by a user; controller for: receiving the first voice command input by the user; When the display screen saver screen and the screen saver screen displays an interface prompt prompting to participate in network activities, in response to the received first voice command, maintain the display of the screen saver screen, and display the screen saver screen above the screen saver screen Displaying a feedback message corresponding to the first voice instruction, wherein the first voice instruction corresponds to the interface prompt, and the feedback message is used to prompt the participation result of the network activity; When the monitor displays a screen saver screen and the screen saver screen does not display the interface prompt prompting to participate in the network activity, in response to the received first voice instruction, cancel the display of the screen saver screen, and display the The activity interface corresponding to the first voice instruction, so as to prompt the participation result of the network activity on the activity interface. 6. The display device according to claim 5, wherein the controller, in response to the received first voice command, cancels the display of the screen saver screen, and displays an image corresponding to the first voice command. The activity interface is specifically: The controller cancels the display of the screen saver in response to the received first voice instruction; When the operation corresponding to the first voice command is not recognized, display the interface in front of the screen saver; When the operation corresponding to the first voice command is recognized, an active interface corresponding to the first voice command is displayed. 7. A display device, characterized in that it comprises: The monitor is configured to present a screen saver image when the monitor enters a screen saver state; A user interface, configured to receive voice instructions from the user; controller for: When receiving the voice command input by the user in the screen saver state, maintain the screen saver state, and obtain the semantic analysis result of the voice command; judging whether the voice command is a preset command indicating participation in network activities according to the semantic analysis result; When the voice instruction is the preset instruction, send a participation request requesting to participate in the network activity to the server, and display the received participation result while maintaining the screen saver state, wherein the participation request Used to make the server return the participation result; When the voice command is not the preset command, exit the screen saver state, and display an operation result corresponding to the voice command on the user interface, wherein the operation result is different from the participation result result. 8. The display device according to claim 7, wherein the screen saver screen has an interface prompt for participating in the network activity; the controller is specifically used for: determining whether the voice instruction is the preset instruction by judging whether the semantic analysis result matches the interface prompt corresponding to the preset instruction; Wherein, if the semantic analysis result matches the interface prompt corresponding to the preset instruction, the voice instruction is the preset instruction, and if the semantic analysis result matches the interface prompt corresponding to the preset instruction language does not match, the voice instruction is not the preset instruction. 9. The display device according to claim 7, wherein the sending a participation request requesting to participate in the network activity to the server comprises: Obtain user information; Send a participation request requesting to participate in the network activity to the server according to the user information and the service interface corresponding to the network activity. 10. The display device according to claim 7, wherein the presenting the received participation result comprises: The floating layer above the screen saver displays text prompts containing participation results, and/or plays voice prompts corresponding to the participation results. 11. The display device according to claim 7, wherein, before maintaining the screen saver state and obtaining the semantic analysis result of the voice command, the controller is further configured to: When a voice command input by a user is received, it is judged whether the display screen is in a screen saver state. 12. The display device according to claim 11, wherein the controller is further used for: When a voice command input by the user is received in the non-screen saver state, in response to receiving the voice command, perform an operation corresponding to the received voice command or give back a prompt that the voice command cannot be recognized. 13. A display method applied to a display device, characterized in that the method comprises: When the monitor displays a screen saver, a voice command input by the user is received, wherein the screen saver screen displays an interface prompt for prompting participation in network activities; When the voice command matches the preset command, the display of the screen saver screen is maintained, and a feedback message corresponding to the voice command is displayed above the screen saver screen, wherein the preset command is related to the interface An instruction corresponding to the prompt, the feedback message is used to prompt the participation result of the network activity; When the voice command does not match the preset command, the display of the screen saver screen is cancelled, and an operation result corresponding to the voice command is displayed on the user interface, wherein the operation result and the participation result are different results. 14. A display method applied to a display device, characterized in that the method comprises: receiving the first voice command input by the user; When the screen saver screen is displayed and an interface prompt prompting to participate in network activities is displayed on the screen saver screen, in response to the received first voice command, the display of the screen saver screen is maintained and displayed on the top of the screen saver screen A feedback message corresponding to the first voice instruction, wherein the first voice instruction corresponds to the interface prompt, and the feedback message is used to prompt the participation result of the network activity; When the screen saver screen is displayed and the screen saver screen does not display the interface prompt prompting to participate in network activities, in response to the received first voice command, cancel the display of the screen saver screen and display the first voice instructing the corresponding activity interface, so as to prompt the participation result of the network activity on the activity interface. 15. A display method applied to a display device, characterized in that the method comprises: When receiving the voice command input by the user in the screen saver state, maintain the screen saver state, and obtain the semantic analysis result of the voice command; judging whether the voice command is a preset command indicating participation in network activities according to the semantic analysis result; When the voice instruction is the preset instruction, send a participation request requesting to participate in the network activity to the server, and display the received participation result while maintaining the screen saver state, the participation request is used for making the server return the participation result; When the voice command is not the preset command, exit the screen saver state, and display an operation result corresponding to the voice command on the user interface, wherein the operation result is different from the participation result result.

Images