CN120407059A

CN120407059A - Display device and media playback method

Info

Publication number: CN120407059A
Application number: CN202510344461.9A
Authority: CN
Inventors: 陆世明; 邵肖明; 贾桂丽
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2025-03-21
Filing date: 2025-03-21
Publication date: 2025-08-01

Abstract

Some embodiments of the present application illustrate a display device and a media playback method, which relate to the field of media playback. The method includes: in the case of displaying a multi-window page, in response to an instruction to switch the first window to full-screen mode, changing the first window from a small window state to a full-screen state, canceling the display of the second window, and sending a pause playback instruction to the second window, and recording the window change state as a multi-window to full-screen state. In the case of receiving a return instruction, when the window change state is obtained from multi-window to full-screen, the first window is changed to a small window state, the second window is restored to display, and a media playback instruction is sent to the second window. In the embodiment of the present application, after the multi-window enters the full-screen state, the return instruction can be input to directly return to the multi-window page, without multiple operations, shortening the operation path. When the multi-window is in full-screen mode, a pause decoding operation is performed on the non-full-screen window, which reduces time and operations and improves the continuity of media playback.

Description

Display equipment and media asset playing method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a media asset playing method.

Background

The multi-window mode is a function that allows a user to view or operate a plurality of content sources at the same time on the same screen. This mode is suitable for users who wish to view other information or channels without affecting the primary content viewing experience. The multi-window mode may display multiple windows on a screen, different windows may display media from different content sources, such as television signals, DLNA (DIGITAL LIVING Network Alliance) push, miracast drop, etc.

In the multi-window mode, a full screen control may be displayed in each window. The user may enter a single window full screen mode from a multi-window mode by selecting a full screen control. However, if the user wants to return to the multi-window mode again at this time, the multi-window mode needs to be entered again by entering the multi-window application, and a complex operation is required, resulting in long operation path and low efficiency. And when the multi-window is in a full-screen state, media assets of the non-full-screen window are disconnected, so that re-playing and re-screen throwing are required for re-entering the multi-window mode, and the time consumption and the operation path are prolonged.

Disclosure of Invention

Some embodiments of the present application provide a display device and a media playing method, which can directly return to a multi-window page by inputting a return instruction after the multi-window enters a full-screen state, so as to shorten a user operation path. And when the multi-window is full-screen, a pause decoding operation is adopted for the non-full-screen window, so that re-playing and screen throwing are not required when the multi-window page is returned, time consumption and operation are reduced, and the continuity of media resource playing is improved.

In a first aspect, some embodiments of the present application provide a display apparatus, including:

a display configured to display a user interface;

a controller coupled to the display and configured to:

Under the condition of displaying a multi-window page, responding to an instruction of switching a first window to a full-screen mode by a user input, changing the state of the first window from a small window to a full-screen state, wherein the multi-window page comprises a first window and a second window, the first window is used for displaying images of a first media asset, and the second window is used for displaying images of a second media asset;

canceling the display of the second window, and sending a play pause instruction to the second window to pause decoding the image of the second media asset;

Recording the window change state as a multi-window to full-screen state;

Under the condition that a return instruction input by a user is received, acquiring a window change state;

Changing the first window from a full-screen state to a small-window state under the condition that the window changing state is from a multi-window state to a full-screen state;

restoring to display the second window, and sending a media asset playing instruction to the second window so as to continuously decode the image of the second media asset, and displaying the image of the second media asset in the second window.

The technical scheme has the advantages that after the multi-window enters the full-screen state, the multi-window page can be directly returned to by inputting the return instruction, and the operation path of the user is shortened. And when the multi-window is full-screen, a pause decoding operation is adopted for the non-full-screen window, so that re-playing and screen throwing are not required when the multi-window page is returned, time consumption and operation are reduced, and the continuity of media resource playing is improved.

In some embodiments, after performing the recording of the window change state as a multi-window to full-screen state, the controller is further configured to:

under the condition that a multi-window application starting instruction input by a user is received, changing a first window from a full-screen state to a small window state;

The technical scheme has the advantages that the pause decoding operation is adopted for the non-full screen window when the multi-window is full screen, and the playing and screen throwing are not required to be restarted when the multi-window application is restarted, so that the time consumption and the operation are reduced, and the continuity of media resource playing is improved.

In some embodiments, the controller is further configured to mark the first window as a full-screen window after performing the recording of the window change state as a multi-window to full-screen state;

the controller, after performing the resuming of displaying the second window, is further configured to:

Recording the window change state as a full-screen to multi-window state;

responding to a return instruction input by a user, and acquiring a window change state;

In the case that the window change state is a full-screen to multi-window state, changing a first window marked as a full-screen window from the full-screen state to a small window state;

And canceling the display of the second window, and sending a play pause instruction to the second window so as to pause decoding the image of the second media asset.

The technical scheme has the advantages that after the full screen enters the multi-window state, the return instruction can be input to directly return to the single-window full screen page, so that the user operation path is shortened.

In some embodiments, the controller, in the case of displaying a multi-window page, is further configured to:

Acquiring an audio playing mode;

When the audio playing mode is mixed audio playing, controlling the audio output device to play the audio of the first media asset and the audio of the second media asset;

when the audio playing mode is single-tone playing, controlling the audio output device to play the audio of the first media asset or the second media asset.

The technical scheme has the advantages that different audio playing modes are set, more audio playing modes can be selected for the user, and the audio playing requirements of the user are met.

In some embodiments, the controller performs the capture audio playback mode, and is further configured to:

if the content sources of the first media asset and the second media asset are preset content sources, acquiring an audio playing mode as audio mixing playing;

If the content source of the first media asset or the second media asset is not the preset content source, the audio playing mode is obtained to play the single sound.

The technical scheme has the advantages that the audio playing mode can be rapidly determined according to the content resources of the media assets played by the windows, so that the subsequent control of the audio decoding of the media assets of different windows is facilitated.

In some embodiments, in the case of controlling the audio output device to play the audio of the first asset and the audio of the second asset, the controller performs sending a pause play instruction to the second window to pause decoding the image of the second asset, and is further configured to:

sending a play pause instruction to the second window to pause decoding the image and the audio of the second media asset;

The controller executing the sending of the media asset playing instruction to the second window to continue decoding the image of the second media asset, is further configured to:

Sending a media asset playing instruction to a second window to continuously decode the image and the audio of the second media asset;

controlling the audio output device to play the audio of the second media asset.

The technical scheme has the advantages that when the audios of a plurality of media assets are simultaneously played, decoding of the media asset images is paused, and meanwhile decoding of the media asset audios is paused, so that interference of the second media asset audios to the playing of the first media asset is avoided. When the multi-window page is restored to be displayed, the media resource image is continuously decoded, and meanwhile, the media resource audio is required to be continuously decoded so as to meet the requirements of users.

In some embodiments, in the case of controlling the audio output device to play the audio of the second asset, the controller performs sending a pause play instruction to the second window to pause decoding the image of the second asset, and is further configured to:

and sending an audio playing instruction to the first window to start decoding the audio of the first media asset, and controlling the audio output device to play the audio of the first media asset.

The technical scheme has the advantages that when the user wants to switch to the full screen of the first window under the condition that the multi-window page independently plays the audio of the second media asset, the user pauses decoding the image and the audio of the second media asset and simultaneously needs to start decoding the audio of the first media asset so as to realize the audio-video synchronization of the first media asset.

In some embodiments, the controller executing the send media asset play instruction to the second window to continue decoding the image of the second media asset is further configured to:

sending an audio pause instruction to the first window to pause decoding the audio of the first media asset;

The technical scheme has the advantages that when the multi-window page is restored to be displayed by the full-screen page of the first window, the second media resource image and the audio are continuously decoded, and meanwhile, the audio of the first media resource is required to be paused for decoding so as to quickly restore to the original multi-window page audio playing mode.

Recording the window change state as a multi-window state;

If a return instruction input by a user is received, acquiring a window change state;

and in the case that the window change state is a multi-window state, exiting the multi-window application.

The technical scheme has the advantages that the return instruction is not only the switching of the multi-window full screen and the single-window full screen, but also different operations are executed according to different window change states. When the window change state is a single state, the multi-window application can be directly exited.

In a second aspect, some embodiments of the present application provide a media playing method, including:

Recording the window change state as a multi-window to full-screen state;

According to the technical scheme provided by the embodiment of the application, after the multi-window enters the full-screen state, the multi-window page can be returned directly by inputting the return instruction, the multi-window page can be reentered without repeated operation of a user, and the operation path of the user is shortened. And when the multi-window is full-screen, a pause decoding operation is adopted for the non-full-screen window, so that re-playing and screen throwing are not required when the multi-window page is returned, time consumption and operation are reduced, and the continuity of media resource playing is improved.

Drawings

In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application;

Fig. 2 is a schematic diagram of a hardware configuration of a display device according to some embodiments of the present application;

FIG. 3 is a schematic software configuration of a display device according to some embodiments of the present application;

FIG. 4 is a timing diagram of a method for playing media according to some embodiments of the present application;

FIG. 5 is a flowchart of a method for playing media according to some embodiments of the present application;

FIG. 6 is a schematic diagram of a setup menu box provided by some embodiments of the present application;

FIG. 7 is a diagram illustrating a multi-window mode selection box according to some embodiments of the present application;

FIG. 8 is a schematic diagram of a first multi-window page according to some embodiments of the present application;

FIG. 9 is a diagram of a second multi-window page according to some embodiments of the present application;

FIG. 10 is a schematic diagram of a menu page provided by some embodiments of the present application;

FIG. 11 is a diagram illustrating another multi-window mode selection box according to some embodiments of the present application;

FIG. 12 is a schematic diagram of a third multi-window page provided in some embodiments of the present application;

FIG. 13 is a software architecture diagram of a multi-window application provided in some embodiments of the present application;

FIG. 14 is a schematic diagram of a first windowed full-screen page provided by some embodiments of the present application;

FIG. 15 is a schematic diagram of another setup page provided by some embodiments of the present application;

Fig. 16 is a timing diagram of another media playing method according to some embodiments of the present application.

Detailed Description

Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the examples below do not represent all embodiments consistent with the application. Merely exemplary of systems and methods consistent with aspects of the application as set forth in the claims.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

In the present embodiment, the display device 200 generally refers to a device having screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, a smart television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, and the like.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application. As shown in fig. 1, a user may operate the display device 200 through a touch operation, the mobile terminal 300, and the control device 100. Wherein the control device 100 is configured to receive an operation instruction input by a user, and convert the operation instruction into a control instruction recognizable and responsive by the display device 200. For example, the control device 100 may be a remote control, a stylus, a handle, or the like.

The mobile terminal 300 may serve as a control device for performing man-machine interaction between a user and the display device 200. The mobile terminal 300 may also be used as a communication device for establishing a communication connection with the display device 200 for data interaction. In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

In some embodiments, the mobile terminal 300 or other electronic device may also simulate the functions of the control device 100 by running an application program that controls the display device 200.

As also shown in fig. 1, the display device 200 is also in data communication with the server 400 via a variety of communication means. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks.

The display device 200 may provide a broadcast receiving tv function, and may additionally provide an intelligent network tv function of a computer supporting function, including, but not limited to, a network tv, an intelligent tv, an Internet Protocol Tv (IPTV), etc.

Fig. 2 is a block diagram of a hardware configuration of the display device 200 of fig. 1 according to some embodiments of the present application.

In some embodiments, the display apparatus 200 may include at least one of a modem 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, a user input interface.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver for collecting a sensor of the intensity of ambient light, or the detector 230 includes an image collector such as a camera that may be used to collect external ambient scenes, user attributes or user interaction gestures, or the detector 230 includes a sound collector such as a microphone or the like for receiving external sounds.

In some embodiments, display 260 includes display functionality for presenting pictures, and a drive component that drives the display of images. The display 260 is used for receiving and displaying image signals output from the controller 250. For example, the display 260 may be used to display video content, image content, and components of menu manipulation interfaces, user manipulation UI interfaces, and the like.

In some embodiments, the communication apparatus 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display apparatus 200 may be provided with a plurality of communication devices 220 according to the supported communication manner. For example, when the display apparatus 200 supports wireless network communication, the display apparatus 200 may be provided with a communication device 220 including a WiFi function. When the display apparatus 200 supports bluetooth connection communication, the display apparatus 200 needs to be provided with a communication device 220 including a bluetooth function.

The communication means 220 may communicatively connect the display device 200 with an external device or the server 400 by means of a wireless or wired connection. Wherein the wired connection may connect the display device 200 with an external device through a data line, an interface, etc. The wireless connection may then connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 may directly establish a connection with an external device, or may indirectly establish a connection through a gateway, a route, a connection device, or the like.

In some embodiments, the controller 250 may include at least one of a central processor, a video processor, an audio processor, a graphic processor, a power supply processor, first to nth interfaces for input/output, and the controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, a user may input a user command through a graphical user interface (GRAPHICAL USER INTERFACE, GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI).

In some embodiments, audio output device 270 may be a speaker local to display device 200 or an audio output device external to display device 200. For an external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output sound of the display device 200.

In some embodiments, user input interface 280 may be used to receive instructions from user input.

To perform user interactions, in some embodiments, display device 200 may be run with an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may control the display device to provide a user interface, for example, the operating system may directly control the display device to provide a user interface, or may run an application to provide a user interface. The operating system also allows a user to interact with the display device 200.

It should be noted that the operating system may be a native operating system based on a specific operating platform, a third party operating system customized based on a depth of the specific operating platform, or an independent operating system specially developed for a display device.

The operating system may be divided into different modules or tiers depending on the functionality implemented, for example, as shown in FIG. 3, in some embodiments the system is divided into four layers, an application layer (simply "application layer"), an application framework layer (Application Framework) layer (simply "framework layer"), a system library layer, and a kernel layer, from top to bottom, respectively.

In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. The application layer may be run with at least one application program, which may be a Window (Window) program, a system setting program, or a clock program of the operating system, or may be an application program developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The application layer includes a multi-window application. The multi-window application is used to display a plurality of windows and to display images of different content sources in the plurality of windows. The multi-window application includes a UI component for displaying a multi-window interface and operating buttons.

The framework layer provides an application programming interface (Application Programming Interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 3, in the embodiment of the present application, the application framework layer includes a view system (VIEW SYSTEM), a manager (Managers), a Content Provider (Content Provider), and the like, where the view system may design and implement interfaces and interactions of the application, and the view system includes a list (lists), a network (grids), text boxes, buttons (buttons), and the like. The Manager includes at least one of an activity Manager (ACTIVITY MANAGER) for interacting with all activities running in the system, a Location Manager (Location Manager) for providing system Location service access to system services or applications, a package Manager (PACKAGE MANAGER) for retrieving various information related to application packages currently installed on the device, a notification Manager (Notification Manager) for controlling the display and removal of notification messages, a Window Manager (Window Manager) for managing icons, windows, toolbars, wallpaper and desktop components on the user interface, and a decode Manager for coordinating and controlling the decoding operations of media assets by respective players in the plurality of windows. The resource manager is used for recording window state changes. Content providers include television signals, DLNA push, and Miracast projection screens.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window, for example, reducing the display window to display, dithering display, distorting display, displaying a small window in a multi-window mode, displaying a full screen, and the like.

In some embodiments, the system runtime layer may provide support for the framework layer, and when the framework layer is in use, the operating system may run instruction libraries, such as the C/C++ instruction library, contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a functional hierarchy between the hardware and software of the display device 200. The kernel layer can realize the functions of hardware abstraction, multitasking, memory management and the like. For example, as shown in FIG. 3, a hardware driver may be configured in the kernel layer, where the driver included in the kernel layer may be at least one of an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver.

It should be noted that the above examples are merely a simple division of functions of an operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiment of the present application, and the number of levels and specific types of levels included in the operating system may be expressed in other forms according to factors such as the functions of the display device and the type of the operating system.

The multi-window mode is a function that allows a user to view or operate a plurality of content sources at the same time on the same screen. This mode is suitable for users who wish to view other information or channels without affecting the primary content viewing experience. The multi-window mode may display multiple windows on a screen, different windows may display media from different content sources, such as television signals, DLNA push, miracast, etc.

In the multi-window mode, a full screen control may be displayed in each window. The user may enter a single window full screen mode from a multi-window mode by selecting a full screen control. If the user presses the return button at this time, i.e. enters a return instruction, the multi-window mode is not returned, but the multi-window application is directly exited. If the user wants to return to the multi-window mode again at this time, the multi-window mode needs to be entered again by entering the multi-window application, and a complex operation is required, resulting in long operation path and low efficiency. And when the multi-window is in a full-screen state, media assets of a non-full-screen window are disconnected, so that re-playing and re-screen throwing are required for re-entering the multi-window mode, and time consumption and operation paths are increased.

Illustratively, as shown in FIG. 4, the control display 260 displays a multi-window page, where the multi-window page includes a first window displaying an image of a first asset and a second window displaying an image of a second asset. And after receiving the confirmation operation of the user on the full screen control in the first window, the first window sends a maximized window request to the window manager. The window manager processes the window maximization request, performs maximization/full-screen processing on the first window, changes the display size of the first window into full-screen size, then conceals the second window, and stops playing the second media asset in the second window, namely, sends an instruction for stopping decoding to the second window so as to stop decoding the data of the second media asset. The window manager sends a message to enter full screen mode informing the UI components of the multi-window application.

While the first window is displayed full screen, the user may generate two operations, 1) the UI component of the multi-window application receives a return instruction input by the user by pressing the return key of the control device 100, and exits the multi-window application. 2) The setting module receives a call-up setting menu instruction input by the user by pressing a menu key of the control apparatus 100, controls the display 260 to display a setting menu page including a multi-window control. And if the confirmation operation of the user on the multi-window control is received, the setting module sends a multi-window restoration instruction to the window manager. And the window manager restores the first window to the small window, restores the second window to be displayed, and reinitializes the player of the second window, and waits for the terminal equipment to be reconnected, screen-thrown and played.

The method can be seen that 1) after the multi-window is in full screen, the return key cannot quickly return to the multi-window, but firstly the multi-window can be displayed only after the multi-window control is selected from a plurality of controls in the setting menu through operation, and then the operation path is complex. 2) The playback before going back again after the multiple windows has been disconnected, requiring the user to reconnect the playback. Thus, after entering the single window full screen mode from the multi-window mode, the user is required to perform a complicated operation and re-screen if he wants to return to the multi-window mode from the single window full screen mode. In order to reduce the user operation and waiting time when returning from the multi-window mode to the single-window full-screen mode to the multi-window mode, the embodiment of the present application provides a display device 200, and the structure and functions of the various parts of the display device 200 may refer to the above-mentioned embodiments. In addition, on the basis of the display device 200 shown in the above embodiment, the present embodiment further improves some functions of the display device 200. As shown in fig. 5, the controller 250 is configured to perform the steps of:

Step S501, in the case of displaying the multi-window page, receiving an instruction of switching the first window to the full-screen mode by user input.

In some embodiments, the step of displaying the multi-window page includes:

In the case of displaying a home page (Launcher), receiving an instruction from a user to open a setup page, the control display 260 displays a setup menu box including a multi-window control at an upper layer of the home page. After receiving the confirmation operation of the user on the multi-window control, the display 260 is controlled to display a multi-window mode selection box on the upper layer of the homepage, wherein the multi-window mode selection box comprises a first mode control, a second mode control and a third mode control, and different mode controls are used for representing supportable different content sources. After receiving a confirmation operation of the user to the first mode control, the second mode control or the third mode control, the display 260 may be controlled to display the multi-window page.

The first mode control is for supporting content from at least one terminal device Miracast drop screen. The second mode control is used for supporting the content from television information and Miracast or DLNA push from at least one terminal device. The third mode control is used for supporting the content pushed by the DLNA from at least one terminal device. It should be noted that, in the case of displaying the homepage, the recommended user selects the first mode control and the third mode control. And if the instruction of selecting the second mode control is received by the user, starting the live application of the television program and displaying the multi-window page.

The Miracast screen-throwing technology adopts Wi-Fi Direct technology, can directly establish point-to-point connection without depending on the existing network, and can mirror the content of the whole screen, including a real-time operation interface. The Miracast screen is suitable for the situation that the screen content of the equipment needs to be displayed immediately, such as a presentation, a game or an online video is expected to be synchronously displayed on a large screen. Miracast's screen-casting provides a tighter synchronization experience because it is a real-time mirror of your screen, supporting bi-directional data flow, theoretically enabling more interactions between two devices.

DLNA push is based on a home network (wired or wireless) allowing compatible devices such as smartphones, tablets, personal computers, etc. to discover and play content from a media server. It is mainly used for pushing multimedia files (such as music, video and pictures). DLNA pushing is suitable for sharing and playing media content within a local area network, and a user can select a specific media file to play. DLNA push supports asynchronous operations, i.e. you can choose a playlist to do something else, only unidirectional data flow from the server to the client.

When the multi-window page is displayed, a preset number of windows may be directly displayed, for example, the first window and the second window may be directly displayed. When the multi-window page is displayed, a window can be displayed first, and the windows are added and arranged appropriately according to the real-time delivered picture.

Taking the example of displaying the first window and the second window on the multi-window page, the first window and the second window may wait to display images of the first media asset and the second media asset pushed by the terminal device DLNA or thrown by Miracast, which establishes communication connection with the display device 200.

For example, in the case of displaying a homepage, an instruction to open a setting menu bar is received by a user by pressing a menu key of the control apparatus 100, and the setting menu box is displayed at an upper layer of the homepage. As shown in fig. 6, the setup menu box includes a multi-window control 61. Upon receiving an instruction from the user to select the multi-window control 61, a multi-window mode selection frame is displayed at the upper layer of the homepage. As shown in fig. 7, the multi-window mode selection box includes a first mode control 71, a second mode control 72, and a third mode control 73. Upon receiving a user instruction to select third mode control 73, a multi-window page is displayed. As shown in fig. 8, the multi-window page includes a first window 81 and a second window 82. The multi-window page as shown in fig. 9 can be displayed when the first terminal device pushes the first media asset to the first window and the second terminal device pushes the second media asset to the second window.

In other embodiments, the step of displaying the multi-window page includes:

in the case of playing a television program, receiving a user input to open a setup page, the display 260 is controlled to display the setup page on top of the television program page, the setup page including a multi-window control. After receiving the confirmation operation of the user on the multi-window control, the display 260 may be controlled to display the multi-window page. The multi-window page comprises a first window and a second window, wherein the first window displays television program pictures, and the second window waits for terminal equipment DLNA push or Miracast screen media resource images which are in communication connection with the display equipment 200.

For example, in the case of playing a television program, an instruction to open a setting page by pressing a menu key of the control apparatus 100 is received from a user, and a menu page is displayed at an upper layer of a television program screen. As shown in fig. 10, the menu page includes a multi-window control 101. Upon receiving a user instruction to select the multi-window control 101, a multi-window mode selection box may be displayed at an upper layer of the television program picture. As shown in fig. 11, the multi-window mode selection box includes a first mode control 71, a second mode control 72, and a third mode control 73. Upon receiving a user instruction to select the second mode control 72, a multi-window page is displayed. After receiving the instruction of selecting the multi-window control 101 from the user, the multi-window page may also be directly displayed. As shown in fig. 12, the multi-window page includes a first window 81 and a second window 82. Wherein the first window 81 displays a television program picture. The second window 82 waits for the terminal device DLNA to push or Miracast to throw the screen media asset image.

In some embodiments, the instruction to switch the first window to full-screen mode may be received by receiving a user input by receiving a user confirmation operation of the first window corresponding to the full-screen control, and the instruction to switch the first window to full-screen mode may be received by receiving a user input by receiving a user confirmation operation of the first window.

Illustratively, in FIG. 9, the multi-window page includes a first window 81, a second window 82, and a focus 83. Also included below the first window 81 are a full screen control 811, a fast reverse control 812, a pause control 813, a fast forward control 814, a sound control 815, and an exit control 816. The fast-back control 812 is used for backing the playing progress of the first media asset by 15s, the pause control 813 is used for pausing the playing of the first media asset, the fast-forward control 814 is used for advancing the playing progress of the first media asset by 15s, the sound control 815 is used for controlling the playing and pausing of the audio, and the exit control 816 is used for stopping Miracast screen throwing or DLNA pushing. The user may input an instruction to switch the first window to full screen mode by selecting either the first window 81 or full screen control 811.

In some embodiments, as shown in FIG. 13, the multi-window application software architecture includes a user interface layer, a business logic layer, and a data layer. The user interface layer is composed of UI components and is a user interface of the multi-window application, and is mainly used for displaying the multi-window interface and operation buttons. The UI component particularly refers to a parent container carrying a plurality of portlets, and mainly receives operations of users. The business logic layer is used for controlling various businesses, including a window manager, a decoding manager and a resource manager. The data layer is mainly the source of play data, including television signals, DLNA services and Miracast services.

In the case of displaying a multi-window page, the first window may directly receive a user confirmation operation of the full screen control, and then send a window maximization request to the window manager. In the case of displaying a multi-window page, the UI component may receive a confirmation operation of the user on the first window full screen control and send a full screen instruction to the first window. The first window sends a window maximization request to a window manager.

When the multi-window page is displayed for the first time, the window manager sends the multi-window state to the resource manager. The resource manager acquires the window change state, and the recorded information of the window change state is empty because the multi-window page is displayed for the first time. After receiving the multi-window state sent by the window manager, the window change state can be directly recorded as the multi-window state. If a return instruction input by the user is received at this time, the window change state can be acquired, and the multi-window application is exited under the condition that the window change state is the multi-window state.

Step S502, changing the state of the first window from the small window state to the full-screen state.

And the window manager processes the window maximization request after receiving the window maximization request sent by the first window, and adjusts the size of the first window to be full-screen size.

Step S503, cancel display of the second window, and send a pause playing instruction to the second window to pause decoding the image of the second media asset.

The window manager may hide or cancel the second window from being displayed, send a pause play instruction to the second window, and send the pause play instruction to the decoding manager. The decoding manager controls the decoder to suspend decoding the image of the second asset. The window manager may also invoke the decode manager to pause decoding the image of the second window corresponding to the second asset.

In some embodiments, the content source of the second window is Miracast, and after the decoding manager pauses decoding the image of the second media asset, the terminal device continuously sends the image/video data to the display device 200, and the display device 200 still receives the image/video data, but does not decode and display the image/video data.

In some embodiments, the content source of the second window is DLNA push, and after the decoding manager pauses decoding the image of the second asset, the image/video data may no longer be acquired from the specified address, nor need decoding and display.

It should be noted that, suspending decoding means temporarily interrupting the current decoding process, but retaining the state of the decoder and other relevant information, the decoder still maintains the initialized state, the decoding resources are not released, and the decoding can be quickly continued from the suspension point. Stopping decoding refers to completely terminating the current decoding process and clearing all states and resources associated with the decoding. Once the decoding process is stopped, all decoding progress is lost and the decoder must be reinitialized from scratch and the media file loaded if playback is required again.

Step S504, the window change state is recorded as a multi-window to full-screen state.

The window manager also sends the window status (full screen status) to the resource manager. The resource manager obtains the window change status. Since the window change state has been recorded as the multi-window state when the multi-window page is first displayed. After receiving the full screen state sent by the window manager, the window change state may be recorded as a multi-window to full screen state. The window manager may also send the decoding status of the second window to and be recorded by the resource manager.

In some embodiments, the window manager also sends a full screen window (first window) to the resource manager. The resource manager marks the first window as a full screen window.

It should be noted that, the execution sequence of the step S502 to the step S504 is not limited in the embodiment of the present application.

Illustratively, in FIG. 9, receiving a user confirmation of the first window 81 or full screen control 811, the control display 260 displays a first window full screen page. As shown in fig. 14. The first window full screen page displays only the first media image.

In some embodiments, the decoding statuses of the decoder for the first window and the second window may also be transmitted to and recorded by the resource manager. For example, in the decoding of the first window corresponding to the decoding state of the decoder, the decoding of the second window corresponding to the decoding state of the decoder is suspended.

Step S505, receiving a return instruction input by a user.

In some embodiments, in the case of displaying the first window in full screen, embodiments of the present application may receive a return instruction input by the user by receiving a return key of the control apparatus 100 pressed by the user.

In other embodiments, in the case of displaying the first window in full screen, the embodiments of the present application may receive the return instruction input by the user by receiving the confirmation operation of the user on the return control in the first window.

Illustratively, as shown in FIG. 14, the first window full screen page includes a return control 141. The user may input a return instruction to the display device 200 by selecting the return control 141.

Step S506, acquiring a window change state.

The UI component of the multi-window application receives the return instruction, sends a message for inquiring the window change state to the resource manager, and the resource manager sends the window change state to the window manager. Wherein, the decoding states of the decoders corresponding to the first window and the second window can also be obtained.

Step S507, changing the first window from the full-screen state to the small-window state under the condition that the window change state is from the multi-window state to the full-screen state.

And under the condition that the window change state is from a multi-window state to a full-screen state, the window manager cancels the full-screen state of the first window and changes the full-screen state of the first window into a small-window state, namely, changes the full-screen size of the first window into the small-window size. The small window size refers to the size of the first window when the first window and the second window are displayed simultaneously.

Step S508, resume display of the second window, and send the media playing instruction to the second window to continue decoding the image of the second media, and display the image of the second media in the second window.

And the window manager resumes displaying the second window under the condition that the window change state is from the multi-window state to the full-screen state. And when the decoding state of the decoder corresponding to the second window is pause decoding, sending a media asset playing instruction to the second window, and sending the media asset playing instruction to the decoding manager by the second window. The decoding manager controls the decoder to continue decoding the image of the second asset. The window manager may also invoke the decode manager to continue decoding the image of the second window corresponding to the second asset.

In some embodiments, the content source of the second window is Miracast, and when the decoding manager starts decoding the image of the second asset, the terminal device sends the latest image/video data to the display device 200, and the display device 200 may receive the image/video data, and decode and display the image/video data.

In some embodiments, the content source of the second window is DLNA push, and the decoding manager may continue to obtain image/video data from the specified address and decode and display as it continues to decode the image of the second asset.

Illustratively, in fig. 14, receiving a return instruction entered by the user pressing the return key of the control device 100, the control display 260 displays a multi-window page as shown in fig. 9.

If the terminal device corresponding to the second window receives the instruction of exiting the screen input by the user when the first window is displayed in full screen, the terminal device may send the instruction of exiting the screen to the display device 200, the window manager sends the instruction of stopping decoding to the second window, and the second window sends the instruction of stopping decoding to the decoding manager. The decoding manager controls the decoder to stop decoding the second media asset, and sends the decoding state of the decoder corresponding to the second window to the resource manager, so that the resource manager updates the decoding state of the decoder to stop decoding. And after receiving a return instruction input by a user, restoring to display the second window, and reinitializing the player of the second window when the decoding state is that decoding is stopped, and waiting for the terminal equipment to be reconnected and played.

The embodiment of the application memorizes the change of the window state through the state variable, carries out special processing on the return key/return instruction, judges the subsequent execution logic according to the state variable, and improves the interaction of the multi-window broadcast amplifying small screen switching. After the multi-window enters a full-screen state, the multi-window page can be directly returned to by inputting a return instruction, so that the user operation path is shortened. And when the multi-window is full-screen, a pause decoding operation is adopted for the non-full-screen window, so that re-playing and screen throwing are not required when the multi-window page is returned, time consumption and operation are reduced, and the continuity of media resource playing is improved.

In some embodiments, in the case of displaying the first window full screen, if an instruction to exit the first window is received by the user input, the UI component sends a message to the resource manager querying for the window change status, and the resource manager sends the window change status to the window manager. And the window manager changes the first window from the full-screen state to the small-window state under the condition that the window change state is from the multi-window state to the full-screen state, and sends a play stopping instruction to the first window so as to stop decoding the image of the first media asset. The window manager also sends a resume display second window and sends a media playing instruction to the second window, and the second window sends the media playing instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the second asset. The positions of the first window and the second window can be exchanged, or the first window can be omitted from being displayed and the second window can be subjected to full-screen processing. According to the embodiment of the application, under the condition that the first window is displayed in a full screen mode, if the exit instruction is received, the media resource picture of the second window can be displayed quickly.

In some embodiments, after the window change status is recorded as the multi-window to full-screen status, a start multi-window application instruction input by the user may be received, in response to the instruction, the first window is changed from the full-screen status to the widget status, the second window is resumed to be displayed, and a media asset playing instruction is sent to the second window to continue decoding the image of the second media asset and displaying the image of the second media asset in the second window.

The setting module can receive a multi-window application starting instruction input by a user and send an instruction for recovering the multi-window to the window manager. The window manager changes the first window from a full-screen state to a small window state, resumes displaying the second window, and sends a media playing instruction to the second window. The second window sends the media asset playing instruction to the decoding manager, and the decoding manager controls the decoder to continuously decode the image of the second media asset, and the second window displays the image of the second media asset.

For example, in fig. 14, an instruction to open a setting page is received by a user by pressing a menu key of the control apparatus 100, and the setting page is displayed at the upper layer of the first window. As shown in fig. 15, the setup page includes a multi-window control 101. After receiving an instruction of selecting the multi-window control 101 from the user, a multi-window page as shown in fig. 9 is displayed.

In some embodiments, after resuming display of the second window and sending the media playback instruction to the second window, the window change state is recorded as a full-screen to multi-window state and the first window is marked as a full-screen window. Responding to a return instruction input by a user, acquiring a window change state, changing a first window marked as a full-screen window from the full-screen state to a small window state under the condition that the window change state is the full-screen to multi-window state, canceling to display a second window, and sending a play pause instruction to the second window so as to pause decoding an image of the second media asset.

Upon resuming the display of the multi-window page, the window manager may send the multi-window state to the resource manager. The resource manager obtains that the current window change state is from a multi-window to a full-screen state, and the first window is marked as a full-screen window. After receiving the multi-window state sent by the window manager, the window change state can be directly recorded as a full-screen to multi-window state, and the first window is marked as a full-screen window. After receiving a return instruction input by the user by pressing a return key of the control device 100, the UI component of the multi-window application sends a message for querying the window change state to the resource manager, and the resource manager sends the window change state to the window manager. Under the condition that the window change state is a full-screen to multi-window state, the window manager changes the first window marked as a full-screen window from the full-screen state to a small window state, cancels the display of the second window and sends a play pause instruction to the second window so as to pause the decoding of the image of the second media asset.

Illustratively, after displaying the multi-window page as shown in fig. 9 in response to an instruction of selecting the multi-window control 101 by the user, a return instruction input by the user pressing a return key of the control device 100 is received, and the display 260 is controlled to display the first window full-screen page as shown in fig. 14.

After the full screen enters the multi-window state, the embodiment of the application can directly return to the single-window full screen page by inputting the return instruction, so that the user operation path is shortened.

In some embodiments, the window change state recorded by the resource manager may be a single state only or a switch of the last two states. Wherein the single state includes a multi-window state and a full-screen state. The last two states of switching include a multi-window to full-screen state and a full-screen to multi-window state. The window changes state record can only support the return operation of the last state.

In other embodiments, the window change state recorded by the resource manager may be a single state or a plurality of switches between the last two states. And adding record information of a state change at the last position every time the window state is received, and reducing the state change at the last position every time a return instruction is received.

For example, the window change state may be a multi-window state-multi-window to full-screen (first window) state-full-screen (first window) to multi-window state-multi-window to full-screen (second window) state, with marked full-screen windows in brackets. After receiving the first return instruction, the second window page with full screen can be changed into a multi-window page, and the window change state is changed into a multi-window state-a multi-window to full screen (first window) state. After receiving the second return instruction, the multi-window page can be changed into a full-screen first window page, and the window change state is changed into a multi-window state.

In some embodiments, in the case of a multi-window page being displayed, an audio play mode may also be acquired. The audio play mode includes a mix play and a single play. Mixing playback refers to allowing multiple assets to play audio data simultaneously. Single-tone playback refers to allowing only one asset to play audio data.

In the case that the audio playing mode is the audio mixing playing mode, the audio output device 270 is controlled to play the audio of the first media asset and the audio of the second media asset while the first window displays the image of the first media asset and the second window displays the image of the second media asset.

In the case that the audio playing mode is single-tone playing, the audio output device 270 is controlled to play the audio of the first media asset or the second media asset designated by the user while the first window displays the image of the first media asset and the second window displays the image of the second media asset. The audio data of the media resource corresponding to the first window can be played by default.

As shown in fig. 9, the audio playback of the first and second assets may be controlled by sound control controls under the first and second windows. Under the condition of single-tone playing, when the user starts the audio playing of the first media asset, the confirmation operation of the user on the sound control under the second window is received, an instruction for pausing audio decoding can be sent to the first window so as to pause the audio playing of the first media asset, and an instruction for starting audio decoding can be sent to the second window so as to start the audio playing of the second media asset.

In some embodiments, the step of obtaining the audio playback mode includes determining whether the content sources of the first media asset and the second media asset are both preset content sources. If the content sources of the first media asset and the second media asset are both preset content sources, the audio playing mode is obtained to be the audio mixing playing mode. If the content source of the first media asset or the second media asset is not the preset content source, the audio playing mode is obtained to play the single sound. The preset content source is Miracast screen.

Illustratively, the single-tone playing includes the following scenes of television signal+Miracast, television signal+DLNA push and DLNA push+DLNA push. The mixing playing comprises the following scenes of Miracast screen throwing and Miracast screen throwing.

In other embodiments, the step of obtaining the audio playback mode includes obtaining a multi-window mode, and obtaining the audio playback mode as a mix playback if the multi-window mode is the first mode. If the multi-window mode is the second mode or the third mode, the audio playing mode is acquired to be single-tone playing.

In still other embodiments, the step of obtaining the audio playback mode includes obtaining a flag bit of the audio playback mode, and obtaining the audio playback mode as a mix playback if the flag bit of the audio playback mode is a preset value. If the flag bit of the audio playing mode is not a preset value, acquiring the audio playing mode as single-tone playing. And changing the zone bit of the audio playing mode through the selection of the single-tone playing control and the mixed-tone playing control in the audio playing mode page selection surface by a user.

And playing the audio of the first media asset and the audio of the second media asset at the same time when the first window displays the image of the first media asset and the second window displays the image of the second media asset under the scene of the mixed audio playing. If the instruction of switching the first window to the full-screen mode is received by the user input, the state of the first window is changed from the small window state to the full-screen state, the second window is canceled from being displayed, and a play pause instruction is sent to the second window to pause decoding of the image and the audio of the second media asset, and the window change state is recorded as a multi-window to full-screen state. In response to a return instruction input by the user, acquiring a window change state, changing the first window from the full-screen state to the small-window state under the condition that the window change state is from the multi-window state to the full-screen state, resuming displaying the second window, sending a media asset playing instruction to the second window so as to continue decoding the image and the audio of the second media asset, displaying the image of the second media asset in the second window, and controlling the audio output device 270 to play the audio of the second media asset.

And playing the audio of the second media asset while displaying the image of the second media asset in the single-tone playing scene, namely the first window displays the image of the first media asset and the second window displays the image of the second media asset. If an instruction of switching the first window to the full-screen mode is received by the user input, the state of the first window can be changed from the small window state to the full-screen state, and the second window is canceled from being displayed. And then sending a pause instruction to the second window to pause decoding the image and audio of the second media asset, sending an audio play instruction to the first window to start decoding the audio of the first media asset, and controlling the audio output device 270 to play the audio of the first media asset. The window change state also needs to be recorded as a multi-window to full-screen state.

Responding to a return instruction input by a user, acquiring a window change state, changing the first window from the full-screen state to the small-window state under the condition that the window change state is from the multi-window state to the full-screen state, and recovering to display the second window. And then sending an audio pause instruction to the first window to pause decoding the audio of the first media asset, sending a media asset playing instruction to the second window to continue decoding the image and the audio of the second media asset, displaying the image of the second media asset on the second window, and controlling the audio output device to play the audio of the second media asset.

And playing the audio of the first media asset while displaying the image of the second media asset in the single-tone playing scene, namely the first window displays the image of the first media asset and the second window displays the image of the second media asset. If an instruction of switching the first window to the full-screen mode is received by the user input, the first window can be changed from the small window state to the full-screen state, the second window is canceled from being displayed, and then a play pause instruction is sent to the second window so as to pause decoding of the image of the second media asset. Responding to a return instruction input by a user, acquiring a window change state, changing the first window from the full-screen state to the small-window state under the condition that the window change state is from the multi-window state to the full-screen state, restoring to display the second window, and sending a media resource playing instruction to the second window so as to continuously decode the image of the second media resource.

In some embodiments, a timing diagram of the media playback method may be as shown in fig. 16. The UI component of the multi-window application displays the multi-window page. The multi-window page comprises a first window and a second window, wherein the first window displays images of the first media asset, and the second window displays images of the second media asset. And after receiving the confirmation operation of the user on the full screen control in the first window, the first window sends a maximized window request to the window manager. The window manager processes the window maximization request, performs maximization/full-screen processing on the first window, changes the display size of the first window into full-screen size, then conceals the second window, and pauses playing of the second media resource in the second window, namely, sends an instruction of pausing playing to the second window, and the second window sends an instruction of decoding, playing and decoding to the decoding manager. The decoding manager controls the decoder to suspend decoding the second asset. The window manager sends the window status to the resource manager. The resource manager records the window change state as a multi-window to full-screen state. The window manager also sends a message to enter full screen mode informing the UI component of the multi-window application.

When the first window is displayed in full screen, the user may generate two operations, 1) the UI component of the multi-window application receives a return instruction input by the user by pressing a return key of the control device 100, and the UI component sends a message for querying the window change state to the resource manager, and the resource manager sends the window change state to the window manager. Under the condition that the window change state is from a multi-window state to a full-screen state, the window manager cancels the full-screen state of the first window, changes the first window from the full-screen state to a small window state, resumes displaying the second window, sends a media playing instruction to the second window, and sends the media playing instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the second asset to display the image of the second asset in the second window.

2) The setting module receives a call-up setting menu instruction input by the user by pressing a menu key of the control apparatus 100, controls the display 260 to display a setting menu page including a multi-window control. And after receiving the confirmation operation of the user on the multi-window control, the setting module sends a multi-window restoration instruction to the window manager. The window manager cancels the full-screen state of the first window, changes the full-screen state of the first window into the small window state, resumes displaying the second window, sends the media playing instruction to the second window, and sends the media playing instruction to the decoding manager. The decoding manager controls the decoder to continue decoding the second asset to display the image of the second asset in the second window.

The embodiment of the application optimizes the multi-window and single-window switching logic, and when the multi-window is switched to the single-window full screen, the window maximizing button can be clicked, other windows are hidden and play is stopped. When the single window is switched to the multiple windows in full screen, the multi-window layout is directly restored by pressing the return key, and other windows are restored to play. The embodiment of the application also optimizes the playing control logic, pauses the playing of other windows when the single window is full screen, and automatically resumes the playing of other windows when the multi-window is returned. The embodiment of the application also supports the following scenes of television signal+Miracast screen, television signal+DLNA push, DLNA push+DLNA push, miracast screen+Miracast screen. According to the application, the return key is used for directly returning to the multi-window page from the single window full screen, so that the operation steps are reduced, smooth switching to the last user interface is realized, and the user experience is obviously improved. And through pause/resume play logic optimization, the natural and smooth window size switching experience is realized.

Some embodiments of the present application also provide a computer-readable storage medium, which may store a program. When the computer storage medium is configured in a display device or a server, the program may include program steps involved in the media playback method in the above embodiment when executed. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random-access Memory (Random Access Memory, RAM), or the like.

An embodiment of the application provides an electronic device, which comprises a processor and a memory for storing instructions executable by the processor. The processor is configured to read the executable instructions from the memory and execute the instructions to implement the media playing method in the above embodiment.

It should be noted that the above embodiments are merely for illustrating the technical solution of the present application and not for limiting the same, and although the present application has been described in detail with reference to the above embodiments, it should be understood by those skilled in the art that the technical solution described in the above embodiments may be modified or some or all of the technical features may be equivalently replaced, and these modifications or substitutions do not make the essence of the corresponding technical solution deviate from the scope of the technical solution of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

A display configured to display a user interface;

a controller coupled to the display and configured to:

In a case where a multi-window page is displayed, in response to a user inputting an instruction to switch a first window to a full-screen mode, changing the first window from a small window state to a full-screen state, the multi-window page including a first window and a second window, the first window being used to display an image of a first media asset, and the second window being used to display an image of a second media asset;

canceling display of the second window and sending a pause playback instruction to the second window to pause decoding of the image of the second media asset;

Record the window change state from multi-window to full-screen state;

When receiving a return instruction input by the user, obtaining the window change state;

When the window state changes from a multi-window state to a full-screen state, changing the first window from the full-screen state to a small window state;

The second window is restored to display, and a media asset playback instruction is sent to the second window to continue decoding the image of the second media asset and display the image of the second media asset in the second window.

2. The display device according to claim 1 , wherein after recording the window change state from multi-window to full-screen state, the controller is further configured to:

When receiving a user input instruction to start a multi-window application, changing the first window from a full-screen state to a small window state;

3. The display device according to claim 1 , wherein after recording the window change state from multi-window to full-screen state, the controller is further configured to: mark the first window as a full-screen window;

After resuming display of the second window, the controller is further configured to:

Record the window change state from full screen to multi-window state;

In response to a return instruction input by the user, acquiring the window change state;

When the window state changes from the full-screen state to the multi-window state, changing the first window marked as a full-screen window from the full-screen state to the small window state;

The second window is canceled from being displayed, and a pause playback instruction is sent to the second window to pause decoding of the image of the second media asset.

4. The display device according to claim 1, wherein the controller is further configured to:

Get the audio playback mode;

When the audio playback mode is mixed playback, controlling the audio output device to play the audio of the first media asset and the audio of the second media asset;

When the audio playback mode is single-tone playback, the audio output device is controlled to play the audio of the first media asset or the second media asset.

5. The display device according to claim 4, wherein the controller executes acquiring the audio playback mode and is further configured to:

If the content sources of the first media asset and the second media asset are preset content sources, the audio playback mode is obtained as mixed playback;

If the content source of the first media asset or the second media asset is not a preset content source, the audio playback mode is obtained as single-tone playback.

6. The display device according to claim 4, wherein, when controlling the audio output device to play the audio of the first media asset and the audio of the second media asset, the controller executes sending a pause playback instruction to the second window to pause decoding of the image of the second media asset, and is further configured to:

Sending a pause playback instruction to the second window to pause decoding of the image and audio of the second media asset;

The controller executes sending a media asset playback instruction to the second window to continue decoding an image of the second media asset, and is further configured to:

Sending a media resource playback instruction to the second window to continue decoding the image and audio of the second media resource;

Control the audio output device to play the audio of the second media asset.

7. The display device according to claim 4, wherein, when controlling the audio output device to play the audio of the second media asset, the controller executes sending a pause playback instruction to the second window to pause decoding of the image of the second media asset, and is further configured to:

An audio play instruction is sent to the first window to start decoding the audio of the first media asset, and the audio output device is controlled to play the audio of the first media asset.

8. The display device according to claim 7, wherein the controller executes sending a media asset playback instruction to the second window to continue decoding an image of the second media asset, and is further configured to:

Sending an audio pause instruction to the first window to pause decoding of the audio of the first media asset;

Control the audio output device to play the audio of the second media asset.

9. The display device according to claim 1, wherein the controller is further configured to:

Record the window change status as a multi-window state;

If a return instruction input by the user is received, obtaining the window change state;

When the window change state is a multi-window state, exit the multi-window application.

10. A media resource playback method, comprising:

Record the window change state from multi-window to full-screen state;