CN113051432B - Display device and media resource playback method - Google Patents

Abstract

Embodiments of the present application provide a display device and a method for playing media assets. The display device includes: a display; a controller connected to the display, and the controller is configured to: receive a media asset playing instruction input by a user; Play instruction, obtain the target video corresponding to the media asset playback instruction; when no control is set above the first play window corresponding to the target video, play the target video in the first play window; When the control is provided above the first playback window of the video, the display position of the target video is moved away from the control in the first playback window, so that the center of the screen of the target video is moved. It is displayed near the center of the target display area in the first play window that is not blocked by the control, wherein the control is opaque and blocks one side of the first play window. The present application improves the display effect of media asset playback.

Description

Display device and media resource playback method

technical field

The present application relates to the field of display technologies, and in particular, to a display device and a method for playing media assets.

Background technique

Nowadays, it is a popular way to exercise by following the fitness videos on TV. In order to better grasp whether your fitness movements are standard, some TVs can collect user images through cameras, and display the user images and fitness videos on the TV at the same time. Play, so that users can see their actions on the TV, so that they can compare and analyze their actions with the actions in the fitness video terminal.

At present, the display ratio of most TVs is 16:9, and the ratio of fitness videos is usually 16:9. If the TV only plays fitness videos, the fitness videos can be displayed in full screen. If the fitness videos and user images are displayed at the same time, Since the user image occupies part of the display area of the TV, the display area of the fitness video may not be 16:9. In the related art, when the ratio of a video is inconsistent with the ratio of the playback window, the video is usually scaled to a smaller size so that it can be displayed in the playback window. However, this will cause black borders to appear around the video. , and the video will also become smaller. For fitness videos, the smaller video will make some fitness movements difficult to see, which will seriously affect the user's viewing experience.

SUMMARY OF THE INVENTION

In order to solve the technical problem of poor fitness video playback effect, the present application provides a display device and a media asset playback method.

In a first aspect, the present application provides a display device, the display device comprising:

monitor;

a controller, connected to the display, the controller being configured to:

Receive the media asset playback instruction input by the user;

In response to the media asset playback instruction, obtain a target video corresponding to the media asset playback instruction;

When the control is not set above the first playback window corresponding to the target video, the target video is played in the first playback window;

When the control is provided above the first playback window corresponding to the target video, the display position of the target video is moved in the first playback window away from the control, so that the target video is displayed in a direction away from the control. The center position of the screen is displayed close to the center position of the target display area in the first play window that is not blocked by the controls, wherein the controls are opaque and block one side of the first play window.

In a second aspect, the present application provides a method for playing media assets, the method comprising:

Receive the media asset playback instruction input by the user;

In response to the media asset playback instruction, obtain a target video corresponding to the media asset playback instruction;

When the control is not set above the first playback window corresponding to the target video, the target video is played in the first playback window;

When the control is provided above the first playback window corresponding to the target video, the display position of the target video is moved in the first playback window away from the control, so that the target video is displayed in a direction away from the control. The center position of the screen is displayed close to the center position of the target display area in the first play window that is not blocked by the controls, wherein the controls are opaque and block one side of the first play window.

The beneficial effects of the display device and the media asset playback method provided by the present application include:

In the embodiment of the present application, a display area where the target video is not blocked is detected on the display device, and it is determined as the target display area, and then after scaling the target video, the image of the target video is controlled to be offset and displayed in the target display area, It solves the problem of poor display effect caused by the target video being blocked by the second playback window when playing in the follow-up mode, and improves the user's viewing experience.

Description of drawings

In order to illustrate the technical solutions of the present application more clearly, the accompanying drawings that need to be used in the embodiments will be briefly introduced below. Other drawings can also be obtained from these drawings.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control apparatus according to some embodiments;

FIG. 2 exemplarily shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

FIG. 3 exemplarily shows a hardware configuration block diagram of the display device 200 according to some embodiments;

FIG. 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments;

FIG. 5 exemplarily shows a schematic diagram of a fitness home page according to some embodiments;

Figure 6 exemplarily shows a schematic diagram of a media asset details interface according to some embodiments;

FIG. 7 exemplarily shows a schematic diagram of a playback mode selection interface according to some embodiments;

FIG. 8 exemplarily shows a schematic diagram of a full-screen playback interface in normal mode according to some embodiments;

FIG. 9 exemplarily shows a double-window schematic diagram in follow-up mode according to some embodiments;

FIG. 10 exemplarily shows a schematic diagram of a target display area in a follow-up mode according to some embodiments;

FIG. 11 exemplarily shows a schematic diagram of the offset in the follow-up mode according to some embodiments;

FIG. 12 exemplarily shows a schematic diagram of occlusion in a follow-up mode according to some embodiments;

FIG. 13 exemplarily shows a schematic diagram of a dual-window playing interface in a follow-up practice mode according to some embodiments.

Detailed ways

In order to make the purpose and implementation of the present application clearer, the exemplary embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only the Some embodiments are claimed, but not all embodiments.

It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described below, rather than intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.

The terms "first", "second", "third", etc. in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit specific Sequential or sequential, unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprising" and "having", and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that incorporates a series of components is not necessarily limited to all components explicitly listed, but may include no explicit other components listed or inherent to these products or devices.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user can operate the display device 200 through the smart device 300 or the control device 100 .

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wiredly. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.

In some embodiments, a smart device 300 (eg, a mobile terminal, a tablet computer, a computer, a notebook computer, etc.) can also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device.

In some embodiments, the display device 200 can also be controlled in a manner other than the control apparatus 100 and the smart device 300. For example, the module for acquiring voice commands configured inside the display device 200 can directly receive the user's voice command for control. , the user's voice command control can also be received through a voice control device provided outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with the server 400 . The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

FIG. 2 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .

FIG. 3 is a block diagram showing a hardware configuration of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, display device 200 includes tuner 210, communicator 220, detector 230, external device interface 240, controller 250, display 260, audio output interface 270, memory, power supply, user interface at least one.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving the image display, for receiving the image signal output from the controller, for displaying the video content, the image content and the menu manipulation interface Components and user manipulation UI interface.

In some embodiments, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220 .

In some embodiments, the user interface may be used to receive control signals from the control device 100 (eg, an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals from the external environment or interaction with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI), Analog or Data High Definition Component Input (Component), Composite Video Input (CVBS), USB Input (USB) , RGB port, etc. any one or more interfaces. It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.

In some embodiments, the tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or cable broadcast television signals.

In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.

In some embodiments, the controller 250, through various software control programs stored on the memory, controls the operation of the display device and responds to user operations. The controller 250 controls the overall operation of the display apparatus 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any of the selectable objects, such as hyperlinks, icons, or other operable controls. The operations related to the selected object include: displaying operations connected to hyperlinked pages, documents, images, etc., or executing operations of programs corresponding to the icons.

In some embodiments, the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processing unit (Graphics Processing Unit, GPU), RAM (Random Access Memory, RAM), ROM (Read-Only). Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.

In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. A commonly used form of user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. visual interface elements.

Referring to FIG. 4 , in some embodiments, the system is divided into four layers, from top to bottom, the applications layer (referred to as “application layer”), the application framework layer (referred to as “framework layer”) "), the Android runtime (Android runtime) and the system library layer (referred to as "system runtime library layer"), and the kernel layer.

In some embodiments, at least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, or a clock program that comes with the operating system; they may also be developed by third-party developers. s application. During specific implementation, the application package in the application layer is not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and a programming framework for the application. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action. The application program can access the resources in the system and obtain the services of the system during execution through the API interface.

As shown in FIG. 4 , the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: the activity manager (ActivityManager) is used with Interact with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device. Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers and desktops on the user interface part.

In some embodiments, the activity manager is used to manage the life cycle of the various applications and general navigation rollback functions, such as controlling the exit, opening, rollback, etc. of the application. The window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (such as reducing the display window, shaking display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensors, etc.), and power drives, etc.

The hardware or software architecture in some embodiments may be based on the introduction in the foregoing embodiments, and may be based on other similar hardware or software architectures in some embodiments, and the technical solutions of the present application may be implemented.

In some embodiments, the display device can directly enter a preset VOD program interface after startup. The VOD program interface can be as shown in FIG. 5 , at least including a navigation bar and a content display area below the navigation bar. The content displayed in the display area changes with the selected control in the navigation bar. The program in the application layer can be integrated in the video-on-demand program to be displayed through a control in the navigation bar, or it can be further displayed after the application control in the navigation bar is selected.

In some embodiments, after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video-on-demand program, and can also be an HDMI interface, a live TV interface At least one of etc., after the user selects different signal sources, the display can display the content obtained from the different signal sources.

In some embodiments, as shown in FIG. 5 , the navigation bar may be provided with multiple controls, such as "My", "Channel", "Video", "Fitness", "VIP", "Education", "Mall" , "Games" and applications, different navigation bar controls correspond to different channel interfaces, if the user wants to exercise, select the "Fitness" control, the interface shown in Figure 5 is the interface after the "Fitness" control is selected, the user can Select a fitness video in this interface to follow the fitness video to exercise.

Referring to Figure 6, after the user clicks a fitness video on the interface shown in Figure 5, the display device requests the server to send the corresponding details page data according to the configuration parameters corresponding to the selected video control, and then enters the details page data according to the received details page data. The media asset details interface shown in Figure 6. As shown in Figure 6, the media asset details interface can display multiple course subsection controls of the fitness video, or it may not include it. After the user clicks one of the course subsection controls or starts training controls, the display device will obtain the course subsection controls/details page corresponding to the fitness video, and then enter the playback mode selection interface. In the following expressions, the played fitness video is also referred to as a target video.

Referring to FIG. 7, the playback mode selection interface can display three mode controls. The playback mode corresponding to the first mode control is the normal mode, which can also be called the first mode, and the playback mode corresponding to the second mode control is the follow-up mode. mode, this mode may also be referred to as the second mode, and the playback mode corresponding to the third mode control is the movie viewing mode, which may also be referred to as the third mode. Each mode control can display an explanation of the playback mode. Exemplarily, the explanation of the normal mode can be: "Shield the camera to watch the complete teaching video to become familiar with the training action", and the explanation of the follow-up mode can be: "Turn on The camera obtains the real-time comparison of the action to make the action more standard", and the explanation of the viewing mode can be: "The effect of exercising while shielding the camera will not be discounted".

According to the above explanation, in some embodiments, in the normal mode, the display device does not activate the camera, and only sets a playback window on a new interface to play the fitness video. In the follow-up mode, the display device activates the camera, Two playback windows are set on the new interface of the monitor to play the images captured by the camera and the fitness video at the same time. In the movie viewing mode, the display device does not start the camera, and two playback windows are set on the new interface of the monitor, respectively simultaneously. Play a workout video and a movie.

In some embodiments, the display device may be provided with a camera, and the camera may include an elevating camera or a non-elevating camera, the camera may capture user images to obtain local camera data, and the controller of the display device may display the local camera data captured by the camera on the On the display of the display device, the user can see his actions on the display.

In some embodiments, the display device is not provided with a camera, but a camera can be connected, such as an external camera connected through USB, and the camera is used to capture user images, and the controller of the display device can display the local data captured by the camera on the display device. on the device's display.

The user can select a playback mode to watch the fitness video according to the above explanation.

In some embodiments, if the user clicks the normal mode control on the playback mode selection interface shown in FIG. 7 , the display device generates a media asset playback instruction, and the media asset playback instruction includes information about the playback mode and the target video. The mode is the normal mode, and the information of the target video includes the playback address of the target video. The display device obtains the video data stream of the target video from the playback address of the target video according to the media asset playback instruction, and generates a first playback window for playing the target video on the new interface according to the normal playback mode. In some embodiments, the first playback window may be a full-screen window with a display ratio of 16:9.

In some embodiments, since the ratio of the fitness video is generally 16:9, and the ratio of the full-screen window is also 16:9, the ratio of the fitness video is consistent with the ratio of the full-screen window. In the normal mode, the display device only generates a first playback window, and does not generate other windows, and no other windows will block the display content of the first playback window. Therefore, after generating the first playback window, the display device can The playback mode of the media asset playback instruction is the normal mode, which directly plays the fitness video in full screen in the first playback window.

In some embodiments, in order to play the fitness video in full screen in the first playback window, the display device may zoom the image of the target video, so that the image size of the zoomed target video is scaled to be consistent with the size of the full screen window.

In some embodiments, the method for scaling the target video by the display device may be: parsing the video data stream of the target video to obtain a video frame sequence of the target video, taking the first frame image in the video frame sequence, and according to the image The ratio of the height to the height of the target display area obtains a scaling ratio, and then the video frame sequence of the target video is scaled according to the scaling ratio. Exemplarily, the image height of the target video is 100, the height of the full-screen window of the display device is 1000, where the height can be the number of pixels in the vertical direction, and the scaling ratio is: 100:1000=1:10, according to this The zoom ratio is to enlarge the video frame sequence of the target video by 10 times, so that the enlarged image of the target video can fill the entire full-screen window.

In some embodiments, after zooming the target video, the display device obtains a video frame sequence of the zoomed target video, and sends the video frame sequence to the first playback window, so that the first playback window can continuously play the video frame sequence .

Referring to FIG. 8 , it is a schematic diagram of a full-screen playback interface in the normal playback mode according to some embodiments. As shown in FIG. 8 , in the normal playback mode, the target video can be played in full screen. The character in FIG. 8 can be a fitness coach. It can represent the background of the person. Usually, in the image of the target video, the person is displayed in the center, and the left and right sides behind the person are background images.

In some embodiments, if the user clicks the follow-up mode control on the playback mode selection interface shown in FIG. 7, the display device generates a media asset playback instruction, and the media asset playback instruction includes the information of the playback mode and the target video. At this time, The playback mode is the follow-up mode, and the information of the target video includes the playback address of the target video. The display device obtains the video data stream of the target video from the playback address of the target video according to the media asset playback instruction, and generates a first playback window for playing the target video on the new interface according to the playback mode as a follow-up mode, and A second playback window for playback of local camera data.

In some embodiments, the second play window is superimposed on the first play window.

In some embodiments, the height of the second play window and the first play window are the same, the left border of the second play window and the left border of the first play window overlap, or, the right border of the second play window and the first play window The right borders of .

In some embodiments, the position of the window can be realized by setting the coordinate parameters of the window in the interface.

In some embodiments, referring to FIG. 9 , in the follow-up mode, the first playback window can be a full-screen window with a display ratio of 16:9, and the second playback window can be a window of the same height as the display, and the display ratio can be adjusted according to The shooting parameters of the camera are determined. The second playback window can be displayed on one side of the first playback window in the form of a texture. For example, the second playback window can be displayed on the right side of the first playback window and overlap with the right edge of the first playback window. The display area on the right side of a playback window constitutes a block. If the display device scales the target video to the same size as the full-screen window and directly displays the scaled image in the full-screen window, due to the occlusion of the second playback window, if the normal window display logic is followed, part of the target video cannot be displayed. When the user watches, the user can only watch the images in the target video that are not blocked by the second play window. When the target video is a fitness video, the user needs to follow the movements of the fitness coach in the fitness video. The fitness coach is the character in the target video, usually located in the middle of the fitness video, and the second playback window may block the fitness coach. The body affects the viewing effect of fitness videos.

In some embodiments, in order to reduce the probability that the body of the fitness coach is blocked, the display device may determine a target display area in the first playback window in the follow-up mode, and the target display area is not blocked by the second playback window. In the occluded area, the display device can display the image of the target video to the left in the target display area, so that the user can see a relatively complete exercise action in the target display area.

In some embodiments, the target display area is determined according to the position coordinates of the first play window and the position coordinates of the second play window. By subtracting the position coordinates of the first play window from the position coordinates of the second play window, the position coordinates of the target display area can be obtained.

It should be noted that the target display area refers to the preferred display area in the first playback window, and the content displayed in the target display area will not be blocked by other images. window, there is also a second playback window, and the second playback window forms a partial block to the first playback window, then the display device can display the area in the first playback window that is located on the left side of the second playback window and is not blocked by the second playback window. Determined as the target display area. Referring to FIG. 10 , the second play window is superimposed and displayed on the upper right side of the first play window, and the area on the left side of the first play window that is not covered by the second play window can be determined as the target display area of the first play window.

It should be noted that, in the follow-up mode, the first playback window is blocked by the second playback window, and the display device determines the target display area according to the position of the second playback window on the first playback window. In some video playback scenarios, the first playback window used for video playback may not be blocked by the second playback window used to play the local data of the camera, but by other images, for example, by an opaque control for displaying pictures In this case, the method provided by the embodiment of the present application can also be applied to determine a target display area, and play a video in the target display area, so as to achieve a better playback effect. At this time, if the position where the control blocks the first playback window is the same as the position where the second playback window blocks the first playback window, that is, both are blocked on one side of the first playback window, and one width side of the control is the same as the first playback window. One of the width sides of , the target display area can be determined as a rectangular area in the first playback window that is not blocked by the controls. If all sides of the control are not overlapped with the first playback window, at this time, no matter which side of the control the target display area is set to, the size of the target display area will be smaller. The display area is determined as the target display area, that is, the target video is played in full screen in the first play window.

In some embodiments, in the follow-up mode, since the target display area is only a partial display area of the first playback window, the size ratio of the target display area may not be 16:9. First zoom the target video, and then offset the image of the zoomed target video to the left, so that the center line of the offset image is close to the center line of the target display area, or the center line of the offset image is close to the center line of the target display area. The center lines of the display areas are coincident, so that the user can see a relatively complete person image in the target display area.

In some embodiments, during the software execution process, the target display area may be determined, and the first moving distance of the target video may be directly determined according to the position parameters of the first playback window and the second playback window in the playback interface. The exemplary target video will be scaled during the playback of the player. In order to ensure that the displayed content is not deformed, the image is generally scaled in equal proportions in the height and width directions. The general scaling rule is to confirm the scaling factor according to the height (width). After scaling the image, the scaled image fills the height (width) of the playback window in height (width), and black can be inserted in another dimension. The height direction may be used as the reference, or the width direction may be used as the reference. The first distance that the image of the target video needs to move during the display process can be determined according to the width parameter of the first player and the width parameter of the second player. So that the middle position of the target video image frame is displayed as far as possible in the unobstructed area on the first video window.

Referring to FIG. 11 , after shifting the image of the target video to the left by the first moving distance D, it can be seen that the image of the person in the target video is closer to the left side of the screen than before the shift.

Referring to FIG. 12 , after the image of the target video is shifted to the left by the first moving distance D, the background image on the right side of the character in the target video can be blocked by the second playback window. The characters in the window are occluded, which achieves a good display effect.

In order to calculate the first moving distance D, in some embodiments, the image of the target video may be zoomed to obtain the image width after the target video is zoomed to the size of the first playback window, and the image width may be referred to as the width to be displayed; Obtain the width of the second playback window; take the difference between the two widths to obtain the width of the target display area; take half of the difference between the width to be displayed and the width of the target display area as the first moving distance. According to this calculation method, the first moving distance D offset from the left side of the target video is the same as the distance that the right side of the target video is blocked by the second playback window, so that the center line of the target video and the center line of the target display area are overlapped. This calculation method may be called an average method, and has the advantages of simple calculation and fast calculation speed, and can quickly determine the size of the first moving distance D.

In some embodiments, the first moving distance may be any distance less than the difference in width of the two playback windows.

In some embodiments, the first moving distance is not greater than the width of the second playback window.

In some embodiments, the first moving distance may be directly determined according to the width of the second playing window. Exemplarily, half of the width of the second playing window is used as the distance to be moved, and the first moving distance is not greater than the distance to be moved. .

In some embodiments, the first moving distance may also be obtained according to the difference between the width of the zoomed movie and the width of the second playback window, for example, half of the difference may be used as the first moving distance.

In some embodiments, the determination of the first movement distance is performed according to a position parameter of the playback window.

In some embodiments, the fitness trainer in the target video may not be located in the middle of the image. At this time, if the first moving distance D offset from the left side of the target video is set to the right side of the target video and is blocked by the second playback window The method with the same distance will cause the fitness trainer in the target video to be skewed to the left or right, and the display effect is not good. In order to solve this technical problem, other methods can also be used to calculate the first moving distance D. For example, human body recognition can also be performed on the image frame of the target video. After identifying the human body, that is, the fitness coach, the central axis of the human body is symmetrically extended to both sides until the width of the display area containing the human body is the same as the width of the target display area. At this time, the difference between the width starting point of the display area containing the human body and the width starting point of the first playback window is used as the first moving distance. The first moving distance obtained by this calculation method may be the same as the first moving distance obtained by the above-mentioned averaging method. Not the same, if the fitness coach is to the left in the media image of the target video, then the first moving distance obtained by this calculation method is smaller than the first moving distance obtained by the above-mentioned averaging method, if the fitness coach is offset in the media image of the target video. Right, then the first moving distance obtained by this calculation method is greater than the first moving distance obtained by the above-mentioned averaging method.

After obtaining the first moving distance D, in some embodiments, the display device may implement the image offset display of the target video by dynamically setting the display of the surfaceView (planar view). The offset output function of surfaceView can be: layoutParam.setMargins(0-D,0,0,0). As shown in Figure 12, the offset output function indicates that the left offset is D, so that the left starting point of the media asset image is (0-D), and the starting point on the left side of the media asset image in the first playback window is 0, Since the first playback window is displaying an image, the image needs to be displayed from the position where the starting point is 0. Therefore, according to the above-mentioned offset output function, when displaying each frame of the target video in the first playback window, the first playback window starts to display media assets from the pixel point on the right side of the target video at the first moving distance D in the first playback window. Image, the image within the first moving distance D exceeds the display range of the first playback window, and the first playback window will not display this part of the image, realizing the display effect of shifting the image of the target video to the left and displaying it in the target video. On the right side of the image, the first playback window still has a part of the display area, and this part of the display area can display black borders. By placing the second playback window on top, the second playback window can cover the right side of the character in the image of the target video. part of the background image and the above black border, the user will not see this part of the background image and the black border, and will not affect the user's viewing experience. Wherein, the topping method of the second playback window may be setZOrderOnTop(true) to be on top.

According to the above method of dynamically setting the surfaceView, the playback interface of the display device in the follow-up mode is shown in Figure 13, the middle image of the target video is displayed in the target display area of the first playback window, and the user image is displayed in the second playback window. displayed inside.

In some embodiments, after receiving the target video, the display device decodes the target video, scales it according to the parameters of the first playback window, and then moves the image frame to the left by the first The position parameter after the distance is displayed. Since the image outside the playback area of the first playback window cannot be displayed, the edge of the image frame close to the second playback window is blocked by the second playback window, and the central area of the image frame can be in the first playback window. Unoccluded areas are rendered.

In some embodiments, the second play window plays the acquired video data of the camera.

It can be seen from the above embodiments that in the embodiment of the present application, a display area where the target video is not blocked is detected on the display device, and it is determined as the target display area, and then after scaling the target video, the image of the target video is controlled to be displayed on the target. The area is offset and displayed, which solves the problem of poor display effect caused by the target video being blocked by the second playback window during playback in the follow-up mode, and improves the user's viewing experience.

Since the above embodiments are all cited and combined with other modes for description, different embodiments all have the same parts, and the same and similar parts among the various embodiments in this specification can be referred to each other. It will not be elaborated here.

It should be noted that, in this specification, relational terms such as "first" and "second" etc. are only used to distinguish one entity or operation from another entity or operation, and are not necessarily required or implied Any such actual relationship or ordering exists between these entities or operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a circuit structure, article or device comprising a list of elements includes not only those elements, but also not expressly listed Other elements, or elements inherent to such a circuit structure, article, or device are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the circuit structure, article, or device that includes the element.

Other embodiments of the present application will readily suggest themselves to those skilled in the art upon consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of this application and include common knowledge or common technical means in the technical field not disclosed in this application . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the application being indicated by the content of the claims.

The above embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims (9)

1. A display device, comprising:

a display;

a controller connected with the display, the controller configured to:

receiving a media asset playing instruction input by a user;

responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction, wherein the target video is used for enabling a user to perform action following;

when a second playing window is not arranged on the upper layer of a first playing window for playing the target video, playing the target video in the first playing window, wherein the second playing window is used for playing a local video received by the controller and collected by a camera;

when the second playing window is arranged on the upper layer of a first playing window for playing the target video, setting one longitudinal boundary of the second playing window to be overlapped with the longitudinal boundary of the first playing window, moving the display position of the target video in the first playing window to a direction far away from the second playing window by a first moving distance, wherein the longitudinal boundary comprises a left boundary or a right boundary, the first moving distance is half of the width of the second playing window, so that the central position of the picture of the target video is overlapped with the central position of the target display area of the first playing window, and the edge of the image frame in the first playing window, which is close to the second playing window, is shielded by the second playing window, wherein the second playing window is opaque and shields the area on one side of the first playing window, the target display area is an area which is not shielded by the second playing window.

2. The display device of claim 1, wherein the second playback window comprises a window generated by the controller in response to the asset playback instruction.

3. The display device according to claim 1, wherein moving the display position of the target video in the first playing window in a direction away from the second playing window further comprises:

determining the width to be displayed of the target video when the target video is completely displayed in the first playing window in the height direction;

and determining a first moving distance according to the width to be displayed and the width of the target display area, wherein the first moving distance is a distance in the first playing window, which is required to move the display position of the target video to a direction away from the second playing window.

4. The display device according to claim 3, wherein determining the to-be-displayed width of the target video when the target video is completely displayed in the first playing window in the height direction comprises:

obtaining a scaling according to the ratio of the image height of the target video to the height of the target display area;

and obtaining the width to be displayed of the target video according to the image width of the target video and the scaling.

5. The display device according to claim 1, wherein the target display area is determined based on position coordinates of the first playback window and position coordinates of the second playback window.

6. The display device of claim 1, wherein the height of the second playback window is the same as the height of the first playback window.

7. The display device of claim 1, wherein a right side of the second playback window coincides with a right side of the first playback window.

8. The display device according to claim 1, wherein after the target video corresponding to the asset playing instruction is acquired in response to the asset playing instruction, the method further comprises:

responding to that the play mode corresponding to the media asset play instruction is a first mode, and loading a first play page, wherein the first play page comprises a first play window and does not comprise a second play window, and the first play window is used for playing the target video;

and responding to that the playing mode corresponding to the media asset playing instruction is a second mode, and loading a second playing page, wherein the first playing page comprises a first playing window and a second playing window positioned above the first playing window, the first playing window is used for playing the target video, and the second playing window is used for playing the received local camera data.

9. A method for playing media assets, comprising:

receiving a media asset playing instruction input by a user;

responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction, wherein the target video is used for enabling a user to perform action following;

when a second playing window is not arranged on the upper layer of a first playing window for playing the target video, playing the target video in the first playing window, wherein the second playing window is used for playing a local video which is received by a controller and is collected by a camera;

when a second playing window is arranged on the upper layer of a first playing window for playing the target video, setting one longitudinal boundary of the second playing window to be overlapped with the longitudinal boundary of the first playing window, moving the display position of the target video in the first playing window to a direction far away from the second playing window by a first moving distance, wherein the longitudinal boundary comprises a left boundary or a right boundary, the first moving distance is half of the width of the second playing window, so that the central position of the picture of the target video is overlapped with the central position of the target display area of the first playing window, and the edge of the image frame in the first playing window, which is close to the second playing window, is shielded by the second playing window, wherein the second playing window is opaque and shields the area on one side of the first playing window, the target display area is an area which is not shielded by the second playing window.

Images