CN114647468B - Screen projection image display method and device, electronic equipment and storage medium - Google Patents

Abstract

The present application discloses a projection screen image display method, device, electronic equipment, and storage medium. The projection screen image display method includes: obtaining the upper-level application information of the projection screen push end; and displaying the target projection screen of the projection screen Switching the mode to the screen projection display mode corresponding to the upper layer application information; when receiving the screen projection image sent by the screen projection push end, performing image processing on the screen projection image according to the target screen projection display mode to obtain Target screen projection image; output the target screen projection image. The present application solves the technical problem of poor screen projection display effect in the prior art.

Description

Screen projection image display method, device, electronic device and storage medium

technical field

The present application relates to the technical field of screen projection, and in particular to a screen projection image display method, device, electronic equipment, and storage medium.

Background technique

With the development of science and technology and the improvement of people's living standards, the function of displaying the screens of mobile devices such as mobile phones, tablets, and computers through large TV screens, projectors, and other display devices has become increasingly popular. , videos, etc. are pushed to the display device for playback. However, during the screen projection process, there may often be freezes and frame drops, especially for first-person shooting games, high frame rate movies, etc. Screen scenes, freezes or frame drops will seriously affect the fluency of games or movies, resulting in poor screen projection display effects, which will affect the user's screen projection experience.

Contents of the invention

The main purpose of the present application is to provide a projection screen image display method, device, electronic equipment and storage medium, aiming to solve the technical problem of poor projection display effect in the prior art.

In order to achieve the above purpose, the present application provides a screen projection image display method, the projection screen image display method includes:

Obtain the upper layer application information of the screen projection push end;

Switching the target screen display mode of the screen projection to the screen projection display mode corresponding to the upper layer application information;

When receiving the image to be projected sent by the screen projection push end, perform image processing on the image to be projected according to the display mode of the target screen projection to obtain the target screen projection image;

Outputting the target projection image.

Optionally, the step of performing image processing on the image to be projected according to the display mode of the target projection to obtain the target projection image includes:

Acquiring initial display parameters corresponding to the image to be projected;

Adjusting the initial display parameters according to the target projection display mode to obtain target display parameters;

Performing image processing on the image to be projected according to the target display parameters to obtain a target projected image.

Optionally, the display parameters include frame rate and resolution, and the step of adjusting the initial display parameters according to the target projection display mode to obtain the target display parameters includes:

If it is determined that the target screen projection display mode is the frame rate priority mode, then increase and adjust the initial frame rate to obtain the target frame rate, and decrease and adjust the initial resolution to obtain the target resolution;

If it is determined that the target projection screen display mode is the resolution priority mode, the initial frame rate is decreased and adjusted to obtain the target frame rate, and the initial resolution is increased and adjusted to obtain the target resolution.

Optionally, the screen projection display mode includes a frame rate priority mode and a resolution priority mode, and the step of switching the target screen projection display mode of the projection screen to the screen projection display mode corresponding to the upper-layer application information includes :

According to the upper-layer application information, it is judged whether the upper-layer application of the screen projection push end is a high frame rate application;

If it is determined that the upper layer application of the screen projection push end is a high frame rate application, then switching the target screen projection display mode of the projection screen to a frame rate priority mode;

If it is determined that the upper layer application of the screen projection push end is not a high frame rate application, then switch the target screen projection display mode of the projection screen to a resolution priority mode.

Optionally, the upper-layer application information includes an upper-layer application type, and according to the upper-layer application information, the step of judging whether the upper-layer application at the screen projection push end is a high frame rate application includes:

Judging whether the upper-layer application type belongs to a preset white list of high frame rate applications;

If the upper-layer application type belongs to the preset high frame rate application whitelist, it is determined that the upper-layer application on the screen projection push end is a high frame rate application.

Optionally, after the step of outputting the target projection image, it also includes:

Real-time monitoring whether image frame loss occurs during the screen projection process;

When it is detected that an image frame loss occurs during the screen projection process, the screen projection display mode of the screen projection is switched to a frame rate priority mode.

Optionally, after the step of outputting the target projection image, it also includes:

Real-time monitoring whether the rate of change of the projected image of the target is less than a preset rate of change;

When it is detected whether the change rate of the target screen projection image is less than a preset change rate, the target screen projection display mode of the projection screen is switched to a resolution priority mode.

The present application also provides a projected screen image display device, the projected screen image display device is applied to a projected screen image display device, and the projected screen image display device includes:

An acquisition module, configured to acquire the upper-layer application information of the screen projection push end;

A mode switching module, configured to switch the target screen display mode of the screen projection to the screen projection display mode corresponding to the upper-layer application information;

An image processing module, configured to perform image processing on the image to be projected according to the display mode of the target screen projection when receiving the image to be projected from the screen projection pusher to obtain the target screen projection image;

An output module, configured to output the target projected screen image.

The present application also provides an electronic device, the electronic device is a physical device, and the electronic device includes: a memory, a processor, and the projected image display stored in the memory and operable on the processor The program of the method, when the program of the screen projection image display method is executed by the processor, can realize the steps of the above projection screen image display method.

The present application also provides a storage medium, the storage medium is a computer-readable storage medium, and the computer-readable storage medium stores a program for implementing a method for displaying a projected screen image, and the program for the method for displaying a projected screen image is processed When the device is executed, the steps of the method for displaying the projected screen image as described above are realized.

The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned method for displaying a projected screen image are realized.

The present application provides a projection screen image display method, device, electronic equipment and storage medium, by obtaining the upper layer application information of the projection screen push end, switching the target projection screen display mode of the projection screen to the upper layer application information The corresponding screen projection display mode realizes switching of the target screen projection display mode according to the upper-layer application of the screen projection push end, and then when receiving the image to be screen projection sent by the screen projection push end, according to the target projection screen The display mode performs image processing on the image to be projected to obtain a target projected image, and outputs the target projected image, so that image processing is performed on the projected image to be projected according to the target projected display mode, that is, According to the upper application of the projection push end, image processing is performed on the image to be projected, so that the output target projection image can be adaptively adjusted according to the difference of the upper application, which can meet the different display requirements of different upper applications requirements, and image processing can be used to effectively improve the processing speed of the image to be projected, thereby effectively avoiding possible freezes, frame drops, etc. Effectively improve the display effect of the projection screen.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.

FIG. 1 is a schematic diagram of a screen projection connection scene in an embodiment of a screen projection image display method of the present application;

FIG. 2 is a schematic structural diagram of an electronic device in a hardware operating environment involved in a screen projection image display method in an embodiment of the present application;

FIG. 3 is a schematic flow diagram of an embodiment of a screen projection image display method of the present application;

FIG. 4 is a schematic diagram of a scenario of an implementation mode of the projected image display method of the present application;

FIG. 5 is a schematic flowchart of an embodiment of a method for displaying images on a projected screen according to the present application;

FIG. 6 is a schematic flowchart of an embodiment of a method for displaying images on a projected screen according to the present application;

FIG. 7 is a schematic structural diagram of a device involved in a screen projection image display method in an embodiment of the present application.

The realization of the purpose, functions and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

In order to make the above objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Referring to FIG. 1 , FIG. 1 is a schematic diagram of a screen projection connection involved in an embodiment of the present invention.

As shown in Figure 1, the screen projector includes: a screen projector transmitter and/or a screen projector receiver, wherein the first electronic device may be a personal computer, or a smart phone, a tablet computer, an e-book reader, For mobile terminal equipment such as a portable computer, the second electronic equipment may be a television, or may be a display device with a display function such as a monitor or a projector.

In some embodiments, the first electronic device is connected to the screen projector transmitter and/or screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected to the screen projector receiver through a wireless network for data transmission and interaction. Data transmission and interaction, or the screen projector transmitter is connected to the second electronic device through a wireless network for data transmission and interaction; the screen projector receiver is connected to the second electronic device through a wired or wireless network for data transmission and interaction. In an optional implementation, the wired connection between the screen projector receiver and the second electronic device and between the screen projector transmitter and the first electronic device may include HDMI (High Definition Multimedia Interface, high-definition multimedia Interface), USB (Universal Serial Bus, Universal Serial Bus), DP (DisplayPort, Display Interface) and VGA (VideoGraphics Array, Video Graphics Array) and other wired connections. The wireless communication methods between the first electronic device and the screen projector transmitter and the screen projector receiver, and between the second electronic device and the screen projector transmitter and the screen projector receiver may include Bluetooth, wireless Broadband (Wi-Fi), infrared communication and other wireless communications.

Therefore, possible connection methods for implementing screen projection between the first electronic device, the screen projector transmitter, the screen projector receiver and the second electronic device at least include:

(1) The screen projector transmitter is connected to the screen projector receiver, and the screen of the first electronic device is finally projected to the second electronic device through the screen projector transmitter and the screen projector receiver;

(2) The transmitter of the screen projector is wirelessly connected with the second electronic device, and the screen of the first electronic device is projected to the second electronic device through the transmitter of the screen projector. At this time, the transmitter of the screen projector and the built-in wireless The communication modules are connected through a wireless network;

(3) The first electronic device is connected to the screen projector receiver, and the screen of the first electronic device is projected to the second electronic device through the screen projector receiver.

Referring to FIG. 2 , FIG. 2 is a schematic structural diagram of an electronic device of a hardware operating environment involved in the method for displaying a projected screen image in an embodiment of the present application. Electronic devices in the embodiments of the present disclosure may include, but are not limited to, TVs, screen projectors, screen projector receivers, screen projector transmitters, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants) , PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as vehicle navigation terminal), digital TV, desktop computer and other fixed terminals.

As shown in FIG. 2 , the electronic device further includes: a processor 1001 , such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002 , a network interface 1003 , and a memory 1004 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. Optionally, the network interface 1003 may include a standard wired interface and a wireless interface (such as a Wireless-Fidelity (Wireless-Fidelity, WI-FI) interface). The memory 1004 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. Optionally, the memory 1004 may also be a storage device independent of the aforementioned processor 1001 .

Optionally, the terminal may also include a camera, an RF (Radio Frequency, radio frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. Among them, sensors such as light sensors, motion sensors and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and/or backlight. As a kind of motion sensor, the gravitational acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile terminal posture (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tap), etc.; of course, the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. No longer.

Those skilled in the art can understand that the structure shown in FIG. 2 does not constitute a limitation on the operating equipment, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

As shown in FIG. 2 , the memory 1004 as a storage medium may include an operating system, a data storage module, a network communication module, and a screen projection image display program.

In the running device shown in FIG. 2 , the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and memory 1004 in the operating device of the present invention can be set in the operating device, and the operating device calls the projected screen image display program stored in the memory 1004 through the processor 1001, and performs the following operations:

Obtain the upper layer application information of the screen projection push end;

Switching the target screen display mode of the screen projection to the screen projection display mode corresponding to the upper layer application information;

When receiving the image to be projected sent by the screen projection push end, perform image processing on the image to be projected according to the display mode of the target screen projection to obtain the target screen projection image;

Outputting the target projection image.

Further, the processor 1001 may call the projected screen image display program stored in the memory 1004, and further perform the following operations:

Acquiring initial display parameters corresponding to the image to be projected;

Adjusting the initial display parameters according to the target projection display mode to obtain target display parameters;

Performing image processing on the image to be projected according to the target display parameters to obtain a target projected image.

Further, the processor 1001 may call the projected screen image display program stored in the memory 1004, and further perform the following operations:

If it is determined that the target screen projection display mode is the frame rate priority mode, then increase and adjust the initial frame rate to obtain the target frame rate, and decrease and adjust the initial resolution to obtain the target resolution;

If it is determined that the target projection screen display mode is the resolution priority mode, the initial frame rate is decreased and adjusted to obtain the target frame rate, and the initial resolution is increased and adjusted to obtain the target resolution.

Further, the processor 1001 may call the projected screen image display program stored in the memory 1004, and further perform the following operations:

According to the upper-layer application information, it is judged whether the upper-layer application of the screen projection push end is a high frame rate application;

If it is determined that the upper layer application of the screen projection push end is a high frame rate application, then switching the target screen projection display mode of the projection screen to a frame rate priority mode;

If it is determined that the upper layer application of the screen projection push end is not a high frame rate application, then switch the target screen projection display mode of the projection screen to a resolution priority mode.

Further, the processor 1001 may call the projected screen image display program stored in the memory 1004, and further perform the following operations:

Judging whether the upper-layer application type belongs to a preset white list of high frame rate applications;

If the upper-layer application type belongs to the preset high frame rate application whitelist, it is determined that the upper-layer application on the screen projection push end is a high frame rate application.

Further, the processor 1001 may call the projected screen image display program stored in the memory 1004, and further perform the following operations:

Real-time monitoring whether image frame loss occurs during the screen projection process;

When it is detected that an image frame loss occurs during the screen projection process, the screen projection display mode of the screen projection is switched to a frame rate priority mode.

Further, the processor 1001 may call the projected screen image display program stored in the memory 1004, and further perform the following operations:

Real-time monitoring whether the rate of change of the projected image of the target is less than a preset rate of change;

When it is detected whether the change rate of the target screen projection image is less than a preset change rate, the target screen projection display mode of the projection screen is switched to a resolution priority mode.

An embodiment of the present application provides a screen projection image display method. In the first embodiment of the projection screen image display method of the present application, referring to FIG. 3 , the projection screen image display method includes:

Step S10, obtaining the upper-layer application information of the screen projection push end;

In this embodiment, it should be noted that the screen projection is a process of projecting the display screen and/or sound of the screen projection pusher to the screen projection receiver for output and display. The execution subject of this embodiment is the screen projection receiver, wherein the screen projection receiver is a device that receives the screen projection, such as a TV, a computer, or a projector, etc. In an implementable manner, the screen projection The receiving end may also be a screen projector receiver connected to the display and/or speaker, and the screen projector receiver may be connected to the display and/or speaker through a wired or wireless connection. After receiving the screen projection audio signal and After the image signal, output the received audio signal and image signal for screen projection through the display and/or speaker connected to the receiver of the screen projection device; tablet computer, etc., the screen projection push end can communicate with other mobile devices through a traditional communication network or the Internet, and the screen projection push end and the screen projection receiver can be connected through a wired or wireless connection. In an implementable manner, the screen projection push end may also be a screen projection transmitter connected to a mobile device, and the screen projection transmitter and the mobile device may be connected through a wired or wireless connection. The transmitter transmitter sends the audio signal and image signal of the desired screen projection to the screen projection receiver.

Specifically, in the process of projecting the screen from the screen projection pusher to the screen projection receiver, the current upper-layer application information of the screen projection pusher is obtained from the screen projection pusher, wherein the upper-layer application information is in the Information about the application displayed on the top layer of the screen projection push terminal, including application name, application type (for example: first-person shooter game, chess and card game, video application, chat application, etc.), display parameters (for example: frame rate, resolution, etc. ), etc., the method of obtaining the upper-layer application information of the screen projection push end includes, but is not limited to: detecting the upper-layer application of the screen projection push end, and directly obtaining the upper-layer application information corresponding to the upper-layer application; obtaining the image to be projected, Image recognition is performed on the image to be projected to determine the upper layer application information in the image to be projected.

In an implementable manner, before the step of obtaining the upper-layer application information of the screen-casting pusher, it further includes: monitoring whether the upper-layer application of the screen-casting pusher changes, and when it is detected that the upper-layer application changes At this time, the current upper-layer application information of the screen projection push terminal is obtained, wherein the upper-layer application information is information of a new upper-layer application after the upper-layer application of the screen projection push terminal has been changed.

Step S20, switching the target screen display mode of the screen projection to the screen projection display mode corresponding to the upper application information;

In this embodiment, it should be noted that the screen projection display mode is a way to adjust the display parameters of the output image of the screen projection receiving end, including frame rate priority mode, resolution priority mode, smooth mode, etc., wherein, The frame rate priority mode uses a preset frame rate priority technology or algorithm (such as MEMC (Motion Estimation and Motion Compensation, motion estimation and motion compensation) technology, etc.), so that other display parameters other than the frame rate are reduced or unchanged, In order to increase or keep the frame rate unchanged and ensure the frame rate is within the preset high frame rate range, the resolution priority mode adopts the preset resolution priority technology or algorithm (such as AI-SR (Artificial Intelligence SuperResolution (artificial intelligence super resolution) technology, AI-PQ (Artificial Intelligence Picture Quality, artificial intelligence image quality enhancement) technology, etc.), so that other display parameters other than resolution are reduced or unchanged, so that the resolution is increased or maintained Unchanged, to ensure that the resolution is within the preset high-resolution range. The smooth mode is a mode that adjusts display parameters such as frame rate and resolution by reducing the balance to ensure that the screen does not freeze. The target The screen projection display mode is the screen projection display mode currently set for the projection screen, and can be switched among the preset projection screen display modes based on user operations.

Specifically, according to the preset mapping relationship between the application information and the screen projection display mode, determine the projection screen display mode corresponding to the upper-layer application information, and switch the target screen projection display mode of the projection screen to the upper-layer application The projection display mode corresponding to the information, the mapping relationship between the application information and the projection display mode can be set in advance according to the actual situation, it can be the mapping relationship between the application name and the projection display mode, it can be the application The mapping relationship between the type and the screen projection display mode can be the mapping relationship between the parameter range to which the display parameter belongs and the projection screen display mode, or it can be the application classification determined according to multiple application information (for example, the application type is Movies, applications with a frame rate greater than 60fps are determined to be high frame rate applications, the application type is games, applications with a frame rate greater than 60fps are determined to be high frame rate applications, etc.) and the mapping relationship between the projection display mode.

Optionally, the screen projection display mode includes a frame rate priority mode and a resolution priority mode, and the step of switching the target screen projection display mode of the projection screen to the screen projection display mode corresponding to the upper-layer application information includes :

Step S21, according to the upper-layer application information, it is judged whether the upper-layer application of the screen projection push end is a high frame rate application;

In this embodiment, specifically, according to the preset classification rule and the upper-layer application information, it is judged whether the upper-layer application of the screen projection push terminal is a high frame rate application, wherein the preset classification rule is to determine whether the application The determination rule for whether it is a high frame rate application may be to establish a high frame rate application list, and determine whether the application name or application type in the upper layer application information belongs to the application name or application type in the high frame rate application list; It may be to pre-set the lower frame rate limit, and judge whether the frame rate in the upper-layer application information is higher than the lower frame rate limit, and if the frame rate in the upper-layer application information is higher than the lower frame rate limit, then It is determined that the upper layer application is a high frame rate application.

Optionally, the upper-layer application information includes an upper-layer application type, and according to the upper-layer application information, the step of judging whether the upper-layer application at the screen projection push end is a high frame rate application includes:

Step S211, judging whether the upper-layer application type belongs to the preset white list of high frame rate applications;

Step S212, if the type of the upper-layer application belongs to the preset white list of high frame rate applications, then determine that the upper-layer application on the screen projection push end is a high frame rate application.

In this embodiment, specifically, it is determined whether the upper-layer application type belongs to the preset high frame rate application whitelist, and if the upper-layer application type belongs to the preset high frame rate application whitelist, then it is determined that the screen projection The upper-layer application on the push end is a high frame rate application. If the upper-layer application type does not belong to the preset high frame rate application whitelist, it is determined that the upper-layer application on the screen projection push end is not a high frame rate application. The frame rate application whitelist is the application type corresponding to the high frame rate application. The application type is the classification label of the application. Each application can belong to one or more application types. The high frame rate application whitelist can be determined according to the actual situation. The system or the user can make settings. For example, all games can be included in the high frame rate application whitelist, and first-person shooting games and movies with a frame rate higher than 60fps can also be included in the high frame rate application whitelist. Through the high frame rate The application whitelist setting can accurately classify high frame rate applications and reduce misjudgment.

Step S22, if it is determined that the upper layer application of the screen projection push end is a high frame rate application, then switch the target screen projection display mode of the projection screen to the frame rate priority mode;

In this embodiment, specifically, if it is determined that the upper-layer application of the screen projection push end is a high frame rate application, the target screen projection display mode corresponding to the screen projection is switched to the frame rate priority mode, wherein the frame rate The rate priority mode is to use the preset frame rate priority technology or algorithm (such as MEMC technology, etc.), so that other display parameters other than the frame rate are reduced or unchanged, so that the frame rate is increased or kept unchanged, and the frame rate is guaranteed to be within the preset frame rate. In an implementable manner, the method of switching the target screen display mode of the screen projection to the frame rate priority mode may be to display the target screen projection The mode is switched to the MEMC mode, so as to call the MEMC algorithm to process the image to be projected, wherein the MEMC algorithm is similar to the prior art, and will not be repeated here.

Step S23, if it is determined that the upper-layer application of the screen projection push end is not a high frame rate application, switch the target screen projection display mode of the projection screen to a resolution priority mode.

In this embodiment, specifically, if it is determined that the upper-layer application of the screen projection push end is not a high frame rate application, then the target screen projection display mode corresponding to the projection screen is switched to a preset resolution priority mode, wherein , the resolution priority mode is to use a preset resolution priority technology or algorithm (such as AI-SR technology, AI-PQ technology, etc.), so that other display parameters other than resolution are reduced or unchanged, so that the resolution Improve or keep the same mode to ensure that the resolution is within the preset high-resolution range. In an implementable manner, the target screen display mode of the screen projection is switched to the resolution priority mode. The method may be to switch the display mode of the target projection screen to AI-SR mode or AI-PQ mode, so as to call the AI-SR algorithm or AI-PQ algorithm to process the image to be projected, wherein the AI-SR algorithm The AI-PQ algorithm is similar to the prior art, and will not be described in detail here.

Step S30, when receiving the image to be projected sent by the screen projection pusher, perform image processing on the image to be projected according to the display mode of the target screen projection to obtain the target screen projection image;

In this embodiment, specifically, when receiving the image to be projected from the screen projection pusher, image processing is performed on the image to be projected according to the image processing algorithm corresponding to the target screen projection display mode, wherein, The image to be projected can be a static image or a dynamic image, and the number of images to be projected can be one or more. The image processing includes image resolution adjustment, image frame rate adjustment, image size adjustment, image Reconstruction, etc., the image processing algorithm includes MEMC algorithm, AI-SR algorithm, AI-PQ algorithm, etc.

Optionally, the step of performing image processing on the image to be projected according to the display mode of the target projection to obtain the target projection image includes:

Step S31, acquiring initial display parameters corresponding to the image to be projected;

Step S32, adjusting the initial display parameters according to the target projection screen display mode to obtain target display parameters;

In this embodiment, specifically, at least one initial display parameter corresponding to the image to be projected is acquired, and the initial display corresponding to each of the images to be projected is adjusted according to the image processing algorithm corresponding to the current target projected screen display mode Parameters to obtain target display parameters, wherein the image to be projected can be a static image or a dynamic image, the number of images to be projected can be one or more, and the display parameter is that the image to be projected is displayed Related parameters for output and display on the device, including resolution, frame rate and/or bandwidth, etc.

Optionally, the display parameters include frame rate and resolution, and the step of adjusting the initial display parameters according to the target projection display mode to obtain the target display parameters includes:

Step S321, if it is determined that the target screen projection display mode is the frame rate priority mode, increase and adjust the initial frame rate to obtain the target frame rate, and decrease and adjust the initial resolution to obtain the target resolution Rate;

In this embodiment, it should be noted that the display parameters include frame rate and resolution, that is, the initial display parameters include initial frame rate and initial resolution, and the target display parameters include target frame rate and target resolution .

Specifically, it is judged whether the target screen projection display mode is a frame rate priority mode, and if it is determined that the target screen projection display mode is a frame rate priority mode, then the initial frame rate is increased and adjusted to obtain a target frame rate, And the initial resolution is reduced and adjusted to obtain the target resolution. It is easy to understand that the method of adjusting the frame rate and resolution can be realized by using a preset frame rate priority technology or algorithm, such as MEMC algorithm, etc. , the MEMC algorithm is similar to the prior art, and will not be repeated here.

For screen projection scenes that require a high frame rate, such as first-person shooter games and high frame rate movies, by reducing the adjustment resolution and appropriately increasing the adjustment frame rate, it can effectively ensure the speed of image processing and transmission, and avoid the occurrence of In the case of freeze or frame drop, the frame rate can be compensated to meet the demand for a higher frame rate, effectively improve the smoothness of the screen projection, and improve the screen projection effect.

Step S322, if it is determined that the target projection screen display mode is the resolution priority mode, decrease and adjust the initial frame rate to obtain the target frame rate, and increase and adjust the initial resolution to obtain the target resolution Rate.

In this embodiment, specifically, it is judged whether the target screen projection display mode is a resolution priority mode, and if it is determined that the target screen projection display mode is a resolution priority mode, the initial frame rate is reduced and adjusted , to obtain the target frame rate, and increase and adjust the initial resolution to obtain the target resolution. It is easy to understand that the way to adjust the frame rate and resolution can be to use a preset resolution priority technology or algorithm Realization, such as AI-SR algorithm or AI-PQ algorithm, etc., the AI-SR algorithm and the AI-PQ algorithm are similar to the prior art, and will not be repeated here.

For screen projection scenarios such as image projection and movies with a low frame rate, by appropriately reducing the adjustment frame rate and increasing the adjustment resolution, the image processing and transmission speed can be effectively guaranteed, and the freeze situation can be avoided. It can also improve the resolution of the image, effectively enhance the resolution of the original picture, make the picture clearer, and improve the projection effect.

Step S33 , performing image processing on the image to be projected according to the target display parameters to obtain a target projected image.

In this embodiment, specifically, image processing is performed on the image to be screen-projected according to the target display parameter to obtain a target screen-projection image whose display parameter is the target display parameter.

Step S40, outputting the target projected screen image.

In this embodiment, specifically, the display device corresponding to the screen projection receiving end outputs and displays the target screen projection image.

In an implementable manner, referring to FIG. 4 , the screen projection receiver includes a TV 400 and a screen projector receiver 300, the TV 400 and the screen projector receiver 300 are connected in communication, and the The screen projection push end includes a mobile phone 100 and a screen projector transmitter 200, the mobile phone 100 is communicatively connected to the screen projector transmitter 200, and the screen projector receiver 300 is communicatively connected to the screen projector transmitter 200 , during the screen projection process from the mobile phone 100 to the TV 400, the screen projector transmitter 200 obtains the upper-layer application information of the mobile phone 100, and sends the upper-layer application information to the screen projector receiver 300, and the screen projector receiver 300 sends the The target screen display mode of the screen projection is switched to the screen projection display mode corresponding to the upper layer application information, and the screen projection device transmitter 200 synchronously transmits the screen image and sound of the mobile phone 100 to the screen projection device receiver 300, and the screen projection device The receiver 300 sends the received screen picture and sound of the mobile phone 100 to the TV 400 for picture display and sound playback. Perform image processing on the image to be projected according to the target projection display mode to obtain a target projection image, and send the target projection image to the TV 400 for output and display.

In this embodiment, by obtaining the upper-layer application information of the screen-casting push end, the target screen-casting display mode of the screen-casting is switched to the screen-casting display mode corresponding to the upper-layer application information, so that The upper-layer application on the push end switches the display mode of the target screen projection, and then performs image processing on the image to be projected according to the target screen projection display mode when receiving the image to be projected from the screen projection push end, to obtain Target screen projection image, outputting the target screen projection image, realizing image processing on the screen projection image to be screen projection according to the target projection screen display mode, that is, realizing the projection screen according to the upper layer application of the screen projection push terminal Image processing is performed on the image to be projected, so that the output target projected image can be adaptively adjusted with different upper-layer applications, which can not only meet the different display requirements of different upper-layer applications, but also effectively improve the quality of the image to be projected through image processing. The processing speed can effectively avoid possible freezes and frame drops during the projection process, overcome the technical problem of poor projection display effect in the prior art, and effectively improve the projection display effect.

Further, in another embodiment of the projected screen image display method of the present application, referring to FIG. 5 , after the step of outputting the target projected screen image, it further includes:

Step A10, monitoring in real time whether an image frame is lost during the screen projection process;

In this embodiment, specifically, in the process of projecting a screen from the screen projection pusher to the screen projection receiver, it is monitored in real time whether an image frame is lost, wherein the image frame loss is a part of the image frame output by the screen projection receiver. If the number of frames is less than the theoretical output frame number, such as freeze or frame drop, the method of monitoring whether there is image frame loss can judge whether there is image frame loss by monitoring whether there is data abnormality in the process of image processing and image transmission , by obtaining fluency parameters such as packet loss rate and image processing speed in the screen projection process, calculating and comparing according to the fluency parameters to determine whether an image frame is lost, or by comparing and detecting the difference between the output image frames The similarity between them is used to judge whether there is an image frame loss.

Step A20, when it is detected that an image frame loss occurs during the screen projection, switch the screen projection display mode of the screen projection to a frame rate priority mode.

In this embodiment, specifically, when it is detected that an image frame loss occurs during the screen projection process, the screen projection display mode of the projection screen is switched to the frame rate priority mode, so as to control the target screen projection image The corresponding target resolution is reduced and adjusted, and the target frame rate corresponding to the target projection image is increased and adjusted. By reducing and adjusting the resolution of the target projection image, image processing and image transmission can be effectively reduced. The load of image processing and image transmission is improved, and by increasing and adjusting the frame rate of the target projected image, the frame rate compensation can be performed for the loss of image frames caused by excessive image processing or image transmission load, thereby effectively Improve the display effect of the screen projection and improve the screen projection experience.

Further, in another embodiment of the projected screen image display method of the present application, referring to FIG. 6 , after the step of outputting the target projected screen image, it further includes:

Step B10, monitoring in real time whether the rate of change of the projected image of the target is less than a preset rate of change;

In this embodiment, specifically, in the process of projecting from the screen projection pusher to the screen projection receiver, the similarity between a preset number of consecutive image frames in the image to be projected is compared, and according to the similarity Determine the change rate of the target projected screen image according to the degree of change, and determine whether the change rate is less than a preset change rate, wherein the method of determining the change rate of the target projected screen image according to the similarity may be to use the The similarity as the rate of change may also be a rate of change obtained by further calculating a preset rate of change algorithm according to the similarity, which is not limited in this embodiment.

Step B20, when it is detected whether the rate of change of the target projected screen image is less than a preset rate of change, switch the target projected screen display mode of the projected screen to a resolution priority mode.

In this embodiment, specifically, when it is detected whether the change rate of the target projected screen image is less than a preset change rate, the projected screen display mode of the projected screen is switched to the resolution priority mode, so as to Decrease and increase the target resolution corresponding to the target projection image, and decrease and adjust the target frame rate corresponding to the target projection image. When the change rate of the target projection image is small, the projection The screen content may be pictures, non-high frame rate movies, etc. By reducing and adjusting the frame rate of the target projected image, the load of image processing and image transmission can be effectively reduced, and the speed of image processing and image transmission can be improved. The resolution of the target projection image can improve the image quality of the projection, effectively improve the display effect of the projection, and improve the projection experience.

Further, the embodiment of the present application also provides a projected screen image display device. Referring to FIG. 7 , the projected screen image display device is applied to a projected screen image display device, and the projected screen image display device includes:

An acquisition module 10, configured to acquire the upper-level application information of the screen projection push end;

A mode switching module 20, configured to determine the target projection screen display mode corresponding to the upper-layer application information;

The image processing module 30 is configured to obtain initial display parameters corresponding to the image to be projected when receiving the image to be projected sent by the screen projection push end;

The output module 40 is configured to adjust the initial display parameters according to the target projection display mode to obtain target display parameters, and output the image to be projected based on the target display parameters.

Optionally, the mode switching module 20 is also used for:

According to the upper-layer application information, it is judged whether the upper-layer application of the screen projection push end is a high frame rate application;

If it is determined that the upper layer application on the screen projection push end is a high frame rate application, then the preset frame rate priority mode is determined as the target screen projection display mode.

Optionally, the mode switching module 20 is also used for:

If it is determined that the upper layer application on the screen projection push end is not a high frame rate application, then the preset resolution priority mode is determined as the target screen projection display mode.

Optionally, the output module 40 is also used for:

Judging whether the target projection display mode is a frame rate priority mode;

If it is determined that the target screen projection display mode is the frame rate priority mode, the initial frame rate is adjusted unchanged or increased to obtain the target frame rate, and the initial resolution is adjusted unchanged or decreased, Get the target resolution.

Optionally, the output module 40 is also used for:

Judging whether the target projection display mode is a resolution priority mode;

If it is determined that the target screen projection display mode is the resolution priority mode, the initial frame rate is adjusted unchanged or decreased to obtain the target frame rate, and the initial resolution is adjusted unchanged or increased, Get the target resolution.

Optionally, the screen projection image display device also includes a monitoring module, which is also used for:

Real-time monitoring whether image frame loss occurs during the screen projection process;

When it is detected that image frame loss occurs during the screen projection process, the target display parameter is adjusted according to the target screen projection display mode.

Optionally, the monitoring module is also used for:

If it is determined that the target screen projection display mode is a frame rate priority mode, the target resolution is reduced and adjusted to obtain a new target resolution;

If it is determined that the target screen projection display mode is a resolution priority mode, the target frame rate is reduced and adjusted to obtain a new target frame rate.

The projected screen image display device provided by the present invention adopts the projected screen image display method in the above-mentioned embodiments, and solves the technical problem of poor projected screen display effect in the prior art. Compared with the prior art, the beneficial effect of the screen projection image display device provided by the embodiment of the present invention is the same as that of the screen projection image display method provided by the above embodiment, and other technical features of the screen projection image display device are the same as The features disclosed by the methods in the above embodiments are the same, and will not be repeated here.

Further, the present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned method for displaying a projected screen image are realized.

The computer program product provided by this application solves the technical problem of poor projected screen display effect in the prior art. Compared with the prior art, the beneficial effect of the computer program product provided by the embodiment of the present invention is the same as the beneficial effect of the method for displaying a projected screen image provided by the above embodiment, and details are not repeated here.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent processing scope of the present application in the same way.

Claims (8)

1. A screen-projected image display method is characterized by comprising the following steps:

acquiring upper-layer application information of a screen projection pushing end;

switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper application information;

when receiving a screen image to be projected sent by a screen projection pushing end, carrying out image processing on the screen image to be projected according to the target screen projection display mode to obtain a target screen projection image, wherein the image processing comprises image resolution adjustment and image frame rate adjustment;

outputting the target screen projection image;

wherein, after the step of outputting the target screen projection image, the method further comprises:

monitoring whether image frame loss occurs in the screen projection process in real time;

when the image frame loss is detected in the screen projection process, switching a screen projection display mode of the screen projection to a frame rate priority mode so as to reduce and adjust the target resolution corresponding to the target screen projection image and increase and adjust the target frame rate corresponding to the target screen projection image;

after the step of outputting the target screen projection image, the method further comprises the following steps:

comparing the similarity between a preset number of continuous image frames in the image to be projected, determining the change rate of the target screen projection image according to the similarity, and monitoring whether the change rate of the target screen projection image is smaller than a preset change rate in real time;

when the change rate of the target screen projection image is smaller than the preset change rate, switching the screen projection target display mode to a resolution priority mode to increase and adjust the target resolution corresponding to the target screen projection image and decrease and adjust the target frame rate corresponding to the target screen projection image.

2. The screen-projected image display method of claim 1, wherein the step of performing image processing on the image to be projected according to the target screen-projected display mode to obtain a target screen-projected image comprises:

acquiring initial display parameters corresponding to the image to be projected;

adjusting the initial display parameters according to the target screen projection display mode to obtain target display parameters;

and carrying out image processing on the image to be projected according to the target display parameters to obtain a target screen projection image.

3. The method for displaying a projected image according to claim 2, wherein the display parameters include a frame rate and a resolution, and the step of adjusting the initial display parameters according to the target projected display mode to obtain the target display parameters comprises:

if the target screen projection display mode is determined to be a frame rate priority mode, increasing and adjusting the initial frame rate to obtain a target frame rate, and decreasing and adjusting the initial resolution to obtain a target resolution;

and if the target screen projection display mode is determined to be a resolution priority mode, reducing and adjusting the initial frame rate to obtain a target frame rate, and increasing and adjusting the initial resolution to obtain a target resolution.

4. The method for displaying a projected image according to claim 1, wherein the projected display mode includes a frame rate priority mode and a resolution priority mode, and the step of switching the target projected display mode of the projected screen to the projected display mode corresponding to the upper layer application information includes:

judging whether the upper layer application of the screen projection pushing end is a high frame rate application or not according to the upper layer application information;

if the upper-layer application of the screen projection pushing end is determined to be the high frame rate application, switching the target screen projection display mode of the screen projection to a frame rate priority mode;

and if the upper application of the screen projection pushing end is determined not to be the high frame rate application, switching the target screen projection display mode of the screen projection to a resolution priority mode.

5. The method for displaying the screen-projected image according to claim 4, wherein the upper layer application information includes an upper layer application type, and the step of determining whether the upper layer application of the screen-projected push terminal is a high frame rate application according to the upper layer application information includes:

judging whether the upper layer application type belongs to a preset high frame rate application white list or not;

and if the upper layer application type belongs to a preset high frame rate application white list, judging that the upper layer application of the screen projection pushing end is the high frame rate application.

6. A screen-projected image display apparatus, comprising:

the acquisition module is used for acquiring upper-layer application information of the screen projection pushing end;

the mode switching module is used for switching the target screen projection display mode of the screen projection to a screen projection display mode corresponding to the upper-layer application information;

the image processing module is used for carrying out image processing on the screen image to be projected according to the target screen projection display mode when the screen image to be projected sent by the screen projection pushing end is received, so as to obtain a target screen projection image;

the output module is used for outputting the target screen projection image, wherein the image processing comprises image resolution adjustment and image frame rate adjustment;

the monitoring module is used for monitoring whether the image frame is lost in the screen projection process in real time; when the image frame loss occurs in the screen projection process, adjusting target display parameters according to the target screen projection display mode so as to reduce and adjust the target resolution ratio corresponding to the target screen projection image and increase and adjust the target frame rate corresponding to the target screen projection image;

the monitoring module is further used for comparing the similarity among a preset number of continuous image frames in the image to be projected, determining the change rate of the target screen projected image according to the similarity, and monitoring whether the change rate of the target screen projected image is smaller than a preset change rate in real time; and when detecting that the change rate of the target screen projection image is smaller than a preset change rate, switching the target screen projection display mode of the screen projection to a resolution priority mode.

7. An electronic device, characterized in that the electronic device comprises:

at least one processor; and (c) a second step of,

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the projected image display method of any of claims 1 to 5.

8. A storage medium, characterized in that the storage medium is a computer-readable storage medium having stored thereon a program for implementing a projected image display method, the program being executed by a processor to implement the steps of the projected image display method according to any one of claims 1 to 5.

Images