CN106919402A - A kind of control method of mobile terminal, device and mobile terminal - Google Patents

Abstract

The embodiment of the invention discloses a mobile terminal control method, device and mobile terminal. The method includes acquiring layer content in the currently displayed layer; determining a target object satisfying a set condition according to the layer content, wherein the set condition is that the user's degree of attention to the target object is lower than the set Threshold, the target object includes layers, application programs or interface elements; use a set processing method to perform power consumption reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object 1. Reduce at least one of the synthesis frame rate of the target object, reduce the refresh rate of the area where the target object is located, and reduce the resolution of the target object, and perform power reduction processing on target objects with low user attention , realizing display effects while reducing power consumption of the terminal, and improving battery life of the terminal.

Description

Method and device for controlling mobile terminal, and mobile terminal

technical field

Embodiments of the present invention relate to mobile terminal technologies, and in particular, to a mobile terminal control method and device, and a mobile terminal.

Background technique

With the development of mobile terminal technology, the processing capability and functions of the mobile terminal have been greatly improved, and it has become a necessity for people's life, work and entertainment. In a mobile terminal installed with an operating system, the mobile terminal continuously refreshes the display screen to present various display screens at different times.

The display refresh process in a mobile terminal such as a mobile phone mainly includes a picture drawing operation, a picture composition operation and a display operation. Taking applications such as games or videos as an example, the Render operation is first performed to draw their respective images; after all applications have completed the Render operation, the system performs a Compose operation to combine the images drawn by each application into a A display frame; outputs the display frame to the screen for final display. The display control method of the mobile terminal in various operations in the related art has defects and needs to be improved.

Contents of the invention

Embodiments of the present invention provide a mobile terminal control method, device, and mobile terminal, which can optimize the display control method of the mobile terminal, reduce power consumption of the mobile terminal, and improve battery life.

In a first aspect, an embodiment of the present invention provides a method for controlling a mobile terminal, including:

Get the layer content in the currently displayed layer;

Determining a target object that satisfies a set condition according to the content of the layer, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, an application program, or an interface element;

Use a set processing method to perform power reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object, reducing the composite frame rate of the target object, and reducing the target object At least one of the refresh rate of the region and the reduction of the resolution of the target object.

In a second aspect, an embodiment of the present invention further provides a control device for a mobile terminal, the device comprising:

A content acquisition module, configured to acquire layer content in the currently displayed layer;

An object determination module, configured to determine a target object that satisfies a set condition according to the layer content, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, application or interface elements;

The object processing module is configured to use a set processing method to perform power consumption reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object and reducing the composite frame rate of the target object , reducing at least one of the refresh rate of the area where the target object is located, and reducing the resolution of the target object.

In the third aspect, the embodiment of the present invention also provides a mobile terminal, including a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the following steps when executing the computer program :

Get the layer content in the currently displayed layer;

Determining a target object that satisfies a set condition according to the content of the layer, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, an application program, or an interface element;

Use a set processing method to perform power reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object, reducing the composite frame rate of the target object, and reducing the target object At least one of the refresh rate of the region and the reduction of the resolution of the target object.

In the embodiment of the present invention, by acquiring the layer content in the currently displayed layer; according to the layer content, the target object that satisfies the set condition is determined, wherein the set condition is that the user's degree of attention to the target object is lower than the set condition. Set a threshold, the target object includes a layer, an application program, or an interface element; use a set processing method to perform power reduction processing on the target object, wherein the processing method includes reducing the drawing frame of the target object At least one of rate, reducing the synthesis frame rate of the target object, reducing the refresh rate of the area where the target object is located, and reducing the resolution of the target object. By adopting the above technical solution, the power consumption reduction processing can be performed on the target objects with low user attention, so that the terminal power consumption can be reduced while the display effect is taken into account, and the battery life of the terminal can be improved.

Description of drawings

FIG. 1 is a flowchart of a method for controlling a mobile terminal provided by an embodiment of the present invention;

Fig. 2 is a schematic diagram of a display process provided by an embodiment of the present invention;

3 is a schematic diagram of a Vsync display refresh mechanism provided by an embodiment of the present invention;

FIG. 4 is a schematic flowchart of another method for controlling a mobile terminal provided by an embodiment of the present invention;

Fig. 5 is a schematic diagram of a display interface in a split-screen mode provided by an embodiment of the present invention;

FIG. 6 is a schematic flowchart of another method for controlling a mobile terminal provided by an embodiment of the present invention;

Fig. 7 is a schematic diagram of a display interface in an application split-screen mode provided by an embodiment of the present invention;

FIG. 8 is a structural block diagram of a control device for a mobile terminal provided by an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention.

detailed description

The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the steps as sequential processing, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of steps may be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

FIG. 1 is a flow chart of a method for controlling a mobile terminal provided by an embodiment of the present invention. The method can be executed by a control device of the mobile terminal, wherein the device can be implemented by software and/or hardware, and generally can be integrated in the mobile terminal. As shown in Figure 1, the method includes:

Step 110, acquiring layer content in the currently displayed layer.

Wherein, the layer content includes text, picture, table, plug-in, control or nested layer.

Exemplarily, the mobile terminal in the embodiment of the present invention may specifically be a device including a display screen, such as a mobile phone, a smart watch, a tablet computer, a game console, a personal digital assistant, and a digital multimedia player. The layer displayed on the display screen is detected in real time according to the set cycle. Use the detected layer as the target layer, and get the layer content in the target layer. Exemplarily, the data associated with the layer in the Frame Buffer (frame buffer) is read according to the layer identifier of the currently displayed layer. Determine the text, picture, table, plug-in, control and/or another layer nested in the layer corresponding to the set area in the layer according to the read data.

Step 120, determine the target object satisfying the set condition according to the content of the layer.

Wherein, the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, an application program or an interface element. Interface elements include windows, text boxes, charts, buttons, pull-down menus, and more. There are many ways to determine the set threshold included in the set condition. Exemplarily, it is possible to investigate the user group's attention to different layers, applications or interface elements in the process of using the mobile terminal, and count the operation consumption of most users when operating different layers, applications or interface elements. time, the frequency at which the human eye focuses on the screen or the operating frequency, etc. According to the statistical results, different layers, applications or interface elements are sorted, and a set number of layers, applications or interface elements ranked lower are regarded as objects that users do not pay much attention to. The setting conditions are determined according to the operation time corresponding to the objects that the user does not pay much attention to, the frequency of human eyes focusing on the screen or the operating frequency, and are set before the mobile terminal leaves the factory.

Alternatively, the user may enable the user behavior analysis function before starting to use the mobile terminal. After the user behavior analysis function is turned on, the mobile terminal collects data related to the user's operations on different layers, applications or interface elements. According to the collected data, the objects that the user does not pay much attention to are analyzed. The setting conditions are determined according to the time-consuming operation corresponding to the object that the user does not pay much attention to, the frequency at which the human eye focuses on the screen, or the operating frequency. Preferably, it may be the average elapsed time, the average focus frequency or the average operation frequency.

For example, a camera above the screen of the mobile terminal (such as a front-facing camera or a rotatable camera located on the front of the mobile terminal) may be activated according to a set cycle, and the camera captures an image containing the user's face, and judges the user's posture by identifying the position of the eyeballs. Whether the eyes are focused on the screen. It also determines where the eyes are focusing on the screen. If it is detected that the human eye focuses on the screen once, the counter is incremented by 1. Thus, it is possible to determine the frequency with which the human eye focuses on the screen after an object such as a layer, an application program or an interface element has been displayed on the screen for a set time. For the currently displayed application program, if it is detected that the frequency of human eyes focusing on the screen is lower than the set threshold, it is determined that the application program satisfies the set condition. Or, for the currently displayed application program, if it is detected that the focus frequency of human eyes in the area corresponding to a certain button is lower than the set threshold, it is determined that some interface elements in the application program meet the set conditions.

Step 130: Perform power consumption reduction processing on the target object using a set processing manner.

Wherein, the processing method includes at least one of reducing the drawing frame rate of the target object, reducing the composite frame rate of the target object, reducing the refresh rate of the area where the target object is located, and reducing the resolution of the target object kind.

For example, if the target object is a layer that the user pays little attention to, the drawing frame rate of the layer may be controlled to be reduced to a preset drawing frame rate. On this basis, you can also control the screen refresh rate of the area where the layer is located. For example, if the layer only occupies a partial area of the screen, the refresh rate of the partial area is controlled to be reduced to a preset refresh rate. On this basis, it is also possible to control the resolution of the interface elements displayed in this layer to be reduced to a preset resolution.

For another example, if the target object is an application program that the user pays little attention to, the drawing frame rate of the application program may be controlled to be reduced to a preset drawing frame rate. On this basis, the screen refresh rate of the area where the application is located can also be controlled. For example, if the current terminal is in the application split-screen mode, the refresh rate of the area corresponding to the application is controlled to be reduced to a preset refresh rate. On this basis, it is also possible to control the resolution of the interface elements corresponding to the application program to be reduced to a preset resolution.

There are many ways to reduce power consumption used in the embodiment of the present invention, such as reducing the drawing frame rate of the target object, reducing the composite frame rate of the target object, and reducing the frame rate of the target object. refresh rate of the area or reduce the resolution of the target object.

For ease of understanding, the Android system is taken as an example below to briefly describe the process from generation to display of the display screen in the Android system. FIG. 2 is a schematic diagram of a display process provided by an embodiment of the present invention.

First, at the application layer, each application (hereinafter referred to as application or APP) contains one or more layers, and each application APP1, APP2... APPN is designed according to its own application (generally by the corresponding installation package APK Decision) execute the layer rendering (Render) operation (that is, draw the image on the layer) independently, and after the rendering operation is completed, each application sends all the drawn layers to the layer composition that performs the layer composition operation Module (Surfaceflinger).

Then, at the application framework (Framework) layer, all layers (including visible layers and invisible layers) form a layer list, which is defined as ListAll. The layer composition module selects visible layers from ListAll to form a visible layer list, which is defined as DisplayList. Subsequently, the layer synthesis module finds an idle FB from three recyclable frame buffers (FrameBuffer, referred to as BF or buffer) in the system, and on the idle FB, according to the application configuration information, such as which Layers should be set to the bottom, which layer should be set to the top, which area is the visible area, which area is the transparent area, etc., through the Compose operation, the layers contained in the DisplayList are superimposed together to obtain the final image to be displayed .

Finally, at the kernel (Kernel) layer, the image to be displayed can be transmitted to the display hardware (including a display controller and a display screen, so that the image to be displayed is finally displayed on the display screen. The type of display screen is not limited here, for example, It is a liquid crystal display (Liquid Crystal Display, LCD).

In addition, the Android system introduces a synchronous (Vsync) refresh mechanism in the process of display refresh. FIG. 3 is a schematic diagram of a Vsync display refresh mechanism provided by an embodiment of the present invention. Specifically, the Vsync refresh mechanism is actually to insert a "heartbeat" or system synchronization (Vsync) signal in the entire display process, which is sent by the display controller to the CPU to generate a Vsync interrupt to control each layer drawing operation and graphics. The layer composition operation needs to be completed according to the heartbeat, so that the key steps in the entire display process are included in the unified management mechanism of Vsync. The frequency of the Vsync signal is currently 60 Hz. As shown in Figure 3, assuming that the period of the Vsync signal is T, regardless of the transmission delay of the signal, after the first Vsync signal Vsync1 reaches the CPU, the CPU forwards the first Vsync signal Vsync1 to each application, and each application responds to the Touch and swipe on the screen to start drawing operations; after each application completes the drawing operation, multiple layers drawn by each application are obtained. After the second Vsync signal Vsync2 reaches the CPU, the CPU forwards the second Vsync signal Vsync2 to the layer compositing module, and the layer compositing module starts to perform the layer compositing operation, compositing multiple layers drawn by each application to generate The screen to be displayed. After the third Vsync signal Vsync3 reaches the CPU, the system starts to perform display refresh, and finally displays the picture to be displayed on the display screen. It can be seen from the above description that the frequency of the Vsync signal received by the application program, the layer synthesis module and the display screen is consistent and is a preset fixed value.

In the process of layer drawing, compositing and refresh display on mobile terminals, there are three frame rates: drawing frame rate, compositing frame rate and refresh rate.

Wherein, the drawing frame rate triggers the layer composition module to perform layer composition after the layer drawing is completed, which can be understood as the number of layer frames drawn per unit time (for example, 1 second). The drawing frame rate includes the drawing frame rate of the application program and the drawing frame rate of the layer. There may be multiple applications running in the system, and each application may include multiple layers. For example, the video player application generally includes three layers: a layer that displays video content, which can be defined as U1; Two layers of SurfaceView type, one is used to display bullet chat content, which can be defined as U2, and the other is used to display user interface (UI) controls (such as playback progress bar, volume control bar, and various control buttons, etc. ) and advertisement, which can be defined as U3. The drawing frame rate of the application program is the number of times the application program performs drawing operations per unit time, wherein one or more layers may be drawn during one drawing operation. The drawing frame rate of the layer is the number of triggered drawing times per unit time for the layer with the same number or name (such as U1, U2 or U3 above).

Compositing frame rate is the frame rate at which layers drawn by various applications are synthesized into a frame to be displayed, which can be understood as the number of frame frames synthesized per unit time.

The refresh rate is the frame rate for refreshing the display screen of the mobile terminal. Typically, the display is refreshed at a refresh rate of 60Hz.

It can be achieved by reducing the frequency of the reference signal (such as Vsync signal) used to draw the layer, composite layer or screen refresh to reduce the layer drawing frame rate, reduce the layer composition frame rate or reduce the screen refresh rate, and draw the layer The frequencies of the Vsync signals corresponding to the composition layer and the screen refresh can be the same (for example, both are reduced from 60 Hz to 50 Hz) or different (for example, from 60 Hz to 50 Hz, 52 Hz and 54 Hz respectively). It is also possible to reduce the layer drawing frame rate, layer composition frame rate or screen refresh rate by changing the response mechanism of the layer drawing operation, layer composition operation and screen refresh operation to the reference signal. For example, the 2n+1th signal received responds, and the 2nth signal received does not respond; another example, with n (such as 5) signals as a group, the first type of preset number in each group ( Signals such as 1, 2, 4, 5) respond, and signals of the second type of preset number (such as 4) do not respond.

Reducing the resolution of the display screen can be achieved in the layer drawing stage or the layer composition stage. For example, the application reduces the image resolution when drawing a layer, and the layer composition module can reduce the resolution of the layer before compositing. Decrease or reduce the resolution of the image to be displayed during the layer compositing process, wherein the resolution reduction can be achieved through image processing related means.

In the technical solution of this embodiment, by obtaining the layer content in the currently displayed layer; according to the content of the layer, the target object that satisfies the set condition is determined, wherein the set condition is the user's degree of attention to the target object Below the set threshold, the target object includes a layer, an application program, or an interface element; using a set processing method, the power consumption reduction processing is performed on the target object, wherein the processing method includes reducing the power consumption of the target object At least one of drawing frame rate of the target object, reducing the synthesis frame rate of the target object, reducing the refresh rate of the area where the target object is located, and reducing the resolution of the target object. By adopting the above technical solution, the power consumption reduction processing can be performed on the target objects with low user attention, so that the terminal power consumption can be reduced while the display effect is taken into account, and the battery life of the terminal can be improved.

Fig. 4 is a schematic flowchart of another method for controlling a mobile terminal provided by an embodiment of the present invention. As shown in Figure 4, the method includes:

Step 410, acquiring layer content in the currently displayed layer.

Acquire the layers displayed on the current screen according to the set cycle, and determine the layer content contained in each layer. Wherein, the content of the layer may be an interface element displayed by the layer in a user interface (UI), such as a picture, a button, a numeric keypad, or an icon.

Step 420, determine the target object satisfying the set condition according to the content of the layer.

Since the layer or application is displayed in the user interface, determine the user's attention to the layer or application within a set period of time, and determine whether the attention is lower than the set threshold. If yes, determine that the layer or application is the target object; otherwise, consider that the layer or application is not the target object.

Fig. 5 is a schematic diagram of a display interface in a screen split mode provided by an embodiment of the present invention. As shown in FIG. 5 , a video application is played on the basic screen 510 , and a chat application is displayed on the extended screen 530 . From the moment when the video starts to play on the basic screen 510 , the user's attention to the video application within a set period of time can be counted. For example, by collecting the frequency at which human eyes focus on the basic screen 510 , it is possible to determine the user's degree of attention to the video application within a set period of time. Preferably, according to the focus position of the human eye on the basic screen 510 and the focus frequency corresponding to the focus position, the user's attention degree to the button in the video application within a set period of time can also be determined. By comparing the degree of attention with a set threshold, it can be determined whether the video application corresponding to the degree of attention or the button in the video application is the target object.

It can be understood that, starting from the moment when the layer is displayed in the user interface, a similar manner can be used to determine the user's attention to the layer within a set period of time. For example, if the user enables the bullet chatting function, the bullet chatting information will be displayed on the basic screen 510, and at this time, the bullet chatting layer is displayed in the user interface. For example, by collecting the focus position and frequency of the human eyes on the basic screen 510, it is possible to determine the user's attention to the barrage layer within a set period of time. As another example, since bullet chatting usually slides across the screen in a relatively short period of time, the frequency of human eye movement can also be collected, and by comparing the frequency with the set frequency threshold, it can be determined that the user responds to the bullet screen within the set period of time. The attention of the curtain layer.

Alternatively, the operation time of the interface element corresponding to the layer or the application program is counted, the operation time is compared with the set time threshold, and whether the interface element is the target object is determined according to the comparison result. For example, when making a call, if it takes less than a set time threshold for the user to click the dial pad to perform the dial operation, the dial pad may be used as the target object.

Alternatively, count the operation frequency of the layer or application, compare the operation frequency with a set frequency threshold, and determine whether the layer or application is the target object according to the comparison result. For example, if the user's operation frequency of querying weather conditions through a weather application is lower than a set frequency threshold, the weather application is determined as the target object. For another example, when the user is watching a video, the user usually drags the progress bar to adjust the playback progress. At this time, the dragging operation of the progress bar input by the user is collected, and the frequency at which the user drags the progress bar is calculated. If the frequency is higher than the set playback progress adjustment frequency, the progress bar is determined as the target object.

Step 430 , judging whether the screen is in split-screen mode, if yes, execute step 440 , otherwise, execute step 460 .

Obtain screen configuration information, and judge whether the mobile terminal is in a screen split mode according to the screen configuration information. If yes, execute step 440 , otherwise, execute step 460 . Fig. 5 is a schematic diagram of a display interface in a screen split mode provided by an embodiment of the present invention. As shown in FIG. 5 , a video application is played on the basic screen 510 , and a chat application is displayed on the extended screen 530 . The base screen 510 also displays buttons 520 that control video playback.

Step 440 , judging whether the target object is located in the extended screen according to the display position of the layer content, if yes, execute step 450 , otherwise, execute step 460 .

When the mobile terminal is in the screen splitting mode, judge whether the target object is located in the extended screen, and determine a processing method for reducing power consumption of the target object according to the judgment result

Exemplarily, obtain the display position of the layer content, match the display position with the screen size of the basic screen, and determine whether the target object is located in the extended screen according to the matching result, including that all target objects are located in the extended screen, and can also include the target The object part is located in the extended screen. If the target object is located in the extended screen, perform step 450 , otherwise, perform step 460 .

Step 450: Reduce at least one of the drawing frame rate, composite frame rate, and resolution of the target object, generate an instruction to reduce the refresh rate of the area where the target object is located, and transmit the instruction to the extended screen.

In the first electronic device corresponding to the basic screen, the display frame of the target object to be displayed on the extended screen is drawn and synthesized, and then sent to the extended screen for display. Therefore, the first electronic device corresponding to the basic screen performs the operation of reducing at least one of the drawing frame rate, composite frame rate, and resolution of the target object, uses the reduced drawing frame rate to draw the layer, and then, according to the reduced Compositing frame rate, perform compositing operations on all visible layers to obtain the display frame corresponding to the target object.

If all the target objects are displayed on the extended screen, the first electronic device generates an instruction to reduce the refresh rate of the area where the target object is located. The first electronic device corresponding to the basic screen sends the display frame corresponding to the target object and an instruction to reduce the refresh rate of the area where the target object is located to the second electronic device corresponding to the extended screen. The second electronic device adjusts the screen refresh rate of the area where the target object is located according to the instruction, and refreshes the display frame corresponding to the target object to the extended screen according to the adjusted screen refresh rate.

If the target object is partially displayed on the extended screen and partially displayed on the basic screen, then reduce the screen refresh rate of the area where the target object is displayed in the first electronic device, and generate an instruction to reduce the refresh rate of the area where the target object is located. When the target object is displayed, the display frame corresponding to the target object is refreshed to the basic screen according to the reduced refresh rate. The second electronic device adjusts the screen refresh rate of the area where the target object is located according to the instruction, and refreshes the display frame corresponding to the target object to the extended screen according to the adjusted screen refresh rate.

Step 460: Perform power consumption reduction processing on the target object in a set processing manner.

When the mobile terminal is not in the screen splitting mode, or when the mobile terminal is in the screen splitting mode but the target object is not displayed on the extended screen, the target object is processed in a set processing manner to reduce power consumption.

The technical solution of this embodiment provides a method for controlling a mobile terminal in a split-screen mode, which can implement power reduction processing on electronic devices corresponding to the basic screen and electronic devices corresponding to the extended screen, thereby improving power saving capabilities. Increased battery life of the terminal.

Fig. 6 is a schematic flowchart of another method for controlling a mobile terminal provided by an embodiment of the present invention. As shown in Figure 6, the method includes:

Step 610, acquiring layer content in the currently displayed layer.

Step 620 , judging whether it is in the application split-screen mode, if yes, execute step 630 , otherwise execute step 650 .

Obtain screen configuration information, and judge whether the mobile terminal is in the application split-screen mode according to the screen configuration information. If yes, execute step 630 , otherwise, execute step 650 . FIG. 7 is a schematic diagram of a display interface of an application in a split-screen mode according to an embodiment of the present invention. As shown in FIG. 7 , the first display area 710 of the display screen displays the first APP, and the second display area 720 of the display screen displays the second APP. Wherein, the first APP may be a game application, and the second APP may be an instant chat tool, enabling the user to chat with friends while hanging up the game. The first APP can also be a video application, and the second APP can be a browser, so that the user can query information on the Internet while watching the video.

Step 630: Determine at least two application programs displayed at the same time according to the content of the layer.

The mobile terminal respectively determines the corresponding application program according to the layer content of each display area. When the layer drawn by the application program is obtained in advance, the feature information of the layer content in the layer can be extracted, and the association relationship between the feature information and the application program can be stored. Therefore, the terminal can match the layer content of the currently displayed layer with the adjustment information, and if the matching is successful, can determine the application program corresponding to the layer content of the currently displayed layer.

Step 640: Query a preset white list according to the application program, and use the application program belonging to the white list as a target object.

Wherein, the preset white list is a collection of application programs whose attention degree of the user is lower than a set threshold. After determining the application corresponding to the layer content of the currently displayed layer, query the preset white list according to the application identification of the application, and determine whether the application is the target object according to the query result. If the application program belongs to the white list, the application program is used as the target object.

Step 650: Perform power consumption reduction processing on the target object using a set processing manner.

Preferably, the processing in this step may include: reducing the drawing frame rate and/or resolution of the application in the whitelist, and reducing the refresh rate of the screen area corresponding to the application;

Or, reduce the resource resolution of the application program in the white list, wherein the resource resolution includes the resolution of the area corresponding to the button and/or the resolution of the area corresponding to the numeric keypad;

Or, reduce at least one of the drawing frame rate, compositing frame rate, and resolution of the layer corresponding to the application program in the white list.

Exemplarily, if the mobile terminal is in the application split-screen mode, when the first APP is the target object and the second APP is not the target object, reduce the drawing frame rate of the first APP to the set drawing frame rate; on this basis, The combined frame rate of the first APP can also be reduced to the set combined frame rate; on this basis, the resolution of the first APP can also be reduced to the set resolution. In addition, the screen refresh rate of the first display area corresponding to the first APP is reduced to a set refresh rate. The rendering frame rate and resolution of the second APP and the screen refresh rate of the second display area are not affected. Alternatively, the resolution of the area corresponding to the button of the first APP and/or the resolution of the area corresponding to the numeric keypad may also be reduced. And, reduce the refresh rate of the button of the first APP or the area corresponding to the numeric keypad. Alternatively, at least one of the drawing frame rate, composite frame rate, and resolution of the layer corresponding to the first APP may also be reduced.

When both the first APP and the second APP are target objects, the above power consumption reduction operation is performed on the first APP and the second APP respectively. Wherein, the set rendering frame rate, the set composite frame rate, and the set resolution of the first APP and the second APP may be the same or different.

If the mobile terminal is not in the application split-screen mode, when the application program corresponding to the currently displayed content is the target object, reduce the drawing frame rate and/or resolution of the application program in the white list, and reduce the application program The refresh rate of the corresponding screen area. On this basis, it is also possible to reduce the resource resolution of the application. On this basis, at least one of the drawing frame rate, compositing frame rate, and resolution of the layer corresponding to the application program may also be reduced.

The technical solution of this embodiment provides a method for controlling a mobile terminal in application split-screen mode, which can respectively perform power reduction processing on at least two application programs displayed at the same time, and reduce the power consumption of each application program displayed at the same time. Power consumption operations are isolated from each other. By adopting the above technical solution, corresponding power consumption reduction processing can be performed on applications or layers that are of low user concern, so that the power consumption of the terminal is reduced while the display effect is considered, and the battery life of the terminal is improved.

Fig. 8 is a structural block diagram of an apparatus for controlling a mobile terminal provided by an embodiment of the present invention. The device can be implemented by software and/or hardware, and generally can be integrated in a mobile terminal, and can control the mobile terminal by executing a control method of the mobile terminal. As shown in FIG. 8 , the device includes: a content acquisition module 810 , an object determination module 820 and an object processing module 830 .

A content acquisition module 810, configured to acquire layer content in the currently displayed layer;

The object determination module 820 is configured to determine a target object that satisfies a set condition according to the content of the layer, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer , application or interface element;

The object processing module 830 is configured to use a set processing method to perform power reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object and reducing the composite frame of the target object rate, reducing the refresh rate of the area where the target object is located, and reducing the resolution of the target object.

The control device of the mobile terminal provided by the technical solution of this embodiment can perform power consumption reduction processing on the target objects with low user attention, realize the display effect while reducing the terminal power consumption, and improve the battery life of the terminal.

On the basis of the above technical solution, the device also includes:

The display position judging module is used to judge whether it is in the screen split mode after determining the target object satisfying the set condition according to the content of the layer;

If so, judge whether the target object is located in the extended screen according to the display position of the layer content.

On the basis of the above technical solution, the object processing module 830 is specifically used for:

When the target object is located on the extended screen, reduce at least one of the drawing frame rate, composite frame rate, and resolution of the target object;

An instruction to reduce the refresh rate of the area where the target object is located is generated, and the instruction is transmitted to the extended screen.

On the basis of the above technical solution, the object determination module 820 is specifically used for:

Determine whether the application is in split-screen mode;

If so, then determine at least two application programs displayed simultaneously according to the layer content;

Querying a preset white list according to the application program, and using the application program belonging to the white list as a target object.

On the basis of the above technical solution, the object processing module 830 is specifically used for:

reducing the rendering frame rate and/or resolution of the application in the whitelist, and reducing the refresh rate of the screen area corresponding to the application;

Or, reduce the resource resolution of the application program in the white list, wherein the resource resolution includes the resolution of the area corresponding to the button and/or the resolution of the area corresponding to the numeric keypad;

Or, reduce at least one of the drawing frame rate, compositing frame rate, and resolution of the layer corresponding to the application program in the white list.

An embodiment of the present invention also provides a mobile terminal, and the mobile terminal may include the device for controlling the mobile terminal provided by the embodiment of the present invention. FIG. 9 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention. As shown in FIG. 9, the mobile terminal may include: a housing (not shown in the figure), a memory 901, a central processing unit (Central Processing Unit, CPU ) 902 (also known as a processor, hereinafter referred to as CPU), a computer program stored in the memory 901 and operable on the processor 902, a circuit board (not shown in the figure) and a power circuit (not shown in the figure). The circuit board is placed inside the space surrounded by the housing; the CPU902 and the memory 901 are arranged on the circuit board; the power supply circuit is used to supply power to each circuit or device of the terminal; The memory 901 is used to store computer programs that can run on the processor; the CPU 902 reads and executes the computer programs stored in the memory 901 . The CPU902 implements the following steps when executing the computer program: acquiring layer content in the currently displayed layer; determining a target object satisfying a set condition according to the layer content, wherein the set condition is user The degree of attention to the target object is lower than a set threshold, and the target object includes a layer, an application program, or an interface element; using a set processing method, performing power consumption reduction processing on the target object, wherein the processing method It includes at least one of reducing the drawing frame rate of the target object, reducing the synthesis frame rate of the target object, reducing the refresh rate of the area where the target object is located, and reducing the resolution of the target object.

The terminal also includes: peripheral interface 903, RF (Radio Frequency, radio frequency) circuit 905, audio circuit 906, speaker 911, power management chip 908, input/output (I/O) subsystem 909, touch screen 912, other input/output Control device 910 and external port 904 , these components communicate via one or more communication buses or signal lines 907 .

It should be understood that the illustrated mobile terminal 900 is merely an example of a terminal, and that the mobile terminal 900 may have more or fewer components than shown, two or more components may be combined, or Different component configurations are possible. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The mobile terminal 900 provided in this embodiment is described in detail below, and the mobile terminal 900 takes a mobile phone as an example.

Memory 901, the memory 901 can be accessed by the CPU 902, the peripheral interface 903, etc., the memory 901 can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more disk storage devices, flash memory devices , or other volatile solid-state storage devices.

Peripheral interface 903 , which can connect the input and output peripherals of the device to CPU 902 and memory 901 .

The I/O subsystem 909, the I/O subsystem 909 can connect the input and output peripherals on the device, such as the touch screen 902 (equivalent to the screen in the above-mentioned embodiment) and other input/control devices 910, to the peripherals Interface 903. The I/O subsystem 909 may include a display controller 9091 and one or more input controllers 9092 for controlling other input/control devices 910 . Among them, one or more input controllers 9092 receive electrical signals from or send electrical signals to other input/control devices 910, which may include physical buttons (push buttons, rocker buttons, etc. ), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 9092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

A touch screen 912, the touch screen 912 is an input interface and an output interface between the user terminal and the user, and displays visual output to the user. The visual output may include graphics, text, icons, videos, and the like.

The display controller 9091 in the I/O subsystem 909 receives electrical signals from the touch screen 912 or sends electrical signals to the touch screen 912 . The touch screen 912 detects the contact on the touch screen, and the display controller 9091 converts the detected contact into an interaction with the user interface object displayed on the touch screen 912, that is, realizes human-computer interaction, and the user interface object displayed on the touch screen 912 can be a running Icons for games, icons for networking to appropriate networks, etc. It is worth noting that the device may also include an optical mouse, which is a touch-sensitive surface that does not display visual output, or that is an extension of a touch-sensitive surface formed by a touchscreen.

The RF circuit 905 is mainly used to establish communication between the mobile phone and the wireless network (that is, the network side), and realize data reception and transmission between the mobile phone and the wireless network. Such as sending and receiving short messages, e-mails, etc. Specifically, the RF circuit 905 receives and sends RF signals, which are also called electromagnetic signals, and the RF circuit 905 converts electrical signals into electromagnetic signals or converts electromagnetic signals into electrical signals, and communicates with communication networks and other devices through the electromagnetic signals to communicate. RF circuitry 905 may include known circuitry for performing these functions including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC ( COder-DECoder, Codec) Chipset, Subscriber Identity Module (Subscriber Identity Module, SIM) and so on.

The audio circuit 906 is mainly used to receive audio data from the peripheral interface 903 , convert the audio data into electrical signals, and send the electrical signals to the speaker 911 .

The speaker 911 is used to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 905 into sound and play the sound to the user.

The power management chip 908 is used for power supply and power management for the hardware connected to the CPU 902 , the I/O subsystem 909 and the peripheral interface 903 .

The mobile terminal control device and the mobile terminal provided in the above embodiments can execute the mobile terminal control method provided in any embodiment of the present invention, and have corresponding functional modules and beneficial effects for executing the method. For technical details not exhaustively described in the foregoing embodiments, reference may be made to the method for controlling a mobile terminal provided in any embodiment of the present invention.

Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the appended claims.

Claims (11)

1. A control method for a mobile terminal, comprising: Get the layer content in the currently displayed layer; Determining a target object that satisfies a set condition according to the content of the layer, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, an application program, or an interface element; Use a set processing method to perform power reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object, reducing the composite frame rate of the target object, and reducing the target object At least one of the refresh rate of the region and the reduction of the resolution of the target object. 2. The method according to claim 1, further comprising: Judging whether the mobile terminal is in a screen split mode according to the screen configuration information; If so, judge whether the target object is located in the extended screen according to the display position of the layer content, and determine a processing method for reducing power consumption of the target object according to the judgment result. 3. The method according to claim 2, wherein when the target object is located on the extended screen, the processing of reducing power consumption of the target object using a set processing method includes: Reduce at least one of the drawing frame rate, composite frame rate, and resolution of the target object; An instruction to reduce the refresh rate of the area where the target object is located is generated, and the instruction is transmitted to the extended screen. 4. The method according to claim 1, wherein the determining the target object satisfying the set condition according to the content of the layer comprises: Judging whether the mobile terminal is in the application split-screen mode according to the screen configuration information; If so, then determine at least two application programs displayed simultaneously according to the layer content; Querying a preset white list according to the application program, and using the application program belonging to the white list as a target object. 5. The method according to claim 4, wherein said adopting a set processing method to perform power consumption reduction processing on said target object comprises: reducing the rendering frame rate and/or resolution of the application in the whitelist, and reducing the refresh rate of the screen area corresponding to the application; Or, reduce the resource resolution of the application program in the white list, wherein the resource resolution includes the resolution of the area corresponding to the button and/or the resolution of the area corresponding to the numeric keypad; Or, reduce at least one of the drawing frame rate, compositing frame rate, and resolution of the layer corresponding to the application program in the white list. 6. A control device for a mobile terminal, comprising: A content acquisition module, configured to acquire layer content in the currently displayed layer; An object determination module, configured to determine a target object that satisfies a set condition according to the layer content, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, application or interface elements; The object processing module is configured to use a set processing method to perform power consumption reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object and reducing the composite frame rate of the target object , reducing at least one of the refresh rate of the area where the target object is located, and reducing the resolution of the target object. 7. The device according to claim 6, further comprising: The display position judging module is used to judge whether the mobile terminal is in the screen split mode according to the screen configuration information after determining the target object satisfying the set condition according to the layer content; If so, judge whether the target object is located in the extended screen according to the display position of the layer content, and determine a processing method for reducing power consumption of the target object according to the judgment result. 8. The device according to claim 7, wherein the object processing module is specifically used for: When the target object is located on the extended screen, reduce at least one of the drawing frame rate, composite frame rate, and resolution of the target object; An instruction to reduce the refresh rate of the area where the target object is located is generated, and the instruction is transmitted to the extended screen. 9. The device according to claim 6, wherein the object determining module is specifically used for: Judging whether the mobile terminal is in the application split-screen mode according to the screen configuration information; If so, then determine at least two application programs displayed simultaneously according to the layer content; Querying a preset white list according to the application program, and using the application program belonging to the white list as a target object. 10. The device according to claim 9, wherein the object processing module is specifically configured to: reducing the rendering frame rate and/or resolution of the application in the whitelist, and reducing the refresh rate of the screen area corresponding to the application; Or, reduce the resource resolution of the application program in the white list, wherein the resource resolution includes the resolution of the area corresponding to the button and/or the resolution of the area corresponding to the numeric keypad; Or, reduce at least one of the drawing frame rate, compositing frame rate, and resolution of the layer corresponding to the application program in the white list. 11. A mobile terminal comprising a memory, a processor and a computer program stored on the memory and operable on the processor, wherein the processor implements the following steps when executing the computer program: Get the layer content in the currently displayed layer; Determining a target object that satisfies a set condition according to the content of the layer, wherein the set condition is that the user's degree of attention to the target object is lower than a set threshold, and the target object includes a layer, an application program, or an interface element; Use a set processing method to perform power reduction processing on the target object, wherein the processing method includes reducing the drawing frame rate of the target object, reducing the composite frame rate of the target object, and reducing the target object At least one of the refresh rate of the region and the reduction of the resolution of the target object.