CN107479700A - Blank screen gestural control method, device, storage medium and mobile terminal - Google Patents

Abstract

The embodiment of the invention discloses a black screen gesture control method, device, storage medium and mobile terminal. The method comprises that after waking up the system based on the black screen gesture, when the driving layer reports the black screen gesture event, performing an operation of reading gesture data of the black screen gesture in parallel, and storing the gesture data in a preset node of the driving layer; When the application layer receives the black screen gesture event, it detects whether the gesture data in the preset node is ready; when the preparation is completed, the application layer reads the gesture data from the preset node; When the gesture data is read successfully and is valid, execute the black screen gesture function corresponding to the gesture data. The above technical solution can effectively improve the response speed of the black screen gesture by changing the control logic of the black screen gesture function, and shorten the time required from detecting the black screen gesture to opening the application program corresponding to the black screen gesture.

Description

Black screen gesture control method, device, storage medium and mobile terminal

technical field

The embodiments of the present invention relate to mobile terminal technologies, and in particular to a black screen gesture control method, device, storage medium and mobile terminal.

Background technique

Current mobile terminals, such as smart phones, handheld computers, tablet computers or handheld game consoles, are usually designed to have a structure of a touch screen to provide a touch input method to make the user's operation more convenient.

Black screen gestures are widely used on existing smart phones. When the black screen gesture function is turned on, the gesture operation on the touch screen can also be detected when the smart phone is in standby and black screen, thereby triggering the corresponding functions inside the phone. or software. The black screen gesture is widely used because it can reduce the operation steps for the user to open the gesture's internal functions or application software, and has a cool use effect. However, defects in the current black screen gesture processing flow lead to slow response of the mobile terminal to the black screen gesture, and the response of the black screen gesture function is not sensitive enough. touch screen

Contents of the invention

Embodiments of the present invention provide a black screen gesture control method, device, storage medium and mobile terminal, which can improve the response speed of the black screen gesture.

In a first aspect, an embodiment of the present invention provides a black screen gesture control method, including:

After waking up the system based on the black screen gesture, when the driver layer reports the black screen gesture event, perform the operation of reading the gesture data of the black screen gesture in parallel, and store the gesture data in a preset node of the driver layer;

When the application layer receives the black screen gesture event, it detects whether the gesture data in the preset node is ready;

When the preparation is completed, the application layer reads the gesture data from the preset node, wherein the gesture data includes gesture type;

The application layer executes a black screen gesture function corresponding to the gesture data when the gesture data is read successfully and is valid.

In the second aspect, the embodiment of the present invention also provides a black screen gesture control device, which includes:

The first data reading module is used to execute the operation of reading the gesture data of the black screen gesture in parallel when the driver layer reports the black screen gesture event after waking up the system based on the black screen gesture, and store the gesture data in the driver layer within the preset node;

The data detection module is used for the application layer to detect whether the gesture data in the preset node is ready when receiving the black screen gesture event;

The second data reading module is used to read the gesture data from the preset node at the application layer when the preparation is completed, wherein the gesture data includes gesture type;

The function execution module is used for the application layer to execute the black screen gesture function corresponding to the gesture data when the gesture data is read successfully and valid.

In a third aspect, the embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the black screen gesture control method as described in the embodiment of the present invention is implemented.

In a fourth aspect, an embodiment of the present invention also provides a mobile terminal, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the processor implements the computer program as described in the present invention when executing the computer program. The black screen gesture control method described in the embodiment of the invention.

The black screen gesture control scheme of the mobile terminal provided by the embodiment of the present invention is to perform the operations of reporting a black screen gesture event and reading gesture data in parallel; and if the application layer receives the black screen gesture event during the process of reading the gesture data by the driver layer, Then the application layer detects whether the gesture data is ready according to the set cycle; when the preparation is completed, the application layer reads the gesture data from the preset node, wherein the gesture data includes the gesture type; when the reading is successful, it judges Whether the gesture data is valid, if valid, execute the black screen gesture function corresponding to the gesture data. The above technical solution can effectively improve the response speed of the black screen gesture by changing the control logic of the black screen gesture function, and shorten the time required from detecting the black screen gesture to opening the application program corresponding to the black screen gesture.

Description of drawings

FIG. 1 is a flowchart of a black screen gesture control method provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of an Android system framework provided by an embodiment of the present invention;

Fig. 3a is a flowchart of another black screen gesture control method provided by an embodiment of the present invention;

Fig. 3b is a schematic display diagram of a black screen gesture track provided by an embodiment of the present invention;

Fig. 4a is a flow chart of another black screen gesture control method provided by an embodiment of the present invention;

Fig. 4b is a schematic display diagram of another black screen gesture trajectory provided by an embodiment of the present invention;

Fig. 5 is a schematic structural diagram of a black screen gesture control device provided by an embodiment of the present invention;

Fig. 6 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention.

detailed description

The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention. In addition, it should be noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings but not all structures.

Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the steps as sequential processing, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of steps may be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

The black screen gesture function is that when the mobile terminal (such as a smart phone) is in the dormant state with the screen off, the touch screen operates in a low power consumption state to detect the black screen gesture acting on the touch screen when the screen is off, and according to the A blank screen gesture is used to wake up a certain function of the smart phone or to open a preset application function corresponding to the type of the blank screen gesture. In order to facilitate the understanding of the black screen gesture function, the following describes the process from detecting the black screen gesture in the off-screen state to the application layer opening the application program corresponding to the black screen gesture. The process includes: storing the gesture data corresponding to the black screen gesture in the driver layer In the preset node of , the gesture data includes gesture coordinates and gesture type; the driver layer executes the black screen gesture data validity judgment; if valid, the framework layer executes the black screen gesture event distribution; after the application layer receives the black screen gesture event , the application layer reads the gesture data from the preset node in the driver layer, the gesture coordinates calculate the animation trajectory of the black screen gesture according to the gesture coordinates and gesture type, and send the animation trajectory data to the frame buffer (FrameBuffer) to follow the set screen The refresh rate refreshes the animation track to the touch screen for display; then, the application layer executes the operation of opening the application program corresponding to the black screen gesture.

From the above black screen gesture execution flow, before the touch screen displays the black screen gesture trajectory and opens the application program, it needs to be executed: after the system wakes up, the driver layer reads the gesture coordinates from the touch chip by setting the read function, and Stored in the default node of the driver layer; the driver layer determines the gesture type of the black screen gesture input by the user according to the gesture coordinates, and then stores the gesture type in the preset node as gesture data. The driver layer reports black screen gesture events. After the application layer receives the black screen gesture event, the preset node reads the gesture data, and determines the gesture trajectory according to the gesture data. Since the above steps are carried out when the touch screen is turned off, from the user's point of view, the mobile terminal does not respond, that is, the delay time from inputting the black screen gesture to opening the application program corresponding to the black screen gesture is relatively long. As a result, users intuitively think that the black screen gesture function is not responsive enough. The black screen gesture control solution provided by the embodiment of the present invention can well solve the above-mentioned problem of long delay in starting the application program corresponding to the black screen gesture.

Fig. 1 is a flow chart of a black screen gesture control method provided by an embodiment of the present invention, the method is executed by a black screen gesture control device, wherein the device can be implemented by software and/or hardware, and generally can be integrated into a mobile terminal. As shown in Figure 1, the method includes:

Step 110, after waking up the system based on the black screen gesture, when the driver layer reports the black screen gesture event, execute the operation of reading the gesture data of the black screen gesture in parallel, and store the gesture data in a preset node of the driver layer.

Wherein, the black screen gesture event may be an event negotiated in advance between the driver layer and the application layer to represent the black screen gesture input.

The black screen gesture may be a touch gesture input by the user on the touch display screen of the mobile terminal in a screen-off state after the black screen gesture function is turned on. It can be understood that the black screen gesture is not limited to a touch gesture input on the touch screen, and may also be an operation detected by a sensor of the mobile terminal. For example, the gesture of shaking the smartphone left and right, the gesture of flicking over the touch screen of the smartphone, the gesture of pressing the frame of the smartphone, and so on.

The gesture data includes gesture coordinates corresponding to the black screen gesture, gesture type, preset end position, and the like.

The preset node may be a file node, for example, a virtual file node under the proc-D directory.

Fig. 2 is a schematic diagram of an Android system framework provided by an embodiment of the present invention. Taking the mobile terminal whose operating system is the Android system shown in FIG. 2 as an example, the execution flow of the black screen gesture function provided by the embodiment of the present invention is introduced. As shown in FIG. 2 , the Android system framework includes a kernel layer 210 , a core class library layer 220 , a framework layer 230 and an application layer 240 from bottom to top. Among them, the kernel layer 210 provides core system services, including security, memory management, process management, network protocol stack, and hardware drivers. Wherein, the hardware driver in the kernel layer 210 is recorded as the driver layer 211, and the driver layer 211 includes a touch screen driver, a camera driver, and the like. The core class library layer 220 includes an Android runtime environment (Android Runtime) and class libraries (Libraries). Among them, Android Runtime provides most of the functions available in the Java programming language core class library, including the core library (Core Libraries) and the Dalvik virtual machine (Dalvik VM). Each Android application is an instance of the Dalvik virtual machine, running in its own process. The class library is used by various components of the Android system, including the following functions: media library (Media Framework), interface management (Surface Manager), SQLite (relational database engine) and FreeType (bitmap and vector font rendering), etc., each of which functions through The framework layer 230 of the Android system is exposed to developers. The framework layer 230 provides a series of class libraries required for developing Android applications, so that developers can develop applications quickly, facilitate reuse of components, and also realize personalized expansion through inheritance. The services it provides include component management services, Window management services, system data source components, space frames, resource management services, installation package management services, etc. The application layer 240 includes various application programs directly interacting with the user, or service programs written in the Java language and running in the background, including desktop applications, contact applications, call applications, camera applications, picture browsers, games, maps, programs such as web browsers, and other applications developed by developers.

Exemplarily, after the black-screen gesture function is enabled, the touch chip generates a wake-up signal when detecting the black-screen gesture, and sends the wake-up signal to the kernel layer. The wake-up signal is used to trigger the kernel layer to perform a system wake-up operation. After the system wakes up, the kernel layer calls the driver layer interrupt processing function to execute, and the driver layer reads the gesture data in the touch chip through the interrupt processing function, and stores the read gesture data in the preset node of the driver layer. Among them, the touch chip is used to output the touch sensing control signal to the touch screen to detect the touch operation, identify the gesture coordinates of the black screen gesture acting on the touch screen, and store the gesture coordinates as gesture data in its own register middle. The preset node may be a file node, for example, a virtual file node under the proc-D directory. After the data is read, the driver layer determines the validity of the gesture data. There are many ways to determine the validity, which are not specifically limited in this embodiment. For example, the driver layer determines the gesture type according to the gesture coordinates included in the gesture data, and stores the determined gesture type as gesture data in the preset node. If the gesture type is not a preset black screen gesture, it is determined that the gesture data is invalid. For another example, the driver layer counts the number of the gesture data, and determines whether the number meets the requirement of drawing a preset black screen gesture, and if not, determines that the gesture data is invalid. When the data is valid, the driver layer reports a black screen gesture event. The black screen gesture event is transmitted to the framework layer through the kernel layer and the core class library layer, and distributed through the framework layer to reach the application layer. When the application layer gets the black screen gesture event, it detects whether the gesture data in the preset node of the driver layer is ready. If yes, the gesture data is read by the preset node. A black screen gesture track is calculated according to the gesture coordinates contained in the gesture data, and the black screen gesture track is drawn on the touch screen for display. Then, based on the gesture type in the read gesture data, the application layer opens the application program corresponding to the gesture type. Wherein, the gesture type may be a gesture preset in the mobile terminal for realizing a certain function, or may be a user-defined gesture. For example, the gesture type could be O, which represents turning on the camera. For another example, the gesture type may be V, which means turning on a flashlight and so on.

It can be understood that the execution flow of the black screen gesture function is not limited to the manners listed in this embodiment. For example, it is also possible to report a black screen gesture event when the system wakes up, and the kernel layer calls the driver layer interrupt processing function to execute, and the driver layer reads the gesture data in the touch chip through the interrupt processing function, and stores the gesture data in the driver layer. In the preset node; when reporting a black screen gesture event, the driver layer executes in parallel the operation of reading gesture data from the preset node and determining the gesture type according to the gesture data; optionally, the driver layer reports a black screen gesture event, and the black screen gesture Events are distributed to the application layer through the framework layer. When reporting a black screen gesture event, the kernel layer calls the driver layer interrupt processing function to execute, and the driver layer reads the gesture data corresponding to the black screen gesture from the touch chip through the interrupt processing function in parallel, and stores the gesture data in the driver layer. in the default node. The driver layer detects whether the gesture data in the preset node includes a preset end bit, and if so, determines the gesture type corresponding to the black screen gesture according to the gesture coordinates.

Step 120: When the application layer receives the black screen gesture event, it detects whether the gesture data in the preset node is ready.

Wherein, the state of the gesture data in the preset node includes preparation completed and preparation in progress. It can be determined whether the preset node data is in a ready state or in a ready state according to detecting whether the gesture data in the preset node includes a preset end bit. For example, the character corresponding to the preset end bit is "#". When the user inputs a black screen gesture, the touch chip stores gesture data corresponding to the detected black screen gesture into its preset register. After the touch chip detects that the black screen gesture input is completed (for example, no black screen gesture input by the user is detected within a preset period of time), "#" is added to the end of the gesture data stored in the register. The driver layer reads the gesture data in the preset node according to the set cycle, and if the character corresponding to the preset end bit, ie "#", is detected, it is determined that the data status of the preset node is ready to complete. At this point, change the value of the setting flag in the driver layer to a value representing the completion of gesture data preparation. Wherein, the set identification bit is used to identify the state of the gesture data in the preset node in the driver layer. The value of the setting flag is determined by whether the drive layer reads the preset end bit. If the driver layer reads the preset end bit, the value of the set flag bit is updated to a value corresponding to the ready state. If the drive layer does not read the preset end bit, keep the value of the set flag bit as the value corresponding to the state of preparing.

It can be understood that there may be many kinds of end digits, and it is not limited to "#" listed in this embodiment.

After the application layer receives the black screen gesture event, it periodically reads the value of the set flag configured in the driver layer. The application layer can know whether the status of the gesture data in the preset node is ready or in preparation through the value of the set identification bit. When the gesture data in the preset node is not ready, start the timer to set the time length regularly, wait for the set time length, and then read the value of the flag in the driver layer to judge the value according to the value. Whether the gesture data in the preset node is ready.

It can be understood that the driver layer interrupt processing function is called at the kernel layer, and the driver layer reads the gesture data corresponding to the black screen gesture from the touch chip through the terminal processing function, and stores it in the preset node of the driver layer. , the application layer periodically reads the set flag.

Step 130, when the preparation is completed, the application layer reads the gesture data from the preset node.

After the gesture data in the preset node is prepared, the application layer extracts the gesture data from the preset node. For example, the application layer calls the setting function to read gesture coordinates and gesture types from the virtual file node in the proc-D directory.

Step 140: When the gesture data is read successfully and valid, the application layer executes a black screen gesture function corresponding to the gesture data.

Wherein, if the application layer reads the preset end bit of the gesture data, it is considered that the gesture data is read successfully. If the number of gesture coordinates read by the application layer exceeds the set number threshold, and the black screen gesture corresponding to the gesture type is an enabled black screen gesture, the black screen gesture data is considered valid. Exemplarily, after the gesture data is read by the preset node, the application layer compares the gesture data with the preset end bit, and if the gesture data includes the preset end bit, it determines that the gesture data is read successfully, and stops Read data from preset nodes. The application layer queries the gesture type of the enabled black screen gesture according to the gesture type included in the gesture data. If the black screen gesture corresponding to the gesture type has been enabled, count the number of gesture coordinates in the read gesture data, and determine the gesture coordinate. Whether the number exceeds the set number threshold. If yes, it is determined that the gesture data is valid. A minimum number of gesture coordinates for drawing a black screen gesture track may be set in advance for each black screen gesture.

When the gesture data is read successfully and is valid, the application layer executes the black screen gesture function corresponding to the gesture data. Among them, the black screen gesture function includes opening a certain application program, performing functions such as waking up the mobile terminal or cutting songs. Exemplarily, when the gesture data is read successfully and is valid, the gesture track corresponding to the black screen gesture is determined, and the gesture track is displayed on the touch screen. According to the corresponding relationship between the gesture type and the black screen gesture function, the operation to be performed is determined. For example, if it is determined according to the gesture type that the operation to be performed is to turn on the camera, then turn on the camera and switch the display interface to the camera interface after the gesture track is displayed on the touch screen for a set time.

In the technical solution of this embodiment, the operations of reporting a black screen gesture event and reading gesture data are executed in parallel; Detect whether the gesture data is ready; when the preparation is complete, the application layer reads the gesture data from the preset node, and when the reading is successful, judges whether the gesture data is valid, and if it is valid, executes the black screen gesture corresponding to the gesture data Function. The above technical solution can effectively improve the response speed of the black screen gesture by changing the control logic of the black screen gesture function, and shorten the time required from detecting the black screen gesture to opening the application program corresponding to the black screen gesture.

Fig. 3a is a flow chart of another black screen gesture control method provided by an embodiment of the present invention. As shown in Figure 3a, the method includes:

Step 301. After waking up the system based on the black screen gesture, when the driver layer reports the black screen gesture event, execute the operation of reading the gesture data of the black screen gesture in parallel, and store the gesture data in a preset node of the driver layer.

Step 302, when the application layer receives the black screen gesture event, query the identification bit in the driver layer that identifies the data state of the preset node.

When the driver layer reads the gesture data of the black screen gesture and stores it in the preset node of the driver layer, if the application layer receives a black screen gesture event, it will execute in parallel to query whether the gesture data in the preset node includes the preset end bit operation. That is, in the process of writing the gesture data of the black screen gesture to the preset node, the application layer detects in real time whether the gesture data in the preset node includes the preset end bit, which can effectively avoid finding the preset end bit from a large amount of data. A condition that prolongs the response time of screen-to-black gestures occurs.

Step 303 , judging whether the gesture data is ready according to the value of the flag, if yes, execute step 306 , otherwise, execute step 304 .

The application layer reads the value of the identification bit in the driver layer according to the set period, and matches the value with the value representing the completion of the gesture data preparation in the preset node. If the value is equal to the value representing the completion of gesture data preparation, it is determined that the gesture data in the preset node has been prepared, and step 306 is performed; otherwise, it is determined that the gesture data in the preset node is not ready, and step 304 is performed.

Step 304, timing by a timer.

When the gesture data in the preset node is not ready, the timer is started to set the time length. Wherein, the set time length is equal to the first period for the application layer to read the identification bit in the driver layer.

Step 305 , judging whether the value of the timer reaches the set time length, if yes, execute step 302 , otherwise, execute step 304 .

Read the reading of the timer according to the second cycle, compare the reading with the set time length, if it is greater than or equal to the set time length, then execute step 302; otherwise, return to execute step 304; wherein, the second cycle less than the first cycle.

Step 306, the application layer reads the gesture data from the preset node.

Step 307 , judging whether the gesture data is read successfully and valid, if yes, execute step 308 , otherwise, execute step 306 .

Step 308, the application layer starts the application program corresponding to the gesture type in the background through at least one start thread.

Wherein, the opening thread is used to execute the operation of opening the application program corresponding to the gesture type in the background. In the Android system, the application program is composed of Activities, so the startup process of the application program is actually the startup process of the default Activity in the application program, including the call of the Activity class and the instantiation of the object. After the application program corresponding to the gesture type is started in the background, the screen frame corresponding to the application program interface is cached, and the application program interface is not drawn to the touch display screen temporarily.

The relationship between gesture types and applications or mobile phone functions is established in advance. Gesture types and applications (such as process numbers or installation package names) or mobile phone functions (such as mobile phone wake-up, conference mode or standard mode) can be stored in a white list. and other work mode switch) association relationship. It can be understood that there are many ways to establish the association relationship between the gesture type and the application program, which is not limited in this embodiment of the present invention. For example, a quick launch function can be set for the setting function or setting application of the mobile terminal before leaving the factory, and the setting function can be directly executed or the setting application can be opened in the off-screen state by inputting a setting gesture. Taking the flashlight as an example, the flashlight is preset to have a quick start function before the mobile terminal leaves the factory, and the flashlight can be turned on when the screen is off by entering the black screen gesture "O". As another example, the mobile terminal provides a black screen gesture configuration function. When the user enables the black screen gesture function, the user is prompted to select the application program that needs to be set with the quick start function, and enter or select the corresponding black screen gesture of the application program, so as to establish the gesture type and application program. relationship.

When the application layer receives a black screen gesture event, it starts a thread to query the preset white list, determines the application corresponding to the gesture type, and starts the application in the background.

Step 309 , the application layer determines the gesture track corresponding to the gesture type through at least one drawing thread in parallel with the start thread, and draws the gesture track to the touch screen.

Wherein, the drawing thread is used to execute the operations of determining the gesture track corresponding to the gesture type and displaying the gesture track to the touch screen in parallel with the opening thread. The drawing of the gesture trajectory can be completed by one drawing thread alone, or two or more drawing threads can respectively draw the gesture trajectory fragments. After each drawing thread completes the gesture track segments it is responsible for drawing, the drawn gesture track segments are spliced into a complete gesture track, so that the drawing efficiency of the gesture track can be effectively improved.

Exemplarily, the application layer executes the operation of determining the gesture trajectory corresponding to the gesture type in parallel through at least one other drawing thread while opening the application program corresponding to the gesture type in the background by starting the thread. There are many ways to determine the gesture trajectory corresponding to the gesture type. For example, the drawing thread extracts sampling points satisfying the preset sampling rules of the gesture type from the coordinate information included in the gesture data, and draws the The gesture track corresponding to the gesture type, and send the picture frame including the sampling point and the connection between the sampling point to the frame buffer (FrameBuffer), and display the gesture track on the touch screen in the form of animation to simulate the black screen The gesture drawing process.

Optionally, the preset sampling rule may be to collect a gesture coordinate every set number of gesture coordinates as a sampling point. Curve fitting may be performed on the sampling points to obtain a gesture trajectory corresponding to the gesture type of the black screen gesture input by the user. Starting from the first sampling point of the gesture track, a set number of pixel points can be drawn every set time interval, so that the drawing process of the gesture track can be shown in the form of animation. Wherein, in order to ensure a higher response speed of the black screen gesture, the set time interval is the minimum time interval at which human eyes can distinguish image changes, and of course the time interval can be set as required. Curve fitting is a data processing method, that is, using a continuous curve to approximately describe or compare the functional relationship between the coordinates represented by discrete points on the plane.

Fig. 3b is a schematic display diagram of a black screen gesture track provided by an embodiment of the present invention. As shown in FIG. 3 b , starting from the first sampling point 301 of the gesture type "W", the gesture track among the three sampling points is drawn every set time interval. When drawing for the first time, start from the first sampling point 301 to draw the gesture track between the 3 sampling points, and then perform the second drawing at a set time interval. At this time, the gesture trajectory between the three sampling points is drawn from the fourth sampling point 302, and then the third drawing is performed at a set time interval. At this time, the gesture track between the 3 sampling points is drawn from the seventh sampling point 303, and the gesture track is drawn according to this rule until the last sampling point 304 is drawn to end the drawing, thereby realizing animation on the touch display screen. Displaying the gesture track in a form improves the monotony problem of statically displaying the gesture track and increases interest.

Step 310 , judging whether the preset display condition of the application program interface is satisfied, if yes, execute step 311 , otherwise, execute step 312 .

Pre-set the display conditions for switching from the gesture track display interface to the display interface of the application program. The display conditions can be set as the gesture track drawing displayed on the touch screen when the application program corresponding to the gesture type is successfully opened in the background according to actual needs. to the last sampling point.

When the application layer detects that the application program corresponding to the black screen gesture input by the user has been opened in the background, it judges whether the gesture track on the touch screen is drawn to the last sampling point, and if so, executes step 311; otherwise, executes step 312. Optionally, if the gesture track on the touch screen is drawn to the last sampling point, but the application corresponding to the black screen gesture input by the user has not been started, the completed gesture track will be displayed on the touch screen until it is detected. After the application program has been started in the background, step 311 is executed.

Step 311 , the application layer draws the interface corresponding to the application program to the touch display screen, so as to display the interface of the application program on the touch display screen.

Read data from the preset storage area where the screen frame corresponding to the application program interface is cached, and refresh the application program interface to the touch screen at the set screen refresh rate, so as to realize direct switching from the gesture track interface to the application program interface .

Step 312, continue to display the gesture track on the touch screen.

In the technical solution of this embodiment, while starting the thread to execute the application program corresponding to the gesture type, extracting several sampling points satisfying the preset sampling rules from the coordinate information of the gesture data through the drawing thread, according to the sampling point Draw the gesture track, and display the gesture track on the touch screen in the form of animation; when the preset display conditions for the application program interface are met, switch from the gesture track display interface to the application program interface. By adopting the above technical solution, it is possible to quickly determine the gesture track of the black screen gesture input by the user while opening the application program in the background, and draw the gesture track vividly on the touch display screen, so as to avoid the user intuitively feeling the black screen gesture The situation where the function is not responsive occurs, thereby further improving the response speed of the black screen gesture.

Fig. 4a is a flow chart of another black screen gesture control method provided by an embodiment of the present invention. As shown in Figure 4a, the method includes:

Step 401, when the touch chip detects a black screen gesture, trigger the kernel layer to wake up the system.

Step 402, the driver layer reports the black screen gesture event corresponding to the black screen gesture to the application layer through the framework layer.

Step 403 , when the driver layer reports the black screen gesture event, perform an operation of reading the gesture data of the black screen gesture in parallel, and store the gesture data in a preset node of the driver layer.

Step 404 , when the application layer receives the black screen gesture event, query the identification bit in the driver layer that identifies the data state of the preset node.

Step 405 , judging whether the gesture data is ready according to the value of the flag, if yes, execute step 408 , otherwise, execute step 406 .

Step 406, timing by a timer.

Step 407, judging whether the value of the timer reaches the set time length.

Step 408, the application layer reads the gesture data from the preset node.

Step 409 , judging whether the gesture data is read successfully and valid, if yes, execute step 410 , otherwise, execute step 408 .

Step 410, the application layer determines the gesture track corresponding to the gesture type, and draws the gesture track to the touch screen.

Query the pre-configured standard graphics library to determine the standard graphics that match the gesture type. Wherein, the standard graphics library can be set in the mobile terminal to facilitate the query of the application layer, and has a relatively fast query speed because it does not depend on the Internet. Moreover, the standard graphics library can be updated based on the update message pushed by the remote server after the mobile terminal is connected to the Internet. Optionally, the standard graphics library can also be stored in a remote server, so as to avoid occupying the storage space of the mobile terminal.

Exemplarily, the gesture type of the black screen gesture input by the user is "W", the standard graphic library is queried according to the gesture type, and the standard graphic of "W" for setting the display effect is determined. Wherein, the set display effect may be the default display effect of the system or the display effect preset by the user, including font color, font shape, font size and so on.

The drawing thread can query the standard graphics library according to the gesture type to obtain the standard graphics corresponding to the black screen gesture, without the need to acquire gesture coordinates and draw the gesture trajectory, which greatly reduces the amount of data acquisition.

The application layer finds the standard graphics that match the gesture type in the pre-configured standard graphics library, draws the image of the standard graphics, and stores the image data in the frame buffer of the touch screen, according to the set screen refresh rate The image of the standard graphic is refreshed to the touch screen to display the image of the standard graphic on the touch screen.

Fig. 4b is a schematic display diagram of another black screen gesture trajectory provided by an embodiment of the present invention. As shown in FIG. 4b, when the user inputs a black screen gesture "W" in a black screen state, a standard graphic corresponding to the gesture type can be displayed on the touch screen.

Step 411, the application layer starts the application program corresponding to the gesture type, and displays the interface of the application program on the touch display screen.

Read data from the preset storage area where the screen frame corresponding to the application program interface is cached, and transfer it to the frame buffer, so as to refresh the application program interface to the touch display screen according to the set screen refresh rate, and the display screen will be displayed by gestures Tracks switch directly to the application interface.

In the technical solution of this embodiment, the standard graphic corresponding to the gesture type is determined by querying the preset standard graphic library, and the image of the standard graphic is drawn to the touch screen; then, the application program corresponding to the gesture type is opened, and in the The interface of the application program is displayed on the touch screen. By adopting the above technical solution, by searching the preset standard graphics library, the standard graphics corresponding to the gesture trajectory of the black screen gesture input by the user is quickly determined, and the standard graphics are drawn on the touch display screen, preventing the user from intuitively It feels that the response of the black screen gesture function is not sensitive, so as to further improve the response speed of the black screen gesture.

Fig. 5 is a schematic structural diagram of a black screen gesture control device provided by an embodiment of the present invention. As shown in Figure 5, the device includes:

The first data reading module 510 is configured to execute the operation of reading the gesture data of the black screen gesture in parallel when the driver layer reports the black screen gesture event after waking up the system based on the black screen gesture, and store the gesture data in the driver In the default node of the layer;

The data detection module 520 is used to detect whether the gesture data in the preset node is ready when the application layer receives the black screen gesture event;

The second data reading module 530 is used for the application layer to read the gesture data from the preset node when the preparation is completed;

The function execution module 540 is configured for the application layer to execute the black screen gesture function corresponding to the gesture data when the gesture data is read successfully and valid.

The technical solution of this embodiment provides a black screen gesture control device. By changing the control logic of the black screen gesture function, the response speed of the black screen gesture can be effectively improved, and the time required to open the application program corresponding to the black screen gesture can be shortened. time.

Optionally, before the driver layer wakes up the system based on the black screen gesture, it also includes:

When the touch chip detects a black screen gesture, it triggers the kernel layer to wake up the system;

The reporting of the black screen gesture event includes: the driver layer reports the black screen gesture event corresponding to the black screen gesture to the application layer through the framework layer.

Optionally, the parallel execution of reading the gesture data corresponding to the black screen gesture includes:

The driver layer executes in parallel the operation of reading gesture data corresponding to the black screen gesture from the touch chip through an interrupt processing function.

Optionally, the application layer is triggered by the black screen gesture event to detect whether the gesture data in the preset node is ready, including:

When the application layer receives the black screen gesture event, query the identification bit of the data state of the preset node in the driver layer;

The application layer judges whether the gesture data is ready according to the value of the identification bit;

If so, the application layer performs an operation of extracting the gesture data from the preset node;

Otherwise, after waiting for a set period of time, the application layer returns to perform the operation of querying the identification bit.

Optionally, after the application layer reads the gesture data from the preset node, it further includes:

The application layer judges whether the gesture data read from the preset node includes a preset end bit of the gesture data, and if so, determines that the gesture data is read successfully.

Optionally, executing a black screen gesture function corresponding to the gesture data includes:

The application layer determines the gesture trajectory corresponding to the gesture type, and draws the gesture trajectory to the touch display screen;

The application layer starts the application program corresponding to the gesture type, and displays the interface of the application program on the touch display screen.

Optionally, executing a black screen gesture function corresponding to the gesture data includes:

The application layer opens the application program corresponding to the gesture type in the background through at least one opening thread;

The application layer determines the gesture track corresponding to the gesture type in parallel with the opening thread through at least one drawing thread, and draws the gesture track to the touch display screen;

When the preset display condition is satisfied, the application layer draws the interface corresponding to the application program to the touch display screen, so as to display the interface of the application program on the touch display screen.

An embodiment of the present invention also provides a storage medium containing computer-executable instructions, the computer-executable instructions are used to execute a black screen gesture control method when executed by a computer processor, the method comprising:

After waking up the system based on the black screen gesture, when the driver layer reports the black screen gesture event, perform the operation of reading the gesture data of the black screen gesture in parallel, and store the gesture data in a preset node of the driver layer;

When the application layer receives the black screen gesture event, it detects whether the gesture data in the preset node is ready;

When the preparation is completed, the application layer reads the gesture data from the preset node;

The application layer executes a black screen gesture function corresponding to the gesture data when the gesture data is read successfully and is valid.

storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media such as CD-ROMs, floppy disks or tape drives; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. Also, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network such as the Internet. The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations, such as in different computer systems connected by a network. The storage medium may store program instructions (eg embodied as computer programs) executable by one or more processors.

Of course, a storage medium containing computer-executable instructions provided by an embodiment of the present invention, the computer-executable instructions are not limited to the operation of the black screen gesture control method as described above, and can also execute the black screen provided by any embodiment of the present invention. Related operations in gesture control methods.

An embodiment of the present invention provides a mobile terminal, in which the black screen gesture control device provided by the embodiment of the present invention can be integrated. FIG. 6 is a schematic structural diagram of a mobile terminal provided by an embodiment of the present invention. As shown in FIG. 6, the mobile terminal may include: a housing (not shown in the figure), a memory 601, a central processing unit (Central Processing Unit, CPU) 602 (also called a processor, hereinafter referred to as CPU), a circuit board ( not shown in the figure), touch screen 612 and power supply circuit (not shown in the figure). The touch display screen 612 is used to convert user operations into electrical signals and input them to the processor, and display visible output signals; the circuit board is arranged between the touch display screen 612 and the casing inside the formed space; the CPU 602 and the memory 601 are arranged on the circuit board; the power supply circuit is used to supply power to each circuit or device of the mobile terminal; the memory 601 is used to store computer programs ; The CPU 602 reads and executes the computer program stored in the memory 601 . The CPU 602 implements the following steps when executing the computer program: after waking up the system based on the black screen gesture, when the driver layer reports the black screen gesture event, executes in parallel the operation of reading the gesture data of the black screen gesture, and transfers the gesture The data is stored in the preset node of the driver layer; when the application layer receives the black screen gesture event, it detects whether the gesture data in the preset node is ready; when the preparation is completed, the application layer uses the preset node The gesture data is read within; the application layer executes the black screen gesture function corresponding to the gesture data when the gesture data is read successfully and is valid.

The mobile terminal also includes: peripheral interface 603, RF (Radio Frequency, radio frequency) circuit 605, audio circuit 606, speaker 611, power management chip 608, input/output (I/O) subsystem 609, other input/control Device 610 and external port 604 , these components communicate via one or more communication buses or signal lines 607 .

It should be understood that the illustrated mobile terminal 600 is only an example of a mobile terminal, and the mobile terminal 600 may have more or fewer components than those shown in the figure, and two or more components may be combined, Or can have a different component configuration. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The mobile terminal integrated with the black screen gesture control device provided in this embodiment will be described in detail below, and the mobile terminal is taken as an example.

Memory 601, the memory 601 can be accessed by the CPU 602, the peripheral interface 603, etc., the memory 601 can include a high-speed random access memory, and can also include a non-volatile memory, such as one or more disk storage devices, flash memory devices , or other volatile solid-state storage devices.

Peripheral interface 603 , which can connect the input and output peripherals of the device to CPU 602 and memory 601 .

The I/O subsystem 609 , the I/O subsystem 609 can connect input and output peripherals on the device, such as a touch screen 612 and other input/control devices 610 , to the peripheral interface 603 . I/O subsystem 609 may include a display controller 6091 and one or more input controllers 6092 for controlling other input/control devices 610 . Among them, one or more input controllers 6092 receive electrical signals from or send electrical signals to other input/control devices 610, which may include physical buttons (push buttons, rocker buttons, etc.) ), dials, slide switches, joysticks, click wheels. It is worth noting that the input controller 6092 can be connected to any of the following: a keyboard, an infrared port, a USB interface, and a pointing device such as a mouse.

A touch display screen 612, the touch display screen 612 is an input interface and an output interface between the user terminal and the user, and displays visual output to the user. The visual output may include graphics, text, icons, videos, and the like.

The display controller 6091 in the I/O subsystem 609 receives electrical signals from the touch display 612 or sends electrical signals to the touch display 612 . The touch display screen 612 detects the contact on the touch display screen, and the display controller 6091 converts the detected contact into an interaction with a user interface object displayed on the touch display screen 612, that is, realizes human-computer interaction, and displays it on the touch screen. The user interface objects on the control display 612 may be icons for running games, icons for networking to corresponding networks, and the like. It is worth noting that the device may also include an optical mouse, which is a touch-sensitive surface that does not display visual output, or an extension of the touch-sensitive surface formed by the touch display 612 .

The RF circuit 605 is mainly used to establish communication between the mobile phone and the wireless network (that is, the network side), and realize data reception and transmission between the mobile phone and the wireless network. Such as sending and receiving short messages, e-mails, etc. Specifically, the RF circuit 605 receives and sends RF signals, which are also called electromagnetic signals, and the RF circuit 605 converts electrical signals into electromagnetic signals or converts electromagnetic signals into electrical signals, and communicates with communication networks and other devices through the electromagnetic signals to communicate. RF circuitry 605 may include known circuitry for performing these functions including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC ( COder-DECoder, Codec) Chipset, Subscriber Identity Module (Subscriber Identity Module, SIM) and so on.

The audio circuit 606 is mainly used to receive audio data from the peripheral interface 603 , convert the audio data into electrical signals, and send the electrical signals to the speaker 611 .

The speaker 611 is used to restore the voice signal received by the mobile phone from the wireless network through the RF circuit 605 into sound and play the sound to the user.

The power management chip 608 is used for power supply and power management for the hardware connected to the CPU 602 , the I/O subsystem and the peripheral interface.

The mobile terminal provided by the embodiment of the present invention can effectively improve the response speed of the black screen gesture, and shorten the time required from detecting the black screen gesture to opening the application program corresponding to the black screen gesture.

The black screen gesture control device, storage medium, and mobile terminal provided in the above embodiments can execute the black screen gesture control method provided in any embodiment of the present invention, and have corresponding functional modules and beneficial effects for executing the method. For technical details not exhaustively described in the foregoing embodiments, reference may be made to the black screen gesture control method provided in any embodiment of the present invention.

Note that the above are only preferred embodiments of the present invention and applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present invention, and the present invention The scope is determined by the scope of the appended claims.

Claims (10)

1. A kind of 1. blank screen gestural control method, it is characterised in that including：

   After based on blank screen gesture wake-up system, for driving layer when reporting blank screen gesture event, parallel perform reads the blank screen The operation of the gesture data of gesture, and the gesture data is stored in the default node of driving layer；

   When receiving the blank screen gesture event, whether the gesture data detected in the default node has prepared application layer Into；

   When being ready to complete, application layer by reading the gesture data in the default node, wherein, the gesture data includes Gesture-type；

   Application layer the gesture data read successfully and it is effective when, perform blank screen gesture function corresponding to the gesture data.
2. 2. according to the method for claim 1, it is characterised in that before driving layer is based on blank screen gesture wake-up system, also Including：

   Chip is touched when detecting blank screen gesture, triggering inner nuclear layer wakes up system；

   It is described to report blank screen gesture event, including：Driving layer is reported corresponding to the blank screen gesture by ccf layer to application layer Blank screen gesture event.
3. 3. according to the method for claim 2, it is characterised in that parallel perform reads hand corresponding to the blank screen gesture The operation of gesture data, including：

   The driving layer is read corresponding to the blank screen gesture by interrupt processing function, parallel perform from the touch chip The operation of gesture data.
4. 4. according to the method for claim 1, it is characterised in that application layer triggers perform detection by the blank screen gesture event Whether the gesture data in the default node is ready to complete, including：

   Application layer identifies the data mode of the default node when receiving the blank screen gesture event in query driven layer Flag；

   Application layer judges whether the gesture data is ready to complete according to the value of the flag；

   If so, then application layer performs the operation that the gesture data is extracted out of described default node；

   Otherwise, after setting time length is waited, application layer returns to the operation for performing and inquiring about the flag.
5. 5. according to the method for claim 1, it is characterised in that in application layer by reading the gesture in the default node After data, in addition to：

   Application layer judges the default stop bits for whether including the gesture data by the gesture data read in the default node, If, it is determined that the gesture data is read successfully.
6. 6. method according to any one of claim 1 to 5, it is characterised in that perform black corresponding to the gesture data Shield gesture function, including：

   Application layer determines gesture path corresponding to the gesture-type, and draws gesture path to touching display screen；

   Application layer opens application program corresponding to the gesture-type, and the application program is shown on the touching display screen Interface.
7. 7. method according to any one of claim 1 to 5, it is characterised in that perform black corresponding to the gesture data Shield gesture function, including：

   Application layer is opening application program corresponding to the gesture-type from the background by least one unlatching thread；

   Application layer passes through at least one drafting thread, hand corresponding with the unlatching thread parallel execution determination gesture-type Gesture track, and draw operation of the gesture path to touching display screen；

   When meeting default display condition, interface corresponding to the application layer drafting application program to the touching display screen, To show the interface of the application program on the touching display screen.
8. A kind of 8. blank screen gesture control device, it is characterised in that including：

   First data read module, for after based on blank screen gesture wake-up system, driving layer when reporting blank screen gesture event, The parallel operation for performing the gesture data for reading the blank screen gesture, and the gesture data is stored in the default section for driving layer Point in；

   Data detection module, for application layer when receiving the blank screen gesture event, detect the hand in the default node Whether gesture data are ready to complete；

   Second data read module, for when being ready to complete, application layer by reading the gesture data in the default node, Wherein, the gesture data includes gesture-type；

   Function execution module, for application layer the gesture data read successfully and it is effective when, perform the gesture data pair The blank screen gesture function answered.
9. 9. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the program is held by processor The blank screen gestural control method as described in any in claim 1 to 7 is realized during row.
10. 10. a kind of mobile terminal, including touching display screen, memory, processor and storage are on a memory and can be in processor The computer program of upper operation, it is characterised in that described in the computing device during computer program realize as claim 1 to Any described blank screen gestural control method in 7.