TW201828029A - Data processing method, device and smart terminal to solve the issue of cumbersome operation in the existing smart terminal - Google Patents

Abstract

The embodiment of the present invention provides a data processing method, device and smart terminal to solve the issue of cumbersome operation in the existing smart terminal. The method includes displaying a system control unit which includes an interface element related to a current scene; receiving an operation instruction fed back through the system control unit, and responding the operation instruction. The present invention can simplify an user's operation process during an application and in between. The system control unit assists the user to perform operations and improves the efficiency of use.

Description

 Data processing method, device and smart terminal  

The present invention relates to the field of terminal technologies, and in particular to a data processing method, a data processing device, and a smart terminal.

With the development of terminal technologies, more and more users use smart terminals. Users can install various types of applications in smart terminals, and different applications have the same or different functions.

For example, the player application can play audio and video, the shopping application can make online shopping, and the notebook application records the trip planning. Different applications can be used to perform different operations in a smart terminal, and the user can perform operations using the required application. When performing operations in an application, some operations need to exit the current interface to execute, such as when you want to query the logistics information of an order while shopping. Also. Different applications are independent of each other. To call other applications when using one application, you usually need to quit the application and then look for other applications. It can be seen that the application often has problems of cumbersome operation and affects the use efficiency.

Therefore, a technical problem that needs to be solved urgently by those skilled in the art is to provide a data processing method, device and smart terminal to solve the problem that the existing operation in the smart terminal is cumbersome.

The technical problem to be solved by the embodiments of the present invention is to provide a data processing method to solve the problem that the existing operation in the smart terminal is cumbersome.

Correspondingly, the embodiment of the present invention further provides a data processing device and a smart terminal for ensuring implementation and application of the foregoing method.

In order to solve the above problems, the present invention discloses a data processing method, including: a display system control, the system control includes an interface element related to a current scene; receiving an operation instruction fed back through the system control; and responding to the operation instruction.

Optionally, the method further includes: determining the interface element related to the current scenario: obtaining the interface information or the application package name of the current application; determining at least one of the following interface elements according to the application package name or the interface information: the information label, the function button.

Optionally, the display system control includes: displaying a display interface of the system control according to the interface element; starting a floating window by using an application interface of the current application as a background, and displaying a display interface of the system control in the floating window .

Optionally, the receiving the operation instruction fed back by the system control comprises: receiving an operation instruction according to a trigger on an interface element in the system control.

Optionally, the function button includes a voice button, and the receiving an operation instruction fed back by the system control includes: receiving a voice signal based on triggering a voice button; and identifying the voice signal according to the recognized text data Generate an operation instruction.

Optionally, the responding to the operation instruction includes: analyzing a processing party of the operation instruction, and distributing the operation instruction to the processing party for processing, wherein the processing party includes: a current application or a system control .

Optionally, the processing of the processing instruction includes: detecting whether the current application can process the operation instruction; and if the current application is capable of processing the operation instruction, using the current application as a processing party; When the current application cannot process the operation instruction, the system control itself is treated as a processor.

Optionally, after the operating instruction is distributed to the system control, the method further includes: jumping to the corresponding control page of the system control to process the operation instruction, and exiting the system control.

Optionally, after the operating instruction is distributed to the system control, the method further includes: the system control determines that the operation instruction corresponds to the target application, jumps to the target application, and exits the system control.

Optionally, the display system control includes: displaying the system control when the target input is received.

Optionally, the target input includes: an active start input and a passive start input.

Optionally, the passive activation input includes a sliding gesture, a click on a floating button, a shaking operation, or a touch screen double-click operation.

Optionally, the method further includes: acquiring sliding information on the touch screen, and determining, according to the sliding information, whether it is a sliding motion gesture.

Optionally, the sliding information includes a sliding distance and a sliding direction.

Optionally, determining whether the sliding direction is a sliding gesture according to the sliding information comprises: determining whether the sliding direction is sliding upward from the bottom; and determining whether the sliding distance reaches a target distance when the sliding direction is sliding upward from the bottom; When it is determined that the sliding distance reaches the target distance, it is determined as an upward sliding gesture.

Optionally, the sliding information further includes: a sliding time, and determining that the sliding direction is sliding upward from the bottom, further comprising: determining whether the sliding time meets the target time range.

Optionally, the active start input comprises: at least one sliding input.

Optionally, the method further includes: acquiring sliding information on the touch screen, wherein the sliding information includes a sliding direction and a sliding time; determining a target sliding operation according to the sliding direction; and when the sliding time of the target sliding operation exceeds a pre- When the time is set, the sliding input of the target sliding operation is recorded; when the corresponding number of sliding input of the target sliding operation exceeds the effective threshold, the sliding input is determined to be an active starting input.

Optionally, when the current scenario is an address book application, the information tag includes at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, and the function button includes: a voice button.

Optionally, when the current scene is an album application, the information tag includes at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, and the function button includes: a voice button.

Optionally, when the current scenario is a system desktop, the information tag includes at least one of the following: an entry tag of the recommended application, an entry tag of the most frequently used application, and the function button includes: a voice button.

Optionally, when the current scenario is set by the system, the information tag includes at least one of the following: an entry tag of a recommended setting, an entry tag of a most frequently changed setting, and the function button includes: a voice button.

The embodiment of the invention further discloses a data processing device, comprising: a control display module, configured to display a system control, the system control includes an interface element related to a current scene; and an instruction receiving module, configured to receive through the system An operation instruction fed back by the control; a response module for responding to the operation instruction.

Optionally, the control display module is further configured to determine an interface element related to the current scene; the control display module includes: an element determining sub-module, configured to obtain interface information or an application package name of the current application. Determining at least one of the following interface elements according to the application package name or interface information: a news tag, a function button.

Optionally, the control display module includes: an interface customization sub-module, configured to customize a display interface of the system control according to the interface element; and a floating window display sub-module, configured to use the current application application interface as a background A floating window is activated, and a display interface of the system control is displayed in the floating window.

Optionally, the instruction receiving module is configured to receive an operation instruction according to triggering an interface element in the system control.

Optionally, the command receiving module is configured to receive a voice signal based on triggering a voice button; identify the voice signal, and generate an operation instruction according to the recognized text data.

Optionally, the response module is configured to analyze a processing unit of the operation instruction, and distribute the operation instruction to the processing party for processing, where the processing party includes: a current application or a system control.

Optionally, the response module includes: an instruction determining module, configured to detect whether the current application can process the operation instruction; and if the current application can process the operation instruction, use the current application as a processing When the current application cannot process the operation instruction, the system control itself is treated as a processing party.

Optionally, the response module further includes: a control processing submodule, configured to jump to the corresponding homepage of the system control to process the operation instruction, and exit the system control.

Optionally, the response module further includes: a control processing submodule, wherein the system control determines that the operation instruction corresponds to the target application, jumps to the target application, and exits the system control.

Optionally, the input display module is configured to display the system control when the target input is received.

Optionally, the target input includes: an active start input and a passive start input.

Optionally, the passive activation input includes a sliding gesture, a click on a floating button, a shaking operation, or a touch screen double-click operation.

Optionally, the method further includes: an input determining module, configured to obtain sliding information on the touch screen, and determine, according to the sliding information, whether it is a sliding motion gesture.

Optionally, the sliding information includes a sliding distance and a sliding direction.

Optionally, the input determining module is configured to determine whether the sliding direction is sliding upward from the bottom; when the sliding direction is sliding upward from the bottom, determining whether the sliding distance reaches a target distance; determining the sliding distance When the target distance is reached, it is determined to be a slide-up gesture.

Optionally, the sliding information further includes: a sliding time, wherein the input determining module is further configured to determine whether the sliding time is up to the target time range after sliding from the bottom.

Optionally, the active start input comprises: at least one sliding input.

Optionally, the method further includes: an input determining module, configured to acquire sliding information on the touch screen, wherein the sliding information includes a sliding direction and a sliding time; determining a target sliding operation according to the sliding direction; When the sliding time of the sliding operation exceeds the preset time, the sliding input of the target sliding operation is recorded; when the corresponding number of sliding input of the target sliding operation exceeds the effective threshold, the sliding input is determined to be an active starting input.

Optionally, when the current scenario is an address book application, the information tag includes at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, and the function button includes: a voice button.

Optionally, when the current scene is an album application, the information tag includes at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, and the function button includes: a voice button.

Optionally, when the current scenario is a system desktop, the information tag includes at least one of the following: an entry tag of the recommended application, an entry tag of the most frequently used application, and the function button includes: a voice button.

Optionally, when the current scenario is set by the system, the information tag includes at least one of the following: an entry tag of a recommended setting, an entry tag of a most frequently changed setting, and the function button includes: a voice button.

The embodiment of the invention further discloses a smart terminal, the smart terminal comprising: a memory, a display, a processor and an input unit, wherein the input unit comprises: a touch screen; the processor is configured to execute the embodiment of the invention The data processing method described.

Compared with the prior art, the embodiments of the invention include the following advantages:

In the embodiment of the present invention, a system control including an interface element related to a current scene is displayed, an operation instruction fed back through the system control is received, and then the operation instruction is responded, thereby simplifying operation of the user within the application or between applications. The process is controlled by the system control to assist the user to perform operations and improve the efficiency of use.

1002‧‧‧Control display module

1004‧‧‧Instruction Receiver Module

1006‧‧‧Response module

11011‧‧‧Input judgment module

1102‧‧‧Control display module

11022‧‧‧Element Determination Sub-module

11024‧‧‧Interface custom submodule

11026‧‧‧suspension window display submodule

1104‧‧‧Instruction Receiver Module

11042‧‧‧Command Judgment Module

11044‧‧‧Control processing sub-module

1106‧‧‧Response module

1210‧‧‧ memory

1220‧‧‧ display

1230‧‧‧ Processor

1240‧‧‧ input unit

1241‧‧‧ touch screen

1200‧‧‧Smart Terminal

1 is a flow chart of the steps of an embodiment of the data processing method of the present invention; FIG. 2 is a schematic diagram of a first interface of the embodiment of the present invention; FIG. 3 is a schematic diagram of a second interface of the embodiment of the present invention; FIG. 5 is a flow chart showing the steps of the upper sliding gesture receiving in the embodiment of another data processing method of the present invention; FIG. 6 is another embodiment of the data processing method in the present invention. FIG. 7 is a schematic diagram of a third interface according to an embodiment of the present invention; FIG. 8 is a schematic diagram of an auxiliary control auxiliary operation according to an embodiment of the present invention; FIG. 9 is another assistant control assisted by an embodiment of the present invention. FIG. 10 is a structural block diagram of an embodiment of a data processing apparatus according to the present invention; FIG. 11 is a structural block diagram of another embodiment of a data processing apparatus according to the present invention; and FIG. 12 is a structural block diagram of an embodiment of a smart terminal according to the present invention.

The present invention will be further described in detail with reference to the accompanying drawings and specific embodiments.

One of the core concepts of the embodiments of the present invention is to provide a data processing method, apparatus, and smart terminal to solve the problem of cumbersome operation in a smart terminal. Displaying a system control including an interface element related to the current scene, receiving an operation instruction fed back through the system control, and then responding to the operation instruction, thereby simplifying a user's operation flow within the application or between applications, and being used by the system control Perform operations to improve usage efficiency.

In the embodiment of the present invention, the smart terminal refers to a terminal device having multimedia functions, and the devices support functions in audio, video, data, and the like. In this embodiment, the smart terminal has a touch screen, including a smart mobile terminal such as a smart phone, a tablet computer, a smart wearable device, or a smart TV with a touch screen, a personal computer, and the like.

 Embodiment 1  

Referring to FIG. 1 , a flow chart of steps of an embodiment of a data processing method of the present invention is shown, which may specifically include the following steps:

Step 102: Display a system control, where the system control includes an interface element related to the current scene.

When the user uses the smart terminal, the application can be selected on the main interface such as the desktop, or the corresponding operation can be performed in the application. In order to facilitate the user to use the smart terminal, the embodiment of the present invention adds a system-level assistant control, that is, a system control, to the smart terminal. The system control is a system-level control that can be displayed in various application scenarios of the smart terminal, such as display on the system desktop, and display during application use.

In the use of the smart terminal, the user can display the system control in order to assist the user, such as performing target input in the current scene, such as sliding from the bottom, shaking, and detecting that the user has query requirements. In this embodiment, the system control displays an interface element, which can assist the user to perform a corresponding function, such as performing an operation in the current scene, and calling other applications, etc., and therefore, the interface element is related to the current scene.

Step 104: Receive an operation instruction fed back through the system control.

Step 106, responding to the operation instruction.

After the system control is displayed, the user can trigger the interface element in the system control to perform the corresponding function, so the system control generates a corresponding operation instruction based on the trigger, receives the operation instruction, and responds to the operation instruction. For example, the system control processes the operation instructions by itself, and the system control forwards the operation instructions to the application of the current scene for processing, thereby simplifying the operation flow of the user in the application or between the applications, and improving the efficiency.

In summary, a system control that includes an interface element related to a current scene is displayed, receives an operation instruction fed back through the system control, and then responds to the operation instruction, thereby simplifying a user's operation flow within the application or between applications, by the system Controls help users perform operations and increase efficiency.

 Embodiment 2  

Based on the above embodiments, the present embodiment details the user operation assistance method based on the system control.

In the process of using the smart terminal, the user can start the system control at any time in any scene. For example, the system control is a personal assistant, and the personal assistant is not used as a single application, and can be called out at any time in various application scenarios to provide assistance to the user. .

In any application scenario, the mobile terminal can start the personal assistant's system control by sliding the target input, such as sliding from the bottom of the screen. The system control can display different recommendation results according to the current user's application scenario. For example, launching the system control in the contact application will recommend the most recently used contact, and the system control can receive the user's voice input to complete the user's request.

As shown in FIG. 2, in the address book application, the system control of the personal assistant is started by the target input, and the information label of “Li Si” and “Zhang San” is displayed in the display interface of the system control, and the voice button is displayed in the lower right corner. It is convenient for users to directly input voice. Thus, the user can select a news tag or a voice button in the system control to trigger a corresponding operation instruction, and the system control assists the user in performing the operation. For example, if the user clicks on the "Les" information label, an operation instruction for triggering "Lees" can be generated, and the application can be forwarded to the address book application to display the communication information of "Li Si" or directly call "Lee". For another example, if the user enters the “call to Zhang San” through the voice button, the system control recognizes the voice signal and forwards it to the address book application to dial the “Zhang San” phone.

When the current scene is an address book application, the information label includes at least one of the following: a common contact person label, a recent call contact person label, and a contact person group label, and the function button includes: a voice button. A common contact person may include a contact person who frequently talks, and a recent call may include a contact person who has called for the most recent time, such as a day, and the contact group may include a pre-configured contact group such as a friend, a relative, a colleague, and the like.

As shown in FIG. 3, when the smart terminal displays the system desktop and receives the target input, the interface element related to the current interface information is determined, and the display interface of the customized system control is displayed. For example, in the system control, the information labels such as "Application Center", "Theme Center", "Camera", "Video", and the voice button are displayed in the lower right corner, so that the user can directly input voice. Thus, the user can select a news tag or a voice button in the system control to trigger a corresponding operation instruction, and the system control assists the user in performing the operation. For example, if the user clicks on the "camera" information tag, an operation command to start the camera can be generated, and the operation command is sent to the current system desktop to start the camera application and exit the system control. For another example, the user enters “tell a joke” through the voice button, and the system control opens its own main page, and the main page displays or plays the corresponding joke.

When the current scenario is a system desktop, the information tag includes at least one of the following: an entry tag of the recommended application, an entry tag of the most frequently used application, and the function button includes: a voice button. The most commonly used application can count the number of times the user uses the application for a certain period of time; the recommended application can be recommended according to the user's needs, application type, etc., such as recommended tool applications, communication applications, and the like.

The operation of the user actively triggering the startup system control to provide auxiliary functions is as follows:

Referring to FIG. 4, a flow chart of steps of another embodiment of the data processing method of the present invention is shown, which may specifically include the following steps:

Step 402, receiving a target input.

In this embodiment, the target input includes an active start input and a passive start input; as an example, the passive start may be a user actively launching a system control, wherein the passive start input includes a sliding gesture, a click on a floating button, a shaking operation, or Touch screen double-click operation, etc.; as an example, the active startup may be to start the system control when the user does not actively initiate the system control, according to the user's other input, and the user may need to use the system control. The active start input may include: sliding the input at least once. The upsliding gesture may be an operation in which the user slides from the bottom up in the touch screen by using a finger or a stylus. And the system control can be configured with a quick start icon such as a floating button, and the system control can be started by clicking on the floating button. The shaking operation may include shaking the operation of the smart terminal, and detecting the shaking operation by a sensor built in the smart terminal. Other preset operations can also be performed on the touch screen as target inputs, such as double-click operations, long press operations, and the like. The active start input may be an input that determines that the user has a query requirement in the current application, such as receiving the same or similar sliding input multiple times, and the sliding input may be left to right, from top to bottom, and repeatedly folded. To the input of the display interface of the current application, such as sliding, the query of the user performing the information in the current application is determined by at least one sliding input.

In an optional embodiment of the present invention, the above sliding gesture is taken as an example. For the target input, the sliding information on the touch screen can be acquired, and whether the sliding gesture is determined according to the sliding information. That is, by adding code in the system to obtain the sliding information on the touch screen, the sliding information includes information such as the sliding distance and the sliding direction, and then determining whether it is a sliding gesture based on the sliding distance and the sliding direction. As shown in FIG. 5, the following sub-steps are specifically included:

Sub-step 502: Acquire sliding information on the touch screen.

Sub-step 504, determining whether the sliding direction is sliding upward from the bottom.

The sliding information of the sliding operation on the touch screen is obtained, and the sliding direction of the sliding operation is determined, that is, whether the sliding direction is sliding upward from the bottom.

If yes, that is, the sliding direction is sliding upward from the bottom, performing sub-step 306; if not, the sliding direction is not sliding upward from the bottom, ending the process, and feeding the sliding information to the system, so that the system processes the sliding information, such as forwarding Process the current application.

Sub-step 506 determines whether the sliding distance reaches a target distance.

When the sliding direction is upward sliding from the bottom, the direction is determined to be upward sliding, and then it is determined whether the sliding distance reaches the target distance, that is, in the process of continuously receiving the sliding operation, the sliding distance is calculated by the coordinates of the initial sliding and the coordinates of the current position. , to determine whether the target distance is reached.

If so, that is, the sliding distance reaches the target distance, sub-step 508 is performed, and if not, the flow is ended.

Sub-step 508 determines whether the sliding time meets the target time range.

When the sliding distance reaches the target distance, the sliding time from the initial sliding to the current position is also determined, and it is determined whether the sliding time satisfies the target time range.

If yes, that is, the sliding time meets the target time range, sub-step 510 is performed; if not, that is, the sliding time does not satisfy the target time range, and the process is received.

Sub-step 510, determining to be an up-slide gesture.

It is determined that the sliding distance reaches the target distance, and the sliding time satisfies the target time range, and the sliding operation is determined to be one of the target input.

For example, in this embodiment, the target distance can be configured to be 1/3 of the height of the status bar, and the target time range is within 500 ms. When the user starts to slide from the bottom of the screen, the sliding distance exceeds 1/3 of the height of the status bar, and the sliding is performed. When the time of the distance does not exceed 500 ms, it is judged to be a valid sliding, that is, an upward sliding gesture.

Among them, in order to accurately determine the user's query demand, multiple sliding inputs can be detected continuously. In an optional embodiment of the present invention, the sliding input is taken as an example to obtain the sliding information on the touch screen, and the sliding information input is used to determine whether it is an active starting input, that is, a sliding input having a query requirement. That is, by adding code in the system to obtain the sliding information on the touch screen, the sliding information includes information such as sliding distance, sliding direction and sliding time, and then determining whether it is a sliding input based on the sliding distance, the sliding direction and the sliding time. As shown in FIG. 6, the following sub-steps are specifically included:

Sub-step 602: Acquire sliding information on the touch screen.

Sub-step 604, determining a target sliding operation according to the sliding direction.

Sub-step 606 determines whether the sliding time of the target sliding operation exceeds a preset time.

The sliding information of the sliding operation on the touch screen is obtained, that is, the sliding direction and the sliding distance are determined as the sliding information according to the coordinates of each point of the sliding track. Then, the current sliding operation is swept as a target according to the sliding direction, for example, the sliding or sliding operation in the address book application is used as the target sliding operation, and the left sliding or right sliding operation of the system desktop is taken as the target sliding operation.

While determining the sliding distance and direction, it is also possible to determine the sliding time, that is, the time from the start of sliding to the sliding to the current position, and whether the sliding time of the target sliding operation exceeds the preset time.

If so, i.e., the sliding time of the target sliding operation exceeds the preset time, sub-step 608 is performed; if not, returning to sub-step 606 continues to determine the sliding time.

Sub-step 608 records the sliding input of the target sliding operation.

When the sliding time of the target sliding operation exceeds the preset time, it is determined that the sliding is one effective sliding, that is, one sliding input corresponding to the target sliding operation.

Sub-step 610: Determine whether the corresponding number of sliding input of the target sliding operation exceeds an effective threshold.

Usually, when judging the user's query request, it is judged that the user does not find the required information multiple times. In order to improve the search efficiency, the system control can be used to provide assistance. If the user finds the required information in one query, the user may not Use this system control to provide assistance.

Therefore, the number of sliding inputs can be configured for the target sliding operation. The initial number of sliding times is 0, and the number of sliding times is +1 each time a sliding input is detected, and then it is determined whether the corresponding number of sliding input of the target sliding operation exceeds the effective threshold.

If yes, that is, the corresponding number of sliding input corresponding to the target sliding operation exceeds the effective threshold, sub-step 612 is performed; if not, that is, the corresponding number of sliding input of the target sliding operation does not exceed the effective threshold, and the return sub-step 606 continues to determine the sliding time.

Sub-step 612, determining that the sliding input is an active start input.

The corresponding number of sliding input of the target sliding operation exceeds the effective threshold, and the user is determined to have the query requirement and the required information is not queried. At this time, the target sliding operation of the multiple times is taken as the active start input. Of course, it is also possible to display the system control after determining that more than one sliding input has been received.

In the embodiment of the present invention, the user operates on the touch screen, and adds a gesture judgment code to the PhoneWindow.java file of the operating system such as the YUNOS system to determine whether it is a slide from the bottom of the screen, etc., when the condition is met. Start system controls such as personal assistant controls via the startService method. The personal assistant control is a system-level user-assisted control that assists the user in performing various operations such as voice input operations, command input operations, and the like.

Among them, PhoneWindow is the parent of all views on each smart terminal, that is, the parent view, all the touch operations, that is, the touch event will be first passed to the parent view, and then passed to his child view, so that it can be intercepted in the parent view. The gesture operation of the person can realize the personal assistant control in any scene, thereby realizing the systemization of the personal assistant control, that is, the implementation of the system control is intercepted in the parent view.

Step 404, determining interface elements related to the current scene.

Step 406: Customize a display interface of the system control according to the interface element.

Step 408: Start a floating window by using an application interface of the current application as a background, and display a display interface of the system control in the floating window.

In this embodiment, the step of determining an interface element related to the current scene includes: obtaining interface information or an application package name of the current application; determining at least one interface element according to the application package name or interface information: an information label, a function button.

When receiving the target input in the smart terminal, the current scene may be the scene in which the application is being used, or the scene in the system desktop, and the interface elements displayed in the system control are related to the current scene, so the application package name may be obtained when the application is currently running. When the system interface such as the system desktop is currently located, the interface information can be obtained, such as the main interface or the application display interface. The interface element is then determined based on the application package name or interface information. In this embodiment, the interface elements include information tags and/or function buttons.

The information label is the recommended label information. For example, the data can be configured based on the history of the current scene. For example, the function entry of the application, the recommendation option, and the like can be included. Therefore, the information label can be used to execute the corresponding function in the current application, or can be jumped to other apps. The function button may be related or unrelated to the current scene, for example, the function button includes a voice button, a shooting button, a shutdown button, and the like.

When the current scene is an album application, the information tag includes at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, and the function button includes: a voice button. Intercepting the screen may include capturing snapshot images of various display contents of the screen. The most recent shooting may include photos taken in the most recent event. For example, within a month, the specific ordering may be sorted according to time, content, etc., and the mark may include photos pre-marked by the user, such as Mark as like and so on.

In this embodiment, the display interface of the system control is customized according to the interface element, so that the interface element related to the current scene is displayed in the display interface of the system control, and of course, some common interface elements may also be included. Then, a floating window is started, and the floating window is in the background of the current scene. Currently, the system desktop displays the floating window in the background of the system desktop. If the current scene is an application, the current application interface is used as the background to start the floating window. The display interface of the system control is displayed in the floating window.

In this embodiment, the bottom layer of the system control, such as the personal assistant control, is implemented as a service, so it can be started by the startService. When the control starts, it will first get the package name of the current application (activity), and then create a different display interface according to the package name to display the customized system control.

As shown in FIG. 7 , when the current scenario is set by the system, the information tag includes at least one of the following: an entry tag of a recommended setting, an entry tag of a most frequently changed setting, and the function button includes: a voice button. The system device can be regarded as a system application. The recommended settings can be recommended based on user requirements, such as Bluetooth, WiFi, and other data connection settings. The most frequently changed settings can be statistics devices that users frequently change during a period of time. When the user adjusts the system settings, the target input is sent through the swipe gesture. At this time, the interface elements related to the system settings are determined. For example, some functions in the system settings constitute information tags, including “wallpaper”, “ring tone”, “account”, “storage”. Etc., also set the voice button to receive voice input.

Step 410: Receive an operation instruction according to triggering an interface element in the system control.

The operation control is received by the system control by feeding back corresponding operation instructions, that is, the user can trigger an interface element in the system control, and receive a corresponding operation instruction according to the interface element. If the triggered information tag is a function entry of an application, an operation instruction for starting the application is generated, and if the triggered information tag is a recommended option related to the current application, an operation instruction forwarded to the current application is generated, and if triggered, When the function button is a voice button, an operation command is generated according to the input.

Taking a voice button as an example, in an optional embodiment of the present invention, a voice signal is received based on a trigger of a voice button; the voice signal is identified, and an operation instruction is generated according to the recognized text data.

The user can trigger a voice button to input a voice signal, and the system control receives the corresponding voice signal based on the trigger of the voice button, and then recognizes the voice signal, such as performing feature extraction and matching on the voice signal to identify the corresponding text data. Then, based on the text data, an operation instruction is generated, such as an instruction to find information, an instruction to enter an application, and the like.

Then, in response to the operation instruction, the processor of the operation instruction may be analyzed, and the operation instruction is distributed to the processor for processing, wherein the processing party includes: a current application or a system control. That is, whether the analysis of each operation instruction is processed by the current application or the system control processes itself, thereby performing different response operations, as follows:

Step 412: Detect whether the current application can process the operation instruction.

Determining whether the current application can process the operation instruction, that is, whether the operation instruction is an instruction for the current application, as shown in FIG. 2, the current application is an address book, and the user clicks the information label “Zhang San” to determine that it is the current application instruction. On the other hand, if the user inputs a voice "photograph" through a voice button, it is determined that the current application operation instruction is not.

If yes, that is, the current application can process the operation instruction, step 414 is performed; if not, that is, the current application cannot process the operation instruction, and step 416 is performed.

Step 414, distributing the operation instruction to the current application.

If the current application is capable of processing the operation instruction, the current application is treated as a processing party, the operation instruction is forwarded to the current application, and the system control is exited, and the operation instruction is executed by the current application, as shown in FIG. 2 "Communication information, or directly call "Zhang San" phone.

The operation instruction includes a query message in the current scene. A corresponding query message is generated by the system control to assist the user to perform a query operation, that is, the user can trigger an interface element in the system control, and receive corresponding query data, such as a keyword, according to the interface element, to generate a corresponding query message. If the triggered information tag is a recommended tag of the function entry of an application, a query message for querying the function entry is generated, and if the triggered information tag is a recommended tag of the query keyword in the current application, the tag corresponding to the query is obtained. The word generates a query message containing the query keyword, and if the triggered function button is a voice button, the received voice signal is determined to determine the query data generation query message.

In the embodiment of the present invention, the information label includes a query label, a recommendation label of a function portal, and the like, and the function button includes a voice button, a shooting button, and the like. Query messages can be assisted by user queries in different ways for different information tags and function buttons. When the information tag is a query tag, the query message generated according to the triggering of the interface element includes: receiving a query message generated by using the query keyword based on triggering the query keyword on the query tag.

The query tag can provide the user with the following query keywords, such as displaying the information of the common contact person in the scene of the address book application, or grouping the contacts, so that the user can click on a query tag to trigger the query keyword. The query receives the query keyword corresponding to the query keyword based on the triggering of the query label, and uses the query keyword to generate a query message. Thereby, the user can be provided with a query recommendation to assist the user in querying.

When the function button is a voice button, the query message generated according to the triggering of the interface element includes: receiving a voice signal based on triggering a voice button; identifying the voice signal, determining a query keyword, and adopting The query keyword generates a query message. The user can trigger a voice button to input a voice signal, and the system control receives the corresponding voice signal based on the trigger of the voice button, and then recognizes the voice signal, such as performing feature extraction and matching on the voice signal to identify the corresponding text data. And determining a query keyword based on the text data, and generating the query message by using the query keyword.

The information tag is a recommended tag of the function entry, and the query message generated by triggering the interface element includes: receiving the application information by triggering the information tag, and generating the query message by using the application information. In some application scenarios, the user can find the application or find some functions provided by the application. Therefore, the information label can also be the recommended label of the function portal. As shown in the system setting of FIG. 2, each setting option can be recommended. The user can click on the corresponding recommended label to query and enter the function. Therefore, by triggering the information label, that is, the recommendation label, the function entry corresponding application information is received, and the application information is used to generate the query message.

Then, the query message is responded to, and the processing party of the query message may be determined according to the current application scenario, where the processing party includes: the current application or the system control itself. That is, for each query message analysis, the current application executes the query, or the current system desktop, system settings, etc., or the system control directly executes the query, thereby performing different response operations, as follows:

In an optional embodiment of the present invention, the processing of the query message by the system control includes: transmitting the query message to a processor of a current scene; and processing the current scene from the query message. The query keyword is obtained, and the query is performed according to the query keyword, and the corresponding query result is displayed. The processing party of the current scenario includes a current application, a system desktop, and the like.

When the address book application, the photo album application, and the like are the current scenes, the user usually queries the information in the current application, so the system control sends the query message to the current application, and the current application obtains the query keyword from the query message, according to the The query keyword searches for information, such as finding contact information, chat records, photos, etc., and displays corresponding query results.

The current application can process the query message, that is, whether the query message is a query for the current application. If the current application can process the operation instruction, the query message is distributed to the current application and the system control is exited, and the current The application executes the operation instruction. If the current application cannot process the query message, the system control can perform the query message to find the corresponding information. For example, for the query message generated by the recommended label that triggers the function entry, the system control can initiate the function of the corresponding application or application of the function entry.

In another optional embodiment of the present invention, the processing of the query message by the system control includes: determining, by the system control, application information corresponding to the target application in the query message, jumping to the target application, and exiting The system control.

When the application message is included in the query message, it is usually to open an application or enter a function in the application, so the system control can determine that the application information corresponds to the target application, then jump to the target application and exit the system control.

For example, the system control can open its own main page, which displays various auxiliary function information that can be provided to the user, and then exits the system control, and the main page provides assistance for the user. For example, the query message generated by the trigger of the function label corresponding to the recommended label usually includes application information, so that the application information is determined to correspond to the target application, and then jumps to the target application and exits the system control, and the target application Execute the query content corresponding to the query message.

Thus, through the system control assistant control of the system control, the user query requirements are automatically detected and started in various query scenarios, and the display interface is customized for different query scenarios. When the user needs help in a certain query scenario, the user is actively activated to assist the user in completing the query. The personal assistant acts as a system-level control that interacts deeply with the application.

In step 416, the operation instruction is distributed to the system control for processing.

When the current application cannot process the operation instruction, the system control itself is used as a processing party, and the operation instruction is distributed to the system control for processing. The system control then analyzes the operational command to determine the specific operational requirements of the operational command to determine the actual processing operation. specific:

One way of processing is to jump to the corresponding control page of the system control to process the operation instruction and exit the system control. The system control can open its own main page, which displays various auxiliary function information that can be provided to the user, and then exits the system control, and the main page provides assistance for the user. Another processing manner is: the system control determines that the operation instruction corresponds to the target application, jumps to the target application, and exits the system control. For the information dart flag such as the application portal, the system control determines that the operation instruction is to jump to other applications, so first determining that the operation instruction corresponds to the target application, then jumping to the target application and exiting the system control, and executing by the target application The operation instruction.

Take the scenario of finding contact information in the address book as an example, as shown in Figure 8. The user can swipe up and down in the address book to find the contact person, but it is more difficult to find the contact person because of the more sliding. You can also click on the first letter of the last name, but the first letter of the last name is usually small, so it is easy to click and re-click. Taking the sliding search as an example, if three or more consecutive slides are made in the address book, or when repeated fold-to-slides (ie, up and down slide search) are detected, it is determined that the user has a search requirement, and the address book can be associated with Query labels, as well as function buttons as interface elements, display customized system controls. When the current scenario is an address book application, the information tag includes at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, and the function button includes: a voice button. A common contact person may include a contact person who frequently talks, and a recent call may include a contact person who has called for the most recent time, such as a day, and the contact group may include a pre-configured contact group such as a friend, a relative, a colleague, and the like.

As shown in FIG. 2, in the address book application, the system control of the personal assistant is started by the target input, and the user can select the information label or the voice button in the system control to trigger the corresponding query message, and the system control assists the user to perform the operation. . For example, if the user clicks on the "Les" information tag, the query message triggering "Lees" can be generated, forwarded to the address book application query and displayed "Li Si" communication information or directly dialed "Li Si" phone. For another example, if the user inputs “call to Xiao Zhang” through the voice button, the system control recognizes the voice signal, and then forwards the call to the address book application and dials “Xiao Zhang”.

On the contact list page, when there is continuous sliding or repeated folding action, it is considered that the user is not able to find a contact, and will actively display the personal assistant's display interface, and recommend that the user most likely wants The contact person who is looking for, the user can click on the common title, or a voice conversation, which will help the user find the contact person he wants to find.

Take the photo in the album as an example, as shown in Figure 9. Users can swipe up, down, left, and right in the album to find contacts, but it is more difficult to find them because of the more photos. When sliding three times or more in the album for three consecutive times or more, or detecting repeated folding and sliding (that is, sliding back and forth to find), it is determined that the user has a search requirement, and the query label associated with the album and the function button can be displayed as interface elements. Customized system controls. When the current scene is an album application, the information tag includes at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, and the function button includes: a voice button. Intercepting the screen may include capturing snapshot images of various display contents of the screen. The most recent shooting may include photos taken in the most recent event. For example, within a month, the specific ordering may be sorted according to time, content, etc., and the mark may include photos pre-marked by the user, such as Mark as like and so on.

The user can select a query tag or a voice button in the system control to trigger a corresponding query message, and the system control assists the user in performing the operation. For example, if the user clicks the information label of "this month's shooting", a query message for searching the query keyword "this month" may be generated and forwarded to the album, and the album searches for the photo taken this month based on the query message and displays it. For another example, if the user inputs the “intercept screen” through the voice button, the system control recognizes the voice signal and generates a query message for finding the “capture screen” image, and after forwarding the album to the album, the album looks for all the captured screen images and displays.

That is, in the album list page, when there is a continuous sliding or repeated folding action, it is considered that the user is looking for some photos and cannot be found. At this time, the display interface of the personal assistant is actively displayed, and the user is most recommended. Browse photos, users can click on these common headlines, or voice conversations, will help users find the photos they want to find.

When there are a lot of user data, if there are a lot of photos, there are a lot of contacts, etc., it is more difficult to find a specific information. The embodiment of the present invention will infer the intention of the user, actively understand the user's needs, and provide assistance in time to assist the user to quickly find the required information. If you actively remind you to display the title of the most recently taken photo, or mark the title of the favorite photo, the user can click on the title to view the photo directly. If the recommended information label does not meet the user's needs, the user can also directly describe the voice, such as entering a photo taken in May, Hangzhou, to perform a search and provide a photo that meets the demand.

Thus, through the system control assistant control of the system control, the display interface is provided in various application scenarios, and the display interface is customized for different application scenarios. In the use of an application scenario, the user can call out the control at any time when he needs help, and assist the user to complete the corresponding operation. As a system-level control, the personal assistant comes on call and can interact deeply with the application.

It should be noted that, for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequence. Because certain steps may be performed in other orders or concurrently in accordance with embodiments of the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily required in the embodiments of the present invention.

 Embodiment 3  

Based on the above embodiments, the embodiment further provides a data processing apparatus.

Referring to FIG. 10, it is a structural block diagram of an embodiment of a data processing apparatus according to the present invention, which may specifically include the following modules:

The control display module 1002 is configured to display a system control, and the system control includes an interface element related to the current scene.

The instruction receiving module 1004 is configured to receive an operation instruction fed back through the system control.

The response module 1006 is configured to respond to the operation instruction.

In summary, when the target input is received, the system control is displayed, the operation instruction fed back through the system control is received, and then the operation instruction is responded, thereby simplifying the operation flow of the user in the application or between the applications, and is assisted by the system control. Perform operations to improve usage efficiency.

Referring to FIG. 11, a structural block diagram of another embodiment of a data processing apparatus of the present invention is shown, which may specifically include the following modules:

The input determining module 1108 is configured to obtain the sliding information on the touch screen, and determine whether the sliding motion is based on the sliding information. The sliding information includes a sliding distance and a sliding direction.

The control display module 1102 is configured to display a system control, when the target input is received, the system control includes an interface element related to the current scene. The control display module 8011 is further configured to determine an interface element related to the current scene.

The instruction receiving module 1104 is configured to receive an operation instruction fed back through the system control.

The response module 1106 is configured to respond to the operation instruction.

The control display module 1102 includes:

The element determining sub-module 11022 is configured to obtain interface information or an application package name of the current application; and determine at least one of the following interface elements according to the application package name or interface information: an information label, a function button.

The interface customization sub-module 11024 is configured to customize a display interface of the system control according to the interface element.

The floating window display sub-module 11026 is configured to start a floating window by using an application interface of the current application as a background, and display a display interface of the system control in the floating window.

The instruction receiving module 1104 is configured to receive an operation instruction according to a trigger on an interface element in the system control.

In an optional embodiment of the present invention, the instruction receiving module 804 is configured to receive a voice signal based on a trigger of a voice button; identify the voice signal, and generate an operation instruction according to the recognized text data.

The response module 1104 is configured to analyze a processing unit of the operation instruction, and distribute the operation instruction to the processing party for processing, where the processing party includes: a current application or a system control.

The response module 1104 includes:

The command determining module 11042 is configured to detect whether the current application can process the operation instruction; if the current application is capable of processing the operation instruction, the current application is treated as a processing party; and when the current application cannot process the operation The operation instruction uses the system control itself as the processing side.

The control processing sub-module 11044 is configured to jump to the corresponding control page of the system control to process the operation instruction, and exit the system control, and the system control determines that the operation instruction corresponds to the target application, and jumps to the The target application and exit the system control.

In the embodiment of the present invention, the target input includes: an active start input and a passive start input. The passive activation input includes a slide-up gesture, a click on a floating button, a shaking operation, or a touch screen double-click operation. The active start input includes: at least one sliding input.

The input determining module 1108 is configured to determine whether the sliding direction is sliding upward from the bottom; when the sliding direction is sliding upward from the bottom, determining whether the sliding distance reaches a target distance; determining that the sliding distance reaches a target distance When determined, it is determined as a slide-up gesture. The sliding information further includes: a sliding time, the input determining module 1108 is further configured to determine whether the sliding time is up to the target time range after sliding the sliding direction from the bottom.

The input determining module 1108 is configured to obtain sliding information on the touch screen, wherein the sliding information includes a sliding direction and a sliding time; determining a target sliding operation according to the sliding direction; and when the sliding time of the target sliding operation exceeds When the time is preset, the sliding input of the target sliding operation is recorded; when the corresponding number of sliding input of the target sliding operation exceeds the effective threshold, the sliding input is determined to be an active starting input.

When the current scenario is an address book application, the information tag includes at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, and the function button includes: a voice button.

When the current scene is an album application, the information tag includes at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, and the function button includes: a voice button.

When the current scenario is a system desktop, the information tag includes at least one of the following: an entry tag of the recommended application, an entry tag of the most frequently used application, and the function button includes: a voice button.

When the current scene is set by the system, the information tag includes at least one of the following: an entry label of a recommended setting, an entry label of a most frequently changed setting, and the function button includes: a voice button.

 Embodiment 4  

Based on the foregoing embodiment, the embodiment further discloses a smart terminal.

Referring to FIG. 12, a structural block diagram of an embodiment of a smart terminal according to the present invention is shown, which may specifically include the following modules:

The smart terminal 1200 includes a memory 1210, a display 1220, a processor 1230, and an input unit 1240.

The input unit 1240 can be configured to receive digital or character information input by a user, and a control signal. Specifically, in the embodiment of the present invention, the input unit 1240 may include a touch screen 6121, which can collect touch operations on or near the user (such as the user using any suitable object or accessory such as a finger, a stylus, etc. Touching the operation on the screen 1241) and driving the corresponding connecting device according to a preset program. Of course, in addition to the touch screen 1241, the input unit 1240 may also include other input devices such as a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), a mouse, and the like.

The display 1220 includes a display panel. Alternatively, the display panel may be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED). The touch screen can cover the display panel to form a touch display screen. When the touch display screen detects a touch operation on or near the touch screen, the touch display screen is transmitted to the processor 630 to perform corresponding processing.

In the embodiment of the present invention, by calling a software program stored in the memory 1210, and/or a module, and/or a data, the processor 1230 is configured to display a system control when receiving the target input, The system control includes an interface element associated with the current scene; receives an operation instruction that is fed back through the system control; and responds to the operation instruction.

Optionally, the method further includes: determining the interface element related to the current scenario: obtaining the interface information or the application package name of the current application; determining at least one of the following interface elements according to the application package name or the interface information: the information label, the function button.

Optionally, the display system control includes: displaying a display interface of the system control according to the interface element; starting a floating window by using an application interface of the current application as a background, and displaying a display interface of the system control in the floating window .

Optionally, the receiving the operation instruction fed back by the system control comprises: receiving an operation instruction according to a trigger on an interface element in the system control.

Optionally, the function button includes a voice button, and the receiving an operation instruction fed back by the system control includes: receiving a voice signal based on triggering a voice button; and identifying the voice signal according to the recognized text data Generate an operation instruction.

Optionally, the responding to the operation instruction includes: analyzing a processing party of the operation instruction, and distributing the operation instruction to the processing party for processing, wherein the processing party includes: a current application or a system control .

Optionally, the processing of the processing instruction includes: detecting whether the current application can process the operation instruction; and if the current application is capable of processing the operation instruction, using the current application as a processing party; When the current application cannot process the operation instruction, the system control itself is treated as a processor.

Optionally, after the operating instruction is distributed to the system control, the method further includes: jumping to the corresponding control page of the system control to process the operation instruction, and exiting the system control.

Optionally, after the operating instruction is distributed to the system control, the method further includes: the system control determines that the operation instruction corresponds to the target application, jumps to the target application, and exits the system control.

Optionally, the display system control includes: displaying the system control when the target input is received.

Optionally, the target input includes: an active start input and a passive start input.

Optionally, the passive activation input includes a sliding gesture, a click on a floating button, a shaking operation, or a touch screen double-click operation.

Optionally, the method further includes: acquiring sliding information on the touch screen, and determining, according to the sliding information, whether it is a sliding motion gesture.

Optionally, the sliding information includes a sliding distance and a sliding direction.

Optionally, determining whether the sliding direction is a sliding gesture according to the sliding information comprises: determining whether the sliding direction is sliding upward from the bottom; and determining whether the sliding distance reaches a target distance when the sliding direction is sliding upward from the bottom; When it is determined that the sliding distance reaches the target distance, it is determined as an upward sliding gesture.

Optionally, the sliding information further includes: a sliding time, and determining that the sliding direction is sliding upward from the bottom, further comprising: determining whether the sliding time meets the target time range.

Optionally, the active start input comprises: at least one sliding input.

Optionally, the method further includes: acquiring sliding information on the touch screen, wherein the sliding information includes a sliding direction and a sliding time; determining a target sliding operation according to the sliding direction; and when the sliding time of the target sliding operation exceeds a pre- When the time is set, the sliding input of the target sliding operation is recorded; when the corresponding number of sliding input of the target sliding operation exceeds the effective threshold, the sliding input is determined to be an active starting input.

Optionally, when the current scenario is an address book application, the information tag includes at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, and the function button includes: a voice button.

Optionally, when the current scene is an album application, the information tag includes at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, and the function button includes: a voice button.

Optionally, when the current scenario is a system desktop, the information tag includes at least one of the following: an entry tag of the recommended application, an entry tag of the most frequently used application, and the function button includes: a voice button.

Optionally, when the current scenario is set by the system, the information tag includes at least one of the following: an entry tag of a recommended setting, an entry tag of a most frequently changed setting, and the function button includes: a voice button.

For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.

Those skilled in the art will appreciate that embodiments of the embodiments of the invention may be provided as a method, apparatus, or computer program product. Thus, embodiments of the invention may take the form of a complete hardware embodiment, a full software embodiment, or an embodiment combining soft and hardware aspects. Moreover, embodiments of the present invention may employ computer program products embodied on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical memory, etc.) containing computer usable code therein. form.

In a typical configuration, the computer device includes one or more processors (CPUs), input/output interfaces, a network interface, and memory. The memory may include non-permanent memory, random access memory (RAM) and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory ( Flash RAM). Memory is an example of a computer readable medium. Computer readable media, including both permanent and non-permanent, actionable and non-removable media, can be stored by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other materials. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), and other types of random access memory (RAM). Read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM only, digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape storage or other magnetic storage device or any other non-transportable medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-persistent computer readable media, such as modulated data signals and carrier waves.

Embodiments of the invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. The computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine such that instructions are executed by a processor of a computer or other programmable data processing terminal device Means are provided for implementing the functions specified in one or more of the flow or in one or more blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner such that instructions stored in the computer readable memory produce an article of manufacture including the instruction device. The instruction means implements the functions specified in one or more blocks of the flow or in a flow or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device such that a series of operational steps are performed on a computer or other programmable terminal device to produce computer implemented processing for use in a computer or other programmable terminal device The instructions executed above provide steps for implementing the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.

Although the preferred embodiment of the present invention has been described, it will be apparent to those of ordinary skill in the art that various changes and modifications can be made to the embodiments. Therefore, the scope of the appended claims is intended to be construed as a

Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, or terminal device that includes a plurality of elements includes not only those elements but also Other elements that are included, or include elements inherent to such a process, method, article, or terminal device. An element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that comprises the element, without further limitation.

The above is a detailed description of a data processing method, a data processing device and a smart terminal provided by the present invention. The principle and implementation manner of the present invention are described in the following. The description of the above embodiment is only used. To help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific embodiments and application scope. The content should not be construed as limiting the invention.

Claims (45)

 A data processing method includes: displaying a system control, the system control including an interface element related to a current scene; receiving an operation instruction fed back through the system control; and responding to the operation instruction.    The method of claim 1, further comprising the step of: determining interface elements related to the current scene: obtaining interface information or an application package name of the current application; determining at least the following according to the application package name or interface information; An interface element: information tags, function buttons.    The method of claim 1, wherein the display system control comprises: customizing a display interface of the system control according to the interface element; and starting a floating window by using the current application interface as a background, in the floating The display interface of the system control is displayed in the window.    The method of claim 1, wherein the receiving an operation instruction fed back through the system control comprises: receiving an operation instruction according to a trigger on an interface element in the system control.    The method of claim 2, wherein the function button comprises a voice button, and the receiving an operation instruction fed back by the system control comprises: receiving a voice signal based on a trigger on a voice button; The voice signal is identified, and an operation command is generated according to the recognized text data.    The method of claim 1, wherein the responding to the operation instruction comprises: analyzing a processing party of the operation instruction, and distributing the operation instruction to the processing party for processing, wherein The processing party includes: the current application or system control.    The method of claim 6, wherein the analyzing the processing party of the operation instruction comprises: detecting whether the current application can process the operation instruction; and if the current application is capable of processing the operation instruction, The current application is treated as a processing party; when the current application cannot process the operation instruction, the system control itself is treated as a processing party.    The method of claim 6 or 7, wherein after the operating instruction is distributed to the system control, the method further comprises: jumping to the corresponding control page of the system control to process the operation instruction, and exiting the System controls.    The method of claim 6 or 7, wherein the distributing the operation instruction to the system control further comprises: the system control determining that the operation instruction corresponds to the target application, jumping to the target application and Exit the system control.    The method of any one of claims 1 to 7, wherein the display system control comprises: displaying the system control upon receiving a target input.    The method of claim 10, wherein the target input comprises: an active start input and a passive start input.    The method of claim 11, wherein the passive activation input comprises a swipe gesture, a click on a hover button, a panning operation, or a touch screen double tap operation.    The method of claim 12, further comprising: acquiring the sliding information on the touch screen, and determining whether the sliding gesture is based on the sliding information.    The method of claim 13, wherein the sliding information comprises a sliding distance and a sliding direction.    The method of claim 14, wherein determining whether the sliding direction is based on the sliding information comprises: determining whether the sliding direction is sliding upward from the bottom; and when the sliding direction is sliding upward from the bottom, Determining whether the sliding distance reaches a target distance; determining that the sliding distance reaches a target distance is determined as an upward sliding gesture.    The method of claim 15, wherein the sliding information further comprises: a sliding time, determining that the sliding direction is sliding upward from the bottom, and further comprising: determining whether the sliding time meets the target time range.    The method of claim 11, wherein the active start input comprises: at least one sliding input.    The method of claim 17, further comprising: acquiring sliding information on the touch screen, wherein the sliding information includes a sliding direction and a sliding time; determining a target sliding operation according to the sliding direction; When the sliding time of the target sliding operation exceeds the preset time, the sliding input of the target sliding operation is recorded; when the corresponding number of sliding input of the target sliding operation exceeds the effective threshold, determining that the sliding input is an active starting input .    The method of claim 2, wherein, when the current scenario is an address book application, the information tag comprises at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, Function buttons include: voice button.    The method of claim 2, wherein, when the current scene is an album application, the information tag comprises at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, the function Buttons include: voice button.    The method of claim 2, wherein, when the current scenario is a system desktop, the information tag comprises at least one of: an entry tag of a recommended application, an entry tag of a most frequently used application, and the function button Includes: voice button.    The method of claim 2, wherein, when the current scenario is a system setting, the information tag comprises at least one of the following: an entry tag of a recommended setting, an entry tag of a most frequently changed setting, the function button Includes: voice button.    A data processing device includes: a control display module, configured to display a system control, the system control includes an interface element related to a current scene; and an instruction receiving module, configured to receive an operation instruction fed back through the system control; a module for responding to the operation instruction.    The device of claim 23, wherein the control display module is further configured to determine an interface element related to a current scene; the control display module includes: an element determination sub-module, configured to: Obtain interface information or the application package name of the current application; determine at least one of the following interface elements according to the application package name or interface information: information label, function button.    The device according to claim 23, wherein the control display module comprises: an interface customization sub-module, configured to customize a display interface of the system control according to the interface element; and a floating window display sub-module, The application window of the current application is used as a background to launch a floating window, and a display interface of the system control is displayed in the floating window.    The device of claim 23, wherein the instruction receiving module is configured to receive an operation instruction according to a trigger on an interface element in the system control.    The device according to claim 24, wherein the command receiving module is configured to receive a voice signal based on a trigger on a voice button; identify the voice signal, and generate an operation command according to the recognized text data.    The device according to claim 24, wherein the response module is configured to analyze a processor of the operation instruction, and distribute the operation instruction to the processor for processing, wherein the processing The party includes: current application or system control.    The device of claim 28, wherein the response module comprises: an instruction determining module, configured to detect whether the current application can process the operation instruction; and if the current application is capable of processing the operation The instruction uses the current application as a processing party; when the current application cannot process the operation instruction, the system control itself is treated as a processing party.    The device of claim 28 or 29, wherein the response module further comprises: a control processing sub-module, configured to jump to the corresponding control page of the system control to process the operation instruction, And exit the system control.    The device of claim 28 or 29, wherein the response module further comprises: a control processing submodule, wherein the system control determines that the operation instruction corresponds to a target application, and jumps to the The target application and exits the system control.    The device of any one of claims 23 to 29, wherein the input display module is configured to display the system control upon receiving a target input.    The device of claim 32, wherein the target input comprises: an active start input and a passive start input.    The device of claim 33, wherein the passive activation input comprises a swipe gesture, a click on a hover button, a panning operation, or a touch screen double tap operation.    The device of claim 34, further comprising: an input determining module, configured to acquire sliding information on the touch screen, and determine whether the sliding gesture is based on the sliding information.    The device of claim 35, wherein the sliding information comprises a sliding distance and a sliding direction.    The device of claim 36, wherein the input determination module is configured to determine whether the sliding direction is sliding upward from the bottom; and when the sliding direction is sliding upward from the bottom, determining the sliding distance Whether the target distance is reached; when it is determined that the sliding distance reaches the target distance, it is determined as an upward sliding gesture.    According to the device of claim 36, wherein the sliding information further includes: a sliding time, the input determining module is further configured to determine whether the sliding time is after sliding from the bottom upward, and determining whether the sliding time is Meet the target time range.    The device of claim 33, wherein the active activation input comprises: at least one sliding input.    The device of claim 39, further comprising: an input determining module, configured to acquire sliding information on the touch screen, wherein the sliding information includes a sliding direction and a sliding time; Determining a target sliding operation; when the sliding time of the target sliding operation exceeds a preset time, recording is a sliding input of the target sliding operation; when the corresponding number of sliding input of the target sliding operation exceeds an effective threshold, determining The sliding input is the active start input.    The device of claim 24, wherein, when the current scenario is an address book application, the information tag comprises at least one of the following: a common contact tag, a recent call contact tag, and a contact group tag, Function buttons include: voice button.    The device according to claim 24, wherein, when the current scene is an album application, the information tag comprises at least one of the following: an intercepted screen label, a most recently photographed label, a specific sorting label, and a label label, the function Buttons include: voice button.    The device of claim 24, wherein, when the current scenario is a system desktop, the information tag comprises at least one of: an entry tag of a recommended application, an entry tag of a most frequently used application, the function button Includes: voice button.    The device according to claim 24, wherein, when the current scene is set by the system, the information tag comprises at least one of the following: an entry label of a recommended setting, an entry label of a most frequently changed setting, the function button Includes: voice button.    A smart terminal, comprising: a memory, a display, a processor, and an input unit, wherein the input unit comprises: a touch screen; and the processor is configured to execute any one of the above claims 1 to 22 The method described in the item.