CN106909297B - A data communication processing method, device and electronic device, touch display device - Google Patents

Abstract

The application provides a data communication processing method and device, electronic equipment and touch display equipment. The method comprises the following steps: monitoring a control instruction generated by a control action acting on the touch screen, and identifying a user control track; judging whether the user control track meets a preset trigger condition that the first application points to the second application; sending a communication establishment request of the first application when satisfied; after the second application receives the through 4FE1 establishment request, judging whether the state of the second application is a multi-window mode in which an interface is displayed on a front desk of a touch screen; and when the judgment result is yes, establishing a data communication link between the first application and the second application. By utilizing the embodiments in the application, the user can establish a communication link for at least two applications displayed on the screen at the same time through simple gestures, so that the application interaction between different applications in the terminal equipment is fast and convenient, the user operation is reduced, and the user operation and use experience are improved.

Description

A data communication processing method, device and electronic device, touch display device

technical field

The present application belongs to the technical field of data communication, and in particular, relates to a data communication processing method, device, electronic device, and touch display device.

Background technique

With the rapid development of mobile communication technology, applications on various terminal devices such as mobile phones, tablets, and self-service terminals have brought a lot of convenience to people's daily life. For example, users can chat with friends and colleagues in real time through IM software such as QQ, WeChat, DingTalk, etc., can also use browsers to query information, read news, and purchase goods through mobile terminal applications, which greatly facilitates people's daily life. Life.

With the explosive growth of various APP applications, more and more applications are installed in terminal devices, especially mobile terminals. Now users often need to operate and interact between different applications. For example, many applications currently have a content sharing function. For example, when a user uses the news application APP_NEWS to read news, they can share the news to the communication application APP_CHAT, or share the photos in the local gallery to the circle of friends/life circle of social software. The current cross-application content sharing usually requires users to perform multiple cumbersome operations, and is not intuitive and fast enough. For example, when the user shares the news in the news application APP_NEWS to the communication application APP_CHAT, he usually needs to open the news page of the news application APP_NEWS, find the share button in the page menu, and select the share button (at this time, another prompt box usually pops up Let the user choose which app to share to), select the communication app APP_CHAT. Then jump to the window interface of the communication application APP_CHAT, and select to share with the target object (contact or group) in the communication application APP_CHAT. Such a sharing function requires users to operate multiple steps to complete, and the sharing processes of different applications are often different, and even more or less indicative sharing operations are included, which makes the user's operation cumbersome and reduces the user experience. experience.

In the prior art, the user uses a terminal device to perform content sharing across applications, which is cumbersome and not intuitive enough to quickly send content to other applications. Moreover, this kind of content sharing is one-way. After the user shares the content of application A to application B, if he wants to share the content of application B to application A, he has to repeat the above-mentioned tedious sharing operation process, which reduces the cost of use. for operating experience.

SUMMARY OF THE INVENTION

The purpose of the present application is to provide a data communication processing method, device, electronic device, and touch display device. Using the feature that the screen can display multiple application windows at the same time in a multi-window mode, to provide a method that can be At least two applications displayed on the screen at the same time establish a communication link, realize fast and convenient application interaction between different applications in the terminal device, reduce user operations, and improve user operation and use experience.

A data communication processing method, device, electronic device, and touch display device provided by this application are implemented as follows:

A data communication processing method, the method comprising:

Monitor the control instructions generated by the control behavior acting on the touch screen, and identify the user's control trajectory;

Judging whether the user manipulation trajectory satisfies a preset trigger condition for the first application to point to the second application; when the preset trigger condition is met, a communication establishment request for the first application is sent;

After the second application receives the communication establishment request, determine whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen;

When the result of the judgment is yes, a data communication link between the first application and the second application is established.

A data communication processing method, the method comprising:

Monitor the control instructions generated by the control behavior acting on the touch screen, and identify the user's control trajectory;

Judging whether the user manipulation trajectory satisfies a preset trigger condition that the first service item points to the second service item; and when the judgment result is yes, processing the first service item by using the response mode of the second service item business processing requests.

A data communication processing device, the device comprising:

The monitoring module is used to monitor the manipulation instructions generated by the manipulation behavior acting on the touch screen, and identify the user manipulation track;

a trajectory processing module, configured to determine whether the user-controlled trajectory satisfies a preset trigger condition for the first application to point to the second application; and when the preset trigger condition is met, send a communication establishment request of the first application;

A multi-window judgment module, configured to judge whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen after the second application receives the communication establishment request;

A communication establishment module, configured to establish a data communication link between the first application and the second application when the multi-window judging module determines that the result is yes.

A data communication processing device, the device comprising:

The manipulation instruction acquisition module is used to monitor the manipulation instruction generated by the manipulation behavior on the touch screen, and identify the user manipulation track;

A business processing module, configured to determine whether the user manipulation track satisfies the preset trigger condition that the first business item points to the second business item; and is also configured to use the response of the second business item when the judgment result is yes way to process the service processing request of the first service item.

An electronic device comprising:

an event monitoring unit, configured to monitor the manipulation instruction generated by the manipulation behavior acting on the touch screen, and identify the user manipulation track; and also used to judge whether the user manipulation track satisfies the preset trigger condition that the first application points to the second application;

a window state judgment module, configured to judge whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen after the second application receives the communication establishment request of the first application;

A communication link establishment module, configured to send a communication establishment request of the first application when judging that the user manipulation trajectory satisfies a preset trigger condition that the first application points to the second application; When the state is a multi-window mode in which the interface is displayed in the foreground of the touch screen, a data communication link between the first application and the second application is established.

A touch display device, comprising at least a touch screen and a processor,

The touch screen is used for displaying interface information of the application window and sensing the manipulation behavior acting on the touch screen, and sending corresponding manipulation instructions generated by the manipulation behavior to the processor;

The processor is configured to identify the user manipulation trajectory according to the manipulation instruction, and send the communication of the first application when it is determined that the user manipulation trajectory satisfies a preset trigger condition for the first application to point to the second application establishment request; also used for judging whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen after the second application receives the communication establishment request; also used for when the judgment When the result of is yes, establish a data communication link between the first application and the second application.

A touch display device, comprising at least a touch screen and a processor,

The touch screen is used for displaying interface information of the application window and sensing the manipulation behavior acting on the touch screen, and sending corresponding manipulation instructions generated by the manipulation behavior to the processor;

The processor is configured to judge whether the user manipulation trajectory satisfies the preset trigger condition for sending the first service item to point to the second service item; when the judgment result is yes, use the The response mode of the second service item processes the service processing request of the first service item.

A data communication processing method, device, electronic device, and touch display device provided by the present application can utilize the feature that the screen can display multiple application windows simultaneously in the multi-window mode of the terminal device, and judge the user's manipulation behavior on the touch screen. When it is determined that the user needs to perform information interaction between different applications, the communication between the applications is established, so that the user can intuitively establish a communication chain between at least two applications displayed on the screen at the same time through simple and intuitive sliding gestures. road. The application can use the communication link established by the technical solution provided in this application to perform business-level interaction with another application. The specific interaction method/response content can be designed by the business developer according to different scenarios, such as one-click sharing, One-click payment, one-click listening to songs, etc. Obviously, the implementation of the present application can greatly simplify user sharing, search, and other interactions between different applications in more and more terminal devices that support application multi-windows, such as PC terminals and Android/iOS system terminals, and meet user needs. The interaction between these applications can also greatly improve the user terminal control experience and improve the user's product usage perception.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments described in this application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a method flowchart of an embodiment of a data communication processing method provided by the present application;

Fig. 2 is the scene schematic diagram of simultaneously displaying two application window interfaces under a same-screen multi-window mode of the present application;

FIG. 3 is an example application scenario of a user-controlled track covering a window interface of multiple applications of the present application;

4 is a schematic diagram of an application scenario of another embodiment of the present application in which a user manipulation track covers a window interface of multiple applications;

5 is a schematic diagram of a predicted user manipulation behavior corresponding to a preset trigger condition set by the present application;

6 is a schematic diagram of an embodiment of the multi-window mode in which the interface is displayed in the foreground of the touch screen according to the present application;

7 is a schematic diagram of another embodiment of the multi-window mode in which the interface is displayed in the foreground of the touch screen according to the present application;

8 is a schematic diagram of another embodiment of the multi-window mode in which the interface is displayed in the foreground of the touch screen according to the present application;

9 is a schematic diagram of a scenario in which a user implements cross-application communication establishment through gesture sliding according to the present application;

10 is a method flowchart of another embodiment of a data communication processing method provided by the present application;

11 is a schematic diagram of a scenario in the present application in which a user adopts a click manipulation behavior to realize cross-application communication in a multi-window mode;

12-1 is a schematic diagram of another scenario of the present application in which a user adopts a click manipulation behavior to realize cross-application communication in a multi-window mode;

Figure 12-2 is a schematic diagram of a scenario of the present application for realizing cross-application communication in a multi-window mode through user sliding;

FIG. 13 is a schematic diagram of an implementation flow of an embodiment scenario of a data communication processing method described in the present application;

14 is a method flowchart of another embodiment of a data communication processing method provided by the present application;

15 is a schematic diagram of an application scenario of another embodiment of a data communication processing method provided by the present application;

16 is a schematic diagram of a module structure of an embodiment of a data communication processing apparatus provided by the present application;

17 is a schematic diagram of a module structure of another embodiment of a data communication processing apparatus provided by the present application;

FIG. 18 is a schematic structural diagram of an embodiment of a touch display device described in the present application;

FIG. 19 is a schematic structural diagram of an embodiment of a touch display device described in the present application.

Detailed ways

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described The embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of this application.

FIG. 1 is a method flowchart of an embodiment of a data communication processing method described in the present application. Although the present application provides method operation steps or device structures as shown in the following embodiments or drawings, more or less operation steps or module units may be included in the method or device based on routine or without creative work. . In the steps or structures that logically do not have a necessary causal relationship, the execution order of these steps or the module structure of the device is not limited to the execution order or module structure shown in the embodiments of the present application or the accompanying drawings. When the described method or module structure is applied to an actual device or terminal product, it can be executed sequentially or in parallel according to the method or module structure shown in the embodiments or the accompanying drawings (for example, a parallel processor or a multi-threaded processing environment). , even including the implementation environment of distributed processing).

A specific implementation application scenario is shown in FIG. 1 , an embodiment of a data communication processing method provided by the present application may include:

S1: Monitor the manipulation instruction generated by the manipulation behavior acting on the touch screen, and identify the user manipulation track.

In the application scenario of this embodiment, the terminal device may support a multi-window mode. For example, in the multi-window mode of a certain system version of Android, the screen can display two application window interfaces at the same time, as shown in FIG. 2, the search application and the news application are displayed at the same time. Scenario diagram showing two application window interfaces. Of course, other embodiments of the present application do not exclude implementations in which two or more application window interfaces are simultaneously displayed on the same screen. For example, some tablet computers currently support a multi-window mode in which four application window interfaces are simultaneously displayed on the same screen. Generally, the terminal device may include a mobile communication terminal, a tablet computer, a PC, a handheld device, a PDA, a self-service terminal, a server, a business system, and the like. The terminal device may generally include a touch screen (also referred to as a touch screen or a touch panel). The touch screen described in the embodiments of the present application includes a device that can receive an input signal and display information, such as a device that can receive a stylus, Inductive liquid crystal display device for input signals such as human body touch and light intensity sensing. Generally, the touch screen is provided with a set of transparent absolute positioning system, which can realize the detection of touch, sliding, etc. acting on the touch screen, and realize positioning according to the coordinates.

The user can perform a series of manipulation actions on the application on the touch screen of the terminal device, such as clicking, sliding, long pressing, or multi-touch. These manipulation behaviors acting on the touch screen can generate corresponding manipulation instructions, so that the processing unit can recognize the user's manipulation behavior, and then make a corresponding response. In this embodiment of the present application, the manipulation instructions generated by the manipulation behavior of the user acting on the touch screen can be monitored, such as the user's clicking on the title, sliding pages, etc. when using the news application in the terminal device, and the terminal device can monitor these user actions. The manipulation instruction generated by the manipulation, and then the corresponding user manipulation trajectory is identified. Generally, when the user performs operations such as clicking, sliding, etc. on the touch screen, the window interface of the operation object, such as a news reading application, instant messaging application, picture viewing application, payment application, etc., is displayed in the foreground of the touch screen. of. In one embodiment, it can also be understood that the service window interface of the application controlled by the user at the current moment is displayed in the foreground of the touch screen. The touch screen is displayed in the foreground.

In the application scenario of the embodiment shown in FIG. 2 , the manipulation behavior acting on the touch screen may include the manipulation behavior of directly sliding on the touch screen through the user's limb as shown in FIG. 2 . In other embodiments of the present application, the touch behavior may also include operations such as clicking, sliding, and the like performed by the user on the touch screen using a touch device, such as a stylus, a laser light, or other auxiliary tools. Even, the present application does not exclude other embodiments in which the user's limb does not directly contact the touch screen, but uses photoelectric induction, magnetic induction, etc. to identify the manipulation behavior of the user's space connection on the touch screen. Therefore, in an embodiment of the data communication processing method described in this application, the manipulation behavior acting on the touch screen includes at least one of the following implementations:

S101: a manipulation behavior of touching the touch screen with a user's body;

S102: a manipulation behavior of touching the touch screen by a touch device;

S103 : the manipulation behavior of the compartment contact identified by the body sensing on the touch screen.

In a specific implementation process, the user can perform operations by touching the touch screen with fingers, or even other limbs such as nose, toes, and ears, such as clicking, sliding, long-pressing, and the like. Alternatively, the user can also use a stylus pen (such as a capacitive pen), a laser pen (such as emitting light to the touch screen for sliding), a magnetic or light-sensing pen and other devices to contact the touch screen to operate applications in the terminal device. Of course, in some embodiments, the manipulation behavior acting on the touch screen described in the present application may further include manipulation behavior acting on the screen by the user in a space-interval contact manner, such as a recognized user's body sensing action. Specifically, for example, the user makes a sliding gesture on the touch screen at a certain distance. Although the user's finger does not directly touch the touch screen at this time, the terminal device in the application scenario of the data communication method provided by the embodiment of the present application can still recognize that the user has executed The manipulation behavior of swiping a distance, and translates it into a user manipulation trajectory.

It should be noted that the space connection described in the above embodiment may include that the indirect medium between the operator of the manipulation behavior (such as a finger or a palm) and the touch screen is air, but the space connection described in this embodiment mainly acts as a Refers to the manipulation action performed by the executor of the manipulation behavior on the application of the terminal device without direct contact with the touch screen. Therefore, the space described in this embodiment is not the case where the special medium is air. In other implementation scenarios, there may also be other media, such as water, oil, etc., or even a vacuum between the executor of the manipulation behavior and the touch screen.

In addition, the manipulation behavior acting on the touch screen includes any one or a combination of the various manners listed above. Of course, other manners of manipulation behavior may also be included according to the development of information technology. In other embodiments, the implementation of one or more operation behaviors is not excluded. For example, the user presses and holds a position area of an application on the touch screen with one hand, and the other hand uses a limb sensing method to move to a position of the touch screen in the air. Swiping sideways for a certain distance, and similar implementation scenarios still belong to the manipulation behavior acting on the touch screen as described in the application.

In an embodiment of the data communication processing method described in this application, an operation instruction generated by a manipulation behavior directly or indirectly acting on a touch screen can be monitored, and then a corresponding user manipulation trajectory can be identified. The control trajectory may be continuous, or may be a discontinuous trajectory within a certain period of time, or a multi-point, multi-segment, and combined discontinuous trajectory, or the like.

S2: Determine whether the user manipulation trajectory satisfies a preset trigger condition for the first application to point to the second application; when the preset trigger condition is met, send a communication establishment request of the first application.

As described above, in an embodiment of the present application, the terminal device can monitor the manipulation behavior of the user directly or indirectly acting on the touch of the terminal device, and can obtain corresponding manipulation instructions. The terminal device can support a multi-window mode on the same screen, specifically, an application interface of two or more applications can be displayed simultaneously on a mobile phone or a tablet computer, as shown in FIG. 2 . In the embodiment of the present application, a preset trigger condition for the first application to point to the second application may be preset, which may specifically include various manipulation gestures performed by the user on the touch screen, such as pressing and holding a certain page element in the application and then moving to another An app slides a certain distance. At this time, whether to trigger a manipulation event in which the first application points to the second application may be triggered according to the manipulation behavior of the user on the touch screen. The preset trigger condition for the first application to point to the second application may be set in advance according to the scene or design requirements, so that the terminal device or application can identify whether the user's manipulation behavior conforms to the set manipulation event.

In one embodiment, it can be agreed that the application that the user is currently operating (or the currently activated front-end window) is the first application, and the application that needs to interact with the first application is defined as the second application, such as sharing or searching if necessary. The application of the manipulation behavior performed by the user in the first application. A specific example is that the news application displayed on the front end of the mobile phone screen at the current time T1 for the user to read is defined as the first application, or the application corresponding to the application interface currently operated by the user at the current time T1 is the first application. In this scenario, the user needs to send the content in the information application A to the search application B displayed on the same screen at this time, and the corresponding search application B may be the second application defined in this embodiment. If the user operates the search application B at another time T2, it is necessary to send a certain search result R of the search application B to the news application A displayed on the same screen at this time, so as to check the search results R of the search application B by the news application A. , the search application B is the first application defined in this embodiment, and the news application A is the corresponding second application.

Certainly, in some other embodiments of the present application, the second application corresponding to the first application may not be limited to one application. As shown in Figure 3, the user starts from a certain starting point of the window interface in application A at time T1, continuously slides through application C and stops at the window interface of application B at time T2, and obtains the sliding track S1=A-C-B. Figure 3 shows the user of the application The application scenario of the embodiment in which the manipulation track covers the window interfaces of multiple applications. The sliding track of the user can be irregular semicircle, arc or irregular line segment, etc. Then, application A at time T1 can be defined as the first application, and both application B and application C that the S1 track passes through can be the second application corresponding to when application A is the first application. Therefore, in another embodiment of the data communication processing method described in this application,

S201: The first application is included in the user manipulation track formed by the continuous sliding of the touch screen, and the starting point of the user manipulation track is an application corresponding to the window interface;

Correspondingly, the second application includes an associated application other than the first application, and the associated application includes an application whose window interface covered by the user manipulation track is displayed in the foreground of the touch screen.

Generally, the touch screen is provided with a corresponding coordinate system, usually an absolute coordinate system, so that each pixel on the touch screen has corresponding coordinate information. Various application interfaces, windows and other elements displayed on the touch screen also correspond to corresponding coordinate information, and the user manipulation trajectory data formed by the continuous sliding may also include coordinate information of each pixel in the trajectory. Therefore, in an embodiment of the present application, it can be determined that the continuous sliding track covers the application currently displayed in the foreground of the touch screen according to the user's continuous sliding track and the coordinate information of the application window interface. It should be noted here that the associated application may generally not include the first application corresponding to the starting point of the sliding track, such as a scenario where the starting point and the ending point of the sliding track are not in the same application window interface. However, in some application scenarios, the control used is such that the starting point and the ending point of the sliding track are in the application interface of the same application, for example, the sliding track S2=A-B-C-A, as shown in Figure 4, which shows the user's control track coverage in this application. Another embodiment application scenario of a window interface of an application. Then it can be determined that the application where the sliding track terminal is located is not included in the defined second application, excluding the situation where the second application is the same as the first application, that is, the second application includes associations other than the first application In one embodiment of the application. In the application scenario shown in FIG. 4 , in this embodiment, application A may be used as the first application, and application B and application C may be used as the second application. Of course, the present application does not exclude the situation that the first application and the second application are the same application in some embodiments, and in this case, some corresponding measures may be set according to the design for processing.

In an embodiment of the present application, the data communication processing method may preset a series of manipulation events directed by the first application to the second application. At the same time, preset trigger conditions corresponding to these manipulation events can also be preset. When it is determined that the user's operation trajectory satisfies the preset trigger condition, a manipulation event directed by the first application to the second application can be triggered. For example, in the interface of one application A, slide your finger to the interface of another application A. Or click three times on the interface of application A within 500 milliseconds, and then click once (or multiple times, such as three times) on the interface of another application B to determine to trigger the manipulation event of the first application A pointing to the second application B. Of course, the preset trigger conditions may also include conditions set by other predicted user manipulation behaviors. For example, a predicted user manipulation behavior shown in FIG. 5 may be, FIG. 5 is the corresponding preset trigger conditions set by this application. A schematic diagram for predicting the user's manipulation behavior. The user draws a circle with one finger on the touch screen, and "throws" an element of application A (such as the news title of News_2) into the opposite application B displayed side by side on the same screen, which can indicate the need Communication between the first application A and the second application B is established, so that the second application B can process the elements of the first application that are "thrown". One or more specific preset trigger conditions for the first application to point to the second application can be defined according to user experience or design requirements. When monitoring the user's manipulation instruction, it can identify and determine whether the user's user manipulation trajectory satisfies the preset first set of trigger conditions. An application points to a preset trigger condition of a second application. For example, the user operation can be monitored by registering and activating the listener in the Android system, and the processing unit determines whether the user's sliding track conforms to the preset triggering condition that the first application points to the second application.

In an embodiment of the present application, if it is determined according to the user manipulation track that a manipulation event from the first application pointing to the second application is triggered (for example, the user slides two fingers across the application), the processor can determine that the user executes the manipulation event on the touch screen at this time. For example, the user needs to send the content/elements of the first application to the second application for processing, such as sharing or querying or data copying/migration. At this time, the communication establishment request of the first application may be sent, and the specific manner may include, for example, sending in a broadcast message manner, or directly sending it to the second application in a point-to-point manner.

S3: After the second application receives the communication establishment request, determine whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen.

After the second application receives the communication establishment request sent by the first application, it can determine whether the window interface of the second application is in a multi-window mode, and display it in the foreground window of the touch screen. The main body that specifically executes the judgment logic may be the second application itself judging its current window state, or the same processing system (such as a processing unit in the same mobile phone terminal) where the first application and the second application are located. processing, or third-party judgment logic to execute, etc.

Generally, the window mode may include, for example, that the window interfaces of the first application and the second application are on the same touch screen in the multi-window mode. The window interface of an application, or the window interface of up to four applications can be displayed simultaneously on the same touch screen supported by some tablet computers. FIG. 6 is a schematic diagram of an embodiment of the multi-window mode in which the interface is displayed in the foreground of the touch screen described in the present application. The applications A, B1 and B2 in FIG. 6 are all applications in the same processing server 1 . However, the multi-window mode described in this application does not exclude the embodiment in which multiple application windows are displayed in the foreground on different touch screens. For example, the first application and the second application may belong to the same processing system and be displayed on different touch screen terminals, just like one Multi-screen display of PC host. The same processing system may be a processing unit, module, device including one or more logical units, or a processing system composed of multiple servers, or the same distributed system. In this case, the window interfaces of the first application and the second application may be located on the same touch screen, or may be displayed in a multi-screen display manner, respectively or partially displayed on different touch screens. Of course, the first application and the second application displayed on multiple windows and multiple screens may also belong to different processing systems. FIG. 7 is a schematic diagram of another embodiment of the multi-window mode in which the interface is displayed in the foreground of the touch screen described in the present application. As shown in FIG. 7 , the first application A is an application in the processing server 1, and the second applications B1 and B2 are Process the application in server 2. Or in another implementation scenario, the first applications A and B1 are applications in the processing server 1 , and the second application B2 is an application in the processing server 2 . Therefore, in another embodiment of the data communication processing method described in the present application, the judging whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen may include:

S301: Determine whether the window interface of the second application and the window interface of the first application are simultaneously displayed in the foreground on the same touch screen.

If the window interfaces of the first application and the second application are simultaneously displayed in the foreground of the touch screen at the current moment, it can be determined whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen. Generally, when manipulating the first application, the window interface of the first application is usually displayed in the foreground on the touch screen. Therefore, at this time, it can be determined whether the second window is also displayed in the foreground of the touch screen. If so, it can indicate that Currently, it is a multi-window mode in which the first application and the second application window interface are displayed in the foreground of the touch screen at the same time.

Of course, according to the foregoing, in another embodiment of the method described in this application, when at least one of the following conditions is met, it is determined that the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen:

S302: The window interface of the second application and the window interface of the first application are simultaneously displayed in the foreground on different touch screens;

S303: Among the first application and the second application belonging to the same processing system, at least part of the window interface of one application is displayed in the foreground at the current moment on different touch screens.

The specific judgment implementation mode may select corresponding processing modes according to different data communication application environments/systems. For example, in some terminal devices using the Android system version, whether an application is currently in multi-window mode and whether it is displayed in the foreground of the screen can be determined through the API (Application Programming Interface, API, application programming interface) provided by the Android system. In one implementation manner, the first application and the second application may belong to the same processing system, and in other implementation manners, the first application and the second application may also belong to different processing systems, as described above. are shown in Figures 6 and 7. Therefore, the first application and the second application described in the above embodiment adopt any one of the following implementations:

the first application and the second application belong to the same processing system;

At least one of the first application and the second application belongs to a different processing system.

The multi-window mode described in this application generally means that the window interfaces of at least two applications in the same processing system are displayed on the touch screen in the foreground, for example, a search application and a news application are displayed side by side on the display screen of a mobile phone. Of course, the multi-window described in this embodiment of the present application may also be a business window interface of an application controlled by the user at the current moment in one embodiment, and may also include a thumbnail window interface or a zoomed image of an application in another embodiment. window interface. A specific example is shown in FIG. 8 , the first application A currently activated by the user is a larger window interface, and the application B, application C, and application D displayed in the foreground of multiple windows are displayed on the first application A window interface. On one side, since the window interfaces of other applications are still in an inactive state when the first application A is manipulated, application B, application C, and application D can be displayed on the far right of the touch screen in smaller zoomed images.

S4: When the determination result is yes, establish a data communication link between the first application and the second application.

In the embodiment of the present application, after receiving the communication establishment request, the second application may determine whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen. When the determination result is yes, it may indicate that the window interface of the second application and the window interface of the first application are in a multi-window mode scene simultaneously displayed in the foreground of the touch screen. At this time, the user manipulation track satisfies the preset trigger condition for the first application to point to the second application, which may indicate that the user expects to achieve a certain operation requirement between the first application and the second application. In the multi-window mode in which the window interfaces of the application and the second application are displayed side by side, it is necessary to share a certain news in the first application to the Moments of the second application, or send a certain picture element in the first application to the second application. Search for goods in the search box of the application, or copy/transfer the data selected in the first application to the second application, and so on. Therefore, in an embodiment of the present application, in a multi-window mode in which at least two applications are displayed in the foreground, it can be determined that when the user's manipulation behavior (such as gesture sliding) on the touch screen triggers the manipulation event of the first application pointing to the second application , establishing a data communication link between the first application and the second application, and based on the data communication link, the first application can implement service-level data communication with the second application.

The communication link established in this embodiment is at least a communication connection between the first application and the second application, and the first application can at least transmit data to the second application. When the embodiment of the present application is specifically implemented, the communication link may be a bidirectional communication link, that is, in an implementation manner, the second application may also transmit data to the first application through the established communication link.

The embodiment of the present application utilizes the feature that the screen can display two or more application window interfaces at the same time in the multi-window mode. It allows two or more applications displayed on the screen at the same time to establish a data communication link. Once a data communication link between applications is established, business-level interaction between different applications can be realized, such as one-key/quick cross-application sharing, payment, query, and data transfer. In this way, users can intuitively realize business interaction between different applications such as quick sharing and querying through one gesture. Obviously, in the PC terminal, Android/iOS system terminal and more and more terminal devices that support application multi-window, it can greatly simplify the sharing, searching and other operations performed by users between different applications. In addition, this interaction between applications can also improve the user's operating experience and improve the user's perception of product use.

The user manipulation event described in the above-mentioned embodiment may include a variety of preset judgment logics for judging that the first application points to the second application in the multi-window mode. Generally, in most application scenarios, when a user uses a terminal device equipped with a touch screen, such as current mainstream smartphones, tablet computers, self-service terminals, etc., the user usually uses fingers, palms and other user limbs to slide on the touch screen to control the The operation of the application may of course also include using a stylus or other auxiliary devices. Therefore, in an embodiment of the data communication processing method described in the present application, preset trigger conditions based on some expected sliding behaviors of the user on the touch screen may be preset. Therefore, in an embodiment of the present application, the The preset trigger conditions for the first application to point to the second application include:

S111: The identified user manipulation track is a sliding row that slides from the window interface of the first application to the window interface of the second application.

The sliding behavior may include the sliding behavior performed by the user's limbs, and may also include the sliding behavior performed using an auxiliary input device such as a stylus. The user limbs may include fingers. Of course, the user limbs described in other embodiments may also include human limbs or organs such as head, eyes, neck, elbow, arm, body, hip, and foot. The sliding behavior performed by the user's body touching the touch screen in this embodiment may include a continuous sliding manipulation behavior performed by the user on the touch screen. The user may touch the touch screen with a finger and then slide to one side of the touch screen. A certain distance, or draw a circle on the touch screen and then slide to the other side of the touch screen, or slide a curve, etc.

In an embodiment of the data communication processing method described in the present application, whether the user's manipulation behavior is directed to another application can be identified according to the acquired information in the manipulation instruction generated by the user manipulation. Specifically, in an embodiment of the data communication processing method described in the present application, when the user performs a sliding operation on the touch screen, the judgment is made as to whether the user's manipulation trajectory satisfies the requirement for triggering the first application to point to the second application. Preset trigger conditions can include:

S211: Acquire sliding record information in the manipulation instruction, where the sliding record information includes recorded data information generated when the user performs sliding behavior on the touch screen through at least one limb of the user;

S212: Calculate at least one behavior index data including sliding direction, sliding distance, sliding time, and sliding speed according to the recorded information;

S213: Compare the behavior index data with a corresponding preset trigger threshold, and determine whether the manipulation trajectory satisfies the preset trigger condition according to a result of the comparison.

Generally, in some application scenarios, if the user needs to share the content of the first application to the second application, he can use his finger to touch the window interface of the first application, and then touch the touch screen to the location where the second application is located. Swipe for location. When the user slides on the touch screen, the processing system can record the recorded information generated by the sliding, such as coordinate information, time information, etc., and based on the recorded information, some behavior index data of the user can be calculated. These behavior index data can be used as a basis for judging whether to trigger the first application to point to the second application. In the embodiment of the present application, the second application displayed in the foreground with multiple windows on the same screen and which needs to establish communication with the first application can be identified according to the behavior index data including the sliding direction and the like. A specific example application scenario is shown in FIG. 9 , which is a schematic diagram of a scenario in which a user implements cross-application communication establishment through gesture swiping according to the present application. Currently, the window interfaces of the two applications of the terminal device are displayed side by side on the touch screen at the same time. When the user touches the touch screen with two fingers, the touch time T1 and the coordinates C1 of the touch are recorded. Then, the user slides two fingers on the touch screen for a certain distance, and after the user completes the sliding, the touch time T2 when the sliding is completed and the coordinates C2 of the two-finger touch are recorded. Then, according to T1 and T2, calculate whether the user sliding time interval is less than the threshold of 3000ms. If it is less than the threshold value, the sliding behavior is valid. In addition, according to the coordinates C1 and C2, it is calculated that the user's sliding direction C1→C2 is the due west direction, and the sliding distance of 300 pixels exceeds the minimum effective distance L=20 pixels. This time, it can be determined that the user's sliding behavior points to the touch screen. Another app shown in the foreground side by side. Therefore, according to the sliding time, sliding distance and sliding direction of the user's sliding operation, it can be determined that the user's manipulation behavior triggers the preset manipulation event of the first application pointing to the second application. Of course, in other embodiments, the manipulation instruction may also include time information when the touch screen is touched, and the behavior indicator data may also include sliding time, sliding distance, sliding speed, etc. Therefore, the trigger condition Multiple logical conditions can also be set, such as determining that the sliding direction is sliding from the first application to the second application through the sliding track, and the sliding speed is greater than a certain pixel value. Specifically, it can be set according to the user experience and the preset manipulation behavior that determines that the user needs to establish communication between different applications. The time interval, minimum effective distance, etc. can be pre-defined and set according to design requirements or expected user manipulation behavior.

The implementation of the above-mentioned embodiment enables the user to intuitively establish a communication link between two or more applications displayed on the screen at the same time through a gesture. The communication link and another application quickly enable business-level interaction. FIG. 10 is a method flowchart of another embodiment of a data communication processing method provided by the present application. As shown in FIG. 10 , in a further embodiment of the data communication processing method described in the present application, the establishment of the first After applying the data communication link with the second application, the method may further include:

S5: The first application and the second application perform service-level message interaction processing based on the established data communication link.

The communication link is at least a communication connection between the first application and the second application, and the communication link may be a bidirectional communication link when the embodiment of the present application is specifically implemented. After the communication link is established, the first application can send service-level processing messages such as content sharing or one-click payment to the second application based on the data communication link. This kind of information interaction in a multi-window mode such as sharing and querying across applications is quickly realized based on the user's sliding gesture. The operation is more intuitive, the user is convenient to use, and the user experience is effectively improved. The response of the second application to the service-level processing message in this embodiment may include processing or refusing to process the service-level processing message, or a processing result that is returned to the first application after receiving/processing the service-level processing message Wait. The response may include the case of feeding back or not feeding back the response message to the first application.

Of course, in other implementation manners, the user may also use the manipulation behavior of clicking to establish communication between applications in a multi-window mode. Or, through a combination of taps, swipes, long presses, etc. In another embodiment of the data communication processing method described in this application, it can satisfy and facilitate the manipulation habits of some users when working across applications. Specifically, it is described as a preset trigger for the first application to point to the second application. Conditions can include at least one of the following:

S221: The identified user manipulation trajectory is, within the preset valid period Ts, the number of clicks on the window interface of the first application meets the first requirement M, and the number of clicks on the window interface of the second application meets the second requirement, M, N is the preset number of clicks, Ts>0 seconds, M≥1, N≥1;

S222: The identified user manipulation track is, the identified user manipulation track is, by sliding out a preset pattern in the window interface of the first application, and moving from the preset pattern position to the location where the second application window interface is located The position direction slides at least the first threshold distance;

S223: The identified user manipulation trajectory is that, within the preset effective period Ts, the number of clicks on the window interface of the first application meets the first requirement K, and the number of clicks on the window interface of the first application meets the first requirement K, and the number of clicks from the window interface of the first application to the location where the window interface of the second application is located Slide at least the second threshold distance in the position direction, K is the preset number of clicks, Ts is the effective time of the user's control trajectory, Ts>0 seconds, K≥1;

S224: The identified user manipulation trajectory is that within the preset valid period Ts, the long-press time in the window interface of the first application is longer than T milliseconds, and the user moves from the window interface of the first application to the location where the window interface of the second application is located. Sliding in the position direction of at least a third threshold distance, Ts>0, T>0 seconds.

FIG. 11 is a schematic diagram of a scenario in which a user implements cross-application communication in a multi-window mode by using a click manipulation behavior according to the present application. As shown in FIG. 11 , if the pre-valid period Ts is 5 seconds, M is 3, and N is 1. In the window interface of news application A, if the user determines that the user clicks a picture element P1 three times in a row within 1000 milliseconds, and then clicks another shopping application B after 1500 milliseconds. Then the user's click behavior on the touch screen within 2500 milliseconds this time complies with the preset trigger condition that the first application points to the second application. Therefore, at this time, the picture element P1 selected by the user in the first application can be input into the second shopping application. in B. Then the picture element P1 appears in the search bar of the shopping application B. In the embodiment of S222, one or more preset patterns may be preset, and may include regular patterns or irregular patterns, for example, the preset patterns may be "circle", "triangle", "Z" shape, etc. If it is recognized according to the user's manipulation trajectory that the user draws a circle in the first application, and then slides a distance of 500 pixels to the second application, which is greater than the first threshold distance of 300 pixels, the preset trigger condition described in S222 can be satisfied. . Of course, the preset trigger condition can also be set by combining clicking or long pressing (the long pressing time can be customized) and sliding as described in S223 or S224, as well as other modifications and combinations of the above-mentioned embodiments.

The preset trigger conditions described in the above embodiments provide a number of user-friendly, intuitive and fast manipulation methods for realizing information interaction between different applications, which can simplify user operations and improve user manipulation experience. In addition, the sliding from the window interface of the first application to the position where the window interface of the second application is located may include sliding directly acting on the touch screen through a user's limb, or may include sliding acting on the touch screen through a touch device. Or a swipe performed in the air by a user gesture, etc. The first threshold, the second threshold, the third threshold, etc. can be set according to different use terminals, application interface scenarios, and the like.

As mentioned above, in an embodiment of the present application, the specific manner of sending the communication establishment request of the first application may include, for example, sending a broadcast message, or directly sending it to the second application in a point-to-point manner, and the first application communicates with the second application. A communication link is established between the two applications. For example, when application A sends a communication establishment request through a broadcast message, it starts to monitor the port, and application B that receives the request can directly establish a connection with A. In another implementation manner, the first application may communicate the establishment request in the form of a broadcast message, so all applications that receive the broadcast message may respond to the broadcast message of the first application and return a response. At this time, the first application A can independently select which application to establish a connection with, and the specific judgment basis for the connection object can be set by the developer according to different business scenarios. Therefore, in the data communication processing method provided in this application,

S231: The sending the communication establishment request of the first application includes sending the communication establishment request of the first application by means of message broadcasting;

Correspondingly, the establishing a data communication link between the first application and the second application may include:

After the second application receives the communication establishment request, establish a communication link between the second application and the first application, and return a response message to the first application;

After the first application receives the response message from the second application, a point-to-point communication link between the first application and the second application is established.

The communication establishment request may include the first application identification, and the second application may return a response message to the first application based on the first application identification. Correspondingly, the response message may include a second application identifier of the second application, and the first application may establish a communication connection with the second application based on the second application identifier. The method for establishing communication between different applications displayed in the foreground designed in the embodiment of the present application may use the first application to broadcast a communication establishment message, and one or more applications that receive the broadcast message may feed back a response message to the first application, and then the first application An application can actively select which application it needs to establish a communication link with according to the response messages received from multiple responders. This method of actively selecting an object for establishing a communication link by the first application is especially suitable for a multi-window mode application scenario in which at least three foregrounds are displayed on the touch screen.

Of course, the manner in which all applications that receive the broadcast message of the first application establish a communication link with the first application may also be applicable to a multi-window mode application scenario in which at least three foregrounds are displayed on the touch screen. As shown in Figure 12-1, Figure 12-1 is a schematic diagram of a scenario in the present application for realizing cross-application communication in a multi-window mode through user sliding. In the first application, the user sends a certain search result through gestures in the search application B. After swiping a distance to the right, a broadcast message of a communication establishment request is sent. After receiving the broadcast message, the instant messaging applications IM_1, IM_2, and IM_3 displayed in the foreground can directly establish two-way communication with the search application B. Then, the search application B can send the corresponding service-level processing data (a certain search result RE_1) to the instant messaging applications IM_1, IM_2, and IM_3, and the instant messaging applications IM_1, IM_2, and IM_3 can respectively perform corresponding response processing. However, when the first application selects which responder to establish a communication link with, the instant messaging applications IM_1, IM_2, and IM_3 all return response messages to the search application after receiving the broadcast message, and the search application B can choose to face IM_2 according to the sliding direction. Establish a communication link with IM_2. The search application B can send the corresponding business-level processing data (a search result RE_1) to the instant messaging application IM_2, and the instant messaging application IM_2 performs corresponding response processing, as shown in Figure 12-2, which is the A schematic diagram of a scenario for realizing cross-application communication in a multi-window mode through user sliding is applied.

The following describes the implementation process of using the data communication processing method described in the present application in an application scenario of a specific example. FIG. 13 is a schematic diagram of an implementation flow of an embodiment scenario of a data communication processing method described in the present application. In a specific example application scenario, as shown in FIG. 13 , in the mobile phone terminal of the Android system, it may be pre-agreed that application A is the initiator of establishing communication, and application B is the receiver.

The broadcast receiver in Figure 13 refers to BroadcastReceiver, which is a one-to-many information dissemination mechanism between applications provided by the Android system. Here you can define two Actions (executors or execution processes) that broadcast request and response as com.apptest.message.request and com.apptest.message.response respectively. Application A and Application B need to register these two broadcast receivers with the system. In the Android system, you can set the application A and application B to register the BroadcastReceiver (broadcast receiver) with the Android system after startup, so that when the Android system receives a Broadcast, it will call back the pre-registered BroadcastReceiver to notify the application. For example, a common registration method is static registration. Static registration usually refers to defining the receiver in the application of AndroidManifest.xml and setting the action to be received (executor or execution process, such as com.apptest.message.request and com.apptest .message.response).

When the user touches the touch screen on the mobile phone with two fingers, the time T1 and the coordinates C1 touched by the two fingers are recorded, and the time and coordinate data can be recorded all the time during the sliding process. After the sliding is completed, according to the recorded time T2 when the sliding is completed, it is judged whether the time interval T of the user's sliding is less than the threshold value of 1500ms; the coordinates of the two fingers at the start and end are averaged, and the sliding line is calculated by the start and end coordinates. Whether the distance L exceeds the threshold sliding distance = L300 pixels. Then, it is judged through the API provided by the Android system that the current application A is in the multi-window mode, and if the judgment results meet the above-mentioned triggering requirements of the sliding time interval and sliding distance, it can be determined that the user's sliding behavior on the touch screen has triggered the user to point to another An application manipulation event.

At this time, in the Android system of the mobile phone, application A can send a request broadcast message carrying its own package name. The package name mentioned here refers to the package, which is the unique identifier of the application in the Android system. In the Android system, each application must have a unique package. Generally, this package can be used in product development and design to distinguish different applications. For example, the package of application A can be com.eg.android.ApptestA, and the package of application B can be com.eg.android.ApptestA. Can be com.tencent.mm.

When application B receives the request broadcast, it can first decide whether to respond to the request sent by application A. If the system does not handle emergency events or applications of exclusive processes or is in other busy states at this time, the system can agree to the request of application A and establish a one-way communication link from B to A. Then, it can be judged whether the current application B is in the multi-window mode and whether it is displayed in the foreground of the screen through the API provided by Android.

After the judgment is passed, application B randomly monitors an available network socket port, such as 8080, and sends a response broadcast according to the request received from the application, and carries the package name of application B and the monitored port. Application B listens on network socket port 8080, waiting for the port to be connected.

After application A receives the response broadcast of application B, if it agrees to connect with application B, it will actively connect to the Socket port 8080 monitored by application B. After the connection is successful, a point-to-point communication link between application A and application B is established. Applications A and B can use the communication link of the socket port to perform high-speed bidirectional point-to-point communication. Both sides of the business can perform various business interactions based on this link, such as sharing and payment.

The data communication processing method provided by this application may be used in various terminal devices such as mobile phones, tablets, PCs, servers, PDAs, etc. The user can intuitively use a gesture to establish two-way communication between two applications displayed on the screen at the same time link. For example, if a user slides two fingers in any one application to another application, the processes in which the two applications are located establish a two-way communication channel, which can respond to the user's action in a variety of ways according to different business scenarios, such as sharing the content in application A. To the B application, it can effectively improve the interactive experience of the terminal device.

The basic application idea, this application also provides a data communication processing method that can be used between different business items in the same application, which can realize cross-service communication based on the user's sliding control between different business items in the application window interface. Interactive processing. FIG. 14 is a method flowchart of another embodiment of a data communication processing method provided by the present application. Specifically, as shown in FIG. 14 , in an embodiment of a data communication processing method provided by the present application, the Methods can include:

S1': monitor the manipulation instructions generated by manipulation actions on the application window interface, and identify the user manipulation track;

S2': judging whether the user manipulation trajectory satisfies a preset trigger condition that triggers the first service item to point to the second service item; and when the judgment result is yes, use the response mode of the second service item to process the The business processing request of the first business item.

In a preferred embodiment, the preset trigger condition for the first service item to point to the second service item may include:

S201': The identified user manipulation track is the window interface sliding from the window interface of the first business item to the window interface of the second business item in the application window interface displayed in the foreground of the touch screen.

The above-mentioned first service item and second service item for interactive processing may belong to different service items in the same application, or may be service items in different applications. Therefore, in another embodiment of the data communication processing method provided by the present application in which an existing user manipulates a trajectory and can realize information interaction between different service items, the first service item and the second service item may use the following Either way:

The first business item and the second business item belong to business items in the same application;

At least one of the first service item and the second service item belongs to a different application.

FIG. 15 is a schematic diagram of an application scenario of another embodiment of a data communication processing method provided by the present application. As shown in FIG. 15 , the secondary window interface in a payment application PAY includes several payment payment business items, such as “phone bill recharge”, “utility bill”, “credit card repayment” and so on. At the same time, the bottom of the application window interface also provides three payment method options that users can use for payment: "Balance Payment", "Bank of China Payment", and "China Merchants Credit Card Payment". If it is pre-set that you press and hold a payment option and then slide to a payment service item, it means that you use the pressed payment to select the payment service item to which the payment is swiped. For example, as shown in Figure 15, the user touches the "Balance Payment" option with his finger first, and then slides his finger to "Call Credit Recharge", then the payment application PAY can directly enable the "Balance Payment" service payment method to recharge the user call charges. Of course, if the user presses on the window interface of the "Bank of China Payment" business item, and then slides to "Call Charge", the payment application PAY can use the Bank of China savings card bound by the user to recharge the call charge, or click "Bank of China Pay" After sliding to the "red envelope" business item, you can use the funds of the user's bound Bank of China savings card to issue red envelopes by default. In this way, interaction processing between different business items can be quickly performed between different business items through gesture sliding manipulation on the touch screen, etc., thereby improving user operation experience.

Based on the data communication processing method described in the present application, the present application further provides a data communication processing apparatus. The data communication processing device can be used in a variety of terminal equipment including mobile communication terminals, tablets, PDAs, PCs, etc., to realize certain preset manipulation actions on the user's touch screen in the multi-window mode (such as a user's certain action on the touch screen). Sliding gestures) to establish data communication between different applications, realize business interaction between different applications, and improve user manipulation experience. FIG. 16 is a schematic diagram of a module structure of an embodiment of a data communication processing apparatus provided by the present application. Specifically, as shown in FIG. 16 , the apparatus may include:

The monitoring module 101 can be used to monitor the manipulation instruction generated by the manipulation behavior acting on the touch screen, and identify the user manipulation track;

The trajectory processing module 102 can be used to judge whether the user-controlled trajectory satisfies the preset trigger condition of the first application pointing to the second application; and when the judgment result is yes, send a communication establishment request of the first application;

The multi-window judgment module 103 can judge whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen after the second application receives the communication establishment request;

The communication establishing module 104 may be configured to establish a data communication link between the first application and the second application when the multi-window judging module 103 judges that the result is yes.

In another embodiment of the data communication processing apparatus described in the present application, the preset trigger condition for the first application to point to the second application may include:

The identified user manipulation track is a sliding behavior of sliding from the window interface of the first application to the window interface of the second application.

In another embodiment of the data communication processing apparatus described in the present application, the sending the communication establishment request of the first application includes sending the communication establishment request by means of message broadcasting;

Correspondingly, the establishing a data communication link between the first application and the second application includes:

After the second application receives the communication establishment request, establish a communication link between the second application and the first application, and return a response message to the first application;

After the first application receives the response message from the second application, a point-to-point communication link between the first application and the second application is established.

The preset trigger condition that the first application points to the second application in the device described in the present application may also set other trigger conditions according to the user's click, slide, long press, and combinations thereof. For the specific implementation manner of the foregoing embodiment and the manner of establishing the communication link between the first application and the second application, reference may be made to the description of the foregoing method-related embodiments and the extended implementation manner, which will not be repeated here.

The data communication processing apparatus described in this application can be used in various terminal devices based on the Android system platform and supporting a multi-window mode, such as a commonly used mobile communication terminal. In this way, the user can quickly and intuitively establish a communication link between two or more applications simultaneously displayed on the touch screen through a simple gesture operation on the touch screen when using the terminal device. Use the established communication link to quickly realize business-level interaction between applications, such as one-click sharing, sliding payment, etc., which greatly improves the user's control and use experience. Of course, the manipulation action acting on the touch screen may include a sliding action, a click action, a long press, and a combination thereof by the user's body touching the touch screen.

The present application also provides another embodiment of the data communication processing apparatus, which can realize interactive processing between different services based on the user's sliding control between different service items in the application window interface. FIG. 17 is a schematic diagram of a module structure of another embodiment of a data communication processing device provided by the present application. Specifically, as shown in FIG. 17 , the device described in an embodiment of a data communication processing device provided by the present application Can include:

The manipulation instruction acquisition module 201 can be used to monitor manipulation instructions generated by manipulation actions on the touch screen, and identify the user manipulation track;

The service processing module 202 can be used to judge whether the user manipulation track satisfies the preset trigger condition that the first service item points to the second service item; it can also be used to use the second service when the judgment result is yes The response mode of the item processes the service processing request of the first service item.

In another embodiment of the data communication processing device provided by the present application, the preset trigger condition for the first service item to point to the second service item includes:

The identified user manipulation track is that in the application window interface displayed in the foreground of the touch screen, the window interface of the first business item slides to the window interface of the second business item.

Of course, as mentioned above, the first service item and the second service item in the above interactive processing may belong to different service items in the same application, or may be service items in different applications. Therefore, in another embodiment of the data communication processing device provided by the present application, the first service item and the second service item adopt any one of the following implementations:

The first business item and the second business item belong to business items in the same application;

At least one of the first service item and the second service item belongs to a different application.

For the specific preset trigger condition that the first service item points to the second service item, the user manipulation track formed by sliding, etc., reference may be made to the relevant descriptions of the other embodiments above, which will not be repeated here.

The data communication processing device provided by the embodiment of the present application utilizes the feature that the screen can simultaneously display two or more application window interfaces in the multi-window mode, and recognizes the user's control trajectory on the touch screen, such as sliding two fingers from the first application to the first application window interface. Two or more applications displayed on the screen at the same time can establish a data communication link. Once a data communication link between applications is established, business-level interaction between different applications can be realized, such as one-key/quick cross-application sharing, payment, query, and data transfer. In this way, users can intuitively realize business interaction between different applications such as quick sharing and querying through one gesture. Obviously, in the PC terminal, Android/iOS system terminal and more and more terminal devices that support application multi-window, it can greatly simplify the sharing, searching and other operations performed by users between different applications. In addition, this interaction between applications can also improve the user's operating experience and improve the user's perception of product use.

The data communication processing method and device provided in this application can be used in various terminal devices, such as mobile communication terminals (mobile phones, etc.), tablets, PDAs, PCs, servers, business systems, etc. A certain preset manipulation action (such as a certain sliding gesture of the user on the touch screen) is used to establish data communication between different applications, realize business interaction between different applications, and improve user manipulation experience. Therefore, the present application also provides an electronic device, and the electronic device may include a terminal device including a touch screen device such as the above-mentioned mobile phone, tablet, etc. In some embodiments, the electronic device may also be a part of these terminal devices, such as the data processing electronic device of the terminal device, and the touch screen can be connected with the electronic device separately, and combined into a terminal used by the user. Specifically, an embodiment of an electronic device provided by the present application may include:

The event monitoring unit can be used to monitor the manipulation instructions generated by the manipulation behavior acting on the touch screen, and identify the user manipulation track; it can also be used to judge whether the user manipulation track satisfies the preset trigger condition for the first application to point to the second application ;

a window state judgment module, which can be used to judge whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen after the second application receives the communication establishment request of the first application;

a communication link establishment module, which can be used to send a communication establishment request of the first application when it is judged that the user manipulation trajectory satisfies a preset trigger condition that the first application points to the second application; and is used for judging the second application When the state is a multi-window mode in which the interface is displayed in the foreground of the touch screen, a data communication link between the first application and the second application is established.

In an embodiment, establishing a data communication link between the first application and the second application by the communication link establishing module 303 of the electronic device may include establishing a unidirectional data communication link from the first application to the second application. The first application can send communication data to the second application, and the second application can receive the communication data. In other embodiments, it may also include establishing a bidirectional data communication link between the first application and the second application, that is, in an implementation manner, the first application may send communication data to the second application through the data communication link, and the first application may send communication data to the second application through the data communication link. The second application may also send data communication data to the first application through the data communication connection. Some embodiments of the electronic device described in the present application, and the above-mentioned data communication processing method and apparatus may set a processing manner according to a specific application environment. The present application provides a preferred embodiment. After the first application adopts message broadcast, it establishes point-to-point communication with the second application according to the received response message. Specifically, in another embodiment of the electronic device described in this application, the communication link establishment module sending the first application to send the communication establishment request includes that the first application sends the first application's information in the form of message broadcasting. communication establishment request;

Correspondingly, the establishing a data communication link between the first application and the second application includes:

After the second application receives the communication establishment request, establish a communication link between the second application and the first application, and return a response message to the first application;

After the first application receives the response message from the second application, a point-to-point communication link between the first application and the second application is established.

The manipulation behavior acting on the touch screen may include a manipulation behavior of directly sliding on the touch screen through a user's limb. In other embodiments of the present application, the manipulation behavior may also include operations such as clicking, sliding, etc. performed by the user on the touch screen using a touch device, such as a stylus, a laser light, or other auxiliary tools. Even, the present application does not exclude other embodiments in which the user's limb does not directly contact the touch screen, but uses photoelectric induction, magnetic induction, etc. to identify the manipulation behavior of the user's space connection on the touch screen. For example, the user's body sensing motion is recognized, specifically, for example, the sliding gesture made by the user at a certain distance on the touch screen. Although the user's finger does not directly touch the touch screen at this time, in the application scenario of the electronic device provided by the embodiment of the present application It is still possible to recognize that the user performed a manipulation behavior of sliding a certain distance, and translate it into a user manipulation trajectory. Therefore, in another embodiment of the electronic device described in this application, the manipulation behavior acting on the touch screen may include at least one of the following implementations:

The manipulation behavior of touching the touch screen by the user's body;

The manipulation behavior of touching the touch screen by the touch device;

The manipulation behavior on the touch screen by the space contact identified by the body sensing.

Generally, the window mode may include, for example, that the window interfaces of the first application and the second application are on the same touch screen in the multi-window mode. The window interface of an application, or the window interface of up to four applications can be displayed simultaneously on the same touch screen supported by some tablet computers. However, the multi-window mode described in this application does not exclude the embodiment in which multiple application windows are displayed in the foreground on different touch screens. For example, the first application and the second application may belong to the same processing system and be displayed on different touch screen terminals, just like one Multi-screen display of PC host. The same processing system may be a processing unit, module, device including one or more logical units, or a processing system composed of multiple servers, or the same distributed system. In this case, the window interfaces of the first application and the second application may be located on the same touch screen, or may be displayed in a multi-screen display manner, respectively or partially displayed on different touch screens. Of course, the first application and the second application displayed on multiple windows and multiple screens may also belong to different processing systems. Therefore, in another embodiment of the electronic device described in this application, the window state determination module determines that the state of the second application is an interface displayed in the foreground of the touch screen when at least one of the following conditions is satisfied. Multi-window mode:

The window interface of the second application and the window interface of the first application are simultaneously displayed in the foreground on the same touch screen;

The window interface of the second application and the window interface of the first application are simultaneously displayed in the foreground on different touch screens;

In the first application and the second application, part of the window interface of at least one application is displayed in the foreground on different touch screens.

In one embodiment of the electronic device described in this application, the first application and the second application may belong to the same processing system, and in other embodiments, the first application and the second application may belong to different The processing system is shown in Figures 6 and 7 previously described. Therefore, in another embodiment of the electronic device described in this application, the first application and the second application adopt any one of the following implementations:

the first application and the second application belong to the same processing system;

At least one of the first application and the second application belongs to a different processing system.

Of course, the multi-window described in this embodiment of the present application may also be a business window interface of an application controlled by the user at the current moment in one embodiment, and may also include a thumbnail window interface or a zoomed image of an application in another embodiment. window interface.

In other implementation manners, the user may also use the manipulation behavior of clicking to establish communication between applications in a multi-window mode. Or, through a combination of taps, swipes, long presses, etc. In another embodiment of the electronic device described in the present application, the control habits of some users when working across applications can be satisfied and facilitated. Specifically, in another embodiment of the electronic device described in this application, the preset trigger condition for directing the first application to the second application includes at least one of the following:

The identified user manipulation trajectory is that, within the preset valid period Ts, the number of clicks on the window interface of the first application meets the first requirement M, and the number of clicks on the window interface of the second application meets the second requirement, where M and N are preset. Set the number of clicks, Ts is the effective time of the user's control track, Ts≥0 seconds, M≥1, N≥1;

The identified user manipulation trajectory is: selecting the first application by sliding out a preset pattern in the window interface of the first application, and sliding at least the first threshold distance;

The identified user manipulation trajectory is that within the preset valid period Ts, the number of clicks on the window interface of the first application meets the first requirement K, and the number of clicks from the window interface of the first application to the position where the window interface of the second application is located. The direction slides at least the second threshold distance, K is the preset number of clicks, Ts is the effective time of the user's control trajectory, Ts≥0 seconds, K≥1.

The identified user manipulation trajectory is that, within the preset valid period Ts, the long-press time in the window interface of the first application is greater than T milliseconds, and the user moves from the window interface of the first application to the position where the window interface of the second application is located. The direction slides at least a third threshold distance, T≥0.

The preset trigger conditions described in the above embodiments provide a number of user-friendly, intuitive and fast manipulation methods for realizing information interaction between different applications, which can simplify user operations and improve user manipulation experience. In addition, the sliding from the window interface of the first application to the position where the window interface of the second application is located may include sliding directly acting on the touch screen through a user's limb, or may include sliding acting on the touch screen through a touch device. Or a swipe performed in the air by a user gesture, etc. The first threshold, the second threshold, the third threshold, etc. can be set according to different use terminals, application interface scenarios, and the like.

In another embodiment of the electronic device described in this application, the preset trigger condition for the first application to point to the second application may include:

The identified user manipulation trajectory is a sliding behavior of sliding from the window interface of the first application to the window interface of the second application

For example, after the user slides a certain search result to the right by a gesture in the first application, which is a search application B, a broadcast message of a communication establishment request is sent. After receiving the broadcast message, the instant messaging applications IM_1, IM_2, and IM_3 displayed in the foreground can directly establish two-way communication with the search application B. Then, the search application B can send the corresponding service-level processing data (a certain search result RE_1) to the instant messaging applications IM_1, IM_2, and IM_3, and the instant messaging applications IM_1, IM_2, and IM_3 can respectively perform corresponding response processing.

The implementation of the above-mentioned embodiment enables the user to intuitively establish a communication link between two or more applications displayed on the screen at the same time through a gesture. The communication link and another application quickly enable business-level interaction. Therefore, in another embodiment of the electronic device described in this application, the electronic device may further include:

The service processing unit may be configured to use the established data communication link to implement service-level message interaction processing between the first application and the second application.

The communication link is at least a communication connection between the first application and the second application, and the communication link may be a bidirectional communication link when the embodiment of the present application is specifically implemented. After the communication link is established, the first application can send service-level processing messages such as content sharing or one-click payment to the second application based on the data communication link. This kind of information interaction in a multi-window mode such as sharing and querying across applications is quickly realized based on the user's sliding gesture. The operation is more intuitive, the user is convenient to use, and the user experience is effectively improved.

The data communication processing method or device or electronic device provided in this application can be used in a variety of terminal devices with touch display devices, such as mobile communication terminals (mobile phones, etc.), tablets, PDAs, PCs, servers, business processing systems, etc., Realize the establishment of data communication between different applications in the touch display device based on a certain preset manipulation action on the user's touch screen (such as a certain sliding gesture of the user on the touch screen) in the multi-window mode, and realize business interaction between different applications. , to improve the control experience of the user's touch display device. Therefore, the present application also provides a touch display device. FIG. 18 is a schematic structural diagram of an embodiment of the touch display device described in the present application. As shown in FIG. 18 , the touch display device may include at least one touch screen and a processor,

The touch screen can be used to display interface information of an application window and sense manipulation actions acting on the touch screen, and send corresponding manipulation instructions generated by the manipulation actions to the processor;

The processor is configured to identify the user manipulation track according to the manipulation instruction, and send the first application's information when it is determined that the user manipulation track satisfies a preset trigger condition that the first application points to the second application. communication establishment request; can also be used to determine whether the state of the second application is a multi-window mode in which the interface is displayed in the foreground of the touch screen after the second application receives the communication establishment request; can also be used when When the result of the judgment is yes, a data communication link between the first application and the second application is established.

In some terminal devices using the Android system version, it can be judged whether an application is currently in a multi-window mode and whether it is displayed in the foreground of the screen through an API (Application Programming Interface, API, application programming interface) provided by the Android system. In one implementation manner, the first application and the second application may belong to the same processing system, and in other implementation manners, the first application and the second application may also belong to different processing systems.

In an embodiment of the touch display device, the user can establish a communication link between different applications through a sliding gesture on the touch screen. Therefore, in another embodiment of a touch display device provided by the present application, the preset trigger condition for the first application to point to the second application may include:

The identified user manipulation track is a sliding behavior of sliding from the window interface of the first application to the window interface of the second application.

In another embodiment of the touch display device provided by the present application, the processor sends the communication establishment request of the first application by means of message broadcasting;

Correspondingly, the establishing a data communication link between the first application and the second application includes:

After the second application receives the communication establishment request, establish a communication link between the second application and the first application, and return a response message to the first application;

A point-to-point communication link from the first application to the second application is established after the first application receives the reply message from the second application.

In the Android system, you can set the application A and application B to register the BroadcastReceiver (broadcast receiver) with the Android system after startup, so that when the Android system receives a Broadcast, it will call back the pre-registered BroadcastReceiver to notify the application. For example, a common registration method is static registration. Static registration usually refers to defining the receiver in the application of AndroidManifest.xml and setting the action to be received (executor or execution process, such as com.apptest.message.request and com.apptest .message.response).

When the user touches the touch screen on the mobile phone with two fingers, the time T1 and the coordinates C1 touched by the two fingers are recorded, and the time and coordinate data can be recorded all the time during the sliding process. After the sliding is completed, according to the recorded time T2 when the sliding is completed, it is judged whether the time interval T of the user's sliding is less than the threshold value of 1500ms; the coordinates of the two fingers at the start and end are averaged, and the sliding line is calculated by the start and end coordinates. Whether the distance L exceeds the threshold sliding distance = L300 pixels. Then, it is judged through the API provided by the Android system that the current application A is in the multi-window mode, and if the judgment results meet the above-mentioned triggering requirements of the sliding time interval and sliding distance, it can be determined that the user's sliding behavior on the touch screen has triggered the user to point to another An application manipulation event.

In a specific example, such as in the mobile phone Android system, application A may send a request broadcast message carrying its own package name. When application B receives the request broadcast, it can first decide whether to respond to the request sent by application A. If the system does not handle emergency events or applications of exclusive processes or is in other busy states at this time, the system can agree to the request of application A and establish a one-way communication link from B to A. Then, it can be judged whether the current application B is in the multi-window mode and whether it is displayed in the foreground of the screen through the API provided by Android. After the judgment is passed, application B randomly monitors an available network socket port, such as 8080, and sends a response broadcast according to the request received from the application, and carries the package name of application B and the monitored port. Application B listens on network socket port 8080, waiting for the port to be connected. After application A receives the response broadcast of application B, if it agrees to connect with application B, it will actively connect to the Socket port 8080 monitored by application B. After the connection is successful, a point-to-point communication link between application A and application B is established.

The touch display device provided by the above embodiments of the present application can quickly establish communication between applications when it is determined that the user needs to perform information interaction between different applications, so that the user can intuitively use a simple and intuitive sliding gesture to At least two applications simultaneously displayed on the screen establish a communication link. The touch display device can use the communication link established by the technical solution provided in this application to perform business-level interaction with another application. The specific interaction method/response content can be designed by the business developer according to different scenarios, such as one-click sharing. , one-click payment, one-click listening to songs, etc. Obviously, the implementation of the present application can greatly simplify user sharing, search, and other interactions between different applications in more and more terminal devices that support application multi-windows, such as PC terminals and Android/iOS system terminals, and meet user needs. The interaction between these applications can also greatly improve the user terminal control experience and improve the user's product usage perception.

The data communication processing method or device or electronic device provided in this application can be used in another terminal device with a touch display device, such as a mobile communication terminal (mobile phone, etc.), tablet, PDA, PC, server, business processing system, etc. , to realize the information interaction between different business items in the touch display device based on a certain preset manipulation action on the user's touch screen (such as a certain sliding gesture of the user on the touch screen) in the multi-window mode, and quickly realize the same application or different business items. The operation between the business items of the application improves the user's control experience of the touch display device. Therefore, the present application further provides another touch display device. FIG. 19 is a schematic structural diagram of an embodiment of the touch display device described in the present application. As shown in FIG. 19 , the touch display device may include at least one touch screen. and a processor,

The touch screen can be used to display interface information of an application window and sense manipulation actions acting on the touch screen, and send corresponding manipulation instructions generated by the manipulation actions to the processor;

The processor is configured to judge whether the user manipulation trajectory satisfies the preset trigger condition for sending the first service item to point to the second service item; it can also be used to, when the judgment result is yes, use The response mode of the second service item processes the service processing request of the first service item.

In another embodiment of the touch display device provided by the present application, the preset trigger condition for the first service item to point to the second service item includes:

The identified user manipulation track is that in the application window interface displayed in the foreground of the touch screen, the window interface of the first business item slides to the window interface of the second business item.

The above-mentioned first service item and second service item for interactive processing may belong to different service items in the same application, or may be service items in different applications. In another embodiment of a touch display device provided by the present application, the first service item and the second service item adopt any one of the following implementations:

The first business item and the second business item belong to business items in the same application;

At least one of the first service item and the second service item belongs to a different application.

Another touch display device provided by the embodiment of the present application, China, can realize the sliding control between different business items in the application window interface to realize the interactive processing between the cross-services. Different business items can quickly perform interactive processing between different business items through gesture sliding manipulation on the touch screen, thereby improving user operation experience.

The purpose of this application is to provide a data communication processing method, device, electronic device, and touch display device, which utilizes the feature that multiple application windows can be displayed simultaneously on the screen in a multi-window mode, and can be operated through simple and intuitive manipulation gestures by the user. Let at least two applications displayed on the screen at the same time establish a communication link, realize fast and convenient application interaction between different applications in the terminal device, reduce user operations, and improve user operation and use experience. The embodiments of the present application can greatly simplify the interaction between different applications such as user sharing and searching in PC terminals, Android/iOS system terminals and more and more terminal devices that support application multi-windows, so as to meet user needs. The interaction between the two can also greatly improve the user terminal control experience and improve the user's product usage perception.

Although the content of this application mentions the message interaction method of message broadcasting or point-to-point communication, the control method of two-finger touch or body-sensing air-to-air touch, the user's control trajectory of clicking or long pressing or sliding or drawing a circle, continuous or discontinuous The description of user control trajectory definition, multi-window display mode with multiple applications on the same screen or split screen, etc., user gesture recognition, multi-window foreground display real-time scene, etc., but this application is not limited to the necessary It is in line with industry communication standards, touch screen input information recognition, sliding track definition or the situation described in the embodiments. Some industry standards or implementations described using custom methods or examples with slight modifications can also achieve the same, equivalent or similar, or predictable implementation effects after deformations of the above-mentioned examples. The modified or deformed data acquisition, storage, judgment, processing and other acquisition examples can still fall within the scope of optional embodiments of the present application.

Although the present application provides method operation steps as described in the embodiments or flow charts, more or less operation steps may be included based on conventional or non-inventive means. The sequence of steps enumerated in the embodiments is only one of the execution sequences of many steps, and does not represent the only execution sequence. When an actual device or terminal product is executed, it can be executed sequentially or in parallel according to the methods shown in the embodiments or the drawings (eg, a parallel processor or multi-threaded processing environment, or even a distributed data processing environment). The terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, product or device comprising a list of elements includes not only those elements, but also others not expressly listed elements, or also include elements inherent to such a process, method, product or device. Without further limitation, it does not preclude the presence of additional identical or equivalent elements in a process, method, product or apparatus comprising the stated elements.

The units, devices or modules described in the above embodiments may be specifically implemented by computer chips or entities, or by products with certain functions. For the convenience of description, when describing the above device, the functions are divided into various modules and described respectively. Of course, when implementing the present application, the functions of each module can be implemented in the same one or more software and/or hardware, and the modules that implement the same function can also be implemented by a combination of multiple sub-modules or sub-units. The apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated. to another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

Those skilled in the art also know that, in addition to implementing the controller in the form of pure computer-readable program code, the controller can be implemented as logic gates, switches, application-specific integrated circuits, programmable logic controllers and embedded devices by logically programming the method steps. The same function can be realized in the form of a microcontroller, etc. Therefore, such a controller can be regarded as a hardware component, and the devices included therein for realizing various functions can also be regarded as a structure within the hardware component. Or even, the means for implementing various functions can be regarded as both a software module implementing a method and a structure within a hardware component.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, classes, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including storage devices.

From the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products can be stored in storage media, such as ROM/RAM, magnetic disks , CD, etc., including several instructions to make a computer device (which may be a personal computer, a mobile terminal, a server, or a network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of the present application.

The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. The present application may be used in numerous general purpose or special purpose computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable electronics, network PCs, minicomputers, mainframe computers, including the above Distributed computing environment of any system or device, etc.

Although the application has been described by way of examples, those of ordinary skill in the art will recognize that the application is subject to many modifications and changes without departing from the spirit of the application, and it is intended that the appended claims include such modifications and changes without departing from the spirit of the application.

Claims (23)

1. A data communication processing method, characterized in that the method comprises:

monitoring a control instruction generated by a control action acting on the touch screen, and identifying a user control track;

judging whether the user control track meets a preset trigger condition that a first application points to a second application; when the preset trigger condition is met, sending a communication establishment request of a first application in a message broadcasting mode;

after the second application receives the communication establishment request, judging whether the state of the second application is a multi-window mode in which an interface is displayed on the front desk of the touch screen;

when the judgment result is yes, establishing a data communication link between the first application and the second application;

the first application and the second application perform service-level message interaction processing based on the established data communication link, wherein the service-level message interaction processing comprises: sharing, payment, inquiry, data transfer, listening to songs.

2. The data communication processing method according to claim 1, wherein the preset trigger condition that the first application points to the second application comprises:

the identified user manipulation trajectory is a sliding behavior of a window interface of the first application sliding to a window interface of the second application.

3. The data communication processing method according to claim 2, wherein the determining whether the user manipulation trajectory satisfies a preset trigger condition for triggering the first application to point to the second application includes:

acquiring sliding record information in the control instruction, wherein the sliding record information comprises recorded data information generated when a user performs a sliding action on a touch screen through at least one limb of the user;

calculating at least one behavior index data at least comprising sliding direction, sliding distance, sliding time and sliding speed according to the recorded information;

and comparing the behavior index data with a corresponding preset trigger threshold, and determining whether the control track meets the preset trigger condition according to the comparison result.

4. The data communication processing method according to claim 1, wherein the preset trigger condition that the first application points to the second application includes at least one of the following:

the identified user control track is that in a preset effective period Ts, the number of times of clicking on a window interface of a first application meets a first requirement M, the number of times of clicking on a window interface of a second application meets a second requirement N, M, N is a preset number of times of clicking, Ts is effective time of the user control track, Ts is more than 0 second, M is more than or equal to 1, and N is more than or equal to 1;

the identified user control track is that a preset pattern is slid in a window interface of a first application, and the user control track slides at least a first threshold distance from the position of the preset pattern to the position of a second application window interface;

the identified user operation track is that in a preset effective period Ts, the number of times of clicking on a window interface of a first application meets a first requirement K, the window interface of the first application slides to the position direction of a window interface of a second application for at least a second threshold distance, K is the preset number of times of clicking, Ts is the effective time of the user operation track, Ts is more than 0 second, and K is more than or equal to 1;

the identified user control track is that within a preset effective period Ts, the time is longer than T milliseconds in a window interface of a first application, and at least a third threshold distance is slid from the window interface of the first application to the position direction where a window interface of a second application is located, wherein Ts is larger than 0, and T is larger than 0 second.

5. The data communication processing method according to claim 1, wherein the manipulation behavior acting on the touch screen includes at least one of the following:

a manipulation behavior of touching the touch screen through a user limb;

a control action of touching the touch screen through a touch device;

and the control action of the separated space on the touch screen is sensed and recognized through limbs.

6. The data communication processing method of claim 1,

the establishing a data communication link between the first application and the second application comprises:

after the second application receives the communication establishment request, establishing a communication link of the second application to the first application, and returning a response message to the first application;

and establishing a point-to-point communication link from the first application to the second application after the first application receives the response message of the second application.

7. The data communication processing method of claim 1, wherein the first application comprises: in a user control track formed by the continuous sliding of the touch screen, an application corresponding to a window interface where a starting point of the user control track is located;

correspondingly, the second application comprises an associated application except the first application, and the associated application comprises an application of a window interface covered by the user manipulation track displayed in the foreground of the touch screen.

8. The data communication processing method according to claim 1, wherein said determining whether the state of the second application is a multi-window mode in which an interface is displayed in a foreground of the touch screen includes:

and judging whether the window interface of the second application and the window interface of the first application are simultaneously foreground-displayed in the same touch screen.

9. The data communication processing method according to claim 1, wherein the state of the second application is determined to be a multi-window mode in which an interface is displayed in a foreground of the touch screen when at least one of the following conditions is satisfied:

the window interface of the second application and the window interface of the first application are simultaneously and respectively displayed in different touch screens in a foreground mode;

and at least one of the first application and the second application has a part of window interface foreground displayed in different touch screens.

10. A data communication processing method according to claim 8 or 9, wherein the first application and the second application adopt any one of the following implementation modes:

the first application and the second application belong to the same processing system;

at least one of the first application and the second application belongs to different processing systems.

11. A data communication processing apparatus, characterized in that the apparatus comprises:

the monitoring module is used for monitoring a control instruction generated by a control action acting on the touch screen and identifying a user control track;

the track processing module is used for judging whether the user control track meets a preset trigger condition that the first application points to the second application; when the preset trigger condition is met, sending a communication establishment request of a first application in a message broadcasting mode;

the multi-window judging module is used for judging whether the state of the second application is a multi-window mode in which an interface is displayed on the front desk of the touch screen or not after the second application receives the communication establishing request;

a communication establishing module, configured to establish a data communication link between the first application and the second application when a result of the determination by the multi-window determining module is yes, so that the first application and the second application perform service-level message interaction processing based on the established data communication link, where the service-level message interaction processing includes: sharing, payment, inquiry, data transfer, listening to songs.

12. The data communication processing apparatus according to claim 11, wherein the preset trigger condition that the first application points to the second application comprises:

the identified user manipulation trajectory is a sliding behavior of a window interface of the first application sliding to a window interface of the second application.

13. The data communication processing apparatus according to claim 11, wherein said sending the communication establishment request of the first application includes sending the communication establishment request in a message broadcast;

correspondingly, the establishing of the data communication link between the first application and the second application comprises:

after the second application receives the communication establishment request, establishing a communication link of the second application to the first application, and returning a response message to the first application;

and establishing a point-to-point communication link from the first application to the second application after the first application receives the response message of the second application.

14. An electronic device, comprising:

the event monitoring unit is used for monitoring a control instruction generated by a control action acting on the touch screen and identifying a user control track; the user control track is also used for judging whether the user control track meets a preset trigger condition that the first application points to the second application;

the window state judging module is used for judging whether the state of the second application is a multi-window mode in which an interface is displayed on the foreground of the touch screen or not after the second application receives a communication establishment request of the first application;

the communication link establishing module is used for sending a communication establishing request of the first application in a message broadcasting mode when the user control track is judged to meet a preset trigger condition that the first application points to the second application; the data communication link between the first application and the second application is established when the state of the second application is judged to be a multi-window mode in which an interface is displayed on the front desk of the touch screen;

a service processing unit, configured to implement service-level message interaction processing between the first application and the second application by using the established data communication link, where the service-level message interaction processing includes: sharing, payment, inquiry, data transfer, listening to songs.

15. The electronic device of claim 14, wherein the communication link establishment module sending the communication establishment request of the first application comprises sending the communication establishment request of the first application in a message broadcast;

correspondingly, the establishing of the data communication link between the first application and the second application comprises:

after the second application receives the communication establishment request, establishing a communication link of the second application to the first application, and returning a response message to the first application;

and establishing a point-to-point communication link from the first application to the second application after the first application receives the response message of the second application.

16. An electronic device as claimed in claim 14, wherein the manipulation behavior acting on the touch screen comprises at least one of the following:

a manipulation behavior of touching the touch screen through a user limb;

a control action of touching the touch screen through a touch device;

and the control action of the separated space on the touch screen is sensed and recognized through limbs.

17. The electronic device of claim 14, wherein the window state determining module determines the state of the second application as a multi-window mode in which an interface is displayed in front of the touch screen when at least one of the following conditions is satisfied:

the window interface of the second application and the window interface of the first application are simultaneously displayed in the same touch screen in a foreground mode;

the window interface of the second application and the window interface of the first application are simultaneously and respectively displayed in different touch screens in a foreground mode;

and at least one of the first application and the second application has a part of window interface foreground displayed in different touch screens.

18. An electronic device according to claim 17, wherein the first application and the second application are implemented by any one of the following:

the first application and the second application belong to the same processing system;

at least one of the first application and the second application belongs to different processing systems.

19. An electronic device according to claim 14, wherein the preset trigger condition that the first application points to the second application comprises at least one of:

the identified user control track is that in a preset effective period Ts, the number of times of clicking on a window interface of a first application meets a first requirement M, the number of times of clicking on a window interface of a second application meets a second requirement N, M, N is a preset number of times of clicking, Ts is effective time of the user control track, Ts is more than 0 second, M is more than or equal to 1, and N is more than or equal to 1;

the identified user control track is that a preset pattern is slid in a window interface of a first application, and the user control track slides at least a first threshold distance from the position of the preset pattern to the position of a second application window interface;

the identified user operation track is that in a preset effective period Ts, the number of times of clicking on a window interface of a first application meets a first requirement K, the window interface of the first application slides to the position direction of a window interface of a second application for at least a second threshold distance, K is the preset number of times of clicking, Ts is the effective time of the user operation track, Ts is more than 0 second, and K is more than or equal to 1;

the identified user control track is that within a preset effective period Ts, the time is longer than T milliseconds in a window interface of a first application, and at least a third threshold distance is slid from the window interface of the first application to the position direction where a window interface of a second application is located, wherein Ts is larger than 0, and T is larger than 0.

20. An electronic device as claimed in claim 14, wherein the preset trigger condition for the first application to point to the second application comprises:

the identified user manipulation trajectory is a sliding behavior of a window interface of the first application sliding to a window interface of the second application.

21. A touch display device comprising at least a touch screen and a processor,

the touch screen is used for displaying interface information of an application window and sensing a control behavior acted on the touch screen, and sending a corresponding control instruction generated by the control behavior to the processor;

the processor is configured to identify a user control track according to the control instruction, and send a communication establishment request of the first application in a message broadcasting manner when the user control track is determined to meet a preset trigger condition that the first application points to the second application; the second application is further used for judging whether the state of the second application is a multi-window mode in which an interface is displayed on the front desk of the touch screen or not after receiving the communication establishment request; and when the result of the determination is yes, establishing a data communication link between the first application and the second application, so that the first application and the second application perform service-level message interaction processing based on the established data communication link, where the service-level message interaction processing includes: sharing, payment, inquiry, data transfer, listening to songs.

22. The touch display device of claim 21, wherein the preset trigger condition for the first application to point to the second application comprises:

the identified user manipulation trajectory is a sliding behavior of a window interface of the first application sliding to a window interface of the second application.

23. The touch display device of claim 21, wherein the processor sends the communication establishment request of the first application in a message broadcast;

correspondingly, the establishing of the data communication link between the first application and the second application comprises:

after the second application receives the communication establishment request, establishing a communication link of the second application to the first application, and returning a response message to the first application;

establishing a point-to-point communication link from the first application to the second application after the first application receives the reply message of the second application.

Images