Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart of an operation control method provided in an embodiment of the present invention is shown, and is applied to a first terminal. As shown in fig. 1, an operation control method mainly includes the following steps:
step 101, in a state of establishing remote control connection with a second terminal, displaying a first interface of the first terminal in a first display area, and displaying a second interface of the second terminal in a second display area;
in this embodiment, a remote control connection is established between the first terminal and the second terminal, so as to implement data interaction between the first terminal and the second terminal. The first terminal and the second terminal may be mobile terminals, PC terminals, or other terminal devices, without limitation. Specifically, the first terminal may establish a communication connection with the second terminal through the IP address and the user name, and acquire the remote control permission of the second terminal.
The first terminal comprises at least two display areas which can be defined as a first display area and a second display area, and the first display area and the second display area are not overlapped. After the first terminal establishes the remote control connection with the second terminal, the first terminal may obtain the second interface of the second terminal. The first terminal displays a first interface of the first terminal in the first display area, and displays a second interface of the second terminal in the second display area. Thus, the user can operate the first terminal through the first display area and can also operate the second terminal through the second display area. Of course, if there is only one display area, only the second interface of the second terminal may be displayed to implement the remote control function for the second terminal.
Specifically, the first display area and the second display area may be different areas of the same display screen of the first terminal;
alternatively, as shown in fig. 2, the first display region S1 and the second display region S2 may be regions in different display screens of the first terminal.
If the first terminal is a single-screen terminal, the display area of the single screen can be divided, and the interfaces of the two terminals are displayed in a split screen mode. Of course, the images can be displayed in different areas of the same display screen of the multi-screen terminal in a split-screen manner. If the first terminal is a multi-screen terminal, the interfaces of the two terminals can be respectively displayed through the areas of different display screens.
The first terminal respectively displays the first interface of the first terminal and the second interface of the second terminal through the two display areas, so that a user can check or control the second interface of the second terminal through the second display area and can check or control the first interface of the terminal through the first display area, state monitoring and the like of a control reference or the first interface are carried out, the user can not check the interface of the terminal, and complicated operation of display switching is not needed. The convenience of remote control is greatly improved.
102, receiving a first input of a first terminal user on the second interface;
step 103, responding to the first input, executing an operation corresponding to the first input on the second interface, and sending a first operation instruction corresponding to the first input to the second terminal, so that the second terminal executes an operation corresponding to the first operation instruction.
If the first terminal user needs to apply the remote control operation aiming at the second interface of the second terminal, a first input can be applied on the second display area of the first terminal, and the first input acts on the displayed second interface of the second terminal.
And after receiving the first input, the first terminal responds to the first input and executes the operation corresponding to the first input on the second interface. In addition, the first terminal can also generate a first operation instruction corresponding to the first input and send the first operation instruction to the second terminal. And after receiving the first operation instruction, the second terminal executes the operation corresponding to the first operation instruction. In this way, the user of the second terminal can view the remote operation process of the first terminal user on the second terminal through the display interface of the second terminal.
For example, if a first user applies a first input of opening or dragging a folder in an interface of a second terminal displayed on a screen of a first terminal, the second interface of the first terminal performs an operation of opening or dragging the folder. Meanwhile, the first terminal may generate a first operation instruction and transmit the first operation instruction to the second terminal. After receiving the first operation instruction, the second terminal can open or drag the folder, and a user of the second terminal can also view the operation of opening or dragging the folder. Therefore, the operation of the second terminal is remotely controlled by the first terminal user through the first terminal.
In the embodiment of the invention, the first terminal respectively displays the first interface of the first terminal and the second interface of the second terminal by utilizing the two display areas of the first terminal, so that a user of the first terminal can remotely control the second interface of the second terminal and does not influence the application of corresponding operation on the first interface of the first terminal. The operation control method provided by the embodiment achieves the purpose of remote assistance between the first terminal and the second terminal through relatively simple, convenient and rapid operation, and optimizes the remote assistance scheme of the terminal.
On the basis of the above embodiment, a function of real-time communication between the first terminal user and the second terminal user may be added to facilitate real-time guidance or communication. After the first terminal establishes the remote control connection with the second terminal, a voice call can be established with the second terminal, and the voice call can be in the forms of voice call, audio chat and the like. Of course, dialog boxes may be displayed on the first terminal and the second terminal, respectively, so that the first terminal user and the second terminal user may perform text or language communication through the dialog boxes. When the method is used specifically, the display priority of the dialog box can be set to be the highest, so that the dialog box is prevented from being shielded by interface information of an interface and communication is prevented from being influenced.
In another specific embodiment, the method may further include:
sending the target information of the first interface to the second terminal;
receiving a second operation instruction aiming at the first interface and sent by the second terminal;
and executing the operation corresponding to the second operation instruction on the first interface.
In this embodiment, after the first terminal establishes the remote control connection with the second terminal, the bidirectional remote control operation with the second terminal is realized. In addition to the first terminal displaying the second interface of the second terminal and performing the relevant operations in the above embodiments, the first terminal may also send target information of the first interface to the second terminal, where the target information may be all interface information or part of interface information in the first interface.
And after the second terminal receives the target information of the first interface, displaying the received target information of the first interface in a display area of the second terminal. If the second terminal user needs to perform remote control operation aiming at the first interface of the first terminal, corresponding input can be applied to the target information of the first interface displayed by the second terminal, and the second terminal generates a second operation instruction according to the received input and sends the second operation instruction to the first terminal. And after receiving a second operation instruction aiming at the first interface, the first terminal executes the operation corresponding to the second operation instruction aiming at the first interface. Therefore, the user of the second terminal can also realize the remote control operation of the first interface of the first terminal through the display area of the second terminal, and the user of the first terminal can watch the remote operation process of the first terminal by the user of the second terminal through the first display area of the first terminal.
The operation control method provided by the embodiment effectively realizes bidirectional remote control operation between the first terminal and the second terminal, and further improves convenience of remote control. In addition, the display order of the transmitting and/or receiving counterpart interfaces between the two terminals may not be limited.
Further, the sending the target information of the first interface to the second terminal may include:
receiving a second input of first target interface content displayed on the first interface by the first terminal user;
in response to the second input, sending the first target interface content to the second terminal;
and the first target interface content is all or part of the interface content in the first interface.
In this embodiment, a process of the first terminal sending the target information of the first interface to the second terminal is further limited. When the first terminal sends the first interface to the second terminal, the first terminal may send all interface contents of the first interface, or may send only part of the interface contents.
If the first terminal user needs to send only part of the interface content in the first interface to the second terminal for privacy or remote operation, the first terminal user may select the part of the interface content from the first interface as the first target interface content in the ready stage of establishing the remote control connection between the first terminal and the second terminal. And the first terminal responds to the received second input and sends the first target interface content to the second terminal.
Specifically, the manner in which the first terminal user determines the first target interface content from all interface contents of the first interface may include selecting the interface content included in the first target interface content through operations such as clicking and frame selection. Of course, the same selection effect can be achieved by removing the interface contents except the first target interface content through reverse operation. Other ways of selecting a part of the interface content from all the interface contents as the first target interface content are applicable to the present embodiment, and are not limited.
For example, as shown in fig. 2, the first display area S1 displays all interface contents of the first interface of the first terminal, and the first target interface content is a1, then the first terminal sends only a1 to the second terminal. As shown in fig. 3, only the first target interface content a1 is displayed on the interface of the second terminal.
In addition, the step of applying the second input to select the first target interface content may be performed before the step of initially sending the interface, that is, at a ready stage of establishing a remote control connection between the first terminal and the second terminal, or may be performed during a remote operation process to modify specific content of the first target interface content, so as to appropriately increase or decrease interface content received by the other terminal, and further meet user requirements. For example, if part of the interface content in the first interface is modified from a visible state to an invisible state, the part of the interface content displayed by the second terminal disappears. On the contrary, if part of the interface content in the first interface is modified from the invisible state to the visible state, the part of the interface content is additionally displayed in the first interface displayed by the second terminal.
Correspondingly, in a ready stage when the first terminal establishes the remote control connection with the second terminal, before the second terminal sends the second interface to the first terminal, the second terminal user may also apply a corresponding input on the second interface, and divide the content of the second interface into visible interface content and invisible interface content, so that the second terminal only sends the visible interface content to the first terminal, so as to meet the privacy requirement of the second terminal or simplify the interface content received by the first terminal.
In this embodiment, when the first terminal is configured to send the interface content to the second terminal, the selective sending part does not relate to the interface content that is private or only required for remote operation, but not all the interface content, the other party cannot know the part of the interface content that is hidden and not sent, and the second terminal can also perform the corresponding operation of selective sending when sending the interface content to the first terminal. Therefore, the privacy and the safety of remote control operation can be effectively improved, the interface content in the remote control process is simplified, and the operation of a user is facilitated.
In another specific embodiment, in step 101, after the first interface of the first terminal is displayed in the first display area and the second interface of the second terminal is displayed in the second display area, the method may further include:
receiving a first sliding input of the first end user, wherein a sliding starting point of the first sliding input is located on a first object of the first interface, and a sliding ending point of the first sliding input is located in the second interface;
and responding to the first sliding input, transmitting the first object to the second terminal, and displaying the first object on a second interface.
The operation control method provided by the embodiment adds a content sharing function between terminals. The first terminal user applies a first sliding input on the first terminal, the sliding starting point of the first sliding input is located on the first object of the first interface, and the sliding terminal of the first sliding input is located on the second interface, namely a continuous operation, and the first object is dragged from the first interface to the second interface. Specifically, the first object to be acted upon may be a file, an application icon, and the like, without limitation.
After receiving the first sliding input, the first terminal sends the first object to which the first sliding input is directed to the second terminal, so that the purpose of sharing the first object of the first terminal to the second terminal can be achieved. After that, the first terminal user may also perform related operations on the newly added object in the second terminal by moving, opening, or setting the first object in the second interface of the second display area. In addition, after the first terminal sends the first object to the second terminal, the first object may still be retained in the first terminal, or the first object may be deleted, which is not limited.
According to the embodiment, the first terminal user can directly realize the purpose of sending the first object in the first terminal to the second terminal through the first sliding input acting on the first terminal, and the object sharing operation between the terminals is conveniently realized.
In another embodiment, after the first interface of the first terminal is displayed in the first display area and the second interface of the second terminal is displayed in the second display area, the method may further include:
receiving a second sliding input of a first end user, wherein a sliding starting point of the second sliding input is located on a second object of the second interface, and a sliding ending point of the second sliding input is located in the first interface;
sending a request message for the second object to the second terminal in response to the second slide input;
and receiving the second object sent by the second terminal, and displaying the second object on the first interface.
The operation control method provided by the embodiment is used for realizing a function of sharing a second object in a second terminal to a first terminal. If the first terminal user needs to apply the second object of the second terminal, the second sliding input can be directly applied to the two display areas of the first terminal, and the operation that the second object is dragged to the first terminal from the second terminal is achieved. Specifically, the sliding start point of the second sliding input is located on the second object of the second interface, and the sliding end point is located within the first interface.
After receiving the second sliding input, the first terminal may send a request message of the second object to the second terminal, so as to request the second terminal to acquire the second object. And after receiving the request message of the second object, the second terminal sends the second object to the first terminal, and the first terminal receives and displays the second object. Therefore, the purpose of sharing the second object in the second terminal into the first terminal can be achieved. In addition, after the second terminal sends the first object to the first terminal, the second object may still be retained in the second terminal, or the second object may be directly deleted.
According to the embodiment, the first terminal user can directly slide and input through the second sliding part acting on the first terminal, the purpose that the second object in the second terminal is sent to the first terminal is achieved, and object sharing operation between the terminals is achieved conveniently.
In addition, after the first interface of the first terminal is displayed in the first display area and the second interface of the second terminal is displayed in the second display area, the method may further include:
receiving N times of input of the first terminal user on the second interface;
and recording the N times of input to generate a target operation file.
In this embodiment, the first terminal can receive N times of inputs of the first terminal user on the second interface of the second terminal, so as to implement remote control operation on the second terminal. When the first terminal receives the input of the first terminal user for the second interface, the first terminal may record the received input N times and generate the target operation file. The target operation file is recorded by the first terminal, acts on N times of input of the second interface, and specifically may include a change process of interface content in the second interface before and after receiving the input, and a specific action type, an action area, an action object and the like of the N times of input, and the target operation file may be a video file. Of course, the first terminal may record only a part of the inputs acting on the second interface, such as inputs for modifying configuration parameters, updating file contents, and the like, and may not record inputs not affecting the second interface, such as inputs for turning off a file by a point switch. The first terminal may also record all inputs to the second interface to preserve the complete control process.
After the remote control connection is finished, the first terminal can look back at the remote control process. In addition, the first terminal can also send the generated target operation file to other terminals, so that other terminal users can learn related operations by watching the target operation file, and subsequent multiple remote operation processes are omitted.
Referring to fig. 4, a schematic flow chart of another operation control method according to an embodiment of the present invention is provided. The control method provided by this embodiment is applied to a second terminal, which may be the second terminal related to the foregoing embodiment. As shown in fig. 4, the control method mainly includes:
step 401, in a state of establishing a remote control connection with a first terminal, sending an interface of a second terminal to the first terminal;
in this embodiment, the second terminal establishes a remote control connection with the first terminal, and may send an interface of the second terminal to the first terminal, so as to provide the first terminal with an authority to remotely control the interface of the second terminal.
Before sending the interface of the second terminal to the first terminal, the second terminal may also send a remote control request to the first terminal to request the first terminal to remotely control the second terminal. If a connection instruction returned by the first terminal based on the remote control request is received, the second terminal can establish a remote control connection with the first terminal, and then send interface information of the second interface to the first terminal.
For the specific implementation process of establishing the remote control connection between the second terminal and the first terminal and sending the second interface, reference may be made to the above embodiments, which are not described again.
Step 402, receiving a first operation instruction sent by the first terminal;
and step 403, executing the operation corresponding to the first operation instruction.
The first terminal receives and displays the second interface of the second terminal, a first terminal user applies a first interface acting on the second terminal according to a control requirement, the first terminal generates a corresponding first operation instruction according to the received first input, and sends the first operation instruction to the second terminal. And after receiving the first operation instruction, the second terminal executes the operation corresponding to the first operation instruction. Thus, the remote control operation of the first terminal on the second terminal is realized.
In the control method provided by the embodiment, the second terminal sends the interface of the second terminal to the first terminal, so that the first terminal can remotely control the interface of the second terminal. Therefore, the purpose that the first terminal remotely assists the second terminal can be achieved through simple, convenient and fast operation, and the scheme that the second terminal receives remote assistance of the first terminal is optimized. For a specific implementation process of the operation control method provided in the embodiment of the present invention, reference may be made to the specific implementation process of the operation control method provided in the above embodiment, and details are not described here any more.
In a specific embodiment, the method may further include:
receiving interface information of a first interface of the first terminal, which is sent by the first terminal;
displaying the first interface in a third display area, and displaying the second interface in a fourth display area;
receiving a third input of a second end user on the first interface;
responding to the third input, executing an operation corresponding to the third input on the first interface, and sending a second operation instruction corresponding to the third input to the first terminal, so that the first terminal executes an operation corresponding to the second operation instruction.
In this embodiment, a reverse control function of the second terminal on the first terminal is added to implement a bidirectional remote control operation between the first terminal and the second terminal. The second terminal may apply a remote control operation directed to the first terminal upon receiving the interface information of the first interface.
The second terminal may include at least two display areas, which may be defined as a third display area and a fourth display area, respectively, and the third display area and the fourth display area do not overlap. After the second terminal establishes the remote control connection with the first terminal, the second terminal may obtain the first interface of the first terminal, display the first interface of the first terminal in the third display area, and display the second interface of the second terminal in the fourth display area. Thus, the user can operate the first terminal through the third display area and can also operate the second terminal through the fourth display area. Of course, if there is only one display area, only the first interface of the first terminal may be displayed, so as to implement the remote control function of the second terminal on the first terminal.
And after receiving the interface information of the first interface, the second terminal displays the first interface in the third display area. If the second terminal user needs to apply a remote control operation for the first interface of the first terminal, a third input may be applied on the interface information of the first interface. And the second terminal generates a second operation instruction according to the received third input and sends the second operation instruction to the first terminal. And after receiving a second operation instruction aiming at the first interface, the first terminal executes the operation corresponding to the second operation instruction aiming at the second interface. Therefore, the first terminal user can realize the remote control operation of the second terminal through the first terminal, and the second terminal user can realize the remote control operation of the first terminal through the second terminal.
The operation control method provided by the embodiment effectively realizes bidirectional remote control operation between the first terminal and the second terminal, and further improves convenience of remote control.
Further, the third display area and the fourth display area may be different areas of the same display screen of the second terminal;
alternatively, as shown in fig. 3, the third display region S3 and the fourth display region S4 are regions in different display screens of the second terminal.
If the second terminal is a single-screen terminal, the display area of the single screen can be divided, and the interfaces of the two terminals are displayed in a split screen mode. Of course, the images can be displayed in different areas of the same display screen of the multi-screen terminal in a split-screen manner. If the second terminal is a multi-screen terminal, the interfaces of the two terminals can be respectively displayed through the areas of different display screens.
The second terminal respectively displays the first interface of the first terminal and the second interface of the second terminal through the two display areas, so that a second terminal user can view or control the first interface of the first terminal through the third display area and view or control the second interface of the second terminal through the fourth display area, control reference is carried out or state monitoring of the second interface is carried out, and the like. The user is not influenced to check the interface of the second terminal, and the complicated operation of switching the display is not needed. The remote control system is convenient for users to use to a great extent, and improves the convenience of remote control.
In another specific embodiment, the sending, to the first terminal, interface information of a second interface of the second terminal may include:
receiving a fourth input of second target interface content displayed on the second interface by a second end user;
in response to the fourth input, sending the second target interface content to the first terminal;
and the second target interface content is all or part of the interface content in the second interface.
In this embodiment, when the second terminal transmits the second interface to the first terminal, the second terminal may transmit all the interface contents of the second interface, or may transmit only part of the interface contents.
If the second terminal user only needs to send part of the interface content in the second interface to the first terminal for privacy or remote operation, the part of the interface content may be defined as the second target interface content. And the second terminal applies a third input on the second target interface content of the second interface, and sends the second target interface content to the first terminal corresponding to the third input.
Specifically, the manner in which the second terminal user determines the second target interface content in all the interface contents of the second interface may include selecting the interface content included in the second target interface content through operations such as clicking and frame selection. Of course, the same selection effect can be achieved by removing the interface contents except the second interface contents through reverse operation. Other modes that can select some interface contents from all interface contents as the second target interface contents are applicable to the present embodiment, and are not limited.
Accordingly, as shown in fig. 3, the third display area S3 of the second terminal displays the first interface of the first terminal, and the fourth display area displays the second interface of the second terminal. If the first terminal user sets the first target interface content to be A1 and the second terminal user sets the second target interface content to be A2, the second target interface content A2 is displayed in the second display area of the first terminal and the first target interface content A1 is displayed in the third display area of the second terminal.
In this embodiment, when the second terminal is configured to send the interface content to the first terminal, the interface content that is not sent by the other party cannot be known by the other party because the selective sending part does not relate to the interface content that is private or only required for remote operation, but not all the interface content. Therefore, the privacy and the safety of remote control operation can be effectively improved, the interface content in the remote control process is simplified, and the operation of a user is facilitated.
For a specific implementation process of the embodiment of the present invention, reference may be made to the specific implementation process of the control method provided in the embodiment shown in fig. 1 to fig. 3, and details are not repeated here.
Referring to fig. 5, a schematic structural diagram of a first terminal according to an embodiment of the present invention is provided, where the terminal may be the first terminal according to the foregoing embodiment. As shown in fig. 5, the first terminal 500 includes:
a display module 501, configured to display a first interface of a first terminal in a first display area and display a second interface of a second terminal in a second display area in a state where a remote control connection is established with the second terminal;
a first receiving module 502, configured to receive a first input of a first end user on the second interface;
a first executing module 503, configured to, in response to the first input, execute an operation corresponding to the first input on the second interface, and send a first operation instruction corresponding to the first input to the second terminal, so that the second terminal executes an operation corresponding to the first operation instruction.
Optionally, the first display area and the second display area are different areas of the same display screen of the first terminal;
or the first display area and the second display area are areas in different display screens of the first terminal.
Optionally, as shown in fig. 6, the first terminal 500 may further include:
a first sending module 504, configured to send target information of the first interface to the second terminal;
a second receiving module 505, configured to receive a second operation instruction, which is sent by the second terminal and is addressed to the first interface;
a second executing module 506, configured to execute an operation corresponding to the second operation instruction on the first interface.
Optionally, the first sending module 504 may be configured to:
receiving a second input of first target interface content displayed on the first interface by the first terminal user;
in response to the second input, sending the first target interface content to the second terminal;
and the first target interface content is all or part of the interface content in the first interface.
Optionally, as shown in fig. 7, the first terminal 500 may further include:
a third receiving module 505, configured to receive a first sliding input of the first end user, where a sliding start point of the first sliding input is located on a first object of the first interface, and a sliding end point of the first sliding input is located in the second interface;
a second sending module 508, configured to send the first object to the second terminal in response to the first sliding input, and display the first object on a second interface.
Optionally, as shown in fig. 8, the first terminal 500 may further include:
a fourth receiving module 509, configured to receive a second sliding input of the first end user, where a sliding start point of the second sliding input is located on a second object of the second interface, and a sliding end point of the second sliding input is located in the first interface;
a third sending module 510, configured to send a request message for the second object to the second terminal in response to the second sliding input;
a fifth receiving module 511, configured to receive the second object sent by the second terminal, and display the second object on the first interface.
Optionally, as shown in fig. 9, the first terminal 500 may further include:
a sixth receiving module 512, configured to: receiving N times of input of the first terminal user on the second interface;
and a recording module 513, configured to record the N inputs, and generate a target operation file.
In the embodiment of the invention, the first terminal respectively displays the first interface of the first terminal and the second interface of the second terminal by utilizing the two display areas of the first terminal, so that a user of the first terminal can remotely control the second interface of the second terminal and does not influence the application of corresponding operation on the first interface of the first terminal. The operation control method provided by the embodiment achieves the purpose of remote assistance between the first terminal and the second terminal through relatively simple, convenient and rapid operation, and optimizes the remote assistance scheme of the terminal. For a specific implementation process of the first terminal provided in the embodiment of the present invention, reference may be made to the specific implementation process of the operation control method provided in the above embodiment, and details are not described here any more.
Referring to fig. 10, a schematic structural diagram of a second terminal according to an embodiment of the present invention is provided, where the second terminal may be the second terminal according to the foregoing embodiment. As shown in fig. 10, the second terminal 1000 can include:
a sending module 1001, configured to send interface information of a second interface of the second terminal to a first terminal in a state where a remote control connection is established with the first terminal;
a first receiving module 1002, configured to receive a first operation instruction sent by the first terminal;
a first executing module 1003, configured to execute an operation corresponding to the first operation instruction.
Optionally, as shown in fig. 11, the second terminal 1000 may further include:
a second receiving module 1004, configured to receive interface information of the first interface of the first terminal sent by the first terminal;
a display module 1005, configured to display the first interface in a third display area, and display the second interface in a fourth display area;
a third receiving module 1006, configured to receive a third input of the second end user on the first interface;
a second executing module 1005, configured to, in response to the third input, execute an operation corresponding to the third input on the first interface, and send a second operation instruction corresponding to the third input to the first terminal, so that the first terminal executes an operation corresponding to the second operation instruction.
Optionally, the third display area and the fourth display area are different areas of the same display screen of the second terminal;
or the third display area and the fourth display area are areas in different display screens of the second terminal.
The sending module 1001 is configured to:
receiving a fourth input of second target interface content displayed on the second interface by a second end user;
in response to the fourth input, sending the second target interface content to the first terminal;
and the second target interface content is all or part of the interface content in the second interface.
In the second terminal provided in the foregoing embodiment of the present invention, the second terminal sends the interface of the second terminal to the first terminal, so that the first terminal can remotely control the interface of the second terminal. Therefore, the purpose that the first terminal remotely assists the second terminal can be achieved through simple, convenient and fast operation, and the scheme that the second terminal receives remote assistance of the first terminal is optimized. For a specific implementation process of the second terminal provided in the embodiment of the present invention, reference may be made to the specific implementation process of the operation control method provided in the above embodiment, and details are not described here any more.
Referring to fig. 12, a schematic structural diagram of a related terminal according to another embodiment of the present invention is provided, where the related terminal may be the first terminal or the second terminal provided in the foregoing embodiment. As shown in fig. 12, to implement an associated terminal 1200 according to various embodiments of the present invention, the associated terminal 1200 includes, but is not limited to: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1205, interface unit 1208, memory 1209, processor 1210, and power source 1211. Those skilled in the art will appreciate that the terminal configuration shown in fig. 12 is not intended to be limiting, and that the terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
If the related terminal 1200 is the first terminal in the above embodiment, the processor 1210 may be configured to:
displaying a first interface of a first terminal in a first display area and displaying a second interface of a second terminal in a second display area in a state of establishing remote control connection with the second terminal;
receiving a first input of a first end user on the second interface;
responding to the first input, executing the operation corresponding to the first input on the second interface, and sending a first operation instruction corresponding to the first input to the second terminal, so that the second terminal executes the operation corresponding to the first operation instruction.
Optionally, the first display area and the second display area are different areas of the same display screen of the first terminal;
or the first display area and the second display area are areas in different display screens of the first terminal.
Optionally, the processor 1210 may further be configured to:
sending the target information of the first interface to the second terminal;
receiving a second operation instruction aiming at the first interface and sent by the second terminal;
and executing the operation corresponding to the second operation instruction on the first interface.
Optionally, the processor 1210 is further configured to:
receiving a second input of first target interface content displayed on the first interface by the first terminal user;
in response to the second input, sending the first target interface content to the second terminal;
and the first target interface content is all or part of the interface content in the first interface.
Optionally, the processor 1210 is further configured to:
receiving a first sliding input of the first end user, wherein a sliding starting point of the first sliding input is located on a first object of the first interface, and a sliding ending point of the first sliding input is located in the second interface;
and responding to the first sliding input, transmitting the first object to the second terminal, and displaying the first object on a second interface.
Optionally, the processor 1210 is further configured to:
receiving a second sliding input of a first end user, wherein a sliding starting point of the second sliding input is located on a second object of the second interface, and a sliding ending point of the second sliding input is located in the first interface;
sending a request message for the second object to the second terminal in response to the second slide input;
and receiving the second object sent by the second terminal, and displaying the second object on the first interface.
Optionally, the processor 1210 is further configured to:
receiving N times of input of the first terminal user on the second interface;
and recording the N times of input to generate a target operation file.
If the related terminal 1200 is the second terminal in the above embodiments, the processor 1210 may be configured to:
sending interface information of a second interface of the second terminal to the first terminal in a state of establishing remote control connection with the first terminal;
receiving a first operation instruction sent by the first terminal;
and executing the operation corresponding to the first operation instruction.
Optionally, the processor 1210 is further configured to:
receiving interface information of a first interface of the first terminal, which is sent by the first terminal;
displaying the first interface in a third display area, and displaying the second interface in a fourth display area;
receiving a third input of a second end user on the first interface;
responding to the third input, executing an operation corresponding to the third input on the first interface, and sending a second operation instruction corresponding to the third input to the first terminal, so that the first terminal executes an operation corresponding to the second operation instruction.
Optionally, the third display area and the fourth display area are different areas of the same display screen of the second terminal;
or the third display area and the fourth display area are areas in different display screens of the second terminal.
Optionally, the processor 1210 is further configured to:
receiving a fourth input of second target interface content displayed on the second interface by a second end user;
in response to the fourth input, sending the second target interface content to the first terminal;
and the second target interface content is all or part of the interface content in the second interface.
The relevant terminal 1200 can implement each process implemented by the first terminal or the second terminal in the foregoing embodiments, and details are not described here to avoid repetition.
The related terminal of the embodiment of the invention realizes the purpose of unidirectional or bidirectional remote assistance between terminals through simpler, more convenient and faster operation, and optimizes the remote assistance scheme of the terminal. For a specific implementation process of the related terminal provided in the embodiment of the present invention, reference may be made to the specific implementation process of the operation control method provided in the embodiment shown in fig. 1 to fig. 4, which is not described in detail herein.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 1201 may be used for receiving and sending signals during information transmission and reception or during a call, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 1210; in addition, the uplink data is transmitted to the base station. Typically, the radio frequency unit 1201 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 1201 can also communicate with a network and other devices through a wireless communication system.
The terminal provides wireless broadband internet access to the user through the network module 1202, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 1203 may convert audio data received by the radio frequency unit 1201 or the network module 1202 or stored in the memory 1209 into an audio signal and output as sound. Also, the audio output unit 1203 may also provide audio output related to a specific function performed by the terminal 1200 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 1203 includes a speaker, a buzzer, a receiver, and the like.
The input unit 1204 is used to receive audio or video signals. The input Unit 1204 may include a Graphics Processing Unit (GPU) 12041 and a microphone 12042, and the Graphics processor 12041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 1206. The image frames processed by the graphics processor 12041 may be stored in the memory 1209 (or other storage medium) or transmitted via the radio frequency unit 1201 or the network module 1202. The microphone 12042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1201 in case of the phone call mode.
The terminal 1200 also includes at least one sensor 1205, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 12061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 12061 and/or backlight when the terminal 1200 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the terminal posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration identification related functions (such as pedometer, tapping), and the like; the sensors 1205 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., and will not be described further herein.
The display unit 1206 is used to display information input by the user or information provided to the user. The Display unit 1206 may include a Display panel 12061, and the Display panel 12061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 1205 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal. Specifically, the user input unit 1205 includes a touch panel 12051 and other input devices 12052. The touch panel 12051, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 12051 (e.g., operations by a user on or near the touch panel 12051 using a finger, a stylus, or any suitable object or attachment). The touch panel 12051 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1210, receives a command from the processor 1210, and executes the command. In addition, the touch panel 12051 may be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 12051, the user input unit 1205 may include other input devices 12052. In particular, the other input devices 12052 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 12051 may be overlaid on the display panel 12061, and when the touch panel 12051 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 1210 to determine the type of the touch event, and then the processor 1210 provides a corresponding visual output on the display panel 12061 according to the type of the touch event. Although the touch panel 12051 and the display panel 12061 are shown as two separate components in fig. 12 to implement the input and output functions of the terminal, in some embodiments, the touch panel 12051 and the display panel 12061 may be integrated to implement the input and output functions of the terminal, and this is not limited herein.
An interface unit 1208 is an interface for connecting an external device to the terminal 1200. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 1208 may be used to receive input from an external device (e.g., data information, power, etc.) and transmit the received input to one or more elements within the terminal 1200 or may be used to transmit data between the terminal 1200 and the external device.
The memory 1209 may be used to store software programs as well as various data. The memory 1209 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 1209 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 1210 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by running or executing software programs and/or modules stored in the memory 1209 and calling data stored in the memory 1209, thereby monitoring the entire terminal. Processor 1210 may include one or more processing units; preferably, the processor 1210 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1210.
The terminal 1200 may also include a power source 1211 (e.g., a battery) for powering the various components, and preferably, the power source 1211 is logically connected to the processor 1210 via a power management system such that the functions of managing charging, discharging, and power consumption are performed via the power management system.
In addition, the terminal 1200 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides a terminal, including a processor 1210, a memory 1209, and a computer program stored in the memory 1209 and capable of running on the processor 1210, where the computer program, when executed by the processor 1210, implements each process of the above control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the control method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.