Background
The mobile phone interconnection split screen projection technology is characterized in that a mobile phone and a computer terminal are in communication connection through a USB (universal serial bus) line or WiFi (wireless fidelity), the mobile phone runs an APP, the computer terminal also runs corresponding APPs at the same time, and the two APPs establish a TCP (transmission control protocol) communication channel through the physical communication channel. During interconnection, the APP establishes an invisible virtual screen in a mobile phone system, the main screen locks the screen or displays a screen locking mask, the content displayed on the virtual screen of the mobile phone is displayed, as shown in fig. 2, the APP sends an interface to a computer terminal through video streaming by capturing the screen and video coding, and the APP at the computer terminal receives the video data sent by the mobile phone through decoding the video streaming. If the screen of the computer terminal is a touch screen, control actions such as clicking and dragging can be directly performed on the touch screen, an APP on the computer terminal forwards an event to an APP at a mobile phone end through an interconnection transmission channel, and the APP is injected into a virtual screen interface created by the mobile phone APP after coordinate conversion, so that reverse control is realized.
By the control mode, when a vehicle drives, the position of the display screen is far away from a driver, and the driver can perform touch operation only by leaning on the side, so that the control mode is not safe and convenient enough;
in addition, if the computer terminal is an instrument terminal without a touch function, touch operation cannot be performed on a displayed interface, and only viewing is performed, so that user experience is poor.
Disclosure of Invention
The invention aims to provide a touch pad system and a touch pad method for mobile phone interconnection split screen projection.
In order to achieve the purpose, the touch pad system for interconnecting and split-screen projection of the mobile phone comprises the mobile phone and a computer terminal, wherein the mobile phone is used for establishing a split-screen projection channel with the computer terminal, the computer terminal is used for displaying a mobile phone virtual screen interface of the mobile phone, and the mobile phone displays a simulated touch pad interface;
the mobile phone is also used for converting the position change condition of a touch point when a single finger slides on the simulated touch pad interface to the virtual screen interface of the mobile phone so as to enable a mouse type indication icon on the virtual screen interface of the mobile phone to carry out synchronous position change;
the mobile phone is also used for converting the main screen clicking operation on the simulated touch pad interface into a clicking event of the current position of the mouse type indication icon on the virtual screen interface of the mobile phone.
The invention has the beneficial effects that:
the invention adds a function of simulating the touch pad on the main screen of the mobile phone, and when a user slides, clicks and drags the main screen of the mobile phone, the user directly transmits an event to the interface of the virtual screen. And synchronously displaying mouse indication icons on the virtual screen, so that a user can conveniently know the position of the current coordinate point and operation actions, such as clicking, dragging, double clicking and the like. Through the mobile phone interconnection screen projection technology, the computer terminal can see the interface and the operation process of the virtual screen. The invention takes the main screen of the mobile phone as the touch pad and places the touch pad at the hand of the user, thereby realizing safe, convenient and quick operation and improving the driving safety and smoothness.
Detailed Description
The invention is described in further detail below with reference to the following figures and specific examples:
the touch panel system for interconnection and split screen projection of the mobile phone shown in fig. 1 comprises a mobile phone 1 and a computer terminal 2, wherein the mobile phone 1 is used for establishing a split screen projection channel with the computer terminal 2 (such as a car machine and the like) through a mobile phone interconnection technology, the computer terminal 2 is used for displaying a mobile phone virtual screen interface of the mobile phone 1, the mobile phone 1 displays a simulated touch panel interface, and a mouse indication icon corresponding to the position of a touch point on the simulated touch panel interface is arranged on the mobile phone virtual screen interface as shown in fig. 2;
the mobile phone 1 is also used for converting the position change condition of a touch point when a single finger slides on the simulated touch pad interface to the virtual screen interface of the mobile phone so as to enable a mouse type indication icon on the virtual screen interface of the mobile phone to carry out synchronous position change;
the mobile phone 1 is further configured to convert a main screen clicking operation on the simulated touch panel interface into a clicking event of the current position of a mouse-like indication icon on the virtual screen interface of the mobile phone.
In the technical scheme, hundred million driving assistants or driving partner application programs are installed on the mobile phone 1, hundred million mobile phone interconnection is installed on the computer terminal 2, and a split screen projection channel between the mobile phone 1 and the computer terminal 2 can be realized by utilizing a mobile phone interconnection technology.
In the above technical solution, the application program (driving assistant or driving partner application program) of the mobile phone 1 intercepts a control event simulating a change of a position of a touch point when a single finger slides on a touch pad interface, and converts coordinates of the touch point into coordinates of a mouse type indication icon on a virtual screen interface of the mobile phone in a coordinate transformation manner, so that the mouse type indication icon on the virtual screen interface of the mobile phone performs a synchronous position change.
In the technical scheme, the function of the simulated touch pad is realized through a common interface, for example, a black common control capable of receiving touch events, such as ImageView, is displayed on a main screen of the mobile phone.
When the mobile phone 1 is interconnected with the computer terminal 2, the mobile phone 1 runs an application program, and the mobile phone 1 displays a mask interface for successful interconnection as shown in fig. 2. When the user wants to switch to the touchpad function, the user can "turn on the touchpad" by clicking the button of the mask interface and switch the mask view to the touchpad interface, as shown in fig. 3.
In the technical scheme, the coordinate transformation mode is that the abscissa and the ordinate of the touch point position are multiplied by a coefficient to obtain the abscissa of the mouse type indication icon on the virtual screen interface of the mobile phone, and the coefficient is obtained by dividing the length or the width of the virtual screen interface of the mobile phone by the length or the width of the simulated touch pad interface.
In the technical scheme, the size ratio of the virtual screen interface of the mobile phone is consistent with that of the simulated touch pad interface.
In the above technical solution, the initial position of the touch point on the simulated touch pad interface is defaulted to be the central point of the simulated touch pad interface, and the initial position of the mouse type indication icon on the corresponding mobile phone virtual screen interface is defaulted to be the central point of the mobile phone virtual screen interface. When a user operates on the simulated touch pad interface of the mobile phone, the viewed interface is the interface of the virtual screen, so that the user needs to see where the current touch point is, and the user can conveniently perform accurate touch operation on the touch point.
In the above technical solution, the specific method for converting the click operation of the main screen on the simulated touch panel interface into the click event of the current position of the mouse type indication icon on the virtual screen interface of the mobile phone by the mobile phone 1 is as follows: the method includes the steps that a mobile phone application program (a hundred million driving assistants or driving partner application programs) carries out coordinate transformation on position coordinates of a current touch point on a touch pad interface to obtain position coordinates of a mouse type indication icon on a corresponding mobile phone virtual screen interface, when a main screen clicking operation is generated on a simulated touch pad interface, the mouse type indication icon on the mobile phone virtual screen interface carries out corresponding clicking action prompt, for example, a mouse displays clicking animation, meanwhile, the mobile phone application program forwards coordinates corresponding to the main screen clicking operation of the touch point to the mobile phone virtual screen interface after coordinate transformation, clicking events are directly injected, and the clicking events are injected to the current interface of the mobile phone virtual screen interface.
In the above technical solution, the mobile phone 1 is further configured to determine position changes of two touch points when a double-finger sliding operation is performed on the simulated touch pad interface, and if the distance between the two touch points is fixed, a dragging event is defined as a parallel sliding event, and the dragging event is directly injected into the virtual screen interface of the mobile phone;
if the distance between the two touch points is enlarged or reduced, the event is defined as a zooming event and is directly injected into the virtual screen interface of the mobile phone.
In the above technical solution, the mobile phone 1 displays the simulated touch pad interface to replace a lock screen or display a lock screen mask, or the mobile phone 1 displays the simulated touch pad interface by superimposing on the lock screen or the display of the lock screen mask.
In the above technical solution, the mobile phone 1 is configured to perform corresponding double-click action prompt on a mouse type indication icon on a virtual screen interface of the mobile phone when a main screen double-click operation is generated on a simulated touch pad interface, and simultaneously, the mobile phone application program forwards coordinates corresponding to the main screen double-click operation of a touch point to the virtual screen interface of the mobile phone after coordinate transformation, and directly injects a double-click event.
A touch pad interaction method for interconnection split screen projection of a mobile phone comprises the following steps:
step 1: a split screen projection channel is established between the mobile phone 1 and the computer terminal 2;
step 2: the computer terminal 2 displays a virtual screen interface of the mobile phone 1, and the mobile phone 1 simulates a touch pad interface;
and step 3: the mobile phone 1 converts the position change condition of a touch point when a single finger slides on the simulated touch pad interface to a virtual screen interface of the mobile phone, so that a mouse type indication icon on the virtual screen interface of the mobile phone carries out synchronous position change;
the method comprises the following steps that a mobile phone 1 converts a main screen clicking operation on a simulated touch pad interface into a clicking event of the current position of a mouse type indication icon on a virtual screen interface of the mobile phone;
the mobile phone 1 judges the position change of two touch points when the double fingers slide on the simulated touch pad interface, if the distance between the two touch points is fixed, the two touch points are defined as a dragging event and are directly injected into the virtual screen interface of the mobile phone;
if the distance between the two touch points is enlarged or reduced, the event is defined as a zooming event and is directly injected into the virtual screen interface of the mobile phone.
Details not described in this specification are within the skill of the art that are well known to those skilled in the art.