CN114584815A - Method, computer readable storage medium and device for controlling screen projection in backward mode - Google Patents

Abstract

The present invention provides a returnable screen projection method, which includes: connecting an Android mobile terminal to a target terminal through a USB cable; opening the developer mode of the mobile terminal; using an ADB tool and an app_process tool that comes with the Android mobile terminal on the target terminal Run a control event input service program on the Android mobile terminal as a background service to activate the callback function of the Android mobile terminal; in the WIFI screen projection mode, disconnect the wired connection between the Android mobile terminal and the target terminal. Android mobile terminal users are no longer bound by wired connections in the control screen projection operation, the operation is more flexible and convenient, the user experience is improved, and it is conducive to the further popularization and promotion of screen projection technology. The present invention also provides a reversible screen projection device, including an Android mobile terminal, a target terminal, and a computer-readable storage medium, which have corresponding advantages because the reversible screen projection method of the present invention can be implemented.

Description

A reversible screen projection method, computer-readable storage medium and device

technical field

The present invention belongs to the technical field of screen projection, and in particular relates to a return-controllable screen projection method in the screen projection technology, and a related computer-readable storage medium and a screen projection device.

Background technique

With the increasing development of the Internet and the popularization of mobile terminals such as mobile phones and smart tablets, mobile terminals can more conveniently obtain rich Internet information resources and a large amount of data information due to their portability and the diversity of Internet connection methods; in addition, mobile terminals Based on the characteristics of its operating system, the interface is beautiful and easy to operate. For example, the interface look and feel of Android mobile phones and the user experience of operation are already excellent. However, the display screen of the general mobile terminal is often small, and it is not easy to use it in a fixed place. In many specific usage scenarios, people often need both the Internet content obtained by the mobile terminal and the content obtained in a fixed larger size. Display or operation on the screen, or there is a need to share the display content. For example, in vehicle applications, it is a very common and practical requirement to project the navigation of the mobile phone, the control of incoming calls, etc. onto the fixed screen of the vehicle. The so-called "car machine" refers to the abbreviation of the in-vehicle infotainment products installed in the car. The car machine can functionally realize the information communication between the person and the car, the car and the outside world (car to car). The functions that mobile phone users want to use on the car are projected onto the car, which reduces the development cost of the in-vehicle computer system. In addition to the CarPlay of the iOS system, the Android-based system has better domestic versatility in the application of the car screen projection. , the most used is Baidu's CarLife.

In screencasting applications, people often hope to be able to control the operation of the mobile terminal on the target terminal, that is, return control. For example, when the mobile phone casts the screen to the car machine, the operation performed on the car machine interface is controlled back to the mobile phone. In fact, the operation It's the phone itself. CarLife supports two modes: USB screen projection and WIFI screen projection. In USB screen projection mode, you need to always connect the mobile phone to the car machine with a USB cable, and then the mobile phone can be controlled back on the car machine. At present, the callback control of CarLife in the WIFI screen projection mode is aimed at the mobile terminal based on the iOS system, so it uses the protocol based on the iOS system for the callback control. Therefore, for the Android mobile terminal, CarLife does not support the return control operation in the WIFI screen projection mode, so that the user of the Android mobile terminal has to be constrained by the USB cable if he wants to control the Android mobile terminal on the target terminal when the screen is projected. It reduces the user experience and is not convenient enough in screencasting applications.

SUMMARY OF THE INVENTION

The present invention is based on the above-mentioned problems of the prior art, and aims to provide a reversible screen projection method, computer-readable storage medium and device, so that the user of the Android mobile terminal can be in the USB screen projection mode. The terminal is wired back to control (return control) Android mobile terminal, and it can also be wirelessly controlled in WIFI screen projection mode.

In the description of the present invention, the "screen projection" refers to transmitting the screen data of one terminal to another terminal for display. For the convenience of description, a terminal in this application refers to an Android mobile terminal. The other terminal mainly refers to electronic devices such as TVs and car center consoles (cars) that need to accept screen projections, hereinafter referred to as target terminals. The screen projection function may be provided by a computer system or an application. In this application, the screen projection function provided is called a screen projection main control. The screen-casting interface refers to the interface that the Android mobile terminal needs or actually displays on the target terminal.

It is well known that the expression form of the program interface is a Graphic User Interface (Graphic User Interface, hereinafter referred to as GUI), which refers to a user interface related to computer operations displayed in a graphical manner. The interface can be composed of visual interface elements such as icons, buttons, button groups, option areas, dialog boxes, prompt boxes, and progress bars. These visual interface elements are also known as application interface controls. Events are actions that can be recognized by the control, such as pressing the OK button, selecting a radio button or checkbox. Each control has its own identifiable events, such as form loading, single-click, double-click and other events, edit box (text box) text change events, and so on. All explanations or definitions of terms and related technical principles involved in this application are only illustrative rather than limiting.

In one aspect of the present invention, a method for screen projection that can be controlled back is provided. The steps include: step S1. Connect the Android mobile terminal to the target terminal through a USB cable; step S2. open the developer mode of the Android mobile terminal; step S3. The terminal runs a control event input service program in the Android mobile terminal as a background service through the ADB tool and the app_process tool that comes with the Android mobile terminal, and activates the callback function of the Android mobile terminal. The control event is injected into the Android mobile terminal after the callback event of the target terminal; step S4. In the WIFI screen projection mode, the wired connection between the Android mobile terminal and the target terminal is disconnected.

In the present invention, since the background service program run by the app_process tool has high authority, the control event input service program as the background service program can inject control events into the Android mobile terminal, so that the target terminal can perform operations and return to Android mobile terminal and perform the same operation on the Android mobile terminal. After the control event input service program is successfully run, the USB cable can be unplugged in the WIFI screen projection mode, so that the user can realize wireless return control without the constraints of wired connection.

Specifically, between the step S2 and the step S3, the target terminal pushes the control event input service program to the Android mobile terminal through an ADB tool.

In a preferred embodiment, the Android mobile terminal is an Android mobile phone or an Android smart tablet.

In a specific implementation situation, the target terminal is a vehicle machine.

In a feasible embodiment, the process of injecting control events into the Android mobile terminal by the control event input service program in the step S3 includes: step S31. Setting the running state of the control event input service program to True; step S32. Initialize the control event input service program, then create a Socket socket, and establish a TCP connection with the target terminal through the preset target terminal IP and port number; Step S33. Initialize the control event processing of the control event input service program Function module; Step S34. Start the first sub-thread, and use the reflection mechanism to call the "injectInputEvent" interface to inject control events into the Android mobile terminal when control flow data arrives, so as to realize the operation of controlling the Android mobile terminal on the target terminal.

In a specific method, in step S34, the running state of the control event input service program is judged, if the running state is True, the block waits to receive control flow data; if the running state is not True, the first sub-thread is terminated.

In a preferred embodiment, between step S32 and step S33, it is determined whether the connection between the Android mobile terminal and the target terminal is successful, and if the connection is successful, step S33 is started; if the connection fails, the operation of the control event input program is set to run The state is False, and the operation starts from step S1 again after sleeping for a preset time.

In another preferred embodiment, between step S31 and step S32, a second sub-thread is started, a DatagramSocket socket is created in the second sub-thread, and a socket is created through the UDP port every preset time. Broadcast a "Callback activated" message.

In another preferred embodiment, after step S4, when the user turns off the USB debugging switch on the Android mobile terminal, the control event input service program ends running. At this time, the Android mobile terminal cannot be controlled back on the target terminal.

In another feasible implementation, the specific process of activating the callback function of the Android mobile terminal in the step S3 includes: starting a sub-thread in the target terminal for receiving the pairing connection request of the Android mobile terminal and activating the callback operation. request; when the target terminal receives the request of the Android mobile terminal to activate the control operation, start the ADB tool to detect whether the Android mobile terminal has been connected to the target terminal through the USB cable, and detect whether the Android mobile terminal has turned on the USB debugging switch; The terminal is connected to the target terminal through a USB cable and the USB debugging switch is turned on, then the control event input program is pushed to the Android mobile terminal, and the control event input service program is run in the background of the Android mobile terminal through the ADB tool, and the Android The callback operation of the mobile terminal is activated.

In one of the better practices, the process of activating the callback function of the Android mobile terminal in the step S3 further includes: judging whether the activation is successful, if the activation is successful, the sub-thread is terminated; if the activation is unsuccessful, try again ; After trying the preset number of times, if it still cannot be activated, end the process.

In another aspect of the present invention, a program product is provided, the program product includes instructions, and when the instructions are run on a computer, the instructions cause the computer to execute the above-mentioned reversible screen projection method.

In another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium includes a computer program, and when the computer program runs, the computer can execute the above-mentioned returnable screen projection method.

In addition, the present invention also provides a screen projection device that can be controlled back, including: an Android mobile terminal, a target terminal and a computer program; the Android mobile terminal and the target terminal are communicatively connected; the Android mobile terminal includes a first processor, a third a memory; the target terminal includes a display screen, a control component, a second processor and a second memory; the computer program includes an ADB tool, an app_process tool, a control event input service program and a screen projection service program; the control component uses for receiving input operations; the display screen is used to display a screen projection interface; the first memory is used to store the app_process tool and the control event input service program; the second memory is used to store the ADB tool and the screen projection service program; the control event input program includes a network connection module and a control event processing module; the first processor is configured to perform the following operations: run the app_process tool to run the control event input service program in the background ; Run the network connection module to establish a communication connection between the Android mobile terminal and the target terminal; run the control event processing module to parse and process the control flow data sent from the target terminal, and then inject the corresponding control in the Android mobile terminal The screen projection service program at least includes a callback activation service module; the second processor is configured to perform the following operations: run the callback activation service module to send control flow data to the Android mobile terminal to realize the callback operation activation.

In a specific embodiment, when the control event input service program is running in the background, the first processor performs the following operations: setting the running state of the control event input service program to True; initializing the control event input service program program; run the network connection module to create a Socket socket, establish a TCP connection with the target terminal through the preset target terminal IP and port number; initialize the control event processing module, open the first sub-thread; when there is control flow data When it arrives, the "injectInputEvent" interface is invoked through the reflection mechanism to inject a control event into the Android mobile terminal, so as to realize the operation of controlling the Android mobile terminal on the target terminal.

In an optional approach, after opening the first sub-thread, the first processor also performs an operation: judging the running state of the control event input service program, and if the running state is True, blocking and waiting to receive the control flow. Data; if the running state is not True, the first child thread is terminated.

In a preferred embodiment, before initializing the control event processing module, the first processor further performs an operation: judging whether the connection between the Android mobile terminal and the target terminal is successful, and if the connection is successful, initializing the control event processing module; if the connection fails, set the running state of the control event input program to False, and set the running state of the control event input service program to True again after sleeping for a preset time.

In another preferred embodiment, after initializing the control event input service program, the first processor further executes an operation: running the network connection module to start a second sub-thread, and in the second sub-thread A DatagramSocket socket is created in the thread, and a "return control activated" message is broadcast out through the UDP port every preset time.

In a feasible embodiment, the callback activation service module is run, and the second processor performs the following operations: starting a sub-thread in the target terminal for receiving the pairing connection request of the Android mobile terminal and activating the callback operation. request; when a request for activating the callback operation of the Android mobile terminal is received, start the ADB tool to detect whether the Android mobile terminal has been connected to the target terminal through the USB cable, and detect whether the Android mobile terminal has turned on the USB debugging switch; After the terminal is connected to the target terminal through a USB cable and the USB debugging switch is turned on and the conditions are met, the control event input program is pushed to the Android mobile terminal, and the control event input program is executed in the background of the Android mobile terminal through the ADB tool. The service program activates the callback operation of the Android mobile terminal.

In an optional method, the second processor also performs an operation: judging whether the read activation is successful, and ending the process if the activation is successful; if the activation is unsuccessful, try again; if the activation still fails after a preset number of attempts end the process.

Preferably, the Android mobile terminal is an Android mobile phone or an Android smart tablet; the target terminal is a car machine. It is a common scene to use the screen projection function in the car. The content on the Android phone or Android smart tablet and the obtained Internet resources such as navigation maps, music players, etc. are displayed on the car display screen through the screen projection technology. The above-mentioned reversible screen projection method enables the user to operate the control components of the vehicle, such as knobs, buttons or touch screens, to control the Android mobile phone or the Android smart tablet, which is easier to operate and is also conducive to driving safety.

The present invention has the following beneficial effects: according to a method for screen projection that can be controlled back in the present invention, the control event input program is run in the background of the Android mobile terminal through the ADB tool and the app_process tool that comes with the Android mobile terminal, and the return control operation is performed. , you can bypass the problem that Android mobile terminal screencasting requires specific permissions. At the same time, in WIFI screencasting mode, you only need to open the developer mode, activate the callback function, and then unplug the USB cable to control the Android mobile terminal on the target terminal. The Android mobile terminal users are no longer bound by wired connections in the control screen projection operation, the operation is more flexible and convenient, the user experience is improved, and it is conducive to the further popularization and promotion of the screen projection technology. The reversible screen projection device and the computer storage medium of the present invention also have corresponding advantages because they can realize the above reversible screen projection method.

Description of drawings

FIG. 1 is a schematic diagram of a screen projection device that can be controlled back according to Embodiment 1 of the present invention.

FIG. 2 is a schematic diagram of the structure of a control event input program in Embodiment 1 of the present invention.

FIG. 3 is a schematic diagram of the structure of a screen projection service program in Embodiment 1 of the present invention.

FIG. 4 is a flowchart of a method for reversible screen projection in Embodiment 1 of the present invention.

FIG. 5 is a schematic diagram of an implementation process of a control event input program in Embodiment 1 of the present invention.

FIG. 6 is a schematic diagram of activating the callback function of the Android mobile terminal in Embodiment 1 of the present invention.

FIG. 7 is a schematic diagram of an implementation process of a control event input program in Embodiment 2 of the present invention.

Detailed ways

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings. In the figures, parts of the same structure or function are marked with the same reference numerals, and for reasons of clarity of illustration, if necessary, not all shown parts are marked with the associated reference numerals in all the figures.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise.

As shown in FIG. 1 , in the first embodiment of the present invention, the reversible screen projection device includes an Android mobile terminal and a target terminal. The Android mobile terminal in the specific embodiment is described by taking the Android mobile phone 10 as an example, and does not It can also be other mobile terminals based on the Android system such as Android smart tablet; and the target terminal is illustrated by taking the car machine 20 as an example, which is not limited, and the target terminal can also be a TV or a computer. In this embodiment, the vehicle 20 includes a display screen 201 and a control component 202, such as a central control device controlled by a knob. As is known, the Android mobile phone 10 and the car 20 can be connected through a USB cable. In the embodiment, the USB interface is an interface conforming to the USB standard specification, specifically a Mini USB interface, a Micro USB interface, and a USB Type C interface. In the embodiment of the present invention, the controllable screen projection system can support the USB wired screen projection mode and also support the WIFI wireless screen projection mode. The controllable screen projection device of the present invention can realize the return control in the USB wired screen projection mode. It can also realize wireless return control operation in WIFI wireless screen projection mode. In the USB screen projection mode, when the USB cable is always connected to realize the return control operation, it is only necessary to turn on the developer mode switch of the Android mobile phone 10 and connect the central control touch display screen 20 of the car with the USB cable. In the embodiment described above, the implementation of wireless return control operation in the WIFI screen projection mode is mainly described.

In the embodiment, the main screen projection control of the Android mobile phone 10 is an Android mobile phone terminal screen projection APP named ACarPlay. ACarPlay is used to capture the data being displayed on the screen of the Android phone 10, and then encode it into H264 data stream 10D through MediaCodec, and transmit it to the display screen 201 through the WIFI network (Socket) or USB network (LocalSocket) to realize the screencasting of the mobile phone.

In this embodiment, as shown in FIG. 1 , the Android phone 10 includes a first memory 101 and a first processor 102 ; the vehicle 20 further includes a second memory 203 and a second processor 204 . Both the first memory 101 and the second memory 203 are computer-readable storage media, which can be used to store computer-executable program codes, and the executable program codes include instructions; the first processor 102 is stored in the first memory 101 by running The second processor 203 can execute the instructions stored in the second memory 203 to complete corresponding operations. The controllable screen projection device further includes a computer program, and in this embodiment, it includes the app_process tool and the control event input service program stored in the first memory 101 ; the ADB tool and the screen projection stored in the second memory 203 service program. The ADB tool and the app_process tool that comes with the Android system are relatively common in this field, and will not be elaborated here.

The control event input program is used for injecting control events into the Android mobile phone 10 after receiving the feedback control events from the vehicle machine 20 through the communication WIFI network (Socket) or the USB network (LocalSocket). In this embodiment, the control event input program is named "ACarPlayInputEventServer". Hereinafter, the control event input program is referred to as ACarPlayInputEventServer. In the embodiment, the ACarPlayInputEventServer, as shown in FIG. 2 , includes a network connection module 11 and a control event processing module 12 .

The screen projection service program, as shown in FIG. 3, is named ACarPlayServer in this embodiment, and includes a callback activation service module 21, a mobile phone pairing and connection service module, an H264 data receiving service module, an H264 data decoding service module, a frame Data transmission service module, touch event distribution service module. In order to realize the controllable screen projection, the ACarPlayServer includes at least a callback activation service module 21, which is used to send control flow data to the Android mobile terminal to realize the activation of the callback operation. The other modules included in the ACarPlayServer in this embodiment are the same as this embodiment A better example is not limited, and there may be more or less modules or other specific function modules according to specific application scenarios.

The implementation of the reversible screen projection method in this embodiment, as shown in FIG. 4 , includes steps S1. Connecting the Android mobile phone 10 to the car machine 20 through a USB cable; Step S2. Turning on the developer mode of the Android mobile phone 10; Step S3. The ACarPlayInputEventServer is run on the Android phone 10 as a background service program through the ADB tool and the app_process tool that comes with the Android phone 10 system on the car device 20 to activate the callback function of the Android phone 10, and the ACarPlayInputEventServer receives the callback event from the car device 20 The control event is then injected into the Android phone 10 ; step S4 . In the WIFI screen projection mode, the user disconnects the wired connection between the Android phone 10 and the vehicle 20 . In this way, wireless and reversible screen projection can be realized without being bound by the data cable all the time, and the Android phone 10 can be controlled by operating on the control part 202 during use, the operation is more flexible and convenient, and the user experience of the screen projection application is better.

In still other embodiments, after the above step S4, if the user turns off the USB debugging switch of the Android phone 10 during use, the ACarPlayInputEventServer ends running. At this time, the Android mobile phone 10 can no longer be controlled by the control component 202 .

In the first embodiment, the reversible screen projection device of the present invention implements the above-mentioned reversible screen projection method by performing operations on the first processor 102 and the second processor 204 . The first processor 102 is configured to perform the following operations: run the app_process tool to run in the background of ACarPlayInputEventServer; run the network connection module 11 to establish a communication connection between the Android phone 10 and the vehicle 20; run the control event processing module 12 to parse and process slave vehicles The second processor 204 is configured to perform the following operations: run the callback activation service module 21 to send the control flow data 20D to the Android phone 10, and realize the return activation of the control operation.

With reference to Fig. 1, as shown in Fig. 5, when ACarPlayInputEventServer is running in the background, the first processor 102 performs the following operations: Step S31. Set the running state of ACarPlayInputEventServer to True; Step S32. ACarPlayInputEventServer is initialized, and then run the network connection module 11 to create Socket socket, establishes a TCP connection with the vehicle machine 20 through the preset IP and port number of the vehicle machine 20; Step S33. Initialize the control event processing module 12; Step S34. Open the first sub-thread, block and wait to receive control flow data 20D, determine whether there is data coming, if not, continue to wait; when there is control flow data, the "injectInputEvent" interface is called through the reflection mechanism to inject control events into the Android phone 10, and then process the control events.

In some preferred practices of this embodiment, in the above-mentioned step S34, the first processor 102 also performs a judgment process to judge the running state of the ACarPlayInputEventServer, and if the running state is True, then continue to block and wait to receive the control flow data 20D; If the running state is not True but False, the first sub-thread is terminated. This is an example of a better practice in this embodiment, and does not limit other possible practices in this embodiment.

In this embodiment, the first processor 102 performs an operation to run the network connection module 11 and the vehicle 20 to establish a TCP connection with a port number of “8886”, and through the TCP connection, a request can be sent to the vehicle 20, and the vehicle 20 can also be received. 20 sends the control flow data 20D.

In some other embodiments of the present invention, ACarPlayInputEventServer is not pre-stored in the first memory 101 of the Android mobile phone 10, and the user can also push the ACarPlayInputEventServer from the car device 20 to the Android mobile phone through the ADB tool when performing reversible screen projection for the first time. 10 is stored in the first memory 101. The case of the present invention is not limited to this.

In this embodiment, with reference to FIG. 1 , the specific process of the second processor 204 running the callback activation service module 21 to perform operations to activate the callback function of the Android mobile phone 10 is shown in FIG. The "Mobile phone pairing connection request" sub-thread is used to receive the pairing connection request of the Android mobile phone 10 and the request to activate the callback operation. In the embodiment, what the sub-thread opens is the TCP socket service with the port number "8886", and then waits for the mobile phone to connect. . This is only a connection method of a specific embodiment, and is not intended to be a limiting situation. After receiving the request of the Android phone 10 to activate the callback operation, process the request to activate the callback operation, start the ADB tool to detect whether the Android phone 10 has been connected to the vehicle 20 through the USB cable, and detect whether the Android phone 10 has opened the USB Debug switch; if the above result is otherwise, return, continue to wait for the mobile phone to connect; when the conditions are met, push the ACarPlayInputEventServer to the Android phone 10. In some embodiments, the ACarPlayInputEventServer has been stored in the first memory 101 of the Android mobile phone 10 in advance, so it is not pushed. The ACarPlayInputEventServer is run in the background of the Android phone 10 through the ADB tool, thereby activating the callback operation of the Android phone 10.

In some preferred practices in this embodiment, the second processor 204 also performs the following operations during the specific process of activating the callback function of the Android phone 10: judging whether the activation is successful, and ending the process if the activation is successful; if the activation is unsuccessful, Then try again; if it still fails to activate after the preset number of attempts, end the process. Specifically, in this embodiment, it is set to quit after 10 attempts, and it is also possible to set fewer or more times according to the actual situation to meet the applicable scenarios or specific needs.

The main difference between the second embodiment and the first embodiment is that the first processor 102 runs the ACarPlayInputEventServer to perform operations. With reference to FIG. 1, as shown in FIG. 7, after initializing ACarPlayInputEventServer in this embodiment, the first processor 102 also performs the operation: step S31'. Run the network connection module 11 to open the second sub-thread, in the second sub-thread Creates a DatagramSocket socket and broadcasts a "backward control activated" message through the UDP port every preset time. In this embodiment, the UDP port number is "8885". The specific preset time is 1 second in the embodiment, or 2 seconds, or a preset time according to the actual situation. The purpose is to let ACarPlay know the status of ACarPlayInputEventServer running in the background.

In this embodiment, before initializing the control event processing module 12, the first processor also performs operations: step S32'. Determine whether the Android mobile phone 10 and the vehicle 20 are successfully connected, and if the connection is successful, initialize the control event processing module 12; If the connection fails, set the running state of ACarPlayInputEventServer to False, and set the running state of ACarPlayInputEventServer to True again after sleeping for 1 second to try to continue running. In some embodiments, it sleeps for 2 seconds or other preset time according to the actual situation.

The above-mentioned embodiments are preferred cases of the present invention, and are not intended to limit the protection scope of the present invention. For the sake of clarity, many implementation details are set forth in the above description. It should be understood, however, that details in these implementations should not be used to limit the invention. In addition, for the purpose of simplifying the drawings, some structures and components are shown in a simple schematic manner in the drawings, which are only schematic and do not limit a specific practical possible design situation.

In addition, descriptions such as “first”, “second”, etc. in the present invention are only for the purpose of description, and do not refer to the meaning of order or sequence, nor are they used to limit the present invention. The components or operations are described by the same technical terms, and should not be construed as indicating or implying their relative importance or implying the quantity of the indicated technical features.

The technical solutions between the various embodiments can be combined with each other, but must be based on the realization by those of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be achieved, it should be considered that the combination of technical solutions does not exist, and It is not within the scope of protection claimed by the present invention.

Claims (20)

1. A method for controllable screen projection is characterized in that: the method comprises the following steps:

s1, connecting an android mobile terminal with a target terminal through a USB (universal serial bus) line;

s2, opening a developer mode of the android mobile terminal;

s3, operating a control event input service program on the android mobile terminal as a background service through an ADB tool and an app _ process tool of the android mobile terminal at the target terminal, and activating a back control function of the android mobile terminal, wherein the control event input service program is used for injecting a control event into the android mobile terminal after receiving the back control event from the target terminal;

and S4, disconnecting the wired connection between the android mobile terminal and the target terminal in the WIFI screen projection mode.

2. The method of claim 1, wherein: between the step S2 and the step S3, the control event input service program is pushed to the android mobile terminal by the target terminal through the ADB tool.

3. The method of claim 1, wherein: in step S3, the process of injecting the control event into the android mobile terminal by the control event input service program includes:

s31, setting the running state of the control event input service program to be True;

s32, initializing the control event input service program, then creating a Socket, and establishing TCP connection with a target terminal through a preset target terminal IP and a port number;

s33, initializing a control event processing function module of the control event input service program;

and S34, starting the first sub-thread, and when control stream data arrives, calling an 'injectInputEvent' interface to inject a control event into the android mobile terminal through a reflection mechanism, so as to control the operation of the android mobile terminal at the target terminal.

4. The method of claim 3, wherein: in step S34, determining the running state of the control event input service program, and if the running state is True, blocking waiting for receiving control flow data; ending the first child thread if the running state is not True.

5. The method of claim 3, wherein: between the step S32 and the step S33, determining whether the connection between the android mobile terminal and the target terminal is successful, and if the connection is successful, starting a step S33; if the connection fails, the operation state of the control event input program is set to False, and the operation is started again from step S1 after the sleep preset time.

6. The method of claim 3, wherein: between the step S31 and the step S32, a second sub-thread is opened, a DatagramSocket is created in the second sub-thread, and a message of "back control activated" is broadcast to the outside through a UDP port at preset intervals.

7. The method of any one of claims 1 to 6, wherein: after step S4, when the user turns off the USB debug switch at the android mobile terminal, the control event input service program ends running.

8. The method of any one of claims 1 to 6, wherein: the specific process of activating the callback function of the android mobile terminal in the step S3 includes:

starting a sub thread at a target terminal to receive a pairing connection request of the android mobile terminal and a request for activating a back control operation;

when the target terminal receives a request of activating a back control operation of the android mobile terminal, starting an ADB tool to detect whether the android mobile terminal is connected to the target terminal through a USB line or not, and detecting whether the android mobile terminal turns on a USB debugging switch or not;

and if the android mobile terminal is connected with the target terminal through a USB line and the USB debugging switch is turned on, pushing the control event input program to the android mobile terminal, running the control event input service program on a background of the android mobile terminal through an ADB tool, and activating the back control operation of the android mobile terminal.

9. The method of claim 8, wherein: the process of activating the callback function of the android mobile terminal in step S3 further includes: judging whether the activation is successful, and if the activation is successful, ending the sub-thread; if the activation is not successful, try again; the process ends if it is still not active after a preset number of attempts.

10. The method of any one of claims 1 to 6, wherein: the android mobile terminal is an android mobile phone or an android intelligent tablet.

11. The method of any one of claims 1 to 6, wherein: the target terminal is a vehicle machine.

12. A computer-readable storage medium characterized by: the computer-readable storage medium comprises a computer program which, when executed, enables a computer having the computer program to perform the method of any of claims 1-11.

13. A screen device is thrown in controllable backtracking which characterized in that: the method comprises the following steps:

an android mobile terminal, a target terminal and a computer program; the android mobile terminal is in communication connection with a target terminal;

the android mobile terminal comprises a first processor and a first memory; the target terminal comprises a display screen, a control component, a second processor and a second memory; the computer program comprises an ADB tool, an app _ process tool, a control event input service program and a screen projection service program;

the control component is used for receiving input operation; the display screen is used for displaying a screen projection interface;

the first memory is used for storing the app _ process tool and the control event input service program; the second memory is used for storing the ADB tool and the screen projection service program;

the control event input program comprises a network connection module and a control event processing module; the first processor is configured to perform the following operations:

running the app _ process tool to input the control event into a service program to run in the background;

operating the network connection module to establish communication connection between the android mobile terminal and the target terminal; the control event processing module is operated to analyze and process control flow data sent from a target terminal, and then a corresponding control event is injected into the android mobile terminal;

the screen projection service program at least comprises a back control activation service module; the second processor is configured to: and operating the back control activation service module to send control flow data to the android mobile terminal to realize activation of back control operation.

14. A controllable screen-projecting device according to claim 13, wherein: when the control event input service program runs in the background, the first processor performs the following operations:

setting the running state of the control event input service program to True; initializing the control event input service program;

operating the network connection module to create Socket sockets, and establishing TCP connection with a target terminal through a preset target terminal IP and a preset port number;

initializing the control event processing module and starting a first sub-thread;

when control stream data comes, an injectInputEvent interface is called through a reflection mechanism to inject a control event into the android mobile terminal, and the operation of the android mobile terminal is controlled at a target terminal.

15. A controllable screen-projecting device according to claim 14, wherein: after the first child thread is opened, the first processor further performs the operations of:

judging the running state of the control event input service program, and if the running state is True, blocking and waiting for receiving control flow data; and if the running state is not True, ending the first sub-thread.

16. A controllable screen-projecting device according to claim 14, wherein: prior to initializing the control event processing module, the first processor further performs the operations of:

judging whether the connection between the android mobile terminal and the target terminal is successful, and initializing the control event processing module if the connection is successful; and if the connection fails, setting the running state of the control event input program to False, and setting the running state of the control event input service program to True again after sleeping for preset time.

17. A controllable screen-projecting device according to claim 14, wherein: after initializing the control event input service, the first processor further performs the operations of: and operating the network connection module to start a second sub-thread, creating a DatagramSocket socket in the second sub-thread, and broadcasting a message of 'response control activated' outwards through a UDP port at preset intervals.

18. A controllable screen-projecting device according to claim 13 or 14, wherein: the second processor executes the back control activation service module and performs the following operations: starting a sub thread at a target terminal to receive a pairing connection request of an android mobile terminal and a request for activating a back control operation;

when a request for activating a callback operation of the android mobile terminal is received, starting an ADB tool to detect whether the android mobile terminal is connected to a target terminal through a USB line or not and detect whether the android mobile terminal is turned on a USB debugging switch or not;

and if the android mobile terminal is connected with the target terminal through a USB line and the USB debugging switch is turned on to meet the conditions, pushing the control event input program to the android mobile terminal, executing the control event input service program in the background of the android mobile terminal through an ADB tool, and activating the back control operation of the android mobile terminal.

19. A controllable screen-projecting device according to claim 18, wherein: the second processor further performs the operations of: judging whether the activation is successful, and if the activation is successful, ending the sub-thread; if the activation is not successful, try again; the process ends if it is still not active after a preset number of attempts.

20. A controllable screen-projecting device according to any of claims 13-17, wherein: the android mobile terminal is an android mobile phone or an android smart tablet; the target terminal is a car machine.

Images