CN116992441A - Operation delay detection method, device, equipment and storage medium - Google Patents
Operation delay detection method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN116992441A CN116992441A CN202310835427.2A CN202310835427A CN116992441A CN 116992441 A CN116992441 A CN 116992441A CN 202310835427 A CN202310835427 A CN 202310835427A CN 116992441 A CN116992441 A CN 116992441A
- Authority
- CN
- China
- Prior art keywords
- dimensional code
- code image
- remote
- equipment
- analog input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/56—Computer malware detection or handling, e.g. anti-virus arrangements
- G06F21/566—Dynamic detection, i.e. detection performed at run-time, e.g. emulation, suspicious activities
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/552—Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Virology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides an operation delay detection method, device, equipment and storage medium, relates to the technical field of computer desktop control, and solves the problem of detecting delay corresponding to input operation performed on remote equipment.
Description
Technical Field
The present application relates to the field of computer desktop control technologies, and in particular, to a method, an apparatus, a device, and a storage medium for detecting operation delay.
Background
Remote desktop technology is a technology that allows a user to remotely access the desktop of another computer through the internet or a local area network; the cloud desktop technology is to virtualize various physical devices by using a virtual technology, so as to provide a virtual host on a cloud or a server and provide a corresponding desktop picture.
Along with the maturity of network technology, more and more users select a remote desktop technology to access the desktop of another computer so as to overcome the limitation of factors such as geography, equipment and the like and realize behaviors such as home office, remote setting and the like. Likewise, enterprises adopt cloud desktop technology to realize the purposes of information security and mobile office.
All the above schemes require that the remote device implements input operations made by the local device (i.e. the device operated by the user), such as mouse clicking, keyboard typing, etc. And accordingly there is an operational delay, i.e., the time when the user makes an input operation to the remote device to update the desktop display and render it at the local end device based on the input operation. Whether the operation delay can approach to the screen refreshing time of the local terminal equipment is one of important factors influencing the working efficiency, and is also one of key indexes for measuring the performance of the cloud desktop or the remote desktop.
Disclosure of Invention
The application provides an operation delay detection method, an operation delay detection device, operation delay detection equipment and a storage medium, which solve the problem of detecting delay corresponding to input operation performed on remote equipment.
In a first aspect, the present application provides an operation delay detection method, applied to a local side device, where the method includes:
performing system calibration processing with the remote device establishing connection to synchronize the local end device and the remote device;
after the system calibration processing is completed, based on a preset frequency, injecting analog input operation for a plurality of times within a preset time, wherein the analog input operation is generated by simulating an input signal of corresponding input equipment;
transmitting operation signals associated with analog input operation to the remote equipment, so that the remote equipment responds to each operation signal to generate a two-dimensional code image and transmits desktop display content carrying the two-dimensional code image back to the local equipment;
in the process of collecting and displaying desktop display contents, identifying two-dimensional code images in the desktop display contents in real time to obtain target information carried by the two-dimensional code images, wherein the target information carried by the two-dimensional code images comprises response time;
and determining the operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation.
In a second aspect, the present application further provides an operation delay detection method, applied to a remote device, where the method includes:
according to synchronous calibration information sent by the local end equipment for establishing connection, displaying the detection application interface in a full screen mode, and synchronizing resolution and time with the local end equipment;
when an operation signal sent by local terminal equipment is received, generating a two-dimensional code image and displaying the two-dimensional code image on a detection application interface;
and returning desktop display content to the local terminal equipment in real time, wherein the desktop display content carries the two-dimensional code image.
In a third aspect, the present application further provides an operation delay detection apparatus, applied to a local side device, where the apparatus includes:
the first calibration module is configured to perform system calibration processing with the remote equipment for establishing connection so as to synchronize the local end equipment and the remote equipment;
the operation injection module is configured to inject analog input operation for multiple times in preset time based on preset frequency after the system calibration processing is completed, and correspondingly generate multiple operation signals, wherein the analog input operation is operation generated by simulating input signals of corresponding input equipment;
the signal receiving and transmitting module is configured to send operation signals related to analog input operation to the remote equipment so that the remote equipment can respond to each operation signal to generate a two-dimensional code image and transmit desktop display content carrying the two-dimensional code image back to the local equipment;
the acquisition and identification module is configured to identify a two-dimensional code image in the desktop display content in real time in the process of acquiring and displaying the desktop display content to obtain target information carried by the two-dimensional code image, wherein the target information carried by the two-dimensional code image comprises response time;
and the delay calculation module is configured to determine the operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation.
In a fourth aspect, the present application further provides an operation delay detection apparatus, applied to a remote device, where the apparatus includes:
the second calibration module is configured to display the detection application interface in a full screen mode and synchronize resolution and time with the local terminal equipment according to the synchronous calibration information sent by the local terminal equipment for establishing connection;
the image generation module is configured to generate a two-dimensional code image and display the two-dimensional code image on the detection application interface when receiving an operation signal sent by the local terminal equipment;
and the data returning module is configured to return desktop display content to the local terminal equipment in real time, wherein the desktop display content carries the two-dimensional code image.
In a fifth aspect, the present application also provides an electronic device, including:
one or more processors;
and a storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the method of operation delay detection as provided in the above aspect.
In a sixth aspect, the present application also provides a storage medium storing computer executable instructions which, when executed by a processor, are adapted to carry out the method of operation delay detection as provided in the above aspects.
According to the scheme, the local end equipment and the remote end equipment interact, the local end equipment performs analog input operation through self injection, and generates corresponding operation signals so that the remote end equipment responds to the operation signals to return desktop display content carrying the two-dimension code image, and therefore the local end equipment can acquire operation delay based on the two-dimension code image. In addition, the scheme does not need to change the invasive detection of the application program of the controlled device, and does not need to be in the same space with the local device and the remote device, so that the scheme can better realize the operation delay detection in the remote access process, can periodically and accurately detect the operation delay, and is beneficial to judging the working efficiency of the cloud desktop or the remote desktop and measuring the performance of the cloud desktop or the remote desktop.
Drawings
Fig. 1 is a flowchart illustrating steps of a method for detecting an operation delay according to an embodiment of the present application.
Fig. 2 is a flowchart illustrating steps of a method for detecting an operation delay according to another embodiment of the present application.
Fig. 3 is a flowchart illustrating steps for performing a system calibration process according to an embodiment of the present application.
Fig. 4 is a flowchart illustrating steps for capturing desktop display according to an embodiment of the present application.
FIG. 5 is a flowchart illustrating steps for determining an operation delay according to an embodiment of the present application.
Fig. 6 is a flowchart illustrating steps for displaying a two-dimensional code image according to an embodiment of the present application.
Fig. 7 is a schematic structural diagram of an operation delay detecting device according to an embodiment of the application.
Fig. 8 is a schematic structural diagram of an operation delay detecting device according to another embodiment of the present application.
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Embodiments of the present application will be described in further detail below with reference to the drawings and examples. It should be understood that the particular embodiments described herein are illustrative only and are not limiting of embodiments of the application. It should be further noted that, for convenience of description, only some, but not all structures related to the embodiments of the present application are shown in the drawings, and those skilled in the art will appreciate that any combination of technical features may constitute alternative embodiments as long as the technical features are not contradictory to each other after reading the present specification.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type, and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship. In the description of the present application, "a plurality" means two or more, and "a number" means one or more.
In the application, the equipment operated by the user is used as the local terminal equipment. In remote desktop technology, a user typically accesses another device, i.e., a remote device, remotely over a network on a local end device. In cloud desktop technology, the server serves as a remote device because the server provides a virtual host and provides a corresponding desktop screen.
There is necessarily operation delay between the local device and the cloud device, for example, when the user types a character in the local device, the user makes the same response on the remote device to update the desktop display content and returns the desktop display content to the local device, where the duration occupied by the process is the operation delay. For the detection of the operation delay, the application provides an operation delay detection method.
Fig. 1 is a flowchart illustrating steps of an operation delay detection method according to an embodiment of the present application, as shown in fig. 1, where the method is applied to a local device, and a communication connection is established between the local device and a remote device, and the operation delay detection method of the present application includes the following steps:
step S110, performing system calibration processing with the remote device establishing connection to synchronize the local device and the remote device.
The local end device and the remote device are synchronized whether on the remote desktop or the cloud desktop, so that the main controlled information between the local end device and the remote end device is aligned, and the remote end device is controlled by the local end device conveniently.
It will be appreciated that the detection application is a corresponding detection application in both the local and remote devices, the detection application being an application program for implementing the operation delay detection method. The local end device and the remote end device can realize remote access and operation delay detection through the detection application. Thus, synchronization can be achieved at the local and remote devices based on the detection application.
Step S120, after the system calibration processing is completed, the analog input operation is injected for a plurality of times within a preset time based on a preset frequency, and a plurality of operation signals are correspondingly generated.
After the local end device realizes the synchronization with the remote end device, the local end device generates analog input operation and performs injection, for example, the analog input operation is injected for a plurality of times within a preset time based on a preset frequency, and after each injection of the analog input operation, the local end device can consider that one input exists, so as to generate an operation signal.
The analog input operation is an operation generated by simulating an input signal of a corresponding input device, for example, an input of an input device such as a mouse and a keyboard, and it is conceivable that the analog input operation is an operation generated by simulating a local device, and a user does not need to additionally operate the input device in an actual application process. Of course, when the local side device injects the analog input operation, the local side device will record the injection time of the operation for calculating the operation delay.
It is conceivable that the preset frequency and the preset time are preset in the detection application, and the preset frequency is 60Hz and the preset time is 1 second, and the local end device may inject 60 analog input operations within 1 second. Accordingly, the local end device generates 60 operation signals, and further transmits the operation signals to the remote end device.
Step S130, an operation signal related to the analog input operation is sent to the remote device, so that the remote device can respond to each operation signal to generate a two-dimension code image and transmit desktop display content carrying the two-dimension code image back to the local device.
Of course, after each time an operation signal is generated, the local end device sends the operation signal to the remote end device, and when the remote end device receives the operation signal, the remote end device performs corresponding response operation, for example, if the remote end device responds to an operation signal, a two-dimension code image is generated, and desktop display content carrying the two-dimension code image is returned to the local end device.
It should be appreciated that the desktop display content is a screen displayed on a system desktop of the remote end device, for example, in some embodiments, a detection application interface is displayed on a system desktop of the remote end device in a full screen manner, and correspondingly, the returned desktop display content is a detection application interface, and a two-dimensional code image is also displayed on the detection application interface.
And step 140, identifying the two-dimensional code image in the desktop display content in real time in the process of acquiring and displaying the desktop display content, and obtaining target information carried by the two-dimensional code image.
The display screen of the local terminal equipment is provided with a corresponding screen refresh rate, so that the local terminal equipment also needs to acquire desktop display content according to the screen refresh rate and display the desktop display content on the display screen. The local terminal equipment also displays the two-dimensional code image in the desktop display content in real time so as to acquire target information carried by the two-dimensional code image. It is conceivable that the target information includes a response time, i.e., a time at which the remote device responds to the operation signal in combination, to generate a two-dimensional code image for the local device to calculate the operation delay.
It should be noted that, for the generation and identification of the two-dimensional code image, a generation method and an identification method in the related art are adopted, and the generation method and the identification method are common technical means in the field, and are not described in detail.
Step S150, determining operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation.
After the two-dimensional code image is identified, the local terminal equipment can acquire response time, and then the local terminal equipment can determine the operation delay of the analog input operation according to the injection time corresponding to the analog input operation and the identified response time. It is conceivable that the local end device injects multiple analog input operations, correspondingly, the same number of two-dimensional code images are collected, so that the local end device can use the multiple analog input operations as a group, thereby calculating and obtaining a group of operation delay data, further calculating data such as an average value, a standard deviation and the like, so as to better measure the performance of a remote desktop or a cloud desktop.
According to the scheme, the local terminal equipment performs analog input operation through injection, generates an operation signal so that the remote terminal equipment can provide a corresponding system desktop, and displays a two-dimensional code image on the system desktop, so that the local terminal equipment can conveniently acquire and identify, further, the operation delay detection is finished, and the detection process is simple and convenient.
Fig. 2 is a flowchart of steps of an operation delay detection method according to another embodiment of the present application, as shown in fig. 2, where the method is applied to a remote device, and a communication connection is established between the remote device and a local device, and the operation delay detection method of the present application includes the following steps:
step S210, according to the synchronous calibration information sent by the local terminal equipment for establishing connection, the detection application interface is displayed in a full screen mode, and the resolution and time are synchronous with the local terminal equipment.
It can be understood that in the process of performing the system calibration process between the local end device and the remote end device, the local end device initiates and transmits the synchronization calibration information, such as corresponding control information, device information, etc., to the remote end device to perform synchronization. Thus, after receiving the synchronization calibration information, the remote device performs a corresponding operation.
The local end device and the remote end device synchronize based on the detection application, for example, when the local end device sends a full-screen control signal, the remote end device displays the detection application interface in a full-screen mode; when the local terminal equipment sends resolution information, the remote terminal equipment also adjusts the display resolution of the remote terminal equipment so as to be the same as the screen resolution of the local terminal; when the local terminal device sends the time information, the remote terminal device performs time synchronization with the local terminal device according to the time information.
Of course, the local device and the remote device also synchronize input devices such as a mouse and a keyboard, so that the remote device can synchronously respond to input operations sent by the local device and corresponding to the input devices such as the mouse and the keyboard.
Step S220, when an operation signal sent by the local terminal equipment is received, a two-dimensional code image is generated and displayed on the detection application interface.
After receiving an operation signal, the remote device generates a two-dimensional code image. A detection application interface is displayed on a system desktop of the remote device, for example, a display position for displaying the two-dimensional code image exists on the detection application interface, and the two-dimensional code image generated by the remote device each time is displayed at the display position.
It is conceivable that when the remote device continuously receives a plurality of operation signals, the remote device also corresponds to continuously generating two-dimensional code images, and further continuously updating the displayed two-dimensional code images at the display position.
Step S230, returning desktop display content to the local terminal equipment in real time.
Of course, the remote device establishes communication connection with the local device, and desktop display content displayed on the remote device is also transmitted back to the local device in real time, so that the local device can collect and identify the desktop display content.
According to the scheme, the remote equipment can correspond to the operation information sent by the local equipment, a corresponding two-dimensional code image is generated, and the two-dimensional code image with the time is transmitted back to the local equipment through the remote desktop, so that detection of the operation delay is realized, namely the scheme provides a simple method for detecting the operation delay, and the performance of the cloud desktop or the remote desktop can be quickly and effectively assisted to be determined.
Fig. 3 is a flowchart of a step of performing a system calibration process according to an embodiment of the present application, and as shown in fig. 3, a local device performs a system calibration process with a remote device through the following steps.
And step 111, sending full-screen control information to the remote equipment so as to enable the remote equipment to display the detection application interface in a full-screen mode.
Step S112, the resolution information is sent to the remote device, so that the remote device can adjust the display resolution according to the resolution information.
Step S113, time information is sent to the remote device for the remote device to perform time synchronization with the local device.
It can be understood that, in the process of performing the system calibration process with the connected remote device, the local device sends the relevant information, so that the remote device performs a corresponding response, thereby achieving synchronization of the two devices. If the local terminal equipment sends full-screen control information, the full-screen control information can enable the remote terminal equipment to display the detection application interface in a full-screen mode, and the situation that the displayed two-dimensional code image is too small to be recognized is avoided. The local terminal equipment also transmits resolution information to the remote terminal equipment, wherein the resolution information corresponds to the resolution of a display screen of the local terminal equipment; when the remote device receives the resolution information, the remote device adjusts the display resolution according to the resolution information, and correspondingly, adjusts the display resolution to be the same as the local device. In addition, the local end device sends time information to the remote end device for the remote end device to perform time synchronization with the local end device, for example, the time information includes parameter information such as a server which is connected with the local end device and provides time calibration and a time zone in which the device is located, and the remote end device can use the same time with the local end device after receiving the time information to perform time synchronization.
Therefore, after the system calibration is performed, the local end equipment and the remote end equipment are synchronized, remote access can be performed on the basis of the synchronization, the remote end equipment can transmit desktop display contents to the local end equipment, and after the time synchronization is completed, the detection of operation delay is facilitated.
Fig. 4 is a flowchart of steps for collecting desktop display content according to an embodiment of the present application, in a local device, the steps need to collect the returned desktop display content again to obtain a corresponding image for two-dimensional code recognition, where the steps are as follows:
step S141, based on the current screen refreshing frequency, a plurality of screen images carrying desktop display contents are collected.
Step S142, two-dimensional code recognition is performed on the plurality of screen images respectively to obtain target information carried by the two-dimensional code images in the desktop display content.
It can be understood that the local terminal device acquires the screen image according to the screen refresh rate currently corresponding to the display screen, that is, when the returned desktop display content is displayed on the display screen in real time, the local terminal device acquires the screen image at the corresponding moment according to the screen refresh rate, and the screen image carries the desktop display content at the corresponding moment.
For example, when the current screen refresh rate is 60Hz, 60 screen images are correspondingly acquired within one second, and it is conceivable that each screen image carries a corresponding two-dimensional code image, so that the local terminal device identifies each two-dimensional code image, and then the target information carried on the two-dimensional code image can be acquired, for example, the response time of the corresponding remote terminal device, that is, the time when the remote terminal device responds to the operation signal.
Therefore, the local terminal equipment can identify the two-dimensional code image carried in each frame of image by collecting the screen image, and collect the screen image according to the screen refresh rate, so that the occurrence of the condition of missing the screen image can be effectively reduced, and the operation delay can be better detected.
It is conceivable that in some embodiments, the local device may better acquire the screen image by adjusting the preset frequency and the screen refresh frequency, so as to help acquire the operation delay corresponding to more analog input operations.
Fig. 5 is a flowchart of steps for determining operation delay provided in an embodiment of the present application, where after a two-dimensional code image is obtained, a local terminal device may identify the two-dimensional code image, so as to obtain corresponding target information, where the target information includes a response time and an operation identifier corresponding to an operation signal, and the specific steps are as follows:
step S151, according to the operation identification, determining the analog input operation associated with the operation signal corresponding to the two-dimensional code image.
Step S152, acquiring injection time corresponding to the analog input operation, and taking the difference between the injection time and the response time as delay time corresponding to the analog input operation.
Step S153, after determining the delay time length corresponding to each analog input operation, calculating an operation delay average value, and taking the operation delay average value as the operation delay with the remote equipment.
It can be understood that the target information carries an operation identifier and a response time, that is, the remote device can generate a two-dimensional code image by combining the operation identifier and the response time, wherein one operation identifier corresponds to one operation signal, so that the operation identifiers corresponding to each two-dimensional code image are different, and the local device can position each operation information through the operation identifiers, thereby more accurately calculating the operation delay corresponding to each analog output operation.
The local terminal equipment determines the operation information corresponding to the two-dimensional code image through the obtained operation identification, and further determines the made analog input operation, such as determining the ordinal number of the analog input operation. Therefore, further, the local terminal device can determine the injection time corresponding to the analog input operation, so as to calculate the difference between the injection time and the response time, and take the difference as the delay time.
After each screen image is acquired and identified, the local terminal device can determine the injection time and the response time corresponding to all the injected analog input operations, so as to determine the delay time of each analog input operation, further calculate an average value according to the delay time of each analog input operation, namely an operation delay average value, and take the average value as the operation delay of the local terminal device and the remote terminal device.
After determining the time delay duration of each analog input operation, the local device may further calculate the time delay duration, for example, calculate median, standard deviation, and so on, so as to obtain more statistical data, so as to be used for performing performance analysis on the remote desktop or the cloud desktop.
Fig. 6 is a flowchart of a step of displaying a two-dimensional code image according to an embodiment of the present application, where a remote device may assist a local device in performing operation delay detection by continuously refreshing the displayed two-dimensional code image and returning the display content of a desktop in real time, and the specific steps are as shown in fig. 6:
step S221, under the condition that the operation signal is received, combining the operation identifier corresponding to the operation signal and the response time for responding to the operation signal, generating a two-dimensional code image, and displaying the two-dimensional code image on the detection application interface.
Step S222, if a new operation signal is received, another two-dimensional code image is updated and displayed at the display position corresponding to the two-dimensional code image.
It can be understood that for each operation signal, the remote device generates a two-dimensional code image, and the two-dimensional code image is generated by combining the operation identifier and the response time, so that the local device can acquire the operation identifier and the response time by identifying the two-dimensional code image. The remote device also displays the two-dimensional code image on the full-screen display detection application interface, and it is conceivable that a display position for displaying the two-dimensional code image is arranged on the detection application interface, and the two-dimensional code image generated by the remote device is displayed on the detection application interface.
When a plurality of operation signals exist, the remote device correspondingly generates two-dimensional code images according to the sequence of receiving the operation signals, so that another two-dimensional code image is updated and displayed on the display position corresponding to the two-dimensional code image until all the two-dimensional code images corresponding to the operation signals are displayed.
Of course, in the process of displaying the two-dimension code image, the remote device continuously returns the desktop display content to the local device, so that the local device can receive all the two-dimension code images and acquire the screen image in a corresponding acquisition mode, so that the delay time of each analog input operation can be conveniently determined.
Therefore, the remote device continuously generates the two-dimensional code image to record the response moment of the remote device, and the remote device transmits the information back to the local device based on the remote desktop or the cloud desktop, so that the local device is assisted to complete the detection of the operation delay, and the detection is more effective.
Fig. 7 is a schematic structural diagram of an operation delay detection device according to an embodiment of the present application, where the device is applied to a local device, and may be used to execute the operation delay detection method according to the foregoing embodiment, and has functional modules and beneficial effects corresponding to the execution method.
Wherein the first calibration module 701 is configured to perform a system calibration process with a remote device that establishes a connection to synchronize the local device and the remote device;
the operation injection module 702 is configured to inject an analog input operation, which is an operation generated by simulating an input signal of a corresponding input device, for a plurality of times in a preset time based on a preset frequency after completing a system calibration process and correspondingly generating a plurality of operation signals;
the signal transceiver module 703 is configured to send an operation signal associated with the analog input operation to the remote device, so that the remote device generates a two-dimensional code image in response to each operation signal and returns desktop display content carrying the two-dimensional code image to the local device;
the acquisition and identification module 704 is configured to identify a two-dimensional code image in the desktop display content in real time in the process of acquiring and displaying the desktop display content, so as to obtain target information carried by the two-dimensional code image, wherein the target information carried by the two-dimensional code image comprises response time;
the delay calculation module 705 is configured to determine an operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation.
On the basis of the above embodiment, the first calibration module 701 is further configured to:
sending full screen control information to the remote equipment so that the remote equipment displays the detection application interface in a full screen mode;
the resolution information is sent to the remote equipment, so that the remote equipment can adjust the display resolution according to the resolution information;
and sending the time information to the remote equipment for the remote equipment to perform time synchronization with the local equipment.
On the basis of the above embodiment, the acquisition identification module 704 is further configured to:
based on the current screen refreshing frequency acquisition, a plurality of screen images carrying desktop display contents;
and respectively carrying out two-dimensional code recognition on the plurality of screen images to obtain target information carried by the two-dimensional code images in the desktop display content.
On the basis of the above embodiment, the target information further includes an operation identifier corresponding to the operation signal, and the delay calculation module 705 is further configured to:
according to the operation identification, determining analog input operation associated with an operation signal corresponding to the two-dimensional code image;
acquiring injection time corresponding to the analog input operation, and taking the difference between the injection time and the response time as delay time corresponding to the analog input operation;
after the delay time length corresponding to each analog input operation is determined, an operation delay average value is calculated, and the operation delay average value is used as the operation delay with the remote equipment.
Fig. 8 is a schematic structural diagram of an operation delay detection device according to another embodiment of the present application, where the device is applied to a remote device, and may be used to execute the operation delay detection method according to the foregoing embodiment, and has functional modules and beneficial effects corresponding to the execution method.
The second calibration module 801 is configured to display the detection application interface in full screen and synchronize resolution and time with the local end device according to the synchronization calibration information sent by the local end device for establishing connection;
the image generating module 802 is configured to generate a two-dimensional code image and display the two-dimensional code image on the detection application interface when receiving an operation signal sent by the local terminal device;
the data feedback module 803 is configured to feedback desktop display content to the local terminal device in real time, where the desktop display content carries a two-dimensional code image.
On the basis of the above embodiment, the image generation module 802 is further configured to:
under the condition of receiving the operation signal, generating a two-dimensional code image by combining an operation identifier corresponding to the operation signal and a response time for responding to the operation signal, and displaying the two-dimensional code image on a detection application interface;
and if the new operation signal is received, updating and displaying another two-dimensional code image on the display position corresponding to the two-dimensional code image.
It should be noted that, in the above embodiment of the operation delay detection device, each functional module is only divided according to the functional logic, but not limited to the above division, so long as the corresponding function can be implemented; in addition, the specific names of the functional modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application.
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the device is configured to execute the operation delay detection method according to the foregoing embodiment, and has functional modules and beneficial effects corresponding to the execution method. As shown, it includes a processor 901, a memory 902, an input device 903, and an output device 904. The number of processors 901 may be one or more, one processor 901 being illustrated; the processor 901, memory 902, input devices 903 and output devices 904 may be connected by a bus or other means, the connection being illustrated as a bus. The memory 902 is a computer-readable storage medium, and may be used to store a software program, a computer-executable program, and modules, such as program instructions/modules corresponding to the operation delay detection method in the embodiment of the present application. The processor 901 executes corresponding various functional applications and data processing by executing software programs, instructions and modules stored in the memory 902, i.e., implements the above-described operation delay detection method.
The memory 902 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for a function; the storage data area may store data or the like recorded or created according to the use process. In addition, the memory 902 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 902 may further comprise remotely located memory relative to the processor 901, which may be connected to the terminal device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 903 may be used to input corresponding numeric or character information to the processor 901 and to generate key signal inputs related to user settings and function control of the device; the output means 904 may be used to send or display key signal outputs related to user settings and function control of the device.
Embodiments of the present application also provide a storage medium storing computer-executable instructions that, when executed by a processor, are configured to perform related operations in the method for detecting operation delay provided by any of the embodiments of the present application.
Computer-readable storage media, including both permanent and non-permanent, removable and non-removable media, may be implemented in any method or technology for storage of information. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
Note that the above is only a preferred embodiment of the present application and the technical principle applied. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, while the application has been described in connection with the above embodiments, the application is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the application, which is set forth in the following claims.
Claims (10)
1. An operation delay detection method, which is applied to a local terminal device, comprises the following steps:
performing system calibration processing with a remote device establishing connection to synchronize the local end device and the remote device;
after the system calibration processing is completed, based on a preset frequency, injecting analog input operation for a plurality of times within a preset time and correspondingly generating a plurality of operation signals, wherein the analog input operation is generated by simulating the input signals of corresponding input equipment;
transmitting operation signals associated with the analog input operation to the remote equipment, so that the remote equipment responds to each operation signal to generate a two-dimensional code image and transmits desktop display content carrying the two-dimensional code image back to the local equipment;
in the process of collecting and displaying the desktop display content, identifying a two-dimensional code image in the desktop display content in real time to obtain target information carried by the two-dimensional code image, wherein the target information carried by the two-dimensional code image comprises response time;
and determining the operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation.
2. The operation delay detection method according to claim 1, wherein the performing a system calibration process with the remote device that establishes the connection to synchronize the local end device and the remote device, comprises:
sending full-screen control information to the remote equipment so that the remote equipment displays a detection application interface in a full-screen mode;
transmitting resolution information to the remote device for the remote device to adjust display resolution according to the resolution information;
and sending time information to the remote equipment so as to enable the remote equipment to be time-synchronized with the local equipment.
3. The operation delay detection method of claim 1, wherein the step of identifying the two-dimensional code image in the desktop display content in real time during the process of collecting and displaying the desktop display content to obtain the target information carried by the two-dimensional code image comprises the steps of:
based on the current screen refreshing frequency, collecting a plurality of screen images carrying desktop display contents;
and respectively carrying out two-dimensional code recognition on the screen images to obtain target information carried by the two-dimensional code images in the desktop display content.
4. The operation delay detection method according to claim 1 or 3, wherein the target information further includes an operation identification corresponding to an operation signal; the determining the operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation includes:
according to the operation identification, determining analog input operation associated with the operation signal corresponding to the two-dimensional code image;
acquiring injection time corresponding to the analog input operation, and taking the difference between the injection time and the response time as delay time corresponding to the analog input operation;
after the delay time length corresponding to each analog input operation is determined, an operation delay average value is calculated, and the operation delay average value is used as the operation delay of the remote equipment.
5. A method of operation delay detection, for use with a remote device, the method comprising:
according to synchronous calibration information sent by the local end equipment for establishing connection, displaying a detection application interface in a full screen mode, and synchronizing resolution and time with the local end equipment;
when an operation signal sent by the local terminal equipment is received, generating a two-dimensional code image and displaying the two-dimensional code image on a detection application interface;
and returning desktop display content to the local terminal equipment in real time, wherein the desktop display content carries the two-dimensional code image.
6. The method for detecting operation delay according to claim 5, wherein generating a two-dimensional code image and displaying the two-dimensional code image on a detection application interface when receiving the operation signal sent by the local terminal device comprises:
under the condition that the operation signal is received, combining an operation identifier corresponding to the operation signal and a response time for responding to the operation signal, generating the two-dimensional code image, and displaying the two-dimensional code image on the detection application interface;
and if a new operation signal is received, updating and displaying another two-dimensional code image on the display position corresponding to the two-dimensional code image.
7. An operation delay detection device, which is applied to a local terminal device, comprising:
a first calibration module configured to perform a system calibration process with a remote device establishing a connection to synchronize the local end device and the remote device;
the operation injection module is configured to inject analog input operation for multiple times in preset time based on preset frequency after the system calibration processing is completed, and correspondingly generate multiple operation signals, wherein the analog input operation is generated by simulating the input signals of corresponding input equipment;
the signal receiving and transmitting module is configured to send an operation signal related to the analog input operation to the remote equipment so that the remote equipment can respond to each operation signal to generate a two-dimensional code image and transmit desktop display content carrying the two-dimensional code image back to the local equipment;
the acquisition and identification module is configured to identify a two-dimensional code image in the desktop display content in real time in the process of acquiring and displaying the desktop display content to obtain target information carried by the two-dimensional code image, wherein the target information carried by the two-dimensional code image comprises response time;
and the delay calculation module is configured to determine the operation delay corresponding to the analog input operation based on the response time of the target information and the injection time of the analog input operation.
8. An operation delay detection apparatus, characterized by being applied to a remote device, comprising:
the second calibration module is configured to display the detection application interface in a full screen mode and synchronize resolution and time with the local terminal equipment according to the synchronous calibration information sent by the local terminal equipment for establishing connection;
the image generation module is configured to generate a two-dimensional code image and display the two-dimensional code image on a detection application interface when receiving an operation signal sent by the local terminal equipment;
and the data returning module is configured to return desktop display content to the local terminal equipment in real time, wherein the desktop display content carries the two-dimensional code image.
9. An electronic device, the electronic device comprising:
one or more processors;
storage means for storing one or more programs which when executed by the one or more processors cause the one or more processors to implement the method of operation delay detection as claimed in any one of claims 1 to 6.
10. A storage medium storing computer executable instructions which, when executed by a processor, are adapted to perform the method of operation delay detection of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310835427.2A CN116992441A (en) | 2023-07-07 | 2023-07-07 | Operation delay detection method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310835427.2A CN116992441A (en) | 2023-07-07 | 2023-07-07 | Operation delay detection method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116992441A true CN116992441A (en) | 2023-11-03 |
Family
ID=88525769
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310835427.2A Pending CN116992441A (en) | 2023-07-07 | 2023-07-07 | Operation delay detection method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116992441A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101754046A (en) * | 2008-12-18 | 2010-06-23 | 威睿公司 | Measuring client interactive performance using a display channel |
| CN111555938A (en) * | 2020-04-28 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Information processing method and related device |
| CN112055237A (en) * | 2020-08-31 | 2020-12-08 | 北京爱奇艺科技有限公司 | Method, system, apparatus, device and storage medium for determining screen-to-screen delay |
| CN113521729A (en) * | 2021-07-02 | 2021-10-22 | 咪咕互动娱乐有限公司 | Cloud game delay detection method, server, client, system and medium |
| CN113839829A (en) * | 2020-06-24 | 2021-12-24 | 北京字节跳动网络技术有限公司 | Cloud game delay testing method, device and system and electronic equipment |
| CN114554181A (en) * | 2020-11-27 | 2022-05-27 | 中国联合网络通信集团有限公司 | Time delay detection method and system |
| CN115543714A (en) * | 2022-12-02 | 2022-12-30 | 北京志翔科技股份有限公司 | Remote desktop delay detection method, device, electronic equipment and system |
| CN116132710A (en) * | 2023-01-19 | 2023-05-16 | 支付宝(杭州)信息技术有限公司 | An end-to-end time delay detection method, device and equipment |
-
2023
- 2023-07-07 CN CN202310835427.2A patent/CN116992441A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101754046A (en) * | 2008-12-18 | 2010-06-23 | 威睿公司 | Measuring client interactive performance using a display channel |
| CN111555938A (en) * | 2020-04-28 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Information processing method and related device |
| CN113839829A (en) * | 2020-06-24 | 2021-12-24 | 北京字节跳动网络技术有限公司 | Cloud game delay testing method, device and system and electronic equipment |
| CN112055237A (en) * | 2020-08-31 | 2020-12-08 | 北京爱奇艺科技有限公司 | Method, system, apparatus, device and storage medium for determining screen-to-screen delay |
| CN114554181A (en) * | 2020-11-27 | 2022-05-27 | 中国联合网络通信集团有限公司 | Time delay detection method and system |
| CN113521729A (en) * | 2021-07-02 | 2021-10-22 | 咪咕互动娱乐有限公司 | Cloud game delay detection method, server, client, system and medium |
| CN115543714A (en) * | 2022-12-02 | 2022-12-30 | 北京志翔科技股份有限公司 | Remote desktop delay detection method, device, electronic equipment and system |
| CN116132710A (en) * | 2023-01-19 | 2023-05-16 | 支付宝(杭州)信息技术有限公司 | An end-to-end time delay detection method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200137196A1 (en) | Capturing and replaying application sessions using resource files | |
| US9064029B2 (en) | Dynamically identifying and evaluating component hierarchy for rendering content components on a webpage | |
| EP2847944B1 (en) | Transmitting and displaying offline data | |
| CN108683952B (en) | Video content segment pushing method and device based on interactive video | |
| WO2021197136A1 (en) | Page rendering detection method and apparatus | |
| WO2017036394A1 (en) | Wifi resource processing method and system | |
| CN103576988A (en) | Image processing apparatus, image processing system and image processing method | |
| CN113378036B (en) | Page operation analysis, embedding method, device, equipment and storage medium | |
| CN109587031A (en) | Data processing method | |
| CN113067802B (en) | User identification method, device, equipment and computer readable storage medium | |
| JP6102575B2 (en) | Performance measurement method, performance measurement program, and performance measurement apparatus | |
| CN114327592A (en) | Page point burying method and device, electronic equipment and storage medium | |
| CN112100534A (en) | Information processing method, device, medium and electronic equipment in page sharing | |
| CN111309613A (en) | Application testing method, apparatus, device, and computer-readable storage medium | |
| US10783010B2 (en) | Offline briefcase synchronization | |
| CN113778837B (en) | Page fault determination method and device, electronic equipment and storage medium | |
| CN110890997A (en) | Network delay measuring method, device, equipment and medium | |
| US20130036374A1 (en) | Method and apparatus for providing a banner on a website | |
| CN116992441A (en) | Operation delay detection method, device, equipment and storage medium | |
| US10565636B2 (en) | Electronic device, system, and method | |
| WO2021205271A1 (en) | Oscillating video refresh | |
| CN115086194B (en) | Cloud application data transmission method, computing device and computer storage medium | |
| US20240111410A1 (en) | Drag and drop interactions for a browser software application | |
| CN113961526B (en) | Method and device for detecting screen capturing picture | |
| CN111741337B (en) | Recommendation information display method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |