TWI747666B - Application program automatic detection method and system - Google Patents

Abstract

An application program automatic detection method, which allows a recording device to record a plurality of correct image frames corresponding to a detection operation flow corresponding to an application program that has passed the detection, and causes the image processing device to produce according to the correct image frames and the detection operation flow A detection operation flow script containing a plurality of operation instructions sorted by script number and each correct image screen corresponding to each script number, and then the electronic device is made to operate the application to be detected according to the detection operation flow script to generate corresponding differences A plurality of image frames to be detected with a script number, and compare each image frame to be detected with each correct image frame corresponding to the same script number to produce a detection result, and the application to be detected is the one that has passed the detection The updated version of the application.

Description

Application program automatic detection method and system

The present invention relates to an application program detection method, in particular to an application program automatic detection method.

Existing smart home appliances, such as refrigerators, air conditioners, dehumidifiers, washing machines, etc., allow users to perform remote control by running applications pre-installed in a smart phone. In addition, in order to provide a better user experience or service, these applications are often version updated, and in order to confirm that the screen content presented by the updated application is complete and correct, the existing practice is that testers follow a predetermined inspection process. Input different operation instructions into the operation interface generated by the application program in order to make the application program display the corresponding screen. The tester then refers to a predetermined operation result data to determine whether the display screen is the same as the predetermined content in the operation result data. To determine whether the content of the display screen is incorrect, and manually fill in the test result into a test result form, so that the software engineer can make relevant corrections or adjustments to the updated application based on the test result form.

Therefore, when the same application is undergoing minor revisions, for example, when only the background color, text or graphics of one or a few display screens are updated each time the revision, the inspector must still re-operate the updated application in accordance with the above-mentioned inspection process. It is obviously time-consuming and labor-intensive to manually judge the integrity of each display screen one by one and manually record the test results, and it is necessary to propose an improvement plan.

Therefore, the purpose of the present invention is to provide an application program automatic detection method and system, which can at least solve the above-mentioned problem of manual detection of application programs in the prior art.

Therefore, an application program automatic detection method of the present invention includes: (A) a video recording device is made to record a first electronic device executing an application program that has passed detection to generate a video, and the video records the display of the first electronic device An operation interface of the application program that has passed the test, and multiple correct images generated by the application program that has passed the test based on a plurality of operation instructions sequentially input to the operation interface; wherein the operation instructions are in accordance with one The detection operation flow is sequentially input into the operation interface; (B) an image processing device is asked to extract the correct image frames corresponding to the operation instructions from the video and store them; (C) the image processing device is based on the correct images The screen and the detection operation flow make a detection operation flow script, the detection operation flow script includes the operation instructions sorted by script number and each correct image screen corresponding to each script number; and (D) let a second The electronic device executes a to-be-detected application program to display an operation interface of the to-be-detected application program, and the second electronic device executes the detection operation flow script, and automatically sequentially inputs the operations sorted by the script number Command to the operating interface to make the application program to be detected sequentially generate a plurality of image frames to be detected corresponding to different script numbers, and the second electronic device compares each of the image frames to be detected corresponding to the same script number with each of the image frames to be detected The correct image screen is generated, and a test result is generated accordingly; wherein the application to be tested is the updated version of the application that has passed the test.

In some embodiments of the present invention, the first electronic device and the second electronic device are the same computer device; or, the first electronic device, the second electronic device, and the image processing device are the same computer device; or , The recording device, the image processing device and the second electronic device are the same computer device.

In some embodiments of the present invention, the detected application program is installed on a smart phone and executed by the smart phone to remotely control smart home appliances.

Furthermore, the present invention implements an application program automatic detection system that implements the above method, including a first electronic device, a video recording device, an image processing device, and a second electronic device; wherein the first electronic device performs a passed detection The application program; the recording device records the process of the first electronic device executing the application program that has passed the test to generate a video, the video recording the first electronic device to display an operating interface of the application program that has passed the test, and The application program that has passed the inspection generates multiple correct image frames corresponding to multiple operating instructions sequentially input to the operating interface; wherein the operating instructions are sequentially input to the operating interface according to a testing operation flow; the image processing A device for extracting and storing the correct image frames corresponding to the operation instructions from the video; and the image processing device creates a detection operation flow script according to the correct image frames and the detection operation flow, and the detection operation flow The script includes the operation instructions sorted by script number and each correct image screen corresponding to each script number; the second electronic device executes an application program to be detected to display an operation interface of the application program to be detected , And the second electronic device executes the detection operation flow script, and automatically sequentially inputs the operation instructions sorted by the script number to the operation interface, so that the application to be detected sequentially generates plural numbers corresponding to different script numbers Image frames to be detected, and the second electronic device compares each image frame to be detected with each correct image frame corresponding to the same script number, and generates a detection result accordingly; wherein, the application program to be detected is The updated version of the app that has passed the test.

The effect of the present invention is: according to the correct image screens displayed by the application programs that have passed the test and the test operation flow, the operation instructions sequenced by the script number and the correct ones corresponding to the script numbers are created. The detection operation flow script of the image screen, and the electronic device executes the detection operation flow script to operate the application program to be detected, so that the application program to be detected generates a plurality of image frames to be detected corresponding to different script numbers. At the same time, the electronic device compares each of the to-be-detected image frames corresponding to the same script number with each of the correct image frames, and generates a detection result based on this, so as to achieve automatic detection of the updated application and solve the previous manual manual operation detection and update The problem of time-consuming and labor-intensive applications after the application.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same numbers.

1 shows the main steps of an embodiment of the application program automatic detection method of the present invention, and this embodiment is implemented by an application program automatic detection system shown in FIG. 2, which mainly includes an execution of an application program The first electronic device 1, a video recording device 2, an image processing device 3, and a second electronic device 4 of. And this embodiment is mainly for realizing automated detection applications, and the applications described here mainly (but not limited to) are intended to be installed in portable electronic devices, such as smart phones, and used to remotely control smart phones. Home appliances (or smart appliances) applications. In order to provide better user experience or services, such application developers that remotely control smart home appliances often update the version of the application, and after each version update, in order to confirm that the application does not need to be updated (no update) )’S screen has not been accidentally changed during the update process. Therefore, even if only one or two of the display screens are updated after the application is updated, the user interface generated by it needs to be re-operated step by step to start from the beginning. The tail detects whether the content of the display screen (such as the coordinate position of the user interface, text, graphics, background color, etc.) generated after the operation is correct or not.

Therefore, in order to automatically detect the updated application program to replace the time-consuming and labor-intensive manual detection in the past, as shown in step S1 in Figure 1, first, the first electronic device 1 is made to execute the application program (before the update), and the The recording device 2 records (records) the process of executing the application program by the first electronic device 1 to generate a video, which records an operation interface (ie, user interface) of the application program displayed by the first electronic device 1, and the The application program generates multiple correct image frames corresponding to multiple operation commands inputted by the user in sequence on the operating interface; specifically, the user follows a testing operation process indicated in a testing operation process document in sequence. Input these operating instructions on the operating interface. Moreover, the application program executed by the first electronic device 1 is an application program that has passed the test, so each image frame generated by the application program according to each operation command is the correct image frame.

Then, in step S2 of FIG. 1, the image processing device 3 obtains the video recorded by the video recording device 2, and extracts and stores the correct image frames corresponding to the operation commands from the video; in other words, use By operating the image processing device 3, the correct image frames generated in the movie corresponding to the operation instructions can be segmented and stored (archived) separately, so that each correct image frame in the archive corresponds to the detection. Each operation instruction in the operation flow.

Then, in step S3 of FIG. 1, the image processing device 3 creates a detection operation flow script based on the correct image frames and the detection operation flow. The detection operation flow script includes the operation instructions sorted by the script number and the The script number corresponds to each of the correct image frames (that is, corresponds to each of the operation instructions).

Thereby, when the above-mentioned updated version of the application program becomes an application program to be detected, step S4 of FIG. 1 can be performed to make the second electronic device 4 execute the application program to be detected, and display the application program to be detected Then, the second electronic device 4 executes the detection operation flow script obtained in advance from the image processing device 3, and automatically according to the detection operation flow script Input the operation commands sorted by script number to the operation interface, so that the application program to be tested will sequentially generate a plurality of images to be tested corresponding to different script numbers (that is, corresponding to each operation command), and the first The two electronic devices 4 will sequentially compare whether the content of each image frame to be detected corresponding to the same script number is consistent with the content of each correct image frame, for example, the content of each display screen generated by the application program to be detected after the detection operation is performed one by one. Whether (such as the coordinate position of the user interface, text, graphics, background color, etc.) is exactly the same as the content of the corresponding correct image screen, a detection result is generated based on this. For example, as shown in FIG. 3, when the second electronic device 4 compares the image frame to be detected (the left image in FIG. 3) corresponding to the same script number with the correct image image (the right image in FIG. 3) , It is found that the "OK" at the bottom of the image to be detected is the wrong text, that is, the judgment result and the corresponding script number are automatically filled in a detection result form, so that when the second electronic device 4 is finished executing After the detection operation flow script, the second electronic device 4 automatically generates and stores (or outputs or displays) the detection result form as the detection result of the application to be detected. Therefore, the software engineer can make relevant corrections or adjustments to the error display screen generated by the updated application (that is, the aforementioned application to be tested) according to the test result form.

In addition, it is worth mentioning that the above-mentioned first electronic device 1, the recording device 2, the image processing device 3, and the second electronic device 4 may be independent computer devices or the first electronic device. The device 1 and the second electronic device 2 are in fact the same computer device; or, the first electronic device 1, the second electronic device 2 and the image processing device 3 are in fact the same computer device; or, the video recording device 2 The image processing device 3 and the second electronic device 4 are actually the same computer device.

In summary, the above-mentioned embodiment captures multiple correct image frames corresponding to multiple operation instructions inputted in accordance with a testing operation flow by the application program that has passed the test, and then according to the correct image frames and the A detection operation flow script is created to make the detection operation flow script include the operation instructions sorted by the script number and each correct image screen corresponding to each script number, and then the electronic device executes the above-mentioned application program after updating The latter application program to be detected, and the electronic device executes the detection operation flow script so that the application program to be detected sequentially generates a plurality of to-be-detected image frames corresponding to different script numbers, and at the same time the electronic device compares Correspond to each of the to-be-detected image screens and each of the correct image screens of the same script number, and generate a detection result based on this, so as to achieve automatic detection of updated applications, and solve the problem of manual manual operation to detect updated applications in the past. The time-consuming and labor-intensive problem does indeed achieve the efficacy and purpose of the present invention.

However, the above are only examples of the present invention, and should not be used to limit the scope of implementation of the present invention, all simple equivalent changes and modifications made in accordance with the scope of the patent application of the present invention and the content of the patent specification still belong to This invention patent covers the scope.

1: The first electronic device

2: Recording device

3: Image processing device

4: The second electronic device

S1~S4: steps

Other features and effects of the present invention will be clearly shown in the embodiments with reference to the drawings, in which: FIG. 1 is the main flow of an embodiment of the application automatic detection method of the present invention; 2 is a schematic diagram of the hardware device of an embodiment of the application automatic detection system of the present invention; and FIG. 3 is a schematic diagram illustrating the to-be-detected display screen and the correct display screen of the automatic comparison application in this embodiment.

S1~S4: steps

Claims (10)

An application program automatic detection method, including: (A) a video is generated by making a video recording device record a first electronic device executing an application program that has passed the detection, the video recording the first electronic device showing that the first electronic device has passed the detection An operating interface of the application program, and multiple correct images generated by the application program that has passed the inspection according to the multiple operation instructions sequentially input to the operating interface; wherein the operating instructions are based on a detection operation flow Input the operating interface in sequence; (B) order an image processing device to extract the correct image frames corresponding to the operating instructions from the video and store them; (C) the image processing device according to the correct image frames and the detection The operation flow makes a detection operation flow script, the detection operation flow script includes the operation instructions sorted by script number and each of the correct image frames corresponding to each of the script numbers; and (D) making a second electronic device execute a The application program to be detected displays an operation interface of the application program to be detected, and the second electronic device executes the detection operation flow script, and automatically sequentially inputs the operation instructions sorted by the script number to the operation The interface enables the application program to be detected to sequentially generate a plurality of image frames to be detected corresponding to different script numbers, and the second electronic device compares each image frame to be detected corresponding to the same script number with each correct image frame, Based on this, a test result is generated; among them, the application to be tested is the updated version of the application that has passed the test. The application automatic detection method according to claim 1, wherein the first electronic device and the second electronic device are the same computer device. The application automatic detection method according to claim 1, wherein the first electronic device, the second electronic device, and the image processing device are the same computer device. The application automatic detection method according to claim 1, wherein the recording device, the image processing device and the second electronic device are the same computer device. The application program automatic detection method according to claim 1, wherein the detected application program is installed on a smart phone and executed by the smart phone to remotely control smart home appliances. An application program automatic detection system includes: a first electronic device that executes an application program that has passed the detection; a recording device that records the process of the first electronic device executing the application program that has passed the detection to generate a video , The video records an operation interface of the first electronic device displaying the application program that has passed the test, and multiple correct images generated by the application program that has passed the test according to a plurality of operation instructions sequentially input to the operation interface Screen; where the operation commands are sequentially input to the operation interface according to a detection operation flow; an image processing device that extracts and saves the correct image frames corresponding to the operation commands from the video; and the image processing The device creates a detection operation flow script based on the correct image frames and the detection operation flow, and the detection operation flow script includes a script numbered The sequence of the operating instructions and each of the correct image frames corresponding to each of the script numbers; and a second electronic device that executes an application program to be detected to display an operation interface of the application program to be detected, and The second electronic device executes the detection operation flow script, and automatically sequentially inputs the operation instructions sorted by the script number to the operation interface, so that the application to be detected sequentially generates a plurality of waits corresponding to different script numbers. The image frame is detected, and the second electronic device compares each of the image frames to be detected corresponding to the same script number with each of the correct image frames, and generates a detection result accordingly; wherein, the application to be detected is the The updated version of the app that passed the test. The application automatic detection system according to claim 6, wherein the first electronic device and the second electronic device are the same computer device. The application automatic detection system according to claim 6, wherein the first electronic device, the second electronic device, and the image processing device are the same computer device. The application automatic detection system according to claim 6, wherein the recording device, the image processing device and the second electronic device are the same computer device. The application program automatic detection system according to claim 6, wherein the application program that has passed the detection is installed on a smart phone and executed by the smart phone to remotely control smart home appliances.

Images