CN117667663A

CN117667663A - Control positioning path determining method, device, equipment, storage medium and product

Info

Publication number: CN117667663A
Application number: CN202211098081.4A
Authority: CN
Inventors: 陈泽华; 赵伟成
Original assignee: Douyin Vision Co Ltd
Current assignee: Douyin Vision Co Ltd
Priority date: 2022-09-08
Filing date: 2022-09-08
Publication date: 2024-03-08

Abstract

The embodiment of the disclosure provides a control positioning path determining method, device, equipment, storage medium and product, wherein the method comprises the following steps: determining a target control to be positioned and a control tree corresponding to the target control; traversing the root node corresponding to the control tree by taking the target control as a starting point according to the attribute information corresponding to each control node in the control tree, and determining a target attribute combination of the target control uniquely positioned in the control tree; and determining the target attribute combination as a positioning path corresponding to the target control. The generation of the target control positioning path can be automatically realized through the attribute information on the target control positioning, and the efficiency is high. Even if each level in the control tree changes, the attribute information corresponding to the control node does not change correspondingly. The stability of positioning the target control by adopting the attribute information is higher, and even if each level in the control tree changes, the accurate positioning of the target control can be realized according to the combination of the attribute information.

Description

Control positioning path determining method, device, equipment, storage medium and product

Technical Field

The embodiment of the disclosure relates to the technical field of computer and network communication, in particular to a control positioning path determining method, device, equipment, storage medium and product.

Background

The display interface generally comprises a plurality of control elements, such as buttons, pictures, input boxes and the like in the web page interface, and in order to optimize the display effect of the display interface, the control in the display interface generally needs to be optimized. In practical application, UI automation test can be adopted to simulate the operation of a human to automatically test the control. And the UI automatic test needs to acquire the test information of the control to be tested.

In the prior art, the determination of the control positioning path is generally performed manually. The current control positioning path determining method generally requires that a user knows a control tree structure corresponding to the whole page, and determines the control positioning path according to the identifier of the level of the control to be tested in the control tree.

However, when the control positioning path is determined by adopting the method, on one hand, manually generating the control positioning path consumes more manpower resources and has lower efficiency. On the other hand, the control positioning path is determined by the identification of the level of the control to be detected in the control tree, when a certain level in the control tree is changed, the corresponding control positioning path also needs to be changed correspondingly, otherwise, the control to be detected cannot be positioned correctly, and therefore, the operation is complicated and the accuracy is low.

Disclosure of Invention

The embodiment of the disclosure provides a control positioning path determining method, device, equipment, storage medium and product, which are used for solving the technical problems of low efficiency and low accuracy of the existing control positioning path generating method.

In a first aspect, an embodiment of the present disclosure provides a control positioning path determining method, including:

determining a target control to be positioned and a control tree corresponding to the target control, wherein the control tree comprises attribute information corresponding to all control nodes in a display interface to which the target control belongs;

traversing the root node corresponding to the control tree by taking the target control as a starting point according to attribute information corresponding to each control node in the control tree, and determining a target attribute combination of the target control uniquely positioned in the control tree, wherein the target attribute combination comprises attribute information corresponding to the target control and at least one control node positioned on the upper layer of the target control in the control tree;

and determining the target attribute combination as a positioning path corresponding to the target control.

In a second aspect, an embodiment of the present disclosure provides a control positioning path determining apparatus, including:

The system comprises a determining module, a positioning module and a control tree setting module, wherein the determining module is used for determining a target control to be positioned and a control tree corresponding to the target control, and the control tree comprises attribute information corresponding to all control nodes in a display interface to which the target control belongs;

the processing module is used for performing traversal operation to a root node corresponding to the control tree by taking the target control as a starting point according to attribute information corresponding to each control node in the control tree, determining that the target control target attribute combination is uniquely positioned in the control tree, wherein the target attribute combination comprises attribute information corresponding to the target control and at least one control node positioned on the upper layer of the target control in the control tree;

and the path generation module is used for determining the target attribute combination as a positioning path corresponding to the target control.

In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored in the memory, causing the at least one processor to perform the control positioning path determination method as described above in the first aspect and the various possible designs of the first aspect.

In a fourth aspect, embodiments of the present disclosure provide a computer readable storage medium, where computer executable instructions are stored, which when executed by a processor, implement the control positioning path determining method according to the first aspect and the various possible designs of the first aspect.

In a fifth aspect, embodiments of the present disclosure provide a computer program product comprising a computer program which, when executed by a processor, implements the control positioning path determination method according to the first aspect and the various possible designs of the first aspect.

According to the control positioning path determining method, device, equipment, storage medium and product, after the target control to be positioned and the control tree corresponding to the target control are determined, traversing is performed in the control tree according to the attribute information corresponding to each control node in the control tree, and a target attribute combination is determined, wherein the target attribute combination comprises the target control and the attribute information corresponding to at least one control node, and the target attribute combination can uniquely position the target control in the control tree. And determining the target attribute as a positioning path corresponding to the target control. Compared with the existing manual positioning method, the method has the advantages that the generation of the target control positioning path can be automatically realized through the positioning of the attribute information on the target control, and the efficiency is high. In addition, even if each level in the control tree changes, the attribute information corresponding to the control node does not change correspondingly. Therefore, the stability of positioning the target control by adopting the attribute information is higher, and even if each level in the control tree changes, the accurate positioning of the target control can be realized according to the combination of the attribute information.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the description of the prior art, it being obvious that the drawings in the following description are some embodiments of the present disclosure, and that other drawings may be obtained from these drawings without inventive effort to a person of ordinary skill in the art.

FIG. 1 is a diagram of a system architecture upon which embodiments of the present disclosure are based;

fig. 2 is a flowchart of a control positioning path determining method according to a first embodiment of the disclosure;

FIG. 3 is a schematic diagram of a display interface according to an embodiment of the disclosure;

fig. 4 is a flowchart of a control positioning path determining method according to a second embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a control positioning path determining device according to a third embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of an electronic device 600 according to a fourth embodiment of the disclosure.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.

Noun interpretation:

control: constituent elements in the display interface, such as buttons, pictures, input boxes, etc. in the web interface.

Control tree: a hierarchical representation of the controls in the interface, such as a DOM tree of the web interface, is displayed. Attribute information for each control may be included in the control tree.

Element positioning path, namely path expression capable of positioning corresponding nodes of the control tree species, such as Xpath for positioning webpage elements.

UI automation test: and simulating controls in the human operation application interface by a technical means to perform automatic test.

Aiming at the technical problems that the existing control positioning path generation method is low in efficiency and low in accuracy, the disclosure provides a control positioning path determination method, device, equipment, storage medium and product.

It should be noted that the method, the device, the equipment, the storage medium and the product for determining the control positioning path can be applied to any scene of generating the control positioning path.

In order to realize the test operation of the control in the display interface, in the prior art, a technician generally generates a positioning path according to the specific position of the control to be positioned in the control tree according to the knowledge of the technician on the control tree, and the identifier of the hierarchy to which the control belongs. However, when the control positioning path is generated by adopting the method, the professional requirements of technicians are high, and the efficiency is low. In addition, if the control tree is correspondingly adjusted, which causes the control tree level to change, the generated positioning path may not accurately position the control, so that the accuracy is not high.

In the process of solving the technical problems, the inventor finds that, because the attribute information corresponding to each control is not easy to change in the control tree, the unique attribute information combination capable of positioning the target control can be adopted to generate the positioning path corresponding to the target control. Therefore, the generation of the positioning path can be automatically realized, and the processing efficiency of the generation of the positioning path is improved. In addition, even if the control tree is changed, the positioning of the target control can be accurately realized according to the attribute information combination.

Fig. 1 is a system architecture diagram according to an embodiment of the present disclosure, where, as shown in fig. 1, the system architecture according to the present disclosure at least includes a terminal device 11 and a server 12, where a control positioning path determining device is disposed in the server 12, and the control positioning path determining device may be written in languages such as C/c++, java, shell, or Python; the terminal device 11 may be, for example, a desktop computer, a tablet computer, etc.

Based on the system architecture diagram, the terminal device 11 may display an interactive interface, where the interactive interface includes a plurality of control nodes, and the terminal device 11 may determine, as a target control, a control node triggered by a user in response to a triggering operation of the user on any control node. Accordingly, the server 12 may perform information interaction with the terminal device 11, and after determining the target control to be located, may determine a control tree corresponding to the target control. And further, a target attribute combination for uniquely positioning the target control in the control tree can be determined according to the target control in the control tree and attribute information corresponding to at least one control node, and the target combination is determined to be a positioning path corresponding to the target control.

Fig. 2 is a flowchart of a control positioning path determining method according to an embodiment of the present disclosure, as shown in fig. 2, where the method includes:

step 201, determining a target control to be positioned and a control tree corresponding to the target control, wherein the control tree comprises attribute information corresponding to all control nodes in a display interface to which the target control belongs.

The execution subject of this embodiment is a control positioning path determining device, which may be coupled in a server. The server can be in communication connection with the terminal device, so that the target control can be determined according to the control triggered by the user on the terminal device. And then the positioning path corresponding to the target control can be determined according to the attribute information of each control in the control tree.

Optionally, the control positioning path determining device may be further coupled to the terminal device, so that the target control can be determined according to the triggering operation of the user, and the positioning path corresponding to the target control can be determined according to the attribute information of each control in the control tree.

In this embodiment, the control tree is a hierarchical representation of each control in the display interface, such as a DOM tree of the web page interface, where attribute information of each control may be included in the control tree. Based on the attribute information of each control, specific controls in the control tree can be searched and positioned. For example, the control a includes attribute information, where the attribute information only has a correspondence relationship with the control a in the control tree, and therefore, in the control tree, positioning of the control a may be implemented according to the attribute information.

The control positioning path determining device can determine a target control which needs to be positioned currently, and the target control can be selected by a user on the terminal device according to actual requirements. After determining the target control to be positioned currently, a control tree corresponding to the display interface including the target control can be determined, wherein the control tree includes attribute information corresponding to all the controls in the display interface. Other controls in the control tree have an association relationship with the target control at least in part.

Step 202, performing traversal operation on a root node corresponding to the control tree by taking the target control as a starting point according to attribute information corresponding to each control node in the control tree, and determining that the target control target attribute combination is uniquely positioned in the control tree, wherein the target attribute combination comprises attribute information corresponding to the target control and at least one control node, which is positioned on the upper layer of the target control, in the control tree.

In this embodiment, after determining the target control and the control tree corresponding to the display interface to which the target control belongs, the attribute information corresponding to the target control and at least one control node in the control tree may be subjected to a combination operation to determine the target attribute combination. Wherein the target control can be uniquely located in the control tree by the target attribute combination.

Optionally, in order to determine the target attribute combination, a traversing operation may be performed to a root node corresponding to the control tree with the target control as a starting point, so as to determine the target attribute combination corresponding to one target control and at least one control node, and enable the target control to be uniquely located. The target attribute combination may specifically include attribute information corresponding to a target control and at least one control node located at an upper layer of the target control in a control tree.

For example, if the control a includes attribute information, the attribute information only has a corresponding relationship with the control a in the control tree, so that the attribute information of the control a can be combined with the root node corresponding to the control tree to obtain the target attribute combination. Or if the control a does not include the attribute information capable of being positioned, traversing the control a to the direction of the root node by taking the control a as a starting point to determine whether at least one control node and the attribute information corresponding to the control a exist, and if so, determining the combination as the target attribute combination.

And 203, determining the target attribute combination as a positioning path corresponding to the target control.

In this embodiment, after determining the target attribute combination, since the target control can be uniquely located in the control tree by the target attribute combination, the target attribute combination may be determined as a location path corresponding to the target control.

Optionally, in the subsequent control testing process, the control tree may be screened according to attribute information corresponding to at least one control node in the target attribute combination corresponding to the positioning path, so as to obtain a target control tree. In the target control tree, screening of the target control is carried out through attribute information corresponding to the target control in the target attribute combination, and positioning operation of the target control is achieved.

Further, on the basis of the first embodiment, after step 203, the method further includes:

and acquiring test information corresponding to the target control according to the positioning path.

And carrying out automatic test operation on the target control according to the test information.

In this embodiment, after determining the positioning path corresponding to the target control, automatic testing operation on the target control may be implemented according to the positioning path.

For example, the automatic test operation of the target control may obtain test information corresponding to the target control according to the positioning path, where the test information includes, but is not limited to, attribute information, code segments, and the like of the target control. After the test information is obtained, simulating triggering operation of a user on a control in the display interface of the application program to perform automatic test operation on the target control so as to realize the test on the performance of the target control.

Alternatively, the automatic test operation may be implemented by the control positioning path determining device, or may be implemented by another testing device. When the other testing devices are adopted for automatic testing, the control positioning path determining device can send the positioning path to the other testing devices in communication connection, so that the other testing devices can acquire the testing information corresponding to the target control according to the positioning path. The present disclosure does not limit the execution subject of the test operation.

Further, on the basis of the first embodiment, step 201 includes:

and acquiring a display interface processing request.

And carrying out screen capturing on the current display interface of the target application according to the display interface processing request to obtain a screen capturing.

And displaying the screenshot in a preset first display area, and displaying the control tree corresponding to the current display interface of the target application in a preset second display area.

And responding to the triggering operation of a user on any control on the screen shot, and determining the control as the target control.

In this embodiment, in order to enable a user to more intuitively determine a target control that needs to be positioned currently, a screenshot of an application interface and a control tree corresponding to the application interface may be displayed on an interface in advance, where the screenshot includes multiple controls in multiple application interfaces. Specifically, the control positioning path determining device may acquire a display interface processing request triggered by a user, and respond to the display interface processing request, may perform screen capturing on an application interface of a current target application of the terminal device, so as to obtain a screenshot. And acquiring a control tree corresponding to the application interface.

And displaying the screenshot in a preset first display area, and displaying a control tree corresponding to the current display interface of the target application in a second display area. And the user can trigger the control on the screenshot according to the actual requirement. In response to a triggering operation of the control by the user, the control triggered by the user can be determined to be a target control.

Fig. 3 is a schematic diagram of a display interface provided in the embodiment of the present disclosure, as shown in fig. 3, a first display area 31 and a second display area 32 may be provided on the interface, where a screenshot 33 is displayed on the first display area 31, and a control tree 34 corresponding to the display interface is displayed on the second display area. To implement editing, optimizing, testing, etc. operations on the controls, a user may trigger any control 35 in the screen shot 33.

According to the control positioning path determining method, after the target control to be positioned and the control tree corresponding to the target control are determined, a target attribute combination is determined according to attribute information corresponding to each control node in the control tree, wherein the target attribute combination comprises the target control and attribute information corresponding to at least one control node, and the target attribute combination can uniquely position the target control in the control tree. And determining the target attribute as a positioning path corresponding to the target control. Compared with the existing manual positioning method, the method has the advantages that the generation of the target control positioning path can be automatically realized through the positioning of the attribute information on the target control, and the efficiency is high. In addition, even if each level in the control tree changes, the attribute information corresponding to the control node does not change correspondingly. Therefore, the stability of positioning the target control by adopting the attribute information is higher, and even if each level in the control tree changes, the accurate positioning of the target control can be realized according to the combination of the attribute information.

Fig. 4 is a flow chart of a control positioning path determining method according to a second embodiment of the present disclosure, and on the basis of the first embodiment, as shown in fig. 4, step 202 includes:

step 401, traversing attribute information corresponding to each control node in the control tree, and detecting whether any attribute information combination is included in the attribute information corresponding to the target control, so as to uniquely locate the target control in the control tree through the attribute information combination, wherein the attribute information combination includes at least one attribute information corresponding to the target control.

And step 402, if the combination is included, determining the combination between the attribute information combination corresponding to the target control and the attribute information of the root control corresponding to the control tree as the target attribute combination.

And step 403, if not, detecting whether the parent node corresponding to the target control is the root control corresponding to the control tree.

And step 404, if yes, determining the combination between the attribute information combination corresponding to the target control and the attribute information of the root control as the target attribute combination.

Step 405, if not, determining a parent node corresponding to the target control as a current target control, and returning to the step 401 until any attribute information combination for uniquely positioning the target control is included in the attribute information corresponding to the current target control; and combining any attribute information corresponding to the current target control, and determining the combination between the attribute information corresponding to the target control triggered by the user as the target attribute combination.

In this embodiment, in order to determine the target attribute combination, it may be detected whether the target control includes a unique attribute information combination, so that the positioning operation of the target control can be implemented through the unique attribute information combination.

Specifically, the attribute information corresponding to each control node in the control tree can be traversed, whether any attribute information combination is included in the attribute information corresponding to the target control is detected, so that the target control is uniquely positioned in the control tree through the attribute information combination, wherein the attribute information combination includes at least one attribute information corresponding to the target control. Optionally, it may be detected first whether the target control includes any attribute information that enables the target control to be uniquely located in the control tree. If so, a target property combination may be further determined from the property information. Otherwise, the attribute information corresponding to the target control can be randomly combined to determine whether any attribute information combination is included, so that the target control can be uniquely positioned in the control tree. If so, a target property combination may be further determined from the property information combination.

Further, if any attribute information combination is included in the attribute information corresponding to the target control, so that the target control is uniquely positioned in the control tree through the attribute information combination, and the characteristic is that in all control nodes under the current root control, the positioning of the target control can be realized according to the attribute information combination, so that the combination between the attribute information combination corresponding to the target control and the attribute information of the root control corresponding to the control tree can be determined as the target attribute combination.

Otherwise, if the attribute information corresponding to the target control does not include any attribute information combination, the target control can be uniquely positioned in the control tree through the attribute information combination, and whether the father node corresponding to the target control is the root control corresponding to the control tree can be further detected. It can be understood that if the parent node of the target control is the root node, the positioning operation of the target control can be realized through any attribute information in the target control only after the parent node is positioned to the root node. Therefore, the combination between the attribute information of the parent node corresponding to the target control and the attribute information of the parent node corresponding to the target control, namely the root node of the current control tree, can be determined as the target attribute combination.

Further, if the parent node corresponding to the target control is not the root control corresponding to the control tree, taking the parent node corresponding to the target control as the current target control, and returning to execute the steps until any attribute information combination of the unique positioning target control is included in the attribute information corresponding to the current target control. And determining any attribute information combination corresponding to the current target control and the combination between the attribute information corresponding to the target control triggered by the user as a target attribute combination. Therefore, the control tree can be determined according to any attribute information combination corresponding to the current target control, and the positioning operation of the target control triggered by the user can be realized according to the attribute information corresponding to the target control triggered by the user. During the current cycle, the current target control in the final generated target attribute combination may be different from the initial target control. Thus, after generating a target property combination, it can be detected whether the target property combination can be located to the target control. If the target control can be located, the target attribute combination can be used as a locating path of the target control. Otherwise, if the target control cannot be positioned, the root control and the corresponding path thereof need to be further updated until the target control can be positioned, and the updated target attribute combination is determined as the positioning path of the target control.

For example, with respect to a practical application, the target control corresponds to an attribute of { "type": "ssxxxxxxxx" }, and it may be detected whether the target control can be accurately located according to the attribute information. After detection, other control nodes are found to correspond to the attribute information. Further, according to the control tree, it is determined that the parent node corresponding to the target control is not the root node, so that it can be detected whether the parent node of the target node can be uniquely located through attribute combination. Wherein, the attribute information of the parent node includes { "type": "SSXXXXXXX", "id": "XXXX" }. However, after traversing the control tree, it is found that { "type": "SSXXXXXXX" } and { "id": "XXXXX" } cannot uniquely locate the parent node. The parent node is continuously traversed upwards in sequence until the attribute { "type": "TTXXXXXX", "label": "not logged in" } corresponding to the parent node is found to be uniquely located to the parent node. Thus, the { "type": "TTXXXX", "label": "unregistered" } and { "type": "SSXXXXXXX" } may be combined as a positioning path for the target control.

Further, on the basis of any of the above embodiments, step 401 includes:

and carrying out random combination on the attribute information corresponding to the target control to obtain the attribute combination to be detected.

Searching in all attribute information corresponding to the control tree according to the attribute combination to be detected to obtain a control to be detected, wherein the control to be detected is matched with the attribute combination to be detected.

And judging whether the control to be detected is matched with the target control.

If yes, judging that any attribute information combination is included in the attribute information corresponding to the target control, and uniquely positioning the target control in the control tree through the attribute information combination.

In this embodiment, attribute information corresponding to the target control may be randomly combined to obtain an attribute combination to be detected, where the attribute combination to be detected includes at least one attribute information. Searching in all attribute information corresponding to the control tree according to the attribute combination to be detected to obtain the control to be detected, wherein the control to be detected is matched with the attribute combination to be detected. It can be understood that if the control to be detected is unique and is the target control, the attribute combination to be detected is characterized to be capable of being accurately positioned to the target control, and any attribute information combination in the attribute information corresponding to the target control can be judged to be included, so that the target control is uniquely positioned in the control tree through the attribute information combination. Otherwise, if the number of the to-be-detected controls is multiple or is not matched with the target control, the attribute combination to be detected is characterized in that the to-be-detected attribute combination cannot be accurately positioned to the target control, so that whether the father node corresponding to the target control is the root node needs to be continuously detected.

According to the control positioning path determining method, any attribute information combination is included in the attribute information corresponding to the target control, so that the target control is uniquely positioned in the control tree through the attribute information combination, if not, whether the father node corresponding to the target control is the root node is detected, and if not, the father node corresponding to the target control is traversed upwards in sequence, so that automatic generation of the target control positioning path can be accurately achieved.

Fig. 5 is a schematic structural diagram of a control positioning path determining device according to a third embodiment of the present disclosure, where, as shown in fig. 5, the device includes: a determining module 51, a processing module 52 and a path generating module 53. The determining module 51 is configured to determine a target control to be located and a control tree corresponding to the target control, where the control tree includes attribute information corresponding to all control nodes in a display interface to which the target control belongs; the processing module 52 is configured to perform a traversing operation to a root node corresponding to the control tree with the target control as a starting point according to attribute information corresponding to each control node in the control tree, and determine that the target attribute combination of the target control is uniquely located in the control tree, where the target attribute combination includes attribute information corresponding to the target control and at least one control node located at an upper layer of the target control in the control tree; and the path generating module 53 is configured to determine the target attribute combination as a positioning path corresponding to the target control.

Further, on the basis of the third embodiment, the apparatus further includes: the device comprises an acquisition module and a test module. And the acquisition module is used for acquiring the test information corresponding to the target control according to the positioning path. And the test module is used for carrying out automatic test operation on the target control according to the test information.

Further, on the basis of the third embodiment, the determining module is configured to: and acquiring a display interface processing request. And carrying out screen capturing on the current display interface of the target application according to the display interface processing request to obtain a screen capturing. And displaying the screenshot in a preset first display area, and displaying the control tree corresponding to the current display interface of the target application in a preset second display area. And responding to the triggering operation of a user on any control on the screen shot, and determining the control as the target control.

Further, on the basis of the third embodiment, the processing module is configured to: traversing attribute information corresponding to each control node in the control tree, and detecting whether any attribute information combination is included in the attribute information corresponding to the target control so as to uniquely locate the target control in the control tree through the attribute information combination, wherein the attribute information combination comprises at least one attribute information corresponding to the target control. And if so, determining the combination between the attribute information combination corresponding to the target control and the attribute information of the root control corresponding to the control tree as the target attribute combination.

Further, on the basis of the third embodiment, the processing module is further configured to: if not, detecting whether the parent node corresponding to the target control is the root control corresponding to the control tree. If yes, determining the combination between the attribute information combination corresponding to the target control and the attribute information of the root control as the target attribute combination.

Further, on the basis of the third embodiment, the processing module is further configured to: if not, determining the father node corresponding to the target control as the current target control, returning to execute the traversing of the attribute information corresponding to each control node in the control tree, and detecting whether any attribute information combination is included in the attribute information corresponding to the target control so as to uniquely locate the target control in the control tree through the attribute information combination until any attribute information combination uniquely locating the target control is included in the attribute information corresponding to the current target control. And combining any attribute information corresponding to the current target control, and determining the combination between the attribute information corresponding to the target control triggered by the user as the target attribute combination.

Further, on the basis of any one of the foregoing embodiments, the processing module is further configured to: and carrying out random combination on the attribute information corresponding to the target control to obtain the attribute combination to be detected. Searching in all attribute information corresponding to the control tree according to the attribute combination to be detected to obtain a control to be detected, wherein the control to be detected is matched with the attribute combination to be detected. And judging whether the control to be detected is matched with the target control. If yes, judging that any attribute information combination is included in the attribute information corresponding to the target control, and uniquely positioning the target control in the control tree through the attribute information combination.

The device provided in this embodiment may be used to execute the technical solution of the foregoing method embodiment, and its implementation principle and technical effects are similar, and this embodiment will not be described herein again.

In order to achieve the above embodiments, the embodiments of the present disclosure further provide an electronic device, including: a processor and a memory;

the memory stores computer-executable instructions;

the processor executes the computer-executable instructions stored in the memory, causing the processor to perform the control positioning path determination method as described in any of the embodiments above.

Fig. 6 is a schematic structural diagram of an electronic device 600 according to a fourth embodiment of the present disclosure, where the electronic device 600 may be a terminal device or a server. The terminal device may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (Personal Digital Assistant, PDA for short), a tablet (Portable Android Device, PAD for short), a portable multimedia player (Portable Media Player, PMP for short), an in-vehicle terminal (e.g., an in-vehicle navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 6, the electronic apparatus 600 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 601 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage device 608 into a random access Memory (Random Access Memory, RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.

In general, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 607 including, for example, a liquid crystal display (Liquid Crystal Display, LCD for short), a speaker, a vibrator, and the like; storage 608 including, for example, magnetic tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 shows an electronic device 600 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 609, or from storage means 608, or from ROM 602. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 601.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer-readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above-described embodiments.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (Local Area Network, LAN for short) or a wide area network (Wide Area Network, WAN for short), or it may be connected to an external computer (e.g., connected via the internet using an internet service provider).

Still another embodiment of the present disclosure further provides a computer readable storage medium having stored therein computer executable instructions that when executed by a processor implement a control positioning path determining method according to any one of the above embodiments.

Yet another embodiment of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements a control positioning path determination method as described in any one of the above embodiments.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

In a first aspect, according to one or more embodiments of the present disclosure, there is provided a control positioning path determining method, including:

According to one or more embodiments of the present disclosure, according to attribute information corresponding to each control node in the control tree, performing a traversal operation to a root node corresponding to the control tree with the target control as a starting point, determining that the target attribute combination of the target control is uniquely located in the control tree includes:

Traversing attribute information corresponding to each control node in the control tree, and detecting whether any attribute information combination is included in the attribute information corresponding to the target control so as to uniquely locate the target control in the control tree through the attribute information combination, wherein the attribute information combination comprises at least one attribute information corresponding to the target control;

and if so, determining the combination between the attribute information combination corresponding to the target control and the attribute information of the root control corresponding to the control tree as the target attribute combination.

According to one or more embodiments of the present disclosure, the detecting whether the attribute information corresponding to the target control includes any attribute information combination, so as to uniquely locate the target control in the control tree through the attribute information combination, further includes:

if not, detecting whether the parent node corresponding to the target control is a root control corresponding to the control tree;

if yes, determining the combination between the attribute information combination corresponding to the target control and the attribute information of the root control as the target attribute combination.

According to one or more embodiments of the present disclosure, after detecting whether the parent node corresponding to the target control is the root control corresponding to the control tree, the method further includes:

If not, determining a father node corresponding to the target control as a current target control, returning to execute the traversing of attribute information corresponding to each control node in the control tree, and detecting whether any attribute information combination is included in the attribute information corresponding to the target control so as to uniquely locate the target control in the control tree through the attribute information combination until any attribute information combination uniquely locating the target control is included in the attribute information corresponding to the current target control;

and combining any attribute information corresponding to the current target control, and determining the combination between the attribute information corresponding to the target control triggered by the user as the target attribute combination.

According to one or more embodiments of the present disclosure, traversing attribute information corresponding to each control node in the control tree, and detecting whether any attribute information combination is included in attribute information corresponding to the target control, so as to uniquely locate the target control in the control tree through the attribute information combination includes:

randomly combining attribute information corresponding to the target control to obtain attribute combination to be detected;

Searching in all attribute information corresponding to the control tree according to the attribute combination to be detected to obtain a control to be detected, wherein the control to be detected is matched with the attribute combination to be detected;

judging whether the control to be detected is matched with the target control;

According to one or more embodiments of the present disclosure, the determining the target control to be located and the control tree corresponding to the target control includes:

acquiring a display interface processing request;

according to the display interface processing request, screen capturing is carried out on a current display interface of the target application, and screen capturing is obtained;

displaying the screen shot in a preset first display area, and displaying the control tree corresponding to the current display interface of the target application in a preset second display area;

According to one or more embodiments of the present disclosure, after the determining, by the combination of the target attributes, the positioning path corresponding to the target control, the method further includes:

Acquiring test information corresponding to the target control according to the positioning path;

In a second aspect, according to one or more embodiments of the present disclosure, there is provided a control positioning path determining apparatus, including:

According to one or more embodiments of the present disclosure, the processing module is configured to:

According to one or more embodiments of the present disclosure, the processing module is further configured to:

judging whether the control to be detected is matched with the target control;

According to one or more embodiments of the present disclosure, the determining module is configured to:

acquiring a display interface processing request;

According to one or more embodiments of the present disclosure, the apparatus further comprises:

the acquisition module is used for acquiring the test information corresponding to the target control according to the positioning path;

and the test module is used for carrying out automatic test operation on the target control according to the test information.

In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device comprising: at least one processor and memory;

the memory stores computer-executable instructions;

the at least one processor executes the computer-executable instructions stored by the memory, causing the at least one processor to perform the control positioning path determination method as described above in the first aspect and the various possible designs of the first aspect.

In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium having stored therein computer-executable instructions which, when executed by a processor, implement the control positioning path determination method according to the first aspect and the various possible designs of the first aspect.

In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the control positioning path determination method according to the first aspect and the various possible designs of the first aspect as described above

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. The control positioning path determining method is characterized by comprising the following steps of:

2. The method of claim 1, wherein the determining, according to the attribute information corresponding to each control node in the control tree, the target attribute combination of the target control by performing a traversal operation with the target control as a starting point to a root node corresponding to the control tree, includes:

3. The method according to claim 2, wherein the detecting whether the attribute information corresponding to the target control includes any attribute information combination, so as to uniquely locate the target control in the control tree through the attribute information combination, further includes:

4. The method of claim 3, wherein after detecting whether the parent node corresponding to the target control is the root control corresponding to the control tree, further comprises:

5. The method according to any one of claims 2-4, wherein traversing the attribute information corresponding to each control node in the control tree, detecting whether any attribute information combination is included in the attribute information corresponding to the target control, so as to uniquely locate the target control in the control tree through the attribute information combination, includes:

judging whether the control to be detected is matched with the target control;

6. The method according to any one of claims 1-4, wherein the determining the target control to be located and the control tree corresponding to the target control includes:

acquiring a display interface processing request;

7. The method according to any one of claims 1-4, wherein after determining the target attribute combination as the positioning path corresponding to the target control, further comprises:

8. A control positioning path determining apparatus, characterized by comprising:

9. An electronic device, comprising: a processor and a memory;

the memory stores computer-executable instructions;

the processor executing computer-executable instructions stored in the memory causes the processor to perform the control localization path determination method of any one of claims 1 to 7.

10. A computer-readable storage medium having stored therein computer-executable instructions which, when executed by a processor, implement the control localization path determination method of any one of claims 1 to 7.

11. A computer program product comprising a computer program which, when executed by a processor, implements a control localization path determination method as claimed in any one of claims 1 to 7.