WO2024088531A1 - Method for the automated creation of a graphical user interface and computer-program-based editor - Google Patents

Abstract

The invention relates to a method for the automated creation of a graphical user interface of a human-machine interface for an industrial machine controller, in which data points are specified by a computer program and/or are defined by a user, wherein in each case one data point represents a machine-related value, and in which depending on a selection, by a user, of at least one data point, the computer program proposes at least one already created graphical user element, which is stored such that it can be accessed, for display and/or control of the machine-related values associated with the at least one data point or creates at least one new graphical operating element for display and/or control of the machine-related values associated with the at least one data point.

Description

Method for automated creation of a graphical user interface and computer program-based editor

The invention relates to a method for the automated creation of a graphical user interface of a human-machine interface for an industrial machine control system. Furthermore, the invention relates to a computer program-based editor for carrying out the method according to the invention.

The term “machine” in the sense of the invention includes individual machines, but also systems and/or production lines which have a plurality of individual machines, in particular those which are connected to one another in terms of process technology.

In order for a machine to function fully, it is usually necessary to display information about the operating status of the machine on a control panel that is connected to the machine via a human-machine interface (HMI), particularly a screen, and to give the machine operator the opportunity to intervene in the workflow, particularly the production process. This is done, for example, by making settings or directly operating the machine via the HMI.

The machine itself is controlled by a computer-aided control device, in particular a controller, which is able to process data from the machine in real time and, based on this, to transmit corresponding control values to the machine or its components.

The controller is programmed using PLC or CNC programming (PLC: Programmable Logic Controller; CNC: Computerized Numerical Control) so that the machine can carry out its intended functions as an interaction of all components. The PLC program has access to old machine-related data in order to calculate the required control variables from it.

When creating an MMS, it is important to visually prepare the machine-related data in such a way that the machine can be operated safely and productively. This should enable the machine operator to to be able to reliably identify the state of the machine in order to be able to determine whether intervention is necessary and, if so, what measures need to be taken. The implementation of these measures using the MMS should also be as simple as possible.

For this purpose, modern MMS have a graphical user interface (GUI) on which graphical control elements are displayed and arranged in such a way that the usability is as high as possible. Usability refers to the suitability of the GUI for use as defined by DIN EN ISO 9241 and is a measure of the extent to which a machine operator can carry out his tasks effectively, efficiently and satisfactorily using the GUI.

Due to the different requirements, it must be taken into account that PLC programming on the one hand and MMS design on the other hand are carried out by different professional groups.

However, it has become common practice, particularly among medium-sized industrial machine manufacturers and operators, to only employ PLC programmers who have expertise in this area due to their training, but who fundamentally have no expertise in the field of MMS design, particularly with regard to usability. Nevertheless, in these companies, the design of MMS also falls within the scope of the PLC programmer's work for cost reasons.

The disadvantage of this is that GUIs created under these conditions sometimes have serious deficiencies in terms of their usability.

The invention is therefore based on the object of enabling non-specialist users to create graphical user interfaces of a human-machine interface for an industrial machine control system that is optimized in terms of its usability.

To solve this problem, the invention proposes a method for the automated creation of a graphical user interface of a human-machine interface for an industrial machine control system, in which data points are specified by the computer program and/or defined by the user, each data point representing a machine-related value and in which on the computer program side, depending on a user-side selection of at least one data point, at least one already created and retrievably stored graphical control element is proposed for displaying and/or controlling the machine-related values associated with the at least one data point or at least one new graphical control element is proposed for displaying and/or controlling the machine-related values associated with the at least one

machine-related values associated with the data point.

Furthermore, to solve the problem, the invention proposes a software editor for carrying out the method according to the invention for the automated creation of a graphical user interface of a human-machine interface of an industrial machine and/or system control, comprising its own graphical user interface with a first selection area in which data points can be positioned in a user-selectable manner, with a second selection area in which at least one graphical control element created by the computer program can be positioned in a user-selectable manner, and with a display area which displays the graphical user interface of the human-machine interface to be created.

Interface, wherein a relative position in the display area can be assigned to a graphical control element by the user and/or the computer program and the graphical control element can be positioned by the user and/or the computer program in accordance with the assigned position, and comprising a data storage device, in particular a database, for storing data points, metadata and graphical control elements, wherein the data storage device, in particular the database, is in data communication with the graphical user interface.

The present invention basically supports any non-specialist user, but in particular the PLC programmer, in creating the graphical user interface of the MMS in that he can specify a data point for the MMS and, using the computer program-supported method according to the invention, propose or create a suitable graphical control element that is optimized in terms of usability. For this purpose, corresponding graphical control elements can be stored in a prepared form and linked to known data points via a database. In addition, the computer program allows the user to link specified and/or self-defined data points with corresponding metadata. In this case, it is possible for the computer program to carry out a more in-depth analysis of the data point using the metadata and, based on this, to create at least one new graphical control element and/or to suggest a previously created control element that can be retrieved. The function of a separate MMS designer can therefore be completely taken over by the method according to the invention and the editor according to the invention with maximum automation.

“Position” and “positionable” in the sense of the invention means that a graphical control element of the MMS is added at a specific logical position that relates it to other graphical control elements and/or according to predefinable parameters, and not that it is fixed at a specific position in the sense of concrete coordinates (x,y).

With regard to the machine-related data, only a subset is important for process control. Particularly relevant are values that influence the production process and are specified from outside. These are the so-called manipulated variables. One manipulated variable is in particular the production speed. Also relevant are values that allow conclusions to be drawn about the state of the machine and which the machine operator can use to determine whether the machine is functioning properly. These are the so-called state variables. One state variable is in particular an error message.

These machine-related data are represented graphically in the user interface of the editor by "data points". These are in particular graphic elements with which the user can interact within the editor. Each data point has a programmatic meaning, which is preferably defined by metadata. It is preferably provided that at least one data point is provided with metadata in which at least the data type of the data point is specified. In terms of the method, it is preferred that on the computer program side, depending on a user-side selection of at least one data point and the metadata of the at least one selected data point, at least one already created and retrievably stored graphical control element is proposed for displaying and/or controlling the machine-related values associated with the at least one data point or at least one new graphical control element is created for displaying and/or controlling the machine-related values associated with the at least one data point. For example, a data point associated with the production speed is represented by metadata comprising a specific data type, in particular a floating point number, and a physical unit is defined. In contrast, a data point associated with an error message is defined by metadata comprising an error code in the form of the data type of an integer and an error text in the form of the data type of a text (string). According to a preferred feature of the invention, it is provided that the data points for creating the at least one graphical control element are displayed in a first selection area for a user to select. This allows the user to select data points that have already been specified by the program. Furthermore, it is preferably provided that data points previously defined by the user are also displayed in this first selection area.

With regard to the creation of the subsequent GUI of the MMS, various degrees of automation are preferably possible on the computer program side.

Use of the method or the editor with a minimal degree of automation can in particular provide that the control element proposed or created by the computer program or several such control elements for different data points or for the same data point are displayed in a selection area. The selection area can be the first selection area or it can preferably be a second selection area that is spatially separated from the first selection area. The at least one graphic control element can then be selected by the user and placed in a display area at a freely selectable position, in particular by means of drag & drop. The

The display area represents at least part of the graphical user interface of the MMS to be created. In this "minimal solution", the automation implemented using a computer program in the sense of "replacing a GUI designer" is limited to the suggestion or creation of a graphic design for the graphical control element and otherwise leaves the user with extensive design freedom when creating the GUI. Nevertheless, this already achieves a significant optimization of the later GUI in terms of usability, which contributes advantageously to clear and simple control of the machine or system and its operational reliability.

In contrast, using the process or the editor with the maximum degree of automation can provide in particular that the user only selects those data points that are to be present on the later GUI from a purely control-technical point of view. should. On the computer program side, a complete GUI is created based on the given data points and preferably depending on the metadata linked to the data points, as well as predefinable parameters, such as usability parameters and/or display parameters. In this process, the computer program side selects and/or creates graphical control elements that match the data points and the positioning of all graphical control elements is coordinated in such a way that a GUI is produced that is optimized in terms of the resulting usability. The created GUI is preferably then displayed to the user in the display area. The GUI created in this way and displayed in the display area is preferably editable, so that the user has the option in particular of changing the positions of individual graphical control elements.

Intermediate stages in terms of the degree of automation are possible. In particular, it can be provided that the at least one graphical control element is selected by the user, whereby a position in a display area, which represents the graphical user interface to be created, is determined by the computer program depending on predeterminable parameters, such as in particular usability parameters and/or display parameters, and the graphical control element is positioned by the computer program according to the previously determined position in the display area.

As a further intermediate stage, in the event that one or more graphical control elements have already been used and/or placed in the display area by the computer program, it can be provided that at least one further graphical control element is displayed on the computer program side in a user-selectable manner depending on a user-selected selection of a further data point, a position for the first and the further graphical control element in the display area is determined in mutual dependence and depending on the predeterminable usability parameters, and then the further graphical control element is positioned in the display area according to the previously determined position without the existing position of the first graphical control element being changed or the further graphical control element is positioned in the display area according to the previously determined position and the first graphical control element is repositioned in the display area according to a newly determined position. Usability parameters in the sense of the invention preferably comprise design specifications that can be specified and called up by the computer program and which, in conjunction with the metadata of the data points, in particular with the data types, allow the computer program to arrange the graphical control elements in a way that is optimized for the subsequent user experience (UX), under which usability is to be subsumed as a partial aspect. For example, specifications can be included according to which control elements for data points with matching or similar data types are to be arranged in groups in terms of position and control elements for data points with different data types are to be arranged at a distance from one another in terms of position. This would serve the purpose of visually displaying control elements for manipulated variables on the one hand and for state variables on the other hand as separate from one another. Furthermore, specifications can be included that position individual control elements according to their technical relationship. This would serve the purpose of directly assigning the control element for the technically associated state variable to a control element for a manipulated variable in terms of position. The above specifications are merely for clarification. A large number of other parameters can be specified, which allows the computer program to make a detailed evaluation and decision regarding the positioning of the control elements.

Display parameters within the meaning of the invention include in particular parameters that enable the GUI to be adapted to different end-user display devices. These include in particular resolution, screen size and/or screen format.

According to a preferred feature of the invention, it is provided that the predefinable parameters, which allow the determination of the position of the graphical control elements, are structured in the form of a predefinable decision matrix or a decision tree. Alternatively, the method uses an artificial intelligence (K1) designed for this purpose.

According to a preferred feature of the invention, the data types available within the metadata include basic data types in the form of Booleans (truth values, i.e. only values "TRUE" or "FALSE" are possible), integers, floating point numbers, time specifications, text and lists as well as user-defined data types, such as:

Range: Restriction of the permissible range of values, e.g. BYTE=integer between 0 and 255; STR10=string with max. 10 characters; IP_ADDRESS= abc.def.pqr.xyz (each triple is a BYTE, which is a STR1).

Enumeration (ENUM): Integer or string with extended metadata that contains further information about certain states, such as 1=OK, 2=Warning, 3=Error state; "OK"=OK, "WARN" warning, "ERR"=Error state

Structures (STRUCT): Composite data type that includes at least one, preferably several other data points of any data type. For example, “Account information={name:String; oldInteger; account balance:Floating point number}”.

Furthermore, arrays and lists of basic data types and/or user-defined data types. It is also intended that the metadata include access authorization data and other data in addition to data types. Access authorization data contains information about whether the data of a data point can be overwritten or only read. Other data includes units, limit values and/or the number of relevant decimal places. Using the metadata provided, the machine-related data represented by data points can be characterized in such a way that they are understandable for the user and it is possible on the computer program side to create a graphical user interface for a human-machine interface, at least partially automatically.

Finally, it is preferably provided that the GUI created can be transferred to the production operation. It is conceivable to carry out the method according to the invention directly on the computer-aided control device, in particular the computer-aided controller, to save the GUI created and possibly displayed in the display area in a file and then to execute it on the control device in the production operation using a suitable program. Alternatively, the method can be carried out on a computer system separate from the control device and the GUI created. This can be saved in a file of a predeterminable type and transferred to the computer-aided control device of a machine control system in an executable manner.

The invention is explained below using an embodiment which is not to be understood as limiting for the person skilled in the art. Fig. 1 is a schematic representation of the method according to the invention with a minimal degree of automation;

Fig. 2 is a schematic representation of the method according to the invention with maximum degree of automation.

Figure 1 shows a method according to the invention with a minimal degree of automation. A corresponding computer program product in the form of an editor with its own graphical user interface (GUI) is executed on a data processing device, in particular a computer.

The editor's GUI provides a first selection area in which data points specified by the computer program and/or user-defined data points that represent machine-related data from a PLC program are displayed for the user to select. The data points are linked to metadata that further characterizes the data point.

In a first process step 1, the user selects a data point. To do so, he uses common input methods, such as a computer mouse or a keyboard.

On the computer program side, depending on the user's selection and the metadata associated with the data point, a graphical control element is selected from a corresponding database in a second process step 2 - or created in the case of a user-defined data point.

The selected or created control element is suggested to the user in a third process step 3 by displaying it as a selectable element in a second selection area of the editor's GUI. The user can also be shown alternative control elements for the selected data point, from which he can select one for further use.

Once the user has made a decision in this regard, he can select one of the suggested controls in a fourth step 4 and in a display area provided by the GUI of the editor, which shows the creating graphical user interface of the human-machine interface, in particular positioning by means of drag & drop.

The user can repeat this process with as many data points and controls as desired.

Figure 2 illustrates a method according to the invention with a maximum degree of automation.

As in the process shown in Figure 1, the editor's GUI provides a selection area in which data points specified by the computer program and/or data points defined by the user, which represent machine-related data of a PLC program, are displayed for the user to select. The data points are linked to metadata that further characterizes the data point.

In a first step 1, the user selects all data points that are to be included in the GUI to be created using a respective graphical control element. To do this, he uses common input methods, such as a computer mouse or a keyboard.

After the selection has been made and, if necessary, a final confirmation via a corresponding mechanism provided by the editor, in particular a button, a complete GUI is created on the computer program side in a second process step 2 based on the specified data points, depending on the metadata linked to the data points and predefinable usability parameters.

In this case, graphical control elements suitable for the data points are selected and/or created by the computer program and the positioning of all graphical control elements is coordinated in such a way that a GUI is created that is optimized in terms of resulting usability.

In principle, the process is finished at this point. The GUI created in this way for the MMS is saved in a predefined file and can be executed on the relevant computer-based control device, in particular the controller, and used to control the machine. Optionally, a third process step 3 can be provided, in which the computer-generated GUI is displayed in the display area of the editor and gives the user the opportunity for further editing.

Intermediate stages between the degrees of automation according to Figures 1 and 2 are possible. In particular, in the method according to Figure 2 it can be advantageous to show the user alternative graphical control elements for at least some of the data points, from which the user can select at least one graphical control element for the further creation of the GUI.

Claims

Patent claims 1. Method for the automated creation of a graphical user interface of a human-machine interface for an industrial machine control system, in which data points are specified on the computer program side and/or defined by the user, wherein each data point represents a machine-related value and in which the computer program side, depending on a user-side selection of at least one data point, at least one already created and retrievably stored graphical control element for displaying and/or controlling the machine-related values associated with the at least one data point is proposed or at least one new graphical control element for displaying and/or controlling the machine-related values associated with the at least one data point is created. 2. Method according to claim 1, characterized in that the data points for creating the at least one graphical control element are displayed in a first selection area for a user to select. 3. Method according to claim 2, characterized in that the at least one graphical control element created or proposed by the computer program for at least one data point is displayed in a second selection area so that it can be selected by the user. 4. Method according to one of the preceding claims, characterized in that the at least one graphical control element is selected by the user or the computer program, wherein the graphical control element is positioned by the user in a display area which represents the graphical user interface to be created. 5. Method according to one of the preceding claims, characterized in that the at least one graphical control element is selected by the user or by the computer program, wherein a position in a display area, which represents the graphical user interface to be created, is determined by the computer program in dependence on predeterminable parameters and the graphical control element is selected by the computer program in accordance with the positioned at a previously determined position in the display area. 6. Method according to one of claims 4 or 5, characterized in that on the computer program side at least one further graphic control element is displayed in a user-selectable manner depending on a user-selected selection of a further data point, a position for the first and the further graphic control element in the display area is determined in mutual dependence and depending on the predeterminable parameters and then the further graphic control element is positioned in the display area according to the previously determined position without the existing position of the first graphic control element being changed or the further graphic control element is positioned in the display area according to the previously determined position and the first graphic control element is repositioned in the display area according to a newly determined position. 7. Method according to one of claims 1 to 3, characterized in that a plurality of data points are selected by the user, wherein at least one graphical control element is created for each data point on the computer program side and/or at least one retrievably stored graphical control element is selected, and wherein for the plurality of the control elements created and/or selected on the basis of the data points selected by the user, a position in a display area which represents the graphical user interface to be created is determined on the computer program side in mutual dependence and in dependence on predeterminable parameters, and the plurality of graphical control elements are positioned on the computer program side according to the previously determined positions in the display area. 8. Method according to one of claims 4 to 7, characterized in that the predefinable parameters are usability parameters and/or presentation parameters. . Method according to one of claims 4 to 8, characterized in that the determination of the position of the first and/or further graphic control element or the positions of the majority of graphic control elements is carried out on the basis of the predefinable parameters by means of a decision matrix or by means of an artificial intelligence designed for this purpose. 10. Method according to one of the preceding claims, characterized in that a machine-related value is a manipulated variable or a state variable. 11. Method according to one of the preceding claims, characterized in that at least one data point is provided with metadata in which at least the data type of the data point is defined, wherein the suggestion or the creation of the graphical control element takes place depending on the metadata of the data point selected by the user. 12. The method according to claim 11, characterized in that the data types available within the metadata include basic data types in the form of Booleans, integers, floating point numbers, time specifications, text and lists as well as user-defined data types as well as arrays and lists. 13. Method according to one of the preceding claims 11 or 12, characterized in that the metadata, in addition to data types, additionally comprise access authorization data and/or other data. 14. Method according to claim 13, characterized in that access authorization data contain information about whether the data of a data point can be overwritten or only read out and that the other data comprise units, limit values and/or number of decimal places. 15. Software editor for carrying out the method according to one of the preceding claims for the automated creation of a graphical user interface of a human-machine interface of a machine, comprising its own graphical user interface with a first selection area in which data points can be positioned in a user-selectable manner, with a second Selection area in which at least one graphical control element created and/or suggested by the computer program can be positioned so that it can be selected by the user, and with a display area which represents the graphical user interface of the human-machine interface to be created, wherein a 5 graphical control element can be assigned a relative position in the display area by the user and/or the computer program and the graphical control element can be positioned according to the assigned position by the user and/or the computer program, and comprising a data storage device, in particular a database, for storing data points, metadata and 10 graphical control elements, whereby the data storage, in particular the database, is in data communication with the graphical user interface.