SE545819C2 - System and method of automating a process - Google Patents
System and method of automating a processInfo
- Publication number
- SE545819C2 SE545819C2 SE2151555A SE2151555A SE545819C2 SE 545819 C2 SE545819 C2 SE 545819C2 SE 2151555 A SE2151555 A SE 2151555A SE 2151555 A SE2151555 A SE 2151555A SE 545819 C2 SE545819 C2 SE 545819C2
- Authority
- SE
- Sweden
- Prior art keywords
- steps
- robot
- subsystem
- implementation
- automated
- Prior art date
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1602—Programme controls characterised by the control system, structure, architecture
- B25J9/161—Hardware, e.g. neural networks, fuzzy logic, interfaces, processor
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0426—Programming the control sequence
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J13/00—Controls for manipulators
- B25J13/02—Hand grip control means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
- B25J9/1661—Programme controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/40—Control within particular dimensions
- G05D1/46—Control of position or course in three dimensions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
- B25J9/1671—Programme controls characterised by programming, planning systems for manipulators characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/05—Programmable logic controllers, e.g. simulating logic interconnections of signals according to ladder diagrams or function charts
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Fuzzy Systems (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Manipulator (AREA)
- Preparation Of Compounds By Using Micro-Organisms (AREA)
Abstract
The present disclosure relates to a computer-implemented method (100) of automating a process of at least a first subsystem for implementation in a robot, the method comprising. Obtaining (101) process-steps indicative of an operation of said at least first subsystem.Further, translating (102) said process-steps to a current data set comprising generalized parameters and obtaining (103), from a data source, previous data sets of generalized parameters associated with said process-steps. Moreover, the method determines (104) at least one robot resource required to perform said process-steps and provides (105) an automated process model. The process model being configured for implementation in a robot comprising said at least one robot resource. Wherein said automated process model is based on said current data set and previous data sets, wherein said automated process model is, when executed in said robot, configured to: cause the robot to perform said process-steps.
Description
TECHNICAL FIELD The present disclosure relates to a system and method of automating a process of at least a first subsystem for implementation in a robot. BACKGROUND ART Generally robots that are adapted to perform specific processes are mainly directed to perform a predefined set of tasks. Thus, their operation can usually only be varied within the set of tasks.
To allow a robot to perform a particular process or action, they are conventionally programmed by guiding or off-line programming. Some industrial robots are programmed by guiding a robot point to point through the phases of an operation, with each point stored in the robotic control system.
Even though programming robots for processes is a conventional task, there is recently a desire to automate and prepare processes obtained from at least a first robot or device for implementation in a second robot in an efficient manner. This requires a system to take in information from at least one other device/robot and be able to in an efficient manner prepare it for implementation into another suitable system. ln order to automate and prepare tasks obtained from different types of devices/robots for implementation into another system, there is a need of a solution that can handle a large variety of devices/robots of different types (e.g. linear robot movements, tools, cameras, lights or different types of sensors) and in an efficient manner automate and prepare the processes for implementation in a robot that is suitable to perform the process.
Thus, there is room for systems for automation processes in the present art to explore the domain of providing an improved system that allows for the automation and preparation of tasks of at least a first device/robot for implementation into a second robot in an efficient manner, specifically there is a need of flexibility and efficiency of such a system. 2 Even though some currently known solutions work well in some situations it would be desirable to provide a system that fulfils requirements relating to flexibility and efficiency when automating and preparing tasks for implementation in another system.
SUMMARY lt is therefore an object of the present disclosure to provide a method and a system to mitigate, a||eviate or e|iminate one or more of the above-identified deficiencies and disadva ntages.
This object is achieved by means of a method and a system as defined in the appended claims. ln accordance with the disclosure there is provided a method and a system according to c|aim 1 and c|aim The present disclosure provides a computer-implemented method of automating a process of at least a first subsystem for implementation in a (preferably an industrial robot) robot, the method comprising the steps of obtaining process-steps indicative of an operation of said at least first subsystem. Further, the method translates/transforms said process-steps to a current data set (i.e. a data set of generalized parameters) comprising generalized parameters.
Moreover the method obtains, from a data source, previous data sets of generalized parameters associated with said process-steps. Further, the method determines at least one robot resource required to perform said process-steps. Furthermore an automated process model is provided for implementation in a robot comprising said at least one robot resource, wherein said process model is based on said current data set and previous data sets and when the automated process model is executed in said robot, it's configured to cause the robot to perform said process-steps (which it can then do without the need of any interaction from users/operators). Thus, it's configured to cause the robot to perform said process-steps in an automated manner.
A benefit of the method in accordance with the present disclosure is that it allows for automating processes performed by subsystems for implementation in a robot that can perform these. Thus, the method provides an efficient and convenient way to obtain and automate process steps from a subsystem, and provide it for implementation in a robot. 3 Further, by translating process steps the method functions in a model-based manner allowing it to operate with different kind of subsystems in an efficient manner.
The process-steps may be obtained from at least a first and a second subsystem. The process steps may be values indicative of process-steps. Thus, the method may obtain process steps from several different sub-systems, automate these, and provide it to a robot. Further, the automated process model may coordinate the process-steps of the at least first and the second subsystem. ln other words, the method may be provided such that process-steps of at least a first and a second subsystem are performed in a coordinated manner i.e. so that the robot they are implemented in performs them cooperatively.
Preceding/during the step of providing an automated process model, the method may execute a simulation for said process model, the simulation performing said process-steps over a time period and upon fulfilling/completing/finishing the execution of said simulation, provide said automated process model for implementation in a robot.
Thus, the method may simulate (either virtually or live) and upon fulfilling the simulation the automated process model may be provided for implementation in the robot. A benefit of this is that it allows for testing and verifying that the process model works and can be implemented in a robot.
Further, a simulation may be executed for a plurality of process models, wherein after the step of fulfilling, the method evaluates each of said plurality of process models subject to at least one predetermined parameter and selects, based on the evaluation, one of said plurality of process models for implementation in a robot. ln other words, the method may identify the best matching simulation for the process to be automated and selects said best matching simulation. The parameters may be for instance time to fulfill simulation, power of robot required to fulfil simulation, or any other suitable parameter. Thus, the method may provide a plurality of process models, simulate these and choose the most appropriate one based on how the simulation is performed subject to said predetermined parameters. An advantage of this is that the automated process model will be chosen depending on its performance in simulation.
The step of translating/transforming may comprise matching said process-steps towards previous data sets to determine the generalized parameters. Thus, the method may obtainprocess steps from a subsystem (or an intermediary system), match them towards previous data sets of e.g. other process-steps previously performed and upon matching, the method may determine what type or process-steps that are obtained and these process-steps may subsequently be translated to generalized parameters. The translation may be performed in a translating module configured to obtain process-steps of a plurality of pre-determined formats and transform said process steps to generalized parameters. A benefit of translating process- steps to generalized parameters is that previously stored (i.e. previous data sets) parameters may be utilized in order to optimize a new process to be automated.
Preceding the step of translating, the method may comprise the steps of classifying the process-steps. Moreover the method may input the process steps into a corresponding translating module of a plurality of translating modules, depending on the classification of the process-steps. The step of classifying allows the method to in an efficient manner sort the steps to improve the efficiency in the translating process and to generate generalized parameters for a variety of subsystems of different types.
The generalized parameters may comprise coordinates projected in a coordinate system, matrices, distances or images. Thus, the method may utilize different types of generalized parameters alone or in combination.
The method may further comprise the step oftransmitting the automated process model to a robot for implementation in said robot.
The step of providing may be performed by an orchestrating unit providing logical functions for each of said process-steps, preferably Boolean functions. Thus, the logical functions may allow a robot which executes the automated process model to perform said process steps autonomously.
The at least one robot resource may be a robotic arm with one degree of freedom, a robotic arm with two degrees of freedom, a robotic arm with three degrees of freedom, a robotic arm with four degrees of freedom, a robotic arm with five degrees of freedom, a robotic arm with six degrees of freedom, a measurement device for measuring a physical quantity, a sensing device, an automated guided vehicle or any other suitable robot resource. ln other words, the method may be able to cause any ofthe mentioned robot resources to perform the process-steps in an automated manner.
There is also provided a computer-readable storage medium storing one or more programs configured to be executed by one or more control circuitry of an electronic device, the one or more programs including instructions for performing the method according to the present disclosure. The electronic device may be a robot.
Further, there is provided a system for automating a process of at least a first subsystem for implementation in a robot, the system comprising control circuitry and at least one robot comprising at least one robot resource. The control circuitry is configured to: - obtain process-steps indicative of an operation of at least a first subsystem; - translate said process-steps to a current data set comprising generalized parameters; - obtain, from a data source, previous data sets of generalized parameters associated to said process-steps; - determine at least one robot resource required to perform said process-steps; - provide an automated process model for implementation in one of said robots comprising said at least one robot resource, wherein said process model is based on said current data set and previous data sets, wherein said automated process model is, when executed in said robot, configured to: - cause the robot to perform said process-steps.
The system and the method of the present disclosure allows for a model-based coordination of subsystems for controlling and manoeuvring robot resources automatically. Thus, the system and method in accordance with the disclosure can enable a robot to perform operations in a flexible and optimized manner. Further, by utilizing generalized parameters in a model-based manner, the system can be utilized even if an operation to be automated is new to the system. The general manner of providing automated process models allows for an improved way of providing automated process models for any type of process-steps.
BRIEF DESCRIPTION OF THE DRAWINGS ln the following, the disclosure will be described in a non-limiting way and in more detail with reference to exemplary embodiments illustrated in the enclosed drawings, in which: FigureFigureFigureFigureFigureFigureDETAILED DESCRIPTION 6 illustrates schematically a computer-implemented method 100 of automating a process/operation of at least a first subsystem for implementation in a robot in accordance with some implementations of the disclosure; illustrates schematically a computer-implemented method 100 of automating a process/operation of at least a first subsystem for implementation in a robot in accordance with some implementations of the disclosure; schematically illustrates a system 1 in accordance with some implementations of the present disclosure; illustrates schematically and sequentially providing an automated process model to a robot from at least a first subsystem; illustrates schematically in an exemplary manner the translating step 102 ofthe method 100 in accordance with some aspects ofthe translating step 102; and illustrates schematically a first and a second simulation 15, 16 in an exemplary manner; ln the following detailed description, some embodiments of the present disclosure will be described. However, it is to be understood that features of the different embodiments are exchangeable between the embodiments and may be combined in different ways, unless anything else is specifically indicated. Even though in the following description, numerous specific details are set forth to provide a more thorough understanding ofthe provided disclosure, it will be apparent to one skilled in the art that the embodiments in the present disclosure may be realized without these details. ln other instances, well known constructions or functions are not described in detail, so as not to obscure the present disclosure. ln the following description of example embodiments, the same reference numerals denote the same or similar components.Figure 1 illustrates a computer-implemented method 100 of automating a process/operation of at least a first subsystem for implementation in a robot, the method 100 comprising the steps of obtaining 101 process-steps indicative of an operation of said at least first subsystem. Further, the method comprise the step of translating 102 said process-steps to a current data set comprising generalized parameters. Further, the method comprises obtaining 103, from a data source, previous data sets of generalized parameters associated with said process-steps. Further, determining 104 at least one robot resource required to perform said process-steps. Further, providing 105 an automated process model for implementation in a robot comprising said at least one robot resource, wherein said automated process model is based on said current data set and previous data sets, wherein said automated process model is, when executed in said robot, configured to cause the robot to perform said process-steps.
The method 100 may obtain process-steps from at least a first category of subsystem and a second category of subsystem. A first type may be e.g. a gripper and a second type may be an imaging device. The different categories may be defined by having different functions/hardwa re.
The term "process-steps" may refer to a set of or a plurality of process-steps that jointly form an operation.
The term "data source" may refer to a collection of data stored and accessible from an electronic device. The data source (shown in Figure 3) in accordance with the present disclosure may be a data base or a cloud data source ran on a cloud computing platform, the data source may also be a local data source. The previous data sets may be a training data set.
The term "subsystem" may refer to any parts of devices that can be controlled e.g. arms, grippers, imaging devices etc. The term "robot" may refer to a programmable machine comprising robot resources.
The term "robot resource" may refer to at least one subsystem connected to/operable by a robot.
The term "generalized parameter" may refer to parameters that are compatible with an internal model(s) utilized in the method 100 to provide automated process models. Thus, the method 100 translates/transforms the obtained process-steps into generalized parameters to 8 allow for input into the internal model(s) so to provide a desired output, which within the context of the present disclosure is an automated process model.
|H The term "automated process mode may refer to a model that is configured to, when implemented in a robot, cause the robots resources to automatically (and e.g. jointly) perform a process, or be prepared to automatically perform a process.
The generalized parameters may comprise coordinates projected in a coordinate system, functions, matrices, distances or images. By translating/transforming obtained process-steps into generalized parameters the method 100 is allowed to make use of stored (and trained) data (previous data sets) gained from previously provided automated process models when providing an automated process model for a current data set. Thus, the method 100 is constantly improved in terms of efficiency, speed and accuracy. Further, the method 100 is allowed to be compatible with a plurality of different types of subsystems having different functions.
The generalized parameters are also stored in said data source in the form of previous data sets. The previous data sets may be trained previous data sets e.g. trained by a learning algorithm.
The process-steps may be obtained from at least a first and a second subsystem. Thus, the method 100 may coordinate processes of at least a first and a second subsystem. The first and second subsystems may be of different types. Further, the subsystems may be independent subsystems of different devices, or in the same device.
Figure 2 schematically illustrates the method 100 in accordance with some implementations of the present disclosure. Figure 2 illustrates that preceding/during the step of providing 105 an automated process model, the method 100 may form 104a at least one automated process model and execute 104b a simulation for said process model. The simulation performs said process-steps over a time-period, and upon fulfilling (|.e. successfully completing/validating the simulation), the execution of said simulation, the method 100 may provide said automated process model for implementation in a robot. Thus, after the simulation is completed the automated process model may be implemented in a robot. |fthe simulation is not successfully completed then the method 100 may re-iterate the step of forming 104a. The execution ofthe simulation may be performed virtually or live.As also shown in Figure 2, in some implementations of the present disclosure, the method 100 may execute 104b the simulation for a plurality of process models. After fulfilling said simulation, the method 100 may evaluate 104c each of said plurality of process models subject to at least one predetermined parameter and select 104d, based on the evaluation, one of said plurality of process models for implementation in a robot. The predetermined parameter may be e.g. time. ln other words, the method 100 may select the process model that executed the simulation in the shortest time.
As further shown in Figure 2, the step oftranslating 102 may comprise matching 102a said process-steps towards previous data sets of generalized parameters to determine generalized parameters of the process-steps. Thus, the method 100 may be configured to match the process-steps towards previous data sets and identify the best matching data sets relative the obtained process-steps. Further, the process-steps may be translated/transformed to generalized parameters.
Figure 2 further illustrates that preceding/during the step of translating 102, the method 100 may comprise the steps of classifying 101a the process-steps and depending on the classification ofthe process-steps inputting 101b the process-steps into a corresponding translating module depending on the classification of the process steps. Thus, depending on the classification of the process-steps the process-steps may be inputted into a corresponding translating module that is configured to translate process-steps of a specific type. For example, there may be robot process-steps and device process-steps that may be inputted 101b into a robot translating module and a device translating module respectively. Each module may then utilize specific translation functions or models in order to translate the process-steps into generalized parameters. Thus, by classifying the process-steps it improves the matching process to obtain the generalized parameters. Each module may be directed to translate a specific predetermined type of format.
Figure 2 also illustrates that the method 100 may further comprise the step of transmitting 106 the automated process model to said robot for implementation in said robot.
The step of providing 105 may be performed by an orchestrating unit (shown in Figure 3) providing logical functions for each of said process-steps, preferably Boolean functions.
The at least one robot resources may be a robotic arm with one degree of freedom, a robotic arm with two degrees of freedom, a robotic arm with three degrees of freedom, a robotic arm with four degrees of freedom, a robotic arm with five degrees of freedom, a robotic arm with six degrees of freedom, a measurement device for measuring a physical quantity, a sensing device, an imaging device, an industrial tool or any other suitable robot resource. A robot resource may further in some implementations be several subsystems combined.
Figure 3 schematically illustrates a system 1 for automating a process of at least a first subsystem for implementation in a robot 2, the system 1 comprising, control circuitry 3 and at least one robot 2 comprising at least one robot resource 4. The control circuitry 3 is configured to: - obtain process-steps indicative of an operation of at least a first subsystem; - translate said process-steps to a current data set comprising generalized parameters; - obtain, from a data source, previous data sets of generalized parameters associated to said process-steps; - determine at least one robot resource 4 required to perform said process-steps; - provide an automated process model for implementation in one of said robots 2 comprising said at least one robot resource 4, wherein said process model is based on said current data set and previous data sets, wherein said automated process model is, when executed in said robot 2, configured to: - cause the robot 2 to perform said process-steps.
As illustrated in Figure 3, the control circuitry 3 may comprise one or more memory devices 5, an orchestrating unit 7 and at least one translating module 8. The orchestrating unit 7 may provide logical functions and the translating module 8 may translate process steps to generalized parameters. The control circuitry 3 may further comprise other modules/components for carrying out the method 100 in accordance with any aspect of the present disclosure such as a machine learning component (not shown).
The memory device 5 may comprise any form of volatile or non-volatile computer readable memory including, without limitation, persistent storage, solid-state memory, remotely mounted memory, magnetic media, optical media, random access memory (RAM), read-only memory (ROM), mass storage media (for example, a hard disk), removable storage media (forexample, a flash drive, a Compact Disk (CD) or a Digital Video Disk (DVD)), and/or any other volatile or non-volatile, non-transitory device readable and/or computer-executable memory devices that store information, data, and/or instructions that may be used by each associated control circuitry 3. Each memory device 5 may store any suitable instructions, data or information, including a computer program, software, an application including one or more of logic, rules, code, tables, etc. and/or other instructions capable of being executed by the control circuitry 3 and, utilized. I\/|emory device 5 may be used to store any calculations made by control circuitry 3 and/or any data set having generalized parameters or any data received via the translating modules ofthe present disclosure. ln some embodiments, each control circuitry 3 and each memory device 5 may be considered to be integrated. The previous data sets may be retrieved to the memory device 5 by means of wireless communication or be stored on the memory device 5. The control circuitry 3 may be integrated with the robot Further, the control circuitry 3 may be integrated in an electronic device (e.g. see Fig.4) such as a computer, tablet device, or any other integrated device configured to provide and transmit an automated process model to the robot 2. lt should be noted that the system 1 of the present disclosure may comprise additional modules for carrying out the method 100, e.g. a classifying module, a matching module, a obtaining module, transmitting module etc.
Further, different modules may be integrated.
Each memory device 5 may also store data that can be retrieved, manipulated, created, or stored by the control circuitry 3. The data may include, for instance, previous data sets, current data sets, generalized parameters, training data, trained learning algorithms (and/or internal models, components, or any data utilized in said trained learning algorithms). The control circuitry 3 may comprises a machine learning (not shown) component that based on previous data sets and current data sets may implement a trained learning algorithm for providing, by the orchestrating unit 7, an automated process model in accordance with any embodiment of the present disclosure. Any data obtained from the control circuitry 3 may be stored in one or more data sources 6. The one or more data sources 6 can be connected to the control circuitry by a high bandwidth field area network (FAN) or wide area network (WAN), or through any other type of communication network. The data source 6 and the memory unitmay be integrated in some implementations. 12 The circuitry 3 may include, for example, one or more central processing units (CPUs), graphics processing units (GPUs) dedicated to performing calculations, and/or other processing devices. The memory device 5 may comprise one or more computer-readable media and can store information accessible by the control circuitry 3, including instructions/programs that can be executed by the control circuitry The instructions, which may be executed by the control circuitry 3, may comprise instructions for implementing the method 100 according to any aspects of the present disclosure.
The network may be any type of communication network, such as a local area network (e.g. intranet), wide area network (e.g. Internet), cellular network, or some combination thereof. Communication between control circuitry 3, memory device 5, robot 2, data sources and remote entities can be carried via a network interface (not shown) using any type of wired and/or wireless connection, using a variety of communication protocols (e.g. TCP/IP, HTTP, SI\/|TP, FTP), encodings or formats (e.g. HTMF, XM F), and/or protection schemes (e.g. VPN, secure HTTP, SSF).
Figure 4 illustrates in an exemplary manner at least a part ofthe method 100 and the system 1 in accordance with some implementations ofthe present disclosure. Figure 4 illustrates that a first subsystem 8 and a second subsystem 8' (of different types) perform an operation/process. Namely the first subsystem 1 is configured to move boxes from a first container to a second container, further the second subsystem 8' captures images ofthe first container to determine the number of boxes left in the first container. ln accordance with the process performed by said first and second subsystem 8, 8', the method 100 disclosed in Figure 1, may be performed by an electronic device 9 so to obtain the process-steps performed by said first and second subsystem 8, 8'. The electronic device 9 may obtain the process-steps by manual input from a user or by electronic communication e.g. with control circuitry of said subsystem or any combination thereof. Further, said electronic device 9 may translate said process-steps to generalized parameters. Further, the electronic device 9 may obtain from a data source 6 previous data sets of generalized parameters associated to said process-steps. Moreover, the electronic device 9 provides an automated process model for implementation in a robot 2 comprising the required at least one robot resource 4 for performing the process-steps, wherein said automated process model is based 13 on said current data set and previous data sets. Thus, in Figure 4, the automated process model is implemented 110 in a robot 2 comprising both the first and the second subsystem 8, 8' as resource 4, wherein said process-steps for each subsystem 8, 8' are coordinated to be performed in a cooperative/joint manner by said robot 2. Accordingly, the method 100 may allow a process to be automated and implemented 110 in a second robot Figure 5 illustrates in an exemplary manner at least a part of the method 100 and the system 1 in accordance with some implementations ofthe present disclosure showing the step of translating 102. Figure 5 shows that the electronic device 9 obtains process-steps (current data sets 12) from a first and a second subsystem 8, 8', the process steps being of different types, namely type A and type B which may be classified by the electronic device 9. Further, the electronic device 9 matches 102a the process-steps towards previous data sets 13 of the same or corresponding classification to determine/form generalized parameters. The step of classification 102 and matching 102a may be performed in a translating module (see Fig.4) or different translating modules each configured for a specific classification of process-steps.
Upon generating generalized parameters, the electronic device 9 may provide the automated process model based on the current data set 12 and previous data sets 13. Thus, the previous data sets may facilitate the forming of an automated process model. ln other words, the step of providing (step 105 in the method shown in Figure 1) may combine the current data set and previous data sets to provide an optimized automated process model. The term "optimized" may refer to generating the automated process model having the most functional/effective form as possible. A trained learning algorithm may preferably be incorporated in the step of providing.
Figure 6 illustrates a first and a second simulation 15, 16 in an exemplary manner. Preceding/during the step forming 104a (shown in Fig.2) at least one automated process model the method may execute simulations 15, 16 for a two of process models. After fulfilling the simulation for at least one of said plurality of process models, the method 100 may evaluate 104c each of said plurality of process models subject to at least one predetermined parameter and select 104d, based on the evaluation, one of said plurality of process models for implementation in a robot. Thus, if e.g. the predetermined parameter is time for moving the boxes from the first container to the other, then the automated process model associated to the second simulation 16 may be chosen since the second simulation 16 moves the boxes 14 faster in-between the containers (gripping two boxes at a time). The different simulations may be formed from combining the current and previous data sets. The previous data sets may have previously similar process-steps that have been performed in a different manner, thus knowledge/functions from previous data may be utilized when providing new automated process models. lt should be noted that the Figures 4-6 have the purpose of further describing the disclosure as presented herein accompanied with advantages thereof. lt should be noted that the Figures 3- 6 are based on embodiments for a disclosing purpose, however it is not limited to said embodiments and may be varied within the present disclosure.
Claims (12)
1. CLAIMS A computer-implemented method (100) of automating a process of at least a first subsystem for implementation in a robot, the method comprising the steps of: obtaining (101) process-steps indicative of an operation of said at least first subsystem; translating (102) said process-steps to a current data set comprising generalized parameters, wherein the step oftranslating (102) comprises matching (102a) said ïçjådata sets to determine the generalized parameters; obtaining (103), from a data source, previousjg ¿š_data sets of generalized parameters associated with said process-steps; determining (104) at least one robot resource required to perform said process-steps; providing (105) an automated process model for implementation in a robot comprising said at least one robot resource, wherein said automated process model is based on said current data set and previous _à_'_s“\“**§g§__data__~sets, wherein said automated process model is, when executed in said robot, configured to: - cause the robot to perform said process-steps. The method (100) according to claim 1, wherein the process-steps are obtained from at least a first and a second subsystem. The method (100) according to claims 2, wherein, said automated process model coordinates the process-steps of the at least first and the second subsystem. The method according to any one of the claims 1-3, wherein preceding the step of providing (105) an automated process model, the method (100): - forms (104a) at least one automated process model; - executes (104b) a simulation for said at least one process model, the simulation performing said process-steps over a time period; and 2 upon fulfilling the execution of said simulation, provide said automated process model for implementation in a robot. The method (100) according to c|aim 4, wherein the simulation is executed for a plurality of process models, wherein after fulfilling the simulation for at least one of said plurality of process models, the method (100): - evaluates (104c) each of said plurality of process models subject to at least one predetermined parameter; - selects (104d), based on the evaluation, one of said plurality of process models for implementation in a robot. The method according to any one of the claims 1-5, wherein preceding the step of translating, the method comprises the steps of; classifying (101a) the process-steps; inputting (101b) the process steps into a corresponding translating module depending on the classification of the process-steps. The method (100) according to any one of the claims 1-6, wherein the generalized parameters comprises coordinates projected in a coordinate system, matrices, distances or images. The method (100) according to any one of the claims 1-7, further comprising the step of: transmitting (106) the automated process model to said robot for implementation in said robot. The method (100) according to any one of the claims 1-8, wherein the step of providing (105) is performed by an orchestrating unit providing logical functions for each of said process-steps, preferably Boolean functions. )zo10. The method (100) according to any one of the claims 1-9, wherein said at least one robot resources are a robotic arm with one degree of freedom, a robotic arm with two degrees of freedom, a robotic arm with three degrees of freedom, a robotic arm with four degrees of freedom, a robotic arm with five degrees of freedom, a robotic arm with six degrees of freedom, a measurement device for measuring a physical quantity, a sensing device, an imaging device, an industrial tool or any other suitable robot FQSOUFCQ. A computer-readable storage medium storing one or more programs configured to be executed by one or more control circuitry (3) of an electronic device, the one or more programs including instructions for performing the method (100) of any of claims 1- A system (1) for automating a process of at least a first subsystem for implementation in a robot (2), the system (1) comprising: control circuitry (3); at least one robot (2) comprising at least one robot resource (4); wherein the control circuitry (3) is configured to: obtain process-steps indicative of an operation of at least a first subsystem; translate said process-steps to a current data set comprising generalized parameters, wherein translate comprises to match said process-steps towards previous_ data sets to determine the generalized parameters; obtain, from a data source (6), previous ggšudata sets of generalized parameters associated to said process-steps; determine at least one robot resource (4) required to perform said process-steps; provide an automated process model for implementation in one of said robots (2) comprising said at least one robot resource (4), wherein said process model is based on said current data set and previous :ï__data sets, wherein said automated process model is, when executed in said robot (2), configured to: - cause the robot (2) to perform said process-steps.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| SE2151555A SE545819C2 (en) | 2021-12-17 | 2021-12-17 | System and method of automating a process |
| EP22908088.2A EP4448225A4 (en) | 2021-12-17 | 2022-12-16 | SYSTEM AND METHOD FOR AUTOMATION OF A PROCESS |
| PCT/SE2022/051189 WO2023113686A1 (en) | 2021-12-17 | 2022-12-16 | System and method of automating a process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| SE2151555A SE545819C2 (en) | 2021-12-17 | 2021-12-17 | System and method of automating a process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| SE2151555A1 SE2151555A1 (en) | 2023-06-18 |
| SE545819C2 true SE545819C2 (en) | 2024-02-13 |
Family
ID=86773275
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| SE2151555A SE545819C2 (en) | 2021-12-17 | 2021-12-17 | System and method of automating a process |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4448225A4 (en) |
| SE (1) | SE545819C2 (en) |
| WO (1) | WO2023113686A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150343635A1 (en) * | 2014-06-03 | 2015-12-03 | Bot & Dolly, Llc | Systems and methods for instructing robotic operation |
| KR102040901B1 (en) * | 2017-12-12 | 2019-11-06 | 경기대학교 산학협력단 | System for generating robot task plans |
| US20210197378A1 (en) * | 2019-12-27 | 2021-07-01 | X Development Llc | Offline robot planning with online adaptation |
| US20210362330A1 (en) * | 2020-05-21 | 2021-11-25 | X Development Llc | Skill template distribution for robotic demonstration learning |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11213947B2 (en) * | 2019-06-27 | 2022-01-04 | Intel Corporation | Apparatus and methods for object manipulation via action sequence optimization |
| EP4046099A1 (en) * | 2019-11-12 | 2022-08-24 | Bright Machines, Inc. | A software defined manufacturing/assembly system |
-
2021
- 2021-12-17 SE SE2151555A patent/SE545819C2/en unknown
-
2022
- 2022-12-16 EP EP22908088.2A patent/EP4448225A4/en active Pending
- 2022-12-16 WO PCT/SE2022/051189 patent/WO2023113686A1/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150343635A1 (en) * | 2014-06-03 | 2015-12-03 | Bot & Dolly, Llc | Systems and methods for instructing robotic operation |
| KR102040901B1 (en) * | 2017-12-12 | 2019-11-06 | 경기대학교 산학협력단 | System for generating robot task plans |
| US20210197378A1 (en) * | 2019-12-27 | 2021-07-01 | X Development Llc | Offline robot planning with online adaptation |
| US20210362330A1 (en) * | 2020-05-21 | 2021-11-25 | X Development Llc | Skill template distribution for robotic demonstration learning |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023113686A1 (en) | 2023-06-22 |
| SE2151555A1 (en) | 2023-06-18 |
| EP4448225A1 (en) | 2024-10-23 |
| EP4448225A4 (en) | 2025-12-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11338435B2 (en) | Gripping system with machine learning | |
| CN113826051A (en) | Generating digital twins of interactions between solid system parts | |
| WO2022249649A1 (en) | Object manipulation with collision avoidance using complementarity constraints | |
| CN115351780A (en) | Method for controlling a robotic device | |
| JP7728139B2 (en) | Apparatus and method for controlling a robotic device | |
| EP4175795B1 (en) | Transfer between tasks in different domains | |
| Zacharias | Knowledge representations for planning manipulation tasks | |
| US20240173855A1 (en) | Method for Generating Training Data for a Machine Learning (ML) Model | |
| CN118893633B (en) | Model training method and device and mechanical arm system | |
| Dombrowski et al. | Interactive simulation of human-robot collaboration using a force feedback device | |
| JP2022543865A (en) | Automated system and method for handling product | |
| Nandikolla et al. | Teleoperation Robot Control of a Hybrid EEG‐Based BCI Arm Manipulator Using ROS | |
| Yu et al. | Manipose: A comprehensive benchmark for pose-aware object manipulation in robotics | |
| Arents et al. | Construction of a smart vision-guided robot system for manipulation in a dynamic environment | |
| JP7205752B2 (en) | ROBOT CONTROL DEVICE, ROBOT CONTROL METHOD, AND ROBOT CONTROL PROGRAM | |
| US20240253232A1 (en) | Method for Ascertaining Control Data for a Gripping Device for Gripping an Object | |
| SE545819C2 (en) | System and method of automating a process | |
| Su et al. | A ROS based open source simulation environment for robotics beginners | |
| CN117021111A (en) | A robot workpiece grabbing method based on deep reinforcement learning | |
| CN117621048A (en) | A six-degree-of-freedom industrial robot dynamics simulation analysis method | |
| Michalík et al. | Parallel robot controlled by plc and its digital twin | |
| Cavalli et al. | Towards affordance prediction with vision via task oriented grasp quality metrics | |
| EP4564110A1 (en) | Device and method for configuring a technical system | |
| JP7806098B2 (en) | Robot arm control method, device, electronic device, and computer-readable storage medium | |
| CN120480890B (en) | Robot control method and device |