CN109800024B - Method and device for realizing physical hardware control program release and physical hardware control - Google Patents

Abstract

The present invention relates to a physical hardware control method, a method, device and electronic equipment for realizing physical hardware control program release. The control program integrates the configuration file, hardware analysis protocol and hardware communication library. The configuration file is used to describe the hardware role associated with the physical hardware and the action blocks configured by the hardware role; load the physical hardware control program, and establish a relationship with the physical hardware through program loading. and obtain the action description information that has a mapping relationship with the action block configured by the hardware role; send the action description information to the physical hardware through the communication connection, and the hardware role defined by the action description information can execute the action to perform the associated physical hardware. Action control. By adopting the present invention, the released physical hardware control program can be fully utilized to implement motion control to the physical hardware.

Description

Method and device for realizing physical hardware control program release and physical hardware control

technical field

The present invention relates to the field of computer technology, and in particular, to a method and device for implementing physical hardware control program release and physical hardware control.

Background technique

With the development of computer technology, graphical programming has also developed rapidly. Graphical programming means that the commands and parameters that make up the code are realized through modules similar to the shape of building blocks. Therefore, even if the user is not familiar with the commands and parameters of the code, or is not familiar with keyboard operation, he can drag the module only by the mouse. Move to the programming area to complete the code editing.

In order to facilitate the communication and learning among the enthusiasts of graphical programming, graphical programming now supports publishing the source code of the completed code editing to the designated website. This implements source code browsing to achieve the purpose of communication and learning.

However, for the user, the source code work published on the designated website is still in the demonstration stage and cannot enter the practical application stage, that is, other users can use the source code work to control the physical hardware they have, such as robots. , to implement motion control.

To sum up, how to push the user's source code works into the practical application stage still needs to be solved urgently.

SUMMARY OF THE INVENTION

In order to solve the above technical problems, an object of the present invention is to provide a method and device for implementing physical hardware control program release and physical hardware control.

Wherein, the technical scheme adopted in the present invention is:

A physical hardware control method, comprising: a control terminal downloads a published physical hardware control program from a program publishing terminal, the physical hardware control program integrates a configuration file, a hardware analysis protocol and a hardware communication library, and the configuration file is used to describe The hardware role associated with the physical hardware and the action block configured by the hardware role; load the physical hardware control program, establish a communication connection with the physical hardware through program loading, and obtain a mapping with the action block configured by the hardware role The action description information of the relationship; the action description information is sent to the physical hardware through the communication connection, and the hardware role defined by the action description information can perform actions to control the action of the associated physical hardware.

A method for realizing the release of a physical hardware control program, comprising: a program making end obtains a configuration file of the physical hardware according to the addition of a hardware role associated with the physical hardware or the addition of an action block configured by the hardware role; , the hardware communication library and the configuration file are compiled under the specified program loading environment to generate a physical hardware control program; the physical hardware control program is requested to the program issuing end for the physical hardware to be released.

A physical hardware control device, comprising: a program download module for a control terminal to download a published physical hardware control program from a program release terminal, the physical hardware control program is integrated with a configuration file, a hardware analysis protocol and a hardware communication library, so The configuration file is used to describe the hardware role associated with the physical hardware and the action block configured by the hardware role; the program loading module is used to load the physical hardware control program, and establishes a communication connection with the physical hardware through program loading, and Obtain the action description information that has a mapping relationship with the action block configured by the hardware role; the information sending module is configured to send the action description information to the physical hardware through the communication connection, and the action description information defined by the action description information The hardware roles can perform actions to control the actions of the associated physical hardware.

A device for realizing physical hardware control program release, comprising: a file acquisition module for a program making end to acquire the configuration of the physical hardware according to the addition of a hardware role associated with the physical hardware or the addition of an action block configured by the hardware role file; a program generation module for compiling the hardware parsing protocol, the hardware communication library and the configuration file under a specified program loading environment to generate a physical hardware control program; a program release module for issuing a program for the physical hardware The terminal requests to release the physical hardware control program.

An electronic device includes a processor and a memory, where computer-readable instructions are stored on the memory, and when the computer-readable instructions are executed by the processor, the above method is implemented.

A computer-readable storage medium having a computer program stored thereon, the computer program implementing the method as described above when executed by a processor.

In the above technical solution, the control terminal downloads the published physical hardware control program from the program publishing terminal, and then establishes a communication connection with the physical hardware by loading the physical hardware control program, and obtains all hardware roles associated with the physical hardware. The configuration action block has the action description information of the mapping relationship, so that the action description information is sent to the physical hardware by using the communication connection, so that the physical hardware can execute the action according to the hardware role defined by the action description information. The physical hardware control program integrates configuration files, hardware analysis protocols and hardware communication libraries, so that other users can make full use of the published physical hardware control programs to implement motion control to the physical hardware they own, so that the physical hardware control program can be executed. The published users push their source code works into the actual application stage, which effectively solves the problem that the source code works are released in the demonstration stage in the prior art.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

FIG. 1 is a schematic diagram of an implementation environment involved in accordance with the present invention.

Fig. 2 is a block diagram showing the hardware structure of a control terminal according to an exemplary embodiment.

FIG. 3 is a block diagram of a hardware structure of a program creation terminal according to an exemplary embodiment.

Fig. 4 is a flow chart of a method for controlling physical hardware according to an exemplary embodiment.

FIG. 5 is a flowchart of step 330 in the embodiment of FIG. 4 in one embodiment.

Fig. 6 is a flowchart showing another physical hardware control method according to an exemplary embodiment.

Fig. 7 is a flow chart of another physical hardware control program method according to an exemplary embodiment.

FIG. 8 is a flowchart of step 430 in the embodiment of FIG. 7 in one embodiment.

Fig. 9 is a flow chart of a method for implementing physical hardware control program release according to an exemplary embodiment.

FIG. 10 is a schematic diagram of a specific implementation of a process of generating a physical hardware control program according to an application scenario.

FIG. 11 is a diagram showing a specific implementation of physical hardware control according to an application scenario.

Fig. 12 is a block diagram of a physical hardware control apparatus according to an exemplary embodiment.

Fig. 13 is a block diagram of an apparatus for implementing physical hardware control program distribution according to an exemplary embodiment.

By means of the above-mentioned drawings, which have shown specific embodiments of the present invention, a more detailed description will follow, these drawings and written descriptions are not intended to limit the scope of the inventive concept in any way, but by reference to specific embodiments. The concept of the present invention is explained to those skilled in the art.

Detailed ways

The description will now be made in detail of exemplary embodiments, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

FIG. 1 is a schematic diagram of an implementation environment involved in a physical hardware control method. The implementation environment includes a control terminal 100 , a physical hardware 120 that is controlled by the control terminal 100 to perform actions related to associated hardware roles, and a program publishing terminal 200 that provides the physical hardware control program to the control terminal 100 , and provides the physical hardware to the physical hardware. The program issuer 200 requests the program maker 300 to issue the physical hardware control program.

Wherein, the control terminal 100 where the other users 110 are located may be a desktop computer, a notebook computer, a tablet computer, a smart phone, or other electronic devices capable of running physical hardware control programs, which are not limited herein.

The program making end 300 where the user 310 is located may be a desktop computer, a notebook computer, a tablet computer, a smart phone, or other electronic devices that provide user programming functions, which are not limited herein.

The program publishing end 200 may be a server, or a server cluster composed of multiple servers, or may be a cloud computing center, that is, a virtual computing platform formed by a whole server cluster.

The physical hardware 120 is a hardware device that exists in the physical world independently of the control terminal 100. For example, it can be a robot, a sensor itself, or a hardware device assembled with various sensors and encapsulated by a certain shape shell , or any hardware device equipped with a communication interface (such as a WIFI interface).

Under the control of the control terminal 100, the physical hardware 120 will be able to execute actions related to the executable actions of its associated hardware role through the published physical hardware control program by executing the method shown in the present invention.

In this implementation environment, through the communication connection formed between the program publishing end 200 and the program producing end 300, the user 310 can publish the physical hardware control program generated by his source code work to the program publishing end 200, and then make it available to other users 110. use.

For the control terminal 100 where other users 110 are located, the program publishing terminal 200 can download the published physical hardware control program, and then use the physical hardware control program to implement motion control on the physical hardware owned by the user, so that the user The source code works of 310 are pushed into the practical application stage.

Further, the control terminal 100 performs the interaction between itself and the physical hardware 110. The control terminal 100 is unique, and the corresponding physical hardware 110 may be one or more than one, and may be of a single type or multiple types. This is not limited.

Please refer to FIG. 2 , which is a block diagram of a control terminal according to an exemplary embodiment.

It should be noted that the control terminal 100 is only an example adapted to the present invention, and should not be considered as providing any limitation on the scope of use of the present invention. Neither should the console 100 be construed as requiring or necessarily having one or more components in the exemplary console 100 shown in FIG. 2 .

As shown in FIG. 2 , the control terminal 100 includes a memory 101 , a storage controller 103 , one or more (only one is shown in FIG. 2 ) processors 105 , a peripheral interface 107 , a radio frequency module 109 , a positioning module 111 , and a camera module 113 , an audio module 115 , a touch screen 117 and a key module 119 . These components communicate with each other via one or more communication bus/signal lines 121 .

The memory 101 can be used to store software programs and modules, such as program instructions and modules corresponding to the physical hardware control method and device in the exemplary embodiment of the present invention, and the processor 105 executes the program instructions stored in the memory 101 by running the program instructions. Various functions and data processing, that is, to complete the physical hardware control method.

As a carrier for resource storage, the memory 101 may be random access memory, such as high-speed random access memory, non-volatile memory, such as one or more magnetic storage devices, flash memory, or other solid-state memory. The storage method can be short-term storage or permanent storage.

The peripheral interface 107 may include at least one wired or wireless network interface, at least one serial-parallel conversion interface, at least one input/output interface, and at least one USB interface, etc., for coupling various external input/output devices to the memory 101 and the processor 105 to communicate with various external input/output devices.

The radio frequency module 109 is used for receiving and sending electromagnetic waves to realize mutual conversion between electromagnetic waves and electrical signals, so as to communicate with other devices through a communication network. Communication networks include cellular telephone networks, wireless local area networks, or metropolitan area networks, which may use various communication standards, protocols, and technologies.

The positioning module 111 is used to obtain the current geographic location of the control terminal 100 . Examples of the positioning module 111 include, but are not limited to, Global Positioning System (GPS), positioning technology based on a wireless local area network or a mobile communication network.

The camera module 113 belongs to the camera and is used for taking pictures or videos. The captured pictures or videos can be stored in the memory 101 , and can also be sent to the host computer through the radio frequency module 109 .

The audio module 115 provides an audio interface to the user, which may include one or more microphone interfaces, one or more speaker interfaces, and one or more headphone interfaces. Interaction of audio data with other devices through the audio interface. The audio data can be stored in the memory 101 , and can also be transmitted through the radio frequency module 109 .

The touch screen 117 provides an input and output interface between the control terminal 100 and the user. Specifically, the user can perform an input operation through the touch screen 117 , such as a gesture operation such as clicking, touching, sliding, etc., so that the control terminal 100 responds to the input operation. The control terminal 100 displays the output content formed by any form or combination of text, picture or video to the user through the touch screen 117 .

The key module 119 includes at least one key to provide an interface for the user to input to the control terminal 100 , and the user can make the control terminal 100 perform different functions by pressing different keys. For example, the sound adjustment button can be used by the user to adjust the volume of the sound played by the control terminal 100 .

It can be understood that the structure shown in FIG. 2 is only for illustration, and the control terminal 100 may further include more or less components than those shown in FIG. 2 , or have different components from those shown in FIG. 2 . Each component shown in FIG. 2 may be implemented in hardware, software, or a combination thereof.

FIG. 3 is a block diagram of a hardware structure of a program creation terminal according to an exemplary embodiment. It should be noted that the program creation terminal 300 is only an example suitable for the present invention, and should not be considered as providing any limitation on the scope of use of the present invention. Nor should the programmer 300 be construed as requiring or necessarily having one or more components in the exemplary programmer 300 shown in FIG. 3 .

The hardware structure of the program creation terminal 300 may vary greatly due to different configurations or performances. As shown in FIG. 3 , the program creation terminal 300 includes: a power supply 310 , an interface 330 , at least one memory 350 , and at least one central processing unit CPU (Central Processing Units) 370 .

The power supply 310 is used to provide working voltage for each hardware device on the program creation end 300 .

The interface 330 includes at least one wired or wireless network interface 331, at least one serial-parallel conversion interface 333, at least one input/output interface 335, and at least one USB interface 337, etc., for communicating with external devices.

The memory 350 is used as a carrier for resource storage, which can be a read-only memory, a random access memory, a magnetic disk or an optical disk, etc. The resources stored on it include the operating system 351, the application program 353 and the data 355, etc., and the storage method can be short-term storage or permanent storage. . Wherein, the operating system 351 is used to manage and control each hardware device and application program 353 on the program making end 300, so as to realize the calculation and processing of the massive data 355 by the central processing unit 370, which can be WindowsServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc. The application program 353 is a computer program based on the operating system 351 to complete at least one specific task, and it may include at least one module (not shown in FIG. 3 ), and each module may respectively include a function for the program making terminal 300. series of computer readable instructions. Data 355 may be photos, pictures, etc. stored on disk.

The central processing unit 370 may include one or more processors, and is configured to communicate with the memory 350 through a bus, so as to operate and process the massive data 355 in the memory 350 .

As described in detail above, the program creation terminal 300 applicable to the present invention will issue the physical hardware control program in the form of reading a series of computer-readable instructions stored in the memory 350 by the central processing unit 370, so that the control terminal can download The published physical hardware control program controls the physical hardware to perform actions associated with the actions that the associated hardware character can perform.

In addition, the present invention can also be implemented by hardware circuits or hardware circuits combined with software instructions. Therefore, implementation of the present invention is not limited to any specific hardware circuits, software, and combinations of the two.

Referring to FIG. 4 , in an exemplary embodiment, a physical hardware control method is applicable to the control terminal 100 of the implementation environment shown in FIG. 1 , and the structure of the control terminal 100 may be as shown in FIG. 2 .

This physical hardware control method can be executed by the control terminal 100, and can include the following steps:

In step 310, the control terminal downloads the released physical hardware control program from the program distribution terminal.

The physical hardware control program refers to an executable program that can run independently on the control terminal, and when the executable program is run by the control terminal, enables the control terminal to perform motion control on the physical hardware.

For the program publishing side, the physical hardware control program is issued by the program producing side for the physical hardware request, so that the published physical hardware control program can be provided to the control side.

Specifically, the physical hardware control program integrates configuration files, hardware resolution protocols and hardware communication libraries. The configuration file is used to describe the hardware roles associated with the physical hardware and the action blocks configured by the hardware roles. The hardware parsing protocol is responsible for parsing the configuration file, so that the control end can know which action controls are implemented to the physical hardware. The hardware communication library is used to establish a communication connection between the control terminal and the physical hardware, especially to establish a communication connection between the control terminal and various components of the physical hardware. For example, the physical hardware is a robot, and its components include robot arms, robot legs, etc. Therefore, through the hardware communication library, the control terminal can respectively control the movements of the robot arms and robot legs in real time, thereby making the robot arms and robot legs move in real time. Perform actions separately.

To this end, the user's program making side compiles the physical hardware configuration file, hardware parsing protocol and hardware communication library under the specified program loading environment to generate a physical hardware control program. The specified program loading environment includes, but is not limited to, an Android system compilation environment, a MAC system compilation environment, a Windows system compilation environment, a Linux system compilation environment, and the like.

That is to say, the physical hardware control program includes executable files of various file types, for example, executable files of the APK file type, executable files of the EXE file type, etc., so that the physical hardware control program can be applied to different control terminals. The different operating systems deployed in the system have high versatility. For example, executable files of the APK file type are suitable for Android systems, and executable files of the EXE file type are suitable for Windows systems.

After the physical hardware control program is generated, the program production side uploads the physical hardware control program to the program publishing side, thereby publishing the physical hardware control program for the physical hardware owned by the user, thereby enabling other users to The control terminal can download the physical hardware control program from the program publishing terminal, and implement motion control to the physical hardware owned by the control terminal.

It is worth mentioning that in the generation of the physical hardware control program, the hardware parsing protocol and the hardware communication library are pre-integrated, that is, the complex control environment of the physical hardware is simplified by sandbox packaging. Lower the practical application threshold for other users. For the configuration file, it is obtained according to the addition of a hardware role associated with the physical hardware or the addition of an action block configured by the hardware role. Here, it is necessary to describe the acquisition of the configuration file in detail.

First of all, it is explained that the physical hardware is controlled by the action control implemented by the control terminal and performs corresponding actions through its own components, such as sensors, display screens, motors and combinations of various components, and then To achieve the purpose of controlling the action of the control end to the physical hardware.

For example, through the combination of motors and various components, physical hardware has motion functions. The control terminal drives the motor to start, so that the combination of various components on the physical hardware executes the relevant mechanical movement under the drive of the motor.

Further, different physical hardware is composed of various unique parts and components, and thus can be controlled by different actions. For the program production side, an accessible interactive platform is provided to the physical hardware, so that the physical hardware can display the executable actions of the associated hardware role on the connected interactive platform as it is connected to the interactive platform, thereby making In the interactive platform, the user can request to release the physical hardware control program related to the physical hardware to the program publishing end according to the displayed hardware role that can perform actions.

Among them, the hardware role is the only existing form of physical hardware in the interactive platform, thereby providing users with interaction with the physical hardware and the physical world in which it is located, that is, the user's action control on the hardware role on the interactive platform will be able to be mapped. to the physical hardware it has in the physical world. At the same time, with the release of the physical hardware control program, the action control performed by the user on the hardware character on the interactive platform can also be mapped to the physical hardware owned by other users in the physical world.

Based on graphical programming, in the interactive platform, the executable actions of the hardware roles associated with physical hardware are represented as action blocks, and by building the mapping relationship between the action blocks and the action description information, the action description information reflects the code. Commands and parameters, etc. can be implemented through action blocks.

That is to say, action blocks are constructed for the executable actions of the hardware roles associated with the physical hardware in the interactive platform, and different action blocks are used to represent different executable actions of the hardware roles. The name, definition, parameters, return value, etc. of the executable action of the hardware role are generally described through the constructed action block, and the specific content of the executable action of the hardware role is further defined through the action description information that has a mapping relationship with the action block. . Among them, the specific content based on the code mode refers to the representation and expression of the code, the command of the code, the parameters of the code, the variables in the code, the logical expression, the loop expression, and the like.

It can be seen from the above that the data carried by the configuration file is roughly divided into two categories, one is the hardware role associated with the physical hardware, and the other is the action block configured by the hardware role. With the addition of hardware roles associated with physical hardware, or the addition of action blocks configured by hardware roles, configuration files are either created for the newly added hardware roles, or modified for existing hardware roles. .

Based on this, in the generation of the physical hardware control program, when a hardware role associated with the physical hardware is added, or an action block configured by the hardware role is added, the acquisition of the configuration file can be triggered.

It is further explained that the configuration file only corresponds to the hardware role, but can correspond to one or more action blocks configured by the hardware role. The configuration file includes resource information and configuration information.

Specifically, the resource information is related to the implemented hardware role, and the resource information indicates the name of the implemented hardware role and the display style when the implemented hardware role is displayed. Further, the resource information includes hardware role names, hardware role identifiers, and the like.

The configuration information is related to the action block configured by the hardware role indicated by the hardware role name. The configuration information not only indicates the action block configured for the hardware role, but also indicates the category, name, definition, parameter, return value, and specific content. The specific content refers to action description information that can be rendered to form code information in the code mode.

That is, the configuration file reflects the source code formed when the user performs graphical programming in real time, so that the generated physical hardware control program can be regarded as the user's source code work.

It can be seen from the above that the physical hardware control program integrates the configuration file, hardware analysis protocol, and hardware communication library, so that the physical hardware control program can run on the control side independently, without the need to load the source code by web browsing on the designated website. Avoid release of source work that remains in the demo stage.

Step 330: Load the physical hardware control program, establish a communication connection with the physical hardware through the program loading, and acquire action description information that has a mapping relationship with the action block configured by the hardware role.

For the control terminal, after the published physical hardware control program is downloaded by the program publishing terminal, the physical hardware control program can be run in the control terminal to implement motion control to the physical hardware.

To this end, it is not only necessary to establish a communication connection between the control terminal and the physical hardware, but also to know specifically which actions can be performed by the hardware role, so that the control terminal can implement the relevant hardware role executable actions to the physical hardware based on the communication connection. motion control.

In a specific implementation of an exemplary embodiment, as shown in FIG. 5 , step 330 may include the following steps:

Step 331 , load the physical hardware control program in the specified program loading environment, and extract the configuration file, the hardware parsing protocol and the hardware communication library from the loaded physical hardware control program.

As mentioned above, the physical hardware control program is generated by the program control end compiling the configuration file of the physical hardware, the hardware parsing protocol and the hardware communication library in a specified program loading environment.

Therefore, the physical hardware control program can be loaded based on the specified program loading environment. For example, if the specified program loading environment is the Android system compilation environment, the physical hardware control program loading based on the Android system compilation environment is loading the physical hardware. Executable file that controls the APK file type in the program.

Further, when the physical hardware control program is loaded, the configuration file, the hardware parsing protocol and the hardware communication library can be extracted from it.

In the above implementation process, the physical hardware control program formed by the user's one-time compilation under the specified program loading environment can be applied to different operating systems, that is, no matter what operating system is deployed in the control terminal of other users, the program can The physical hardware control programs downloaded by the publishing end can run independently in the control end, thus possessing high versatility.

In addition, due to the independent operation of the physical hardware control program, regardless of whether it will be deleted later, it will not have any impact on the operation of the operating system or other applications deployed in the control terminal, which fully guarantees the security of the system operation. and reliability, effectively improving the user experience.

In step 333, the action description information is obtained by parsing the configuration file according to the hardware parsing protocol.

The action description information will change with the change of the action block that has a mapping relationship with it, so that the actions that can be performed by the hardware role associated with the physical hardware are increased accordingly. That is to say, when an action is added to the hardware role associated with the physical hardware, the action description information will change accordingly, and the changed action description information will be updated to the configuration file, thus ensuring that the The configuration information is closely related to the implementation of the actions that the hardware role can perform.

Therefore, in order to let the control end know which action controls are implemented to the physical hardware, after obtaining the configuration file and the hardware parsing protocol, it can parse the configuration file according to the hardware parsing protocol to obtain the action description information.

Step 335, establishing a communication connection between the control terminal and the physical hardware by using the hardware communication library.

The communication connection refers to the channel for data transmission between the control terminal and the physical hardware, and the data transmitted in this channel meets the requirements of the data format, transmission timing, etc. specified in the hardware communication library, so as to ensure that the control terminal Security and reliability of data transfers to and from physical hardware.

Step 350: Send the action description information to the physical hardware through the communication connection, and perform the action of the hardware role defined by the action description information to control the action of the associated physical hardware.

After the communication connection between the control terminal and the physical hardware is established by the hardware communication library, the physical hardware can receive the action description information issued by the control terminal, and then follow the hardware role defined by the action description information. An executable action executes the associated action.

Through the above process, when a user adds an associated hardware role to the physical hardware he owns, or adds an executable action to an already associated hardware role, the configuration file that is triggered and acquired will be The physical hardware control program is packaged to form a request to the program issuing end to release the physical hardware control program related to the physical hardware.

For other users, when the program publisher downloads the physical hardware control program and controls the physical hardware owned by the physical hardware control program, the physical hardware controlled and executed will be the same as that of the user. The executable actions of the hardware role associated with the physical hardware are consistent, thereby realizing the advancement of the user's source code work from the demonstration stage to the actual application stage.

In addition, because the physical hardware control program released by the user has real productivity, aiming at the field of graphical programming teaching, it helps to improve the interaction between graphical programming learners and fully stimulate each learner's interest in graphical programming. Interested experience.

Referring to FIG. 6, in an exemplary embodiment, the above-mentioned method may further include the following steps:

Step 410: Start the graphics engine carried in the physical hardware control program through program loading.

It is understandable that other users who want to download the released physical hardware control program from the program publisher may not own any physical hardware. At this time, the other user cannot implement the physical hardware control program that they own through the physical hardware control program. Action control.

To this end, before the physical hardware control program is released, the program production side will also add a graphics engine to the physical hardware control program, so that the graphics engine carried in the physical hardware control program can be activated and provide other users with physical hardware related information. Linked hardware roles and display of action description information.

It should be noted that the graphics engine can be regarded as an application program that can provide users with display functions such as graphics and data, and the application program can run in the control terminal.

Step 430 , displaying the action description information and the hardware role associated with the physical hardware in the activated graphics engine.

Under the action of the above embodiment, through the addition of a graphics engine in the physical hardware control program, no matter whether other users have physical hardware or not, they can download the published physical hardware control program at the program publishing end, so as to achieve communication and learning. The purpose is to fully expand the flexibility of physical hardware control, and further effectively improve the user experience.

Referring to FIG. 7, in an exemplary embodiment, before step 430, the above-mentioned method may further include the following steps:

Step 510: Extract the hardware role identifier from the configuration file in the physical hardware control program.

As mentioned earlier, the configuration file includes resource information as well as configuration information.

The resource information is related to the implemented hardware role, and the resource information indicates the name of the implemented hardware role and the display style when the implemented hardware role is displayed. Further, the resource information includes hardware role names, hardware role identifiers, and the like.

The configuration information not only indicates the action block configured for the hardware role indicated by the hardware role name, but also indicates the category, name, definition, parameter, return value, and specific content to which the action block belongs. The specific content refers to action description information that can be rendered to form code information in the code mode.

Therefore, the hardware role identification and action description information can be obtained through the configuration file.

Specifically, the hardware role identifier is extracted from the configuration file. The configuration file is parsed according to the hardware parsing protocol to obtain the action description information.

Step 530 , performing graphical interface element rendering on the hardware character identifier to form a hardware character associated with the physical hardware.

Step 550: Render the action description information to form code information in the code mode.

First of all, it should be noted that a graphical interface element, which may also be called a user interface element, in this embodiment refers to elements such as numbers, characters, letters, characters, patterns, etc. existing in the graphical interface provided by the graphics engine.

It should be understood that the existence forms of any kind of GUI elements in the GUI are ever-changing, which all depend on the rendering of the GUI elements, so that different GUI elements can be displayed in different forms in the GUI.

It can be seen from the above that, through the rendering of graphical interface elements, the hardware roles associated with physical hardware can be formed by rendering the hardware role identifiers, and the code information is formed by the action description information based on the rendering in the code mode, which is convenient for subsequent graphics engines. displayed in the provided graphical interface.

Referring to FIG. 8, in an exemplary embodiment, step 430 may include the following steps:

In step 431, the stage area and the code area are displayed in the graphical interface provided by the graphics engine.

In order to facilitate the communication and learning of other users who cannot implement physical hardware action control, in the graphical interface provided by the graphics engine, a code area will be set for the display of code information, and a stage area will be set for the display of the hardware character's executable actions.

Specifically, for a user who publishes a physical hardware control program, he/she selects one or more action blocks in the interactive platform and splices them together, and then uses the splicing relationship between the action blocks and the action description mapped by each action block. information to ensure motion control is implemented to the hardware character associated with the physical hardware it owns.

For other users who download the physical hardware control program, the action description information contained in the physical hardware control program is rendered to form code information in code mode, and is displayed in the graphical interface in time, that is, the action block The logical relationship between the mapped action description information and the action description information formed by the splicing relationship of action blocks is directly reflected in the code area.

Correspondingly, the stage area will show to other users the animation effect of the hardware character being executed corresponding actions according to the action blocks reflected in the code area and their splicing relationship.

With the continuous splicing and changing of user-side action blocks, the executable actions of hardware roles are constantly added, which continuously enriches the user-side hardware roles, and further enriches other user-side hardware roles. Correspondingly, it will also continue to enrich The physical hardware associated with each hardware role is beneficial to enhance the flexibility of physical hardware control.

Step 433, displaying the code information in the code mode in the displayed code area.

The display may be an editable display or a non-editable display, which is not limited here.

Editable display means that other users can continue to input code information on this basis to add executable actions for the hardware role, and the newly added executable actions are consistent with the input code information. Once the code information is entered in the code area, when the code area displays the corresponding code information, the stage area will correspondingly show that the hardware character performs the action consistent with the code information.

Of course, in order to protect the source code work released by the user, the code information in the code mode formed by the released physical hardware control program is only provided for display, and cannot be edited, that is, the non-editable display of the code information is provided to other users.

Step 435 , displaying the animation effect of the hardware character performing the action according to the action description information in the displayed stage area.

As mentioned above, a configuration file only corresponds to a hardware role, but can correspond to one or more action blocks configured by the hardware role. Correspondingly, according to the action description information obtained by parsing the configuration file according to the hardware parsing protocol, the executable action of the defined hardware role is not limited to an independent action, but may also be a plurality of consecutive actions.

Therefore, the hardware character displayed in the stage area is unique, and the action performed to control the hardware character may be an independent action or multiple continuous actions, thereby forming an animation effect of the hardware character performing actions.

Through the above implementation process, no matter whether other users have their own physical hardware or not, they can download the released physical hardware control program in the program publishing terminal, so that the physical hardware control program released by the user can be promoted to the practical application stage to the maximum extent, and further to facilitate communication and learning between users and other users.

Referring to FIG. 9 , in an exemplary embodiment, a program creation terminal 300 suitable for the implementation environment shown in FIG. 1 that realizes the distribution of physical hardware control programs is shown. The structure of the program creation terminal 300 may be as shown in FIG. 3 .

The method for implementing physical hardware control program release can be executed by the program making terminal 300, and can include the following steps:

Step 610, the program creation end obtains the configuration file of the physical hardware according to the addition of the hardware role associated with the physical hardware or the addition of the action block configured by the hardware role.

Step 630: Compile the hardware parsing protocol, the hardware communication library and the configuration file under the specified program loading environment to generate a physical hardware control program.

Step 650 , for the physical hardware, request the program issuing end to release the physical hardware control program.

It should be noted that the execution of steps 610 to 630 does not have to depend on the user's instruction, that is, the program creator can actively trigger the configuration file according to the addition of the hardware role associated with the physical hardware or the addition of the action block configured by the hardware role. to obtain the physical hardware control program, and generate a new physical hardware control program for the updated configuration file every time the hardware role is added or the action block is added, and then wait for the user to instruct the physical hardware. Control program release.

Further, the release of the physical hardware control program by the program production side depends on the user's instructions, which not only helps to reduce the interaction between the program production side and the physical hardware, but also reduces the task processing volume between the two. Guarantee the actual needs of users.

Specifically, the program production end detects the trigger operation performed by the user to execute the release of the physical hardware control program, and when detecting the trigger operation performed by the user to execute the release of the physical hardware control program, the physical hardware requests the program release end Publish physical hardware control programs.

For example, in the interface provided by the interactive platform, a corresponding button is set for executing the physical hardware control program. When the user clicks this button, it means that the user needs to release the physical hardware control program. At this time, the physical hardware control program can be pre-generated, that is, steps 610 to 630 are executed independently of the user's instructions, or it can be executed from this Trigger to obtain the configuration file, that is, the execution of steps 610 to 630 depends on the user's instruction. Here, the user clicking the button is the triggering operation performed by the user to execute the release of the physical hardware control program.

Of course, in other application scenarios, the trigger operation may also be a sliding slider, etc., which is not limited here.

In an exemplary embodiment, the method as described above may further include the following steps:

A graphics engine capable of displaying physical hardware-related hardware roles and action description information is added to the physical hardware control program.

The action description information is used to describe the actions that the hardware character can perform.

Taking the physical hardware as a robot as an example, the process of realizing the release of the physical hardware control program is described in combination with an application scenario, and then the released physical hardware control program performs motion control to the physical hardware.

FIG. 10 is a schematic diagram of a specific implementation of a process of generating a physical hardware control program according to an application scenario.

As shown in FIG. 10, on the user side, based on the graphical programming function provided by the graphical editor 701, an associated hardware role is added to the interactive platform accessed by the robot, or, when an action block configured with an associated hardware role is added , triggering the acquisition of the configuration file 702, and then compiling 704 with the hardware communication library 703, the hardware parsing protocol, and the graphics engine under the runtime environment 706, thereby generating executable files of various file types, and packaging them to form a physical hardware control program 705 corresponds to the executable file content, and then requests the program publishing end for publishing.

Wherein, the runtime environment 706 refers to the operating system deployed on the control end where other users are located on which the physical hardware control program 705 will be executed and loaded.

FIG. 11 is a diagram showing a specific implementation of physical hardware control according to an application scenario.

As shown in FIG. 11, other users download the published physical hardware control program 705, and extract the configuration file 801, graphics engine 802, hardware parsing protocol 803 and hardware communication library from its corresponding executable file content 805 804.

Based on the communication connection established between the control terminal and the robot 806 by the hardware communication library 804, the action description information obtained by parsing the configuration file 801 through the hardware parsing protocol 803 is sent to the robot 806, and then the hardware role defined by this is sent to the robot 806. Motion control of the robot 806 can be performed with an executable motion.

In this application scenario, the transformation of the user's source code works from the demonstration stage to the actual application stage is realized, and the released physical hardware control program can be executed independently without any impact on the deployed operating system, and no additional installation of other The application program is helpful for the sharing and dissemination of the user's source code works, and is also conducive to the communication and learning among graphic programming enthusiasts.

In addition, the code information display performed by the graphics engine enables the displayed code information to be fully understood, thereby providing an effective assistance for the learning of graphic programming.

The following are apparatus embodiments of the present invention, which can be used to execute the physical hardware control method involved in the present invention. For details not disclosed in the apparatus embodiments of the present invention, please refer to the embodiments of the physical hardware control method involved in the present invention.

Referring to FIG. 12 , in an exemplary embodiment, a physical hardware control apparatus 900 includes but is not limited to: a program downloading module 910 , a program loading module 930 and an information sending module 950 .

Among them, the program download module 910 is used for the control terminal to download the released physical hardware control program from the program issuing terminal. The physical hardware control program integrates a configuration file, a hardware analysis protocol and a hardware communication library, and the configuration file is used to describe the physical hardware associated The hardware role and the action blocks configured by the hardware role.

The program loading module 930 is used for loading a physical hardware control program, establishing a communication connection with the physical hardware through program loading, and acquiring action description information having a mapping relationship with the action block configured by the hardware role.

The information sending module 950 is configured to send the action description information to the physical hardware through the communication connection, and the hardware role defined by the action description information can execute the action to control the action of the associated physical hardware.

It should be noted that, when the physical hardware control device provided in the above embodiments implements motion control on physical hardware, only the division of the above-mentioned functional modules is used as an example for illustration. The functional modules are completed, that is, the internal structure of the physical hardware control device will be divided into different functional modules to complete all or part of the functions described above.

In addition, the physical hardware control apparatus and the physical hardware control method embodiments provided by the above embodiments belong to the same concept, and the specific manners in which each module performs operations have been described in detail in the method embodiments, which will not be repeated here.

Referring to FIG. 13 , in an exemplary embodiment, an apparatus 1000 for implementing physical hardware control program release includes but is not limited to: a file acquisition module 1010 , a program generation module 1030 and a program release module 1050 .

The file obtaining module 1010 is used for the program production end to obtain the configuration file of the physical hardware according to the addition of a hardware role associated with the physical hardware or the addition of an action block configured by the hardware role.

The program generation module 1030 is used for compiling the hardware parsing protocol, the hardware communication library and the configuration file under a specified program loading environment to generate a physical hardware control program.

The program release module 1050 is configured to request the release of the physical hardware control program from the program release end for the physical hardware.

It should be noted that, when the device for implementing physical hardware control program publishing provided by the above embodiment, when publishing the physical hardware control program, only the division of the above functional modules is used as an example for illustration. The allocation is completed by different functional modules, that is, the internal structure of the device for realizing the release of the physical hardware control program will be divided into different functional modules to complete all or part of the functions described above.

In addition, the device for implementing physical hardware control program publishing provided by the above embodiments and the embodiments of the method for implementing physical hardware control program publishing belong to the same concept, and the specific manner in which each module performs operations has been described in detail in the method embodiment. , and will not be repeated here.

In an exemplary embodiment, an electronic device includes a processor and a memory.

The memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, implements the method for implementing physical hardware control program distribution and the physical hardware control method in the foregoing embodiments.

In an exemplary embodiment, a computer-readable storage medium stores a computer program thereon, and when the computer program is executed by a processor, implements the methods for implementing physical hardware control program distribution in the above-mentioned embodiments, and physical hardware control methods.

The above contents are only preferred exemplary embodiments of the present invention, and are not intended to limit the embodiments of the present invention. Those of ordinary skill in the art can easily make corresponding changes or modifications according to the main concept and spirit of the present invention, Therefore, the protection scope of the present invention should be subject to the protection scope required by the claims.

Claims (5)

1. a physical hardware control method, is characterized in that, comprises: The control terminal downloads the released physical hardware control program from the program issuing terminal. The physical hardware control program integrates a configuration file, a hardware analysis protocol and a hardware communication library. The configuration file is used to describe the hardware roles and hardware associated with the physical hardware. The action block configured by the role, wherein the executable action of the hardware role associated with the physical hardware is represented as the action block, the hardware parsing protocol is used for parsing the configuration file, and the hardware communication library is used to communicate with the controller at the control end. A communication connection is established between physical hardware, and the hardware parsing protocol and the hardware communication library are obtained by processing the control environment of the physical hardware in a sandbox packaging manner; Loading the physical hardware control program under the specified program loading environment, extracting the configuration file, the hardware parsing protocol and the hardware communication library from the loaded physical hardware control program; The action description information is obtained by parsing the configuration file according to the hardware parsing protocol; and Using the hardware communication library to establish the communication connection between the control terminal and the physical hardware; Send action description information to the physical hardware through the communication connection, and the hardware role defined by the action description information can perform actions to control the action of the associated physical hardware; Start the graphics engine carried in the physical hardware control program by loading the program; Extracting the hardware role identifier from the configuration file in the physical hardware control program; performing graphical interface element rendering on the hardware character identifier to form a hardware character associated with the physical hardware; and Rendering the action description information to form code information in the code mode; The display of the stage area and the code area is performed in the graphical interface provided by the graphics engine; Display code information in code mode in the displayed code area; and The animation effect of the hardware character performing the action according to the action description information is displayed in the displayed stage area. 2. a method for realizing physical hardware control program release, is characterized in that, comprises: The program making end obtains the configuration file of the physical hardware according to the addition of a hardware role associated with the physical hardware or the addition of an action block configured by the hardware role; The hardware parsing protocol, the hardware communication library and the configuration file are compiled under the specified program loading environment to generate a physical hardware control program, wherein the hardware parsing protocol is used for parsing the configuration file, and the hardware communication library is used for A communication connection is established between the control terminal and the physical hardware, and the hardware parsing protocol and the hardware communication library are obtained by processing the control environment of the physical hardware in a sandbox packaging manner; Requesting the release of the physical hardware control program from the program issuer for the physical hardware; A graphics engine capable of displaying the physical hardware-related hardware roles and action description information is added to the physical hardware control program, and the action description information is used to describe the actions executable by the hardware role. 3. a physical hardware control device, is characterized in that, comprises: The program download module is used for the control terminal to download the released physical hardware control program from the program issuing terminal. The physical hardware control program integrates a configuration file, a hardware analysis protocol and a hardware communication library, and the configuration file is used to describe the physical hardware related The hardware role associated with the physical hardware and the action block configured by the hardware role, wherein the executable actions of the hardware role associated with the physical hardware are represented as the action block, the hardware parsing protocol is used for parsing configuration files, and the hardware communication library For establishing a communication connection between the control terminal and the physical hardware, the hardware parsing protocol and the hardware communication library are obtained by processing the control environment of the physical hardware in a sandbox packaging manner; The program loading module is used to load the physical hardware control program under the specified program loading environment, and extract the configuration file, the hardware parsing protocol and the hardware communication library from the loaded physical hardware control program. The configuration file is parsed to obtain the action description information, and the communication connection is established between the control terminal and the physical hardware by using the hardware communication library; an information sending module, configured to send action description information to the physical hardware through the communication connection, and perform action control of the associated physical hardware through the hardware role defined by the action description information; A display module, configured to start the graphics engine carried in the physical hardware control program by loading the program, extract the hardware role identification from the configuration file in the physical hardware control program, and perform graphical interface element rendering on the hardware role identification Form the hardware role associated with the physical hardware, and render the action description information to form the code information under the code mode, the stage area and the code area are displayed in the graphical interface provided by the graphics engine, and the displayed code area is displayed. In the code mode, the code information is displayed in the code mode, and the animation effect of the hardware character performing the action according to the action description information is displayed in the displayed stage area. 4. a device for realizing physical hardware control program release, is characterized in that, comprises: a file acquisition module, used for the program production side to acquire the configuration file of the physical hardware according to the addition of a hardware role associated with the physical hardware or the addition of an action block configured by the hardware role; The program generation module is used for compiling the hardware parsing protocol, the hardware communication library and the configuration file under a specified program loading environment to generate a physical hardware control program, wherein the hardware parsing protocol is used for parsing the configuration file, and the The hardware communication library is used to establish a communication connection between the control terminal and the physical hardware, and the hardware parsing protocol and the hardware communication library are obtained by processing the control environment of the physical hardware in a sandbox packaging manner; A graphics engine adding module, configured to add a graphics engine capable of displaying the physical hardware-related hardware roles and action description information to the physical hardware control program, and the action description information is used to describe the actions that the hardware role can perform. ; The program issuing module is configured to request the program issuing end for the physical hardware to issue the physical hardware control program. 5. An electronic device, characterized in that, comprising: processor; and a memory having computer readable instructions stored thereon, the computer readable instructions implementing the method of any one of claims 1 to 2 when executed by the processor.

Images