KR20070004268A - How to use script generator and commercialization tool for robot control of various platforms - Google Patents

Abstract

A method for utilizing a script generator and a commercial authoring tool for robot control of diverse platforms is provided to solve restriction related to synchronization and a problem for developing again the authoring tool and contents for each new robot development by offering an authoring environment to conveniently develop robot contents and supporting a content playback/simulation function. Content data having a specific format is loaded. Playback of the loaded content data is performed and the played content data is edited. All robot command scripts such as operation control, voice recognition, user attention, face recognition, navigation, and conversation technologies of the robot are set and simulated through communication with a robot by defining the command related to the robot control for the loaded content data in a script type. A user selects a display time point for the edited and set content data. In case that the edited and set contents are displayed through resources of the robot, the contents are displayed to the outside based on a selection time point.

Description

{Robot Contents Authoring Method using Script Generator and Commercially-Off-the-Shelf Multimedia Authoring Tool for Control of Various Robot Platforms}

1 is an exemplary view showing a schematic system environment to which the present invention is applied

Figure 2 is an exemplary view schematically showing the structure of a universal authoring tool applied in the present invention

3 is an exemplary diagram showing a structure of a player playing content in a robot;

4 is an exemplary view showing a structure of a player playing content on a PC;

5 is an exemplary view showing an edit screen of the general authoring tool according to the present invention.

6 is a diagram illustrating a class structure of a general authoring tool

7 to 10 are screen shots showing the screen of the automatic script generator of the present invention.

Figure 11 is an illustration of the front and back of the robot for showing the part driving in accordance with the present invention.

* Description of the symbols for the main parts of the drawings *

100: robot 200: PC

210: flash content loading module 220: content playback module

230: flash file adjustment module 240: robot control module

310: playback module 320: socket communication module

330: voice related module unit 410: script generation module

420: playback module 430: simulation module

440: socket communication module 460: database

The present invention relates to a method of utilizing a multimedia authoring tool for controlling a general-purpose robot using a script automation generator. In particular, the present invention provides an authoring environment in which a content developer can quickly and conveniently develop content for a robot without additional programming work by a robot developer. By utilizing the advantages of the existing robot authoring tool, which minimizes errors in robot content creation by supporting playback and simulation functions, it is possible to create a production and playback structure separated into a file with content information and a file with robot control commands. The present invention relates to a method of using a script generator and a commercially available authoring tool for controlling robots of various platforms to solve the problem of synchronizing by integrating into a content file and reproducing the authoring tool and contents each time a new robot is developed.

In general, most of the current robot control methods go through a series of processes where a developer executes programming when needed and runs directly on the robot, finds an error in the result, and goes through several debugging.

 In addition, it was a relatively simple task to connect and synchronize the displayed screen with the actual robot.

Due to these technical limitations, it was difficult to commercialize a robot that provides various contents beneficial to real life.

In order to improve the above problems, the authoring tool for developing contents for robots has been developed in the Korean Patent Application No. 10-2003-0067691, 'authoring tool for contents production of intelligent robots and contents production method for intelligent robots using the same'.

The above-mentioned invention has the advantage of providing an environment in which a content developer having no experience in using a robot or having no knowledge of robot control can produce contents for a robot, but the multimedia file displayed on the screen and actual action information Content files for robots had to be managed separately, and there were some inconveniences due to limitations in synchronization with multimedia files.

In addition, the authoring tool and contents developed for the purpose of controlling a specific robot are difficult to apply to other robots because the platform and the control portion are different for each robot.

For example, the robot developed in the early days did not need to be controlled because there was no arm, but the robot developed in the future needed to be controlled with the addition of an arm. Because of the lack of functionality, each time a new robot is developed, a new authoring tool and content must be developed.

In addition, since it is difficult to apply functions such as robot's specialized face recognition, conversation technology, navigation, and user gaze to contents, there was a limit in developing contents differentiated from contents developed for PC.

Therefore, many users who watched the contents of the robot pointed out that it is difficult to find the difference from the contents developed for the general PC. In order to develop the original contents of the robot, the function of integrating the robot-related development technology into the contents is required.

An object of the present invention for solving the above problems is to provide an authoring environment in which a content developer can quickly and conveniently develop content for a robot without additional programming work by the robot developer, and to support the content playback and simulation function at the time of robot content production By taking advantage of the existing robot authoring tool that minimizes the error of the system, the content-related file and the production and playback structure separated into the file containing the robot control command are combined into one content file to remove the synchronization-related restrictions. In order to improve the problem of redeveloping the authoring tool and contents each time a new robot is developed, the present invention provides a method for using a script generator and a commercially available authoring tool for robot control of various platforms.

In order to achieve the above object, the script generator for the control of various platforms according to the present invention and the method of utilizing a commercial authoring tool are characterized by the robot control, voice recognition, speech synthesis, etc. And authoring environment including content player and 3D simulation that enables users without robots to simulate the same form as robots, but includes authoring environment window for robot action information, voice synthesis, and static object information registration A method of operating a content creation authoring tool for a robot, comprising: a first step of loading arbitrary content material having a specific form; A second step of performing a reproducing operation on the content material loaded in the first step and editing the reproduced content material; By defining the commands related to robot control in the script method for the content material loaded in the first step, all robot command scripts such as robot motion control, voice recognition, voice synthesis, user gaze, face recognition, navigation, and conversation technology are robots. A third step of communicating with and performing setting and simulation of the robot action; A fourth process of arbitrarily selecting a presentation time point for the content material edited and set through the second process and the third process; And a fifth process that is displayed to the outside based on a time point selected in the fourth process when the content edited and set through the second process and the third process is displayed through the resources of the robot. do.

       In addition, the communication in the third process is characterized by using the socket communication.

       In addition, in the third process, the process of defining a script for a command related to robot control provides a variety of action types required for robot control, and a robot action script adjustment mode in which the author can add a robot action according to the robot; Voice recognition script control mode that enables to adjust the voice recognition information of the robot, which is divided into a specific robot content file, a file recognition word used globally for a specific file, and a frame recognition word that is activated only in the start and end frame sections of a specific range. Wow; Speech synthesis adjustment mode to express the voice of the robot according to various emotion changes by using the properties of the pitch and velocity parameter value of the voice; And a characterization object adding mode for adding a technical element implemented as a main function of the robot, such as face recognition and conversation technology, to the content material loaded in the first step according to the needs of the designer.

       In addition, the third process uses a multimedia content authoring tool to define the robot's motion, voice recognition and synthesis, etc. in a script manner, and communicates with the robot, using a function related to the robot control. It generates automatically, and automatically inputs it to the content authoring tool, it characterized in that the robot control commands can be applied to general purpose robots of various platforms.

       In addition, for the development of the content characterized in the robot, characterized in that it further comprises the step of performing the action according to the input and output results, such as whether the face recognition judgment.

       In addition, in order to develop a specialized content to the robot, it is characterized in that it further comprises a process to effectively implement the interaction between the robot and the user by incorporating a dialogue technology.

       In addition, in order to improve the user interface, a script is automatically generated using a function related to robot control, and is automatically input to a commercial authoring tool.

       In addition, in order to be applicable to the robot having various platforms and control parts, all commands related to robot control are defined as external files.

The above object and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of a method for utilizing a script generator and a commercialization authoring tool for robot control of various platforms of the present invention will be described in detail.

1 is a schematic system environment to which the present invention is applied, and a robot 100 as a control object and a multimedia authoring tool for controlling a general purpose robot using a script automation generator are mounted and a robot 100 as a control object. It consists of a PC 200 to operate any multimedia content.

When the implementation of the system as shown in FIG. 1 is performed in the process of setting arbitrary multimedia content on the robot 100 or changing existing content, the robot 100 is otherwise configured as a PC 200. ) Is operated separately with disconnected connections.

Therefore, the multimedia authoring tool mounted on the PC 200 is a program developed for the purpose of producing contents capable of controlling the robot using a multimedia authoring tool for a PC, and a content developer who can use an existing authoring tool can easily use the robot. The script generator used in the present invention can be used to define contents such as robot control, voice recognition, voice synthesis, TTS, face recognition, and dialog technology objects through a script generator that supports flash of Macromedia. It is implemented so that

2 is a schematic view illustrating a structure of a general authoring tool applied to the present invention, and includes a flash content loading module 210 for accessing flash content generated externally or stored in a database, and the flash content loading module ( Content playback module 220 to receive and play the flash content loaded through the 210, and the robot control module 240 to operate the limited resources of the robot when the arbitrary content is provided to the robot to utilize the provided content And flash to transmit the content played through the content playing module 220 to the robot control module 240 and to generate an optimal content through a result of the operation of the robot control module 240. The file adjustment module 230 is configured.

At this time, the robot control module 240 and the flash file adjustment module 230 is exchanged data through the socket communication.

Attached FIG. 3 is an exemplary view illustrating a structure of a player playing content in a robot, and the robot drives the content through a player (ERobotPlayer.exe), which is a playback module 310.

At this time, the socket communication module 320 "ERPPlayer.dll" is responsible for communication between the player (ERobotPlayer.exe) that is the playback module 310 and the robot.

Attached FIG. 3 is an example of utilizing contents related to voice recognition, and a voice related module unit referred to by reference numeral 330 includes a hardware control module, a voice synthesis module, and a voice recognition module for interfacing with a player. .

Accordingly, the hardware control module (Player Interface) is driven by opening the socket communication in the server mode (Open), and the playback module 310 opens the socket communication in the client mode to process voice-related commands. Connected to the hardware control module (Player Interface).

The playback module 310 delivers a command to the "ERPPlayer.dll" through a socket through the "FSCommand Event" while driving the content. "ERPPlayer.dll" controls the robot through a hardware control module (Player Interface) and also processes voice recognition related commands received from the player, and again to the player through "ERPPlayer.dll".

That is, the robot drives the content through the playback module. At this time, the socket communication module 320 is responsible for the communication between the playback module 310 and the robot. At this time, the socket communication module 320 is already driven by opening the socket in the server mode, and the playback module 310 opens the socket in the client mode to connect with the socket communication module.

The playback module 310 delivers a robot control command to the robot through a socket whenever an extension function event occurs while driving content. The robot controls the robot according to the transmitted command or performs related processing such as voice recognition / synthesis, and transfers the result back to the playback module 310 through the socket communication module 320.

4 is an exemplary view showing a structure of a player playing content on a PC, which is a case where a voice recognition and a simulation are performed simultaneously, and the other is a case where only a simulation or a voice recognition engine is operated.

In the former case, when previewing in the script generation module (Script Editor) 410, the playback module (ERobotPlayer.exe) 420 is driven and the hardware control module (Player Interface) and the simulation module (SimulatorProcess.exe; 430) are played. Driven by module 420.

At this time, the hardware control module (Player Interface) is operating by opening the socket communication in the server mode (Open), the playback module 420 opens the socket communication in the client mode to process the voice-related commands (Open) Connected to the hardware control module (Player Interface).

In addition, while the simulation module 430 is also running, the socket communication in the server mode (Open) is open and driven, the playback module 420 is connected to the client mode to communicate.

From this time, whenever the "FsCommand event" occurs while the content is played in the playback module 420, it is transmitted to the hardware control module or the simulation module 430 through socket communication.

In the case of not the former case, that is, when only the simulation module 430 or the voice recognition module is operated in the latter case, the overall operation is the same as that of the former case, and only the simulation module 430 or the voice recognition module The difference is that only one of them works.

In detail, when the preview is performed in the script generation module 410, the socket communication module 440 and the simulation module 430 are driven while the regeneration module 420 is driven. At this time, the socket communication module 440 opens the socket in the server mode, and the playback module 420 opens the socket in the client mode in order to process voice-related commands, thereby connecting to each other. The simulation module 430 also opens a socket in server mode while the program is executed, and the playback module 420 connects to the client mode to communicate with each other. At this time, whenever an extension function event occurs while the contents are rotated in the playback module 420, the content is transmitted to the socket communication module 440 or the simulation module 430 through socket communication.

5 is an exemplary view showing an edit screen and a script generator of a general authoring tool according to the present invention, and there is a general authoring tool (robot action information) window for registering robot action information and voice recognition in a state where a flash authoring tool is executed. .

That is, a script generator window for registering robot action information and voice recognition is executed on the right side while the flash authoring tool is executed. The pattern registration, voice synthesis, and voice recognition word registration of the new robot action are all performed in the robot action information window.

You can also add custom actions through the functionality provided by the script generator. The script generator automatically adds the selected command with the ability to specify the focus area to paste the script into. Insert the flash function fscommand script into the corresponding part of the flash.

The command type distinguishes robot control parts such as head, wheels, eyes, mouth, chest and arms. If an arm is added or additional joint control is required depending on the robot, the command code and parameters are defined using a protocol defined in an external file that contains information related to the robot control. It is supposed to load. Therefore, the script generator can create contents for the robot for a specific purpose and purpose.

The parameters for each command pattern also have a dynamically loaded structure. For example, in the case of conventional robots, all control was possible with 5 parameter types, but it is not known whether more than 10 parameters would be required to control a robot with more complicated arm and leg joints.

Therefore, the external file containing the robot information has not only pattern information but also parameter types and basic values. At this time, it is possible to expand the formula that changes the upper and lower limit values due to the change of the value of other parameters as an independent external file and is not dependent on a specific robot.

Detailed description of the script generation region in FIG. 5 will be described in detail later with reference to FIGS. 7 to 10.

The pattern registration, voice synthesis, and voice recognition word registration of the new robot action are all performed in the robot action information window. In addition, custom action objects can be added through the wizard function provided by the general authoring tool. Insert the fscommand generated by the authoring tool into the corresponding part of the Flash timeline.

At this time, the type of command is to distinguish the robot control parts such as the head, wheel, eyes, mouth, chest, and arms, and the command code is defined as a unique code for possible action patterns for each controlled part.

For example, the action of shaking the head up and down is defined as "HDU0" by combining H (Head) U (Up) D (Down). In case of arm, "AUD0" combining A (Arm) U (Up) D (Down) and the action code to rotate the wheel left and right are "WLR0" combining W (Wheel) L (Left) R (Right). It is defined.

In addition, when an arm is added or additional control such as a joint is required according to the robot, the user can create a content suitable for the robot after adding a user-defined action by defining predefined command codes and parameters as above. Therefore, it has the universality to add a new robot action arbitrarily according to the characteristics of the robot.

Parameters are invented to allow detailed control of the robot action, and the parameter values are registered in pairs. Based on the robots currently under development, all robot actions have a 1 second hold time and one iteration parameter value. The retention time and the number of repetitions can be arbitrarily set by the robot content creator, and the types of parameters such as the moving angle, the moving distance, the moving length, the moving end point, and the moving direction vary depending on the characteristics of the action.

If the creator wants to increase the holding time, change the number of repetitions of the action, or change the parameter values such as the moving angle or the moving distance, etc., to synchronize the narration sound with the TTS during the content production, the parameter value can be changed through the script generation utility. After changing and generating script, “FsCommand” command related to robot control is automatically generated.

At this time, the repetition frequency of the robot action is influenced by the holding time and the moving distance or angle, and all parameters have an upper and lower limit value range.

The upper and lower limit values indicate the limit range that can be processed by the hardware of the robot. The upper and lower limit values are checked internally for the parameter values entered by the user and informed by a message when the upper limit is exceeded.

The default values for all robot actions are once per second, and the content creator can define the values within the upper and lower limits.

For example, the maximum head angle of the robot head is 10 degrees. If the moving angle parameter is entered more than 11 degrees, a parameter upper and lower limit exceeded message will occur. Alternatively, excessive hardware control, such as performing the head of the robot up and down 100 times in a holding time of 1 second, is prevented.

In addition, the robot manufacturer makes it easy to add new robot actions and parameters. Through simple wizard function, new robot action can be added by inputting command code, parameter type, type, and high / lower limit value sequentially for each step of wizard.

6 is a diagram illustrating a class structure of a general authoring tool, and a playback structure of the general authoring tool is responsible for content related control (Play, Pause, Stop) in "CSwfControl". In this case, the respective parts are divided according to robot-related control, voice recognition, LED-related control, and navigation-related control.

In addition, "CRobotCommand" is a part in charge of the control related to the robot command is responsible for transferring the head movement, wheel movement, arm movement control command of the robot to the actual control processor.

In addition, "CRecognitionControl" is a part that manages voice recognition words registered at the time of content creation, and "CRecogWordList" manages voice recognition words, and "CRecogObject" corresponds to a voice recognition word object registered in the content.

In addition, the "CRecognitionControl" receives a speech recognition word received from the voice control part of the robot and compares it with the speech recognition word registered in the content to take a corresponding action.

Finally, "CInterfaceProtocol" is in charge of communication with the control part.

7 to 10 are screen shots showing the screen of the automatic script generator according to the present invention. FIG. 7 is a robot action script window and a window for defining the actual robot control. The form is shown in the expanded state and the reduced state.

Various action types are provided for robot control, and authors can add robot actions depending on the robot. New robot action can be registered and used by defining commands and parameters. In addition, a robot action that is frequently used can be registered to insert an action script into the flash content with a simple operation. Robot action consists of command type, command code, command name, parameter data type, parameter type and upper and lower limit values.

Newly added extensibility means the ability to add new commands according to the robot. If a new joint control is needed, the content that enters the robot will be developed using the content. As such, it supports the function to register and modify the commands that need additional control. It will also be possible to develop content for robots that need to control many legs, such as spiders.

For example, if the wheel control, LED control, and head control must be performed at the same time, instead of adding an action object repeatedly each time, it is registered as a frequently used action so that the user can easily register it through the previously registered action template. .

In addition, it has a function for extensibility applicable to robots of other platforms. Extensibility refers to the ability to add a new command for a robot using a general authoring tool. For example, when a robot needs joint control, the contents entering the robot also require commands related to joint control in order to control the robot. It supports the function of registering and modifying robot control commands that are additionally needed in this general authoring tool.

8 is a voice recognition script window, which is a voice recognition window containing voice recognition information of a robot. There are two types of speech recognition depending on the recognition type. A single recognition word and a section recognition word are two types. A single recognition word corresponds to a file recognition word and a section recognition word includes a frame recognition word. The characteristics are roughly as follows.

The file recognizer is a function to define the globally used identifier of a specific robot content file and a specific file, and the section recognizer can define a frame identifier that can be recognized only at the start and end frame sections of a specific range. to be.

The frame identifier has the advantage of defining different link paths of two or more identical identifiers within the same content page.

However, in the same section, different link paths cannot be processed by overlapping the same recognized word.

9 is a voice synthesis script window, which defines the voice synthesis (TTS) of the robot. In the authoring tool, the same Korean and English speech synthesis engine as the robot is built-in. When authoring content in the authoring tool, the Korean-English mode can be selected and registered. When registering a voice synthesis, the voice of the robot can be expressed according to various emotion changes by using the pitch and velocity parameter values of the robot voice synthesis in the voice synthesis registration window.

FIG. 10 is a window in which a specialized object can be added to a robot, so that technology elements implemented as main functions of the robot, such as face recognition and conversation technology, can be applied to the content, so that the contents can be developed differently from the PC. This function is supported.

It was invented to create new added value of robot with added function for developing contents different from PC. The main functions of the robot, such as face recognition, user gaze, navigation, and conversation technology, are focused on developing various contents by applying the technical elements already implemented to the contents.

An example of applying the HRI object is summarized in Table 1 below.

In the case of a face recognition object, content that takes a specific action according to a recognized user can be produced, for example, "Hello ~." If the sentence is to be implemented on the content, it is possible to find out the currently recognized user through face recognition, and by receiving this information, the content can be implemented differently according to the recognized person.

In the case of a conversation object, when a conversation technology object of a component type composed of a specific scenario is added to the content, it is possible to develop specialized content incorporating the conversation technology when playing the content. For example, if one of the children's fairy tales is produced, it will not be a mere one-sided story, but will be able to produce content suitable for robots that are differentiated from the contents for PCs that enhance thinking through dialogue with each character. By adding a specialized object to such a robot, there is an advantage in that an algorithm for judging based on an input and output result of recognition and conversation object can be configured and reflected in content.

In addition, navigation can be performed such as staring at the user's face or moving to a specific place while playing content.

As an embodiment of the present invention, a method for defining robot control, voice recognition, voice synthesis, TTS, face recognition, and conversation technology object using the flash and script generator of Macromedia Inc. among commercial authoring tools will be described.

Define the "FsCommand" command provided by the script generator as described above is shown in Table 2 below.

In Table 2, "FsCommand" and parameters are defined. Commands for controlling the robot using a function provided by the flash are defined.

In actual production, the script generator receives the developer's information and automatically generates the code.

○ Head Action Script:

ex 1) fscommand ("robotcmd", "# HUD0 # 1 # 1 # 10");

Shake the robot's head up and down once a second for 10 degrees.

ex 2) fscommand ("robotcmd", "# HSK0 # 1 # 1 # 10 # 1 # 30");

Shake and lean the head of the robot once a second for 1 second. At this time, the lean angle is 10, the number of shakes is 1, and the shake angle is 30.

ex 3) fscommand ("robotcmd", "# HCL0 # 1 # 1 # 10 # 1 # 0 # 0 # 0 # 10 # 30");

Start the robot's head in the upper left corner and draw a circle once per second. At this time, the length of the horizontal and vertical long and short is 30, 10.

○ Wheel Action Script:

ex 1) fscommand ("robotcmd", "# WFB0 # 1 # 1");

Move the wheel of the robot back and forth once for 1 second.

○ 8 action scripts:

ex 1) fscommand ("robotcmd", "# AUD0 # 1 # 1 # 10 # 1");

Move the left arm of the robot up and down once for 1 second.

○ navigation script

ex1) fscommand ("navigation", "#prev");

When switching pages, use the history function to move to the previously viewed page.

○ Facial Expression LED Script:

ex1) fscommand ("ledcmd", "# LEH0 # RED # 1 # 5 # 1");

Repeat on the face for 5 seconds with red color.

ex 2) fscommand ("ledcmd", "# LEG0 # GREEN # 2 # 5 # 1");

Repeat the sad expression on your face once for 5 seconds in green color.

○ Voice recognition script:

ex 1) fscommand ("asr", "# KOR # Hello #

http://www.irobi.co.kr/contents/exam.swf#FILE_LINK#10#HistoryType ");

If "hello" is recognized among the voice recognition words, it moves to the file of the corresponding path.

○ Speech Synthesis Script:

ex1) fscommand ("tts", "# KOR # Hello # 1 # 1 # 1");

A voice synthesis TTS called "Hello" is transmitted at height 1, speed 1, and volume 1.

○ Link Information Script:

ex 1) fscommand ("linkinfo", http://www.irobi.com/contents/exam.swf#

FILE_LINK # 10 # HistoryType ");

When a particular object is selected, it will go to the file in that path.

A brief summary of the scripts related to robot control is shown in Table 3 below.

The head action commands and parameters related to the head in the division shown in Table 3 are summarized in Table 4 below.

Table 4 is a table that defines the commands and parameters for robot head control.

There are seven types of action patterns related to head control. Action name defined by action code and default value, minimum value and maximum value of each parameter are defined. The holding time refers to the time to keep the action. The unit is seconds. You can define up to 3,600 seconds, or 1 hour.

The number of repetitions is an attribute that repeats the action with respect to the holding time. The maximum value of the number of repetitions is affected by the holding time, the moving angle, the rotation angle, and the number of shaking times. The types of head action parameters vary and vary depending on the characteristics controlled during operation.

In case of action code HDN0, which moves head up and down, parameter type is only movement angle except holding time and repetition frequency, but in case of action code HSK0, parameter that should be defined as the number of shaking, shaking angle, bow angle There are more varieties than HDN0.

Table 5 is a table that defines the commands and parameters for the wheel control of the robot.

There are four types of action patterns related to wheel control. The action code WFB0 moves back and forth, and it is defined as returning to the starting position after reciprocating a movement distance of 10 cm at a speed of once per second. At this time, the maximum movement distance of the wheel is 10cm, if a parameter value of 11cm or more is input, a message exceeding the upper limit occurs.

Table 6 is a table that defines the commands and parameters for the robot's arm control.

There are a total of three types of patterns defined in relation to arm control. Action code AUD2 is to shake both arms up and down. The basic parameter value is one action for 1 second holding time. You can create new action by changing the parameter value.

Table 7 is a table defining commands and parameters for the expression of the facial expression of the robot.

Commands to control facial expressions for the Face LED on the robot's head. There are currently 10 defined patterns.

Figure 11 is a front and rear view of the robot for showing the driving part according to the present invention, the control of the head, wheel, arm operation by inserting the "fscommand" script in the frame portion of the timeline of the flash editing screen In addition, the head LED, chest LED, eye LED, mouth LED, arm LED, and ear LED control can be used to express effective emotions.

At this time, the LED is defined by each color for each emotion to express the mood of the robot through the color. For example, when face LED is orange color, it expresses joyful feeling, when green face LED expresses emotion of sadness, when it shows red color, it expresses anxiety feeling. can see.

Therefore, through the edit screen of the general authoring tool according to the present invention as shown in Figure 5, the content for the robot is produced using the "FsCommand" function provided by Flash, a multimedia authoring tool, timeline You can specify the starting point of a specific action in an area.

In addition, the content editing area is an area for producing a screen that is displayed on the display device mounted on the robot.

In addition, the action script area is a screen for registering a "FsCommand" function substantially related to robot control in the form of a script.

At this time, the "FsCommand" command can be directly input, but since it is difficult for general producers to use, the interface is improved and the flash is automatically selected when the command is selected in the script generator as shown in FIGS. 7 to 10. It is registered in the ActionScript script area of.

The universal authoring tool is an authoring environment, which allows content authoring tools such as macromedia flash and general authoring tools to be displayed on a window. Create a script in the general authoring tool and insert it into the desired part of the content.

In the way that a content developer inputs a script manually, a script is automatically generated using a general-purpose tool, and the content developer takes the form of inputting the content to provide convenience of content development.

While the invention has been shown and described in connection with specific embodiments thereof, it is well known in the art that various modifications and changes can be made without departing from the spirit and scope of the invention as indicated by the claims. Anyone who owns it can easily find out.

As described above, if a script generator and a commercialization authoring method for controlling robots of various platforms according to the present invention are provided, detailed control of a robot having complex parameters can be added using an action script of a commercialized multimedia authoring tool. Also, through the script generator that automatically creates the script function, it provides a convenient interface for robot contents creators to develop even if they do not have special knowledge about the robot or specific functions. To provide technology.

In addition, it is invented to be applied to various robot platforms of various types that are being developed at home and abroad, thereby reducing the burden of redundant development and developing robot contents with high completion in a relatively short period of time.

In addition, it adds an object that applies user gaze, navigation, and face recognition to differentiate it from the PC and provides a function to develop contents utilizing the characteristics of the robot.

In addition, even if the robot is under development or the content developer does not own the actual robot, it provides a complete simulation function in the PC environment, thereby minimizing the period and cost during the inspection phase.

Claims (8)

Robot action information, including robot action, voice recognition, and voice synthesis, including robot control, multimedia-based authoring functions, and content players and 3D simulations that allow users without robots to simulate the same type of robots. And an authoring environment having a static object information window for speech synthesis and speech recognition registration. Loading any content material with a particular format; A second step of performing a reproducing operation on the content material loaded in the first step and editing the reproduced content material; By defining the commands related to robot control in the script method for the content material loaded in the first step, all robot command scripts such as robot motion control, voice recognition, voice synthesis, user gaze, face recognition, navigation, and conversation technology are robots. A third step of communicating with and performing setting and simulation of the robot action; A fourth process of arbitrarily selecting a presentation time point for the content material edited and set through the second process and the third process; And In the case of displaying the content edited and set through the second process and the third process through the resources of the robot, characterized in that it comprises a fifth process that is displayed to the outside based on the time selected in the fourth process How to use script generator and commercial authoring tool for robot control of various platforms. The method of claim 1, The communication in the third process is a method for using a script generator and commercialized authoring tool for robot control of various platforms, characterized in that using the socket communication. The method of claim 1, The process of defining a script for command related to robot control in the third process provides a variety of action types required for robot control, and a robot action script adjustment mode in which the author can add a robot action according to the robot; Voice recognition script control mode that enables to adjust the voice recognition information of the robot, which is divided into a specific robot content file, a file recognition word used globally for a specific file, and a frame recognition word that is activated only in the start and end frame sections of a specific range. Wow; A voice synthesis adjustment mode for expressing a suitable robot voice according to various emotion changes by using properties of pitch and speed parameter values of the voice; And Robots of various platforms, including a characterization object addition mode for adding technical elements implemented as main functions of the robot, such as face recognition and dialogue technology, to the content data loaded in the first step according to the designer's needs. How to use script generator and commercial authoring tool for control. The method of claim 1, The third process uses a multimedia content authoring tool to define the robot's motion, voice recognition and synthesis, etc. in a script manner and to communicate with the robot, but to automatically communicate the script using a function related to the robot control. A method of utilizing a script generator and commercialization authoring tool for robot control on various platforms, characterized in that for generating, automatically inputting it to a content authoring tool, and applying robot control commands to general purpose robots on various platforms. The method of claim 3, wherein Method for utilizing the script generator and commercialized authoring tool for controlling the robot on a variety of platforms, characterized in that for further developing the content characterized in the robot, the action according to the input and output results such as whether the face recognition judgment. The method of claim 3, wherein Method for utilizing a script generator and commercialization authoring tool for robot control of various platforms, further comprising the step of effectively implementing the interaction between the robot and the user by incorporating a dialogue technology for the development of the specialized content on the robot. . The method of claim 1, In order to improve the user interface, a script is automatically generated using a function related to robot control, and the script generator and commercialization authoring tool for robot control of various platforms are automatically inputted to a commercial authoring tool. Way. The method of claim 1, Method of using a script generator and commercialization authoring tool for robot control on various platforms, characterized in that all commands related to robot control are defined as external files in order to be applicable to robots having various platforms and control parts.

Images