[go: up one dir, main page]

WO2018157355A1 - Robot intelligent humanoïde et système de communication homme-machine - Google Patents

Robot intelligent humanoïde et système de communication homme-machine Download PDF

Info

Publication number
WO2018157355A1
WO2018157355A1 PCT/CN2017/075476 CN2017075476W WO2018157355A1 WO 2018157355 A1 WO2018157355 A1 WO 2018157355A1 CN 2017075476 W CN2017075476 W CN 2017075476W WO 2018157355 A1 WO2018157355 A1 WO 2018157355A1
Authority
WO
WIPO (PCT)
Prior art keywords
voice
robot
data
human
control device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/075476
Other languages
English (en)
Chinese (zh)
Inventor
程时胜
王驰
许晨举
张帝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Iwith Smart Technology Co Ltd
Original Assignee
Shenzhen Iwith Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Iwith Smart Technology Co Ltd filed Critical Shenzhen Iwith Smart Technology Co Ltd
Priority to PCT/CN2017/075476 priority Critical patent/WO2018157355A1/fr
Publication of WO2018157355A1 publication Critical patent/WO2018157355A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for

Definitions

  • the present technology belongs to the field of intelligent automation, and particularly relates to an intelligent automated robot and a human-machine communication dialogue system having a human body shape.
  • a robot is a machine that has a similar appearance and function to a person, or a machine that has the ability to actively perform an operation. Robots that use artificial power can work instead of people, or they can work with people. Often robots are designed to perform the work that the creator designed and do a lot of work for people.
  • An automated robot that performs assembly, welding, handling, and the like in a manufacturing plant is called an industrial robot, and a robot that has a function of recognizing the environment and actively determining it is called an intelligent robot.
  • the waiter robot is different from the industrial robot. It is a robot that provides various services to individuals in the home, medical institutions, and general facilities.
  • the technical solution provides a human intelligent robot and a human-machine communication system, which is composed of a human intelligent robot and a human-machine communication system, and the human intelligent robot includes: a head, a torso, an arm, a leg, and a foot.
  • the base is configured to: the head is provided with an imaging device, a first voice device, a transmission device, a pointing device, and a second display device; the torso is provided with a second voice device, a first display device, a transmission device; the arm is connected to the torso, and a plurality of transmission devices are provided for controlling the rotation direction of the arm; the front end of the arm is provided with a palm, and the palm is provided with a touch device; the robot is internally provided with a control device, the storage device
  • the information transmitting device; the leg portion is provided with a third voice device; the leg portion is provided with a cavity, and the power body is provided with a power source; the power source is a control device, a storage device, an information transmission device, an imaging device, and a voice
  • the device, the transmission device, the indicating device, the second display device, the first display device, and the transmission device are powered; the foot portion is provided with a switch control device and a machine weight device; the base is provided with
  • the control device includes a main chip, the MIPI port and the SPI port are disposed in the main chip; the MIPI port is used to drive the first display screen; the SPI port is used to drive the second display screen; Displayed by two sets of displays, the left eye display and the right eye display.
  • the head is provided with one or more camera devices, the camera device is a camera; the head is provided with a plurality of first voice devices, and the first voice device includes a voice input device microphone at the lower end of the nose. And a voice output device speaker of the double ear; the microphone of the first voice device is connected to the first noise reduction device and connected to the control device; the head is provided with one or more indicating devices, and the indicating device is Indicator light.
  • the body is provided with a display device, one or more second voice devices and a transmission device;
  • the first display device is a display screen, and the display device is provided with a selection device;
  • a plurality of transmissions are used to control the connection and movement of the head, the hands and the feet; and
  • the second voice device is a speaker.
  • the front end of the arm is connected with a palm
  • the back of the palm is provided with one or more touch devices
  • the touch device is a touch sensor
  • the touch device is installed inside the palm and adopts an invisible design
  • the arm setting There are transmissions for controlling the connection and movement of the arms, palms, and finger joints.
  • the base further includes: a leg portion is connected to the leg portion; a power supply is disposed outside the foot portion; a power supply interface is disposed at a bottom portion of the foot portion; and a power transmission interface is disposed on the base portion; On the base The power transmission interface is connected to the power supply interface of the foot, the base is connected to the external power supply, and the power supply in the leg is charged; the indicating device on the base is a power display; the leg is provided with one or more
  • the third voice device is a microphone, and the microphone of the third voice device is connected to the third noise reduction device and connected to the control device.
  • the present technology further includes a human-machine communication system between the user and the robot; including a data acquisition device, a control identification, and a control response; wherein the data acquisition device is one or more cameras, microphones, and sensors.
  • the control device is identified as a software control portion disposed in the control device, including receiving voice, noise cancellation, scene customization recognition model, voice recognition, recognition text, received text, and text analysis;
  • the control response includes a control device Controlling a servo motor inside the robot to perform limb movement and converting the response content into a voice by the control device is played by the speaker;
  • the robot is internally provided with a control device and a storage device; and the control device is provided with a multi-level voice data analysis package;
  • the data analysis package analyzes, processes, and parses the received data.
  • the robot can determine the user's position according to the data collection device and provide service voice and limb information.
  • the voice system in the robot starts and realizes the functions of voice communication and dialogue between the robot and the user; receiving the voice data of the user, after noise clearing, scene customization After identifying the model, speech recognition, etc., the user's voice data is converted into a language within the robot controller for data reception and compilation.
  • the text analysis content adopts a preset method, and has been transmitted to the robot control device in advance in use, so as to utilize the quick judgment of the robot, and the data not included in the data will be fixed according to the setting. Reply to the body and language mode.
  • the limb is restored as follows: After the text is parsed, the control device performs data judgment based on the parsed character, and determines whether the limb movement performance is performed in one step. If it is necessary to transmit the limb motion command, the limb performance is performed according to the speech analysis effect.
  • the voice reply is: another step to determine the text analysis content to determine whether to carry out voice communication, without the need to complete the task, the end of the task can be executed with the set conclusion or action; after the text analysis, the control device according to After parsing, the text is judged by the voice text, and another step is to determine whether to perform voice back. Repeat, no need to complete the task. The end of the task can be performed with the set conclusion or action.
  • the control device After the text analysis, the control device performs data determination based on the parsed text, and requires a voice response, the control device internally generates a reply text, and plays the generated text-based voice playback device to the user, and responds and saves the data.
  • the voice data is stored in the storage device inside the robot and transmitted to the cloud platform, so as to facilitate the process of correcting and sorting the data in the later stage.
  • the technical solution provides a humanoid intelligent robot and a human-machine communication system thereof, which has functions of motion performance, driving travel, display, image operation, voice recognition, human-machine dialogue, data storage, and data processing, and the robot is in service.
  • the application within the industry will improve the service efficiency of the service industry and effectively reduce the labor cost of the enterprise.
  • Data collection and aggregation will better provide managers with the raw data for the improvement of the enterprise development system.
  • FIG. 1 is a schematic view of a product provided by the present invention.
  • FIG. 2 is a schematic diagram of a main chip provided by the present invention.
  • FIG. 3 is a schematic view 1 of the design provided by the present invention.
  • Figure 4 is a schematic view of the design provided by the present invention 2.
  • Figure 5 is a schematic view of the design provided by the present invention 3.
  • Figure 6 is a schematic view of the design provided by the present invention 4.
  • FIG. 7 is a flow chart of a design provided by the present invention.
  • the utility model comprises: a head, a trunk, an arm, a leg, a foot and a base; wherein the head is provided with an image pickup device 2, a first voice device (4 and 5), a transmission device, and a pointing device 1, a display device 3; a second voice device, a first display device 7, and a transmission device; the arm is connected to the torso, and a plurality of transmission devices are provided for controlling the rotation direction of the arm; a palm is provided, and a touch device 9 is disposed on the palm; the robot is internally provided with a control device, a storage device, and an information transmission device; the leg portion is provided with a third voice device 8; and the leg portion 10 is provided with a cavity.
  • a power source is disposed in the cavity; the power source supplies power to the control device, the storage device, the information transmission device, the camera device 2, the voice device 4, the transmission device, the pointing device 1, the second display device 3, the first display device 7, and the transmission device.
  • the control device performs data sharing and transmission with the cloud platform through the information transfer device, and one cloud platform can be connected to one or more control devices
  • the control device performs data sharing and transmission with the terminal product through the information transmission device, that is, the cloud platform can collect the collected data in the robot according to the management needs and collect the data in the robot, and the real data is transmitted to other robots having the control device.
  • the role of communication to improve the intelligent effect of the robot.
  • the control device performs data sharing and transmission with the terminal product through the information transmission device, and one control device can be connected to one or more terminals, that is, one robot can transmit data to multiple terminals, Features with data sharing and management capabilities, as well as the ability to collect customer information and send it to the presence of service personnel and managers. Managers can understand the data collected by the robot through the cloud platform and ⁇ , and put the summary work into the platform software processing in large-scale use, and can accurately understand the working condition of a robot or multiple robots, and adjust it appropriately. The corresponding work arrangement.
  • control device is respectively connected to the head, the body, the arm and the leg by a transmission device; the transmission device is a servo motor.
  • the system controls a plurality of parts on the body of the robot through the control device; and realizes the movement of the joints of the head, the arms, the legs, and the like, thereby realizing the movement of the robot and the expression of various expressions, such as walking, raising hands, opening mouth, blinking Wait for the action.
  • the storage device is configured to store data collected by the camera device and the voice device.
  • the control device includes a main chip, the MIPI port and the SPI port are disposed in the main chip; the MIPI port is used to drive the first display screen 7; the SPI port is used to drive the second display screen 3; The display is displayed by two sets of displays, the left eye display and the right eye display.
  • the expression of the robot's eyes is generally set, for example: blinking, smiling, Sorrow, pain and other expressions, through the changes to the eyes one by one to show everyone to improve the affinity of the robot, so the traditional way for the robot eye and other parts have two or more screens, the display image of the same display
  • two or more main chips are generally used for design, and different display devices are separately controlled to meet the requirements for robot image processing. That is, one master chip can only control one display device, that is, the display screen; the SPI interface is generally used as data transmission, and the robot uses the MIPI port to drive the first display screen 7, and the SPI port can expand the SPI port to transmit after being processed by software.
  • the graphic signal is displayed on the flexible display of the robot's eye to improve the facial expression of the robot.
  • the head is provided with one or more camera devices 2, the camera device 2 is a camera; the camera device 2 is a camera for collecting image data; when a person is close to the camera, the camera device collects After the data is separated, the information is transmitted by the control device to communicate with the person through the voice device; when the walking encounter encounters an obstacle in front, the data is transmitted to the control device, and the control device sends a message to evade the obstacle by modifying the command of the transmission device. Things.
  • the head is provided with a voice device 4, the voice device is a microphone and a speaker; the microphone is used to receive external voice information, and the speaker is used to play the voice information provided by the control device; thereby realizing the robot and the person Two-way communication between.
  • the voice device is a microphone and a speaker; the microphone is used to receive external voice information, and the speaker is used to play the voice information provided by the control device; thereby realizing the robot and the person Two-way communication between.
  • the head is provided with a plurality of first voice devices, and the first voice device includes a voice input device microphone 5 at the lower end of the nose and a voice output device speaker 4 of the binaural portion; A transmission that controls the connection and movement of the eyes, mouth, and eyelids.
  • the head is provided with a plurality of indicating devices 1, and the indicating device 1 is an indicator light.
  • This function can be used in conjunction with other devices to implement reminders or match expression output; for example: blush and other features.
  • the torso is provided with a first display device, a voice device and a transmission device;
  • the first display device is a display screen, and the first display device is mainly used to cooperate with a person to observe image data provided by the robot;
  • the robot is used as a restaurant service staff, both the food introduction and the image information can be presented simultaneously to improve the customer's understanding of the product and service.
  • the first display device can be provided with a selection device for the customer to directly select the confirmation function.
  • a touch screen device or a button is arranged on the display device, and the artificial selection and control can be performed according to the prompt of the display screen, so that the robot realizes a certain technical operation.
  • the torso is provided with a plurality of transmissions for controlling the connection and movement of the head, the hands and the feet.
  • the arm is provided with one or more touch devices 9, the touch device 9 is a touch sensor; the touch device 9 is installed outside the palm and adopts an invisible design, and the touch device 9 adopts an invisible design, the customer
  • the touch robot does not know the specific location of the touch device; for example: when the robot is welcoming the customer, the customer inadvertently touches the touch device, the touch device transmits data to the control device, and the control device sends information through the information transfer device.
  • the holder of the terminal is a waiter, and the waiter can provide services to the customer according to the situation on the spot and pay attention to the customer or come.
  • the front end of the arm is connected with a palm
  • the back of the palm is provided with one or more touch devices
  • the touch device is a touch sensor
  • the touch device is installed in the palm of the hand and adopts an invisible design
  • the arm is provided with a transmission device. Used to control the connection and movement of the arms, palms, and finger joints.
  • the leg is connected with a foot; the outer side of the foot is provided with a power switch; the bottom of the foot is provided with a power supply interface; the base 12 is provided with a power transmission interface, the base 12 The power transmission interface is connected to the power supply interface of the foot, the base 12 is connected to the external power supply, and the power supply in the leg is charged; the indicating device on the base 12 is a power display; the leg is provided with one or The plurality of third voice devices 8 and the third voice device 8 are microphones, and the microphone of the third voice device 8 is connected to the third noise reduction device and connected to the control device.
  • a preferred human-machine communication system includes: a data acquisition device, a control identification, and a control response;
  • the data collection device is a combination device of one or more cameras, microphones, and sensors.
  • control is identified as a software control part disposed in the control device, including receiving voice, noise cancellation, scene customization recognition model, voice recognition, recognition text, receiving text, and text analysis.
  • control response comprises controlling, by the control device, a servo motor inside the robot to perform limb movement and converting the response content into a voice by the control device to be played by the speaker.
  • the robot is internally provided with a control device and a storage device; and the control device is provided with a multi-level speech data analysis package; the data analysis package can analyze, process and parse the received data.
  • the robot can determine the orientation of the user according to the data collection device. Provide voice and physical information. For example: Welcome, what can help you and other voice and body data.
  • the voice system in the robot starts and realizes the functions of voice communication and dialogue between the robot and the user, and receives the voice data of the user, and passes the noise clearing, scene customization recognition model, After the steps of voice recognition and the like, the user's voice data is converted into a language in the robot controller for data reception and compilation.
  • the text analysis content adopts a preset method, and has been transmitted to the robot control device in advance in use, so as to utilize the quick judgment of the robot, and the uncollected data will be set according to the fixed limb and The language mode responds.
  • the limb recovery is: After the text analysis, the control device performs data judgment based on the parsed text, and determines whether to perform the limb motion performance in one step, and if necessary, transmits the limb motion command, and performs the limb performance according to the voice analysis effect, for example, Smile, shake hands, send things, etc. If the text parsing content is not required to complete. At the same time, the voice data is stored in the storage device inside the robot and transmitted to the cloud, so as to facilitate the correction of the data in the later stage.
  • the voice analysis effect for example, Smile, shake hands, send things, etc.
  • the voice reply is: Another step is to judge the text analysis content to determine whether to perform voice communication, and the task can be ended without the need.
  • the end of the task can be performed with the set conclusion or action. For example: Welcome to the light, please wait, welcome to the next time to set the content.
  • the control device judges the voice text based on the analyzed text, and the other step determines whether or not the voice reply is performed, and the task is terminated without the need.
  • the end of the task can be performed with the set conclusion or action. For example: Welcome, please, please come back later and wait for the next time.
  • control device After the text is parsed, the control device performs data judgment based on the parsed text, and requires a voice response, the control device internally generates a reply text, and plays the generated text-based voice playback device to the user, and responds and saves the data.
  • the voice data is stored in the internal storage device of the robot and transmitted to the cloud platform, so as to facilitate the correction, finishing, and the like of the data in the later stage.

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

L'invention concerne un robot intelligent humanoïde et un système de communication homme-machine. Le système de communication homme-machine comprend un dispositif de capture de données, une reconnaissance de commandes et une réponse aux commandes. Le dispositif de capture de données est un dispositif combinant au moins une caméra, un microphone (5) et un capteur. La reconnaissance de commandes est une partie logicielle de commande disposée à l'intérieur d'un dispositif de commande, comprenant la réception vocale, l'annulation de bruit, des modèles de personnalisation et reconnaissance de scènes, la reconnaissance vocale, la reconnaissance de texte, la réception de texte et l'analyse syntaxique de texte. La réponse aux commandes comprend le dispositif de commande qui commande un servomoteur à l'intérieur d'un robot afin de réaliser des mouvements de membres et qui convertit un contenu de réponse en paroles à des fins de lecture par un haut-parleur. Dans le robot sont disposés un dispositif de stockage et le dispositif de commande. Le dispositif de commande est pourvu d'un progiciel d'analyse de données vocales multiniveau. Le progiciel d'analyse de données permet l'analyse, le traitement et l'analyse syntaxique de données reçues.
PCT/CN2017/075476 2017-03-02 2017-03-02 Robot intelligent humanoïde et système de communication homme-machine Ceased WO2018157355A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/075476 WO2018157355A1 (fr) 2017-03-02 2017-03-02 Robot intelligent humanoïde et système de communication homme-machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/075476 WO2018157355A1 (fr) 2017-03-02 2017-03-02 Robot intelligent humanoïde et système de communication homme-machine

Publications (1)

Publication Number Publication Date
WO2018157355A1 true WO2018157355A1 (fr) 2018-09-07

Family

ID=63369544

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/075476 Ceased WO2018157355A1 (fr) 2017-03-02 2017-03-02 Robot intelligent humanoïde et système de communication homme-machine

Country Status (1)

Country Link
WO (1) WO2018157355A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110266750A (zh) * 2019-04-30 2019-09-20 北京云迹科技有限公司 用于机器人语音播报的处理方法及装置
CN111687826A (zh) * 2020-06-19 2020-09-22 丁嘉 智能机器人

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1247624A1 (fr) * 2000-03-24 2002-10-09 Sony Corporation Determination de l'action d'un robot et robot
CN105126355A (zh) * 2015-08-06 2015-12-09 上海元趣信息技术有限公司 儿童陪伴机器人与儿童陪伴系统
CN106737760A (zh) * 2017-03-01 2017-05-31 深圳市爱维尔智能科技有限公司 一种人型智能机器人及人机交流系统
CN206561428U (zh) * 2017-03-01 2017-10-17 深圳市爱维尔智能科技有限公司 一种人型智能机器人

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1247624A1 (fr) * 2000-03-24 2002-10-09 Sony Corporation Determination de l'action d'un robot et robot
CN105126355A (zh) * 2015-08-06 2015-12-09 上海元趣信息技术有限公司 儿童陪伴机器人与儿童陪伴系统
CN106737760A (zh) * 2017-03-01 2017-05-31 深圳市爱维尔智能科技有限公司 一种人型智能机器人及人机交流系统
CN206561428U (zh) * 2017-03-01 2017-10-17 深圳市爱维尔智能科技有限公司 一种人型智能机器人

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110266750A (zh) * 2019-04-30 2019-09-20 北京云迹科技有限公司 用于机器人语音播报的处理方法及装置
CN111687826A (zh) * 2020-06-19 2020-09-22 丁嘉 智能机器人

Similar Documents

Publication Publication Date Title
CN106737760B (zh) 一种人型智能机器人及人机交流系统
CN101436037B (zh) 一种餐厅服务机器人系统
JP5429462B2 (ja) コミュニケーションロボット
CN100360204C (zh) 基于多处理器协作的智能表演机器人的控制系统
CN110405789B (zh) 一种查房陪护机器人、机器人查房陪护系统及方法
CN105912128B (zh) 面向智能机器人的多模态交互数据处理方法及装置
CN108297098A (zh) 人工智能驱动的机器人控制系统及方法
CN116572260A (zh) 基于人工智能生成内容的情感交流陪护养老机器人系统
CN106826838A (zh) 一种基于Kinect视觉深度传感器的交互仿生机械臂控制方法
JP2004230479A (ja) コミュニケーションロボットおよびそれを用いたコミュニケーションシステム
CN100460167C (zh) 仿人机器人头部系统
CN104102346A (zh) 一种家用信息采集和用户情感识别设备及其工作方法
WO2023124026A1 (fr) Procédé et système de commande de robot, dispositif informatique, support de stockage et produit-programme informatique
JP2024023193A (ja) 情報処理装置及び情報処理方法
CN109366504A (zh) 一种智能展会服务机器人系统
CN108453742A (zh) 基于Kinect的机器人人机交互系统及方法
CN103853071A (zh) 基于生物信号的人机面部表情交互系统
CN102895093A (zh) 一种基于rgb-d传感器的助行机器人跟踪系统及方法
CN116061210A (zh) 信息处理装置、信息处理方法和计算机存储介质
JP2005131713A (ja) コミュニケーションロボット
CN113894779B (zh) 一种应用于机器人交互的多模态数据处理方法
WO2018157355A1 (fr) Robot intelligent humanoïde et système de communication homme-machine
CN206561428U (zh) 一种人型智能机器人
CN108608439A (zh) 一种儿童情感宣泄机器人及方法
CN108297109A (zh) 一种智能机器人系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17898665

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17898665

Country of ref document: EP

Kind code of ref document: A1