WO2021114666A1 - Human body safety evaluation method and system in human-machine collaboration - Google Patents
Human body safety evaluation method and system in human-machine collaboration Download PDFInfo
- Publication number
- WO2021114666A1 WO2021114666A1 PCT/CN2020/102934 CN2020102934W WO2021114666A1 WO 2021114666 A1 WO2021114666 A1 WO 2021114666A1 CN 2020102934 W CN2020102934 W CN 2020102934W WO 2021114666 A1 WO2021114666 A1 WO 2021114666A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- coordinate system
- human body
- robot
- posture
- inertial measurement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/02—Sensing devices
- B25J19/04—Viewing devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/06—Safety devices
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Definitions
- the present invention relates to the field of human-machine cooperation, in particular to a method and system for human body safety assessment in the process of collaborative robot and human cooperation.
- the present invention provides a method and system for evaluating human body safety in man-machine collaboration, which makes man-machine collaboration safer and more efficient in man-machine collaboration.
- the present invention provides a human body safety assessment method in human-machine collaboration, including:
- the safety level of the human body in the human-robot collaboration is determined.
- the acquiring the pose of the human body in the global coordinate system specifically includes:
- the ankle on the side where the human foot touches the ground is the origin of the human body base coordinate system; the origin of the human body base coordinate system is switched between the human body's left ankle and the human body's right ankle;
- first inertial measurement unit there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left forearm, right forearm, left forearm, right forearm, and left of the human body. Thigh, right thigh, left calf, right calf, left instep and right instep;
- the posture of the human body in the global coordinate system is determined.
- the determining the pose of the human body in the global coordinate system according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship specifically includes:
- the calibration process is carried out on all the first inertial measurement units, each of which is associated with a body part with a predefined coordinate system.
- the associated first inertial measurement unit is used in real-time motion capture;
- the length of the human body limb is determined and known, and the first inertial measurement unit after the association is placed on the upper torso of the human body, and the initial state is when the human body is upright and stationary; when the human is walking , Always keep one foot touching the ground, and take that side ankle as the origin of the human body base coordinate system.
- the first rotation matrix between each first inertial measurement unit coordinate system and the reference coordinate system be the identity matrix
- the first rotation matrix between each first inertial measurement unit coordinate system and the reference coordinate system be the identity matrix
- the first rotation matrix R ⁇ 1 measured by the first inertial measurement unit at the left calf is:
- the coordinate system is established with the left knee as the origin of the coordinate system, and the posture of the coordinate system is consistent with the basic coordinate system of the human body, and the coordinate system established with the left knee as the origin of the coordinate system is used as the reference coordinate system for the movement of the first inertial measurement unit at the left thigh;
- the first rotation matrix between the first inertial measurement unit coordinate system at the left thigh and the left knee coordinate system be the identity matrix.
- the coordinates of the left hip joint are Obtain the posture and position information of the left thigh in real time through the first rotation matrix R ⁇ 2 expressed by the quaternion returned by the first inertial measurement unit at the left thigh;
- the coordinate system is established with the left hip joint as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body. Assuming that the posture of the pelvis does not change during the movement of the person, the position of the pelvis in the coordinate system of the left hip joint is fixed , And get the position of the pelvis in the basic coordinate system of the human body at the same time;
- the coordinate system is established with the center of the pelvis as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the position of the right hip joint in the pelvic coordinate system is fixed, and the position of the right hip joint in the basic coordinate system of the human body is obtained. ;
- the coordinate system is established with the right hip joint as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the coordinate system of the right hip joint is used as the reference coordinate system of the first inertial measurement unit at the right thigh.
- the first rotation matrix between the coordinate system of the first inertial measurement unit and the coordinate system of the right hip joint is the unit matrix. In the coordinate system of the right hip joint, it is represented by the quaternion returned by the first inertial measurement unit at the right thigh.
- the first rotation matrix obtains the posture and position information of the right thigh in real time, and obtains the position coordinates of the right knee in the basic coordinate system of the human body according to the coordinate transformation;
- the coordinate system is established with the right knee as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the coordinate system of the right knee is used as the reference coordinate system of the first inertial measurement unit at the right calf.
- the right calf is the first
- the first rotation matrix between the inertial measurement unit coordinate system and the right knee coordinate system is the unit matrix.
- the first rotation matrix expressed by the quaternion returned by the first inertial measurement unit at the right calf Obtain the posture and position information of the right calf, and obtain the position coordinates of the right ankle in the basic coordinate system of the human body according to the coordinate transformation;
- the pelvic coordinate system is used as the reference coordinate system of the upper body torso.
- the first rotation matrix between the upper body torso inertial measurement unit coordinate system and the pelvic coordinate system is the identity matrix.
- the pelvic coordinate system Through the first rotation matrix represented by the quaternion returned by the first inertial measurement unit of the upper body torso, the posture and position information of the upper body torso are obtained in real time, and the shoulder position coordinates in the basic coordinate system of the human body are obtained according to the coordinate transformation;
- the coordinate system is established with the shoulder as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body, and the shoulder coordinate system is used as the reference coordinate system for the movement of the boom, which is expressed by the quaternion returned by the first inertial measurement unit at the boom
- the first rotation matrix of obtains the posture and position information of the boom in real time, and obtains the position coordinates of the elbow in the basic coordinate system of the human body according to the coordinate transformation;
- the coordinate system is established with the elbow as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the elbow coordinate system is used as the reference coordinate system for the forearm movement, and the quaternion is returned by the first inertial measurement unit at the forearm.
- the first rotation matrix represented by the number obtains the posture and position information of the forearm in real time, and obtains the position coordinates of the wrist in the basic coordinate system of the human body according to the coordinate transformation;
- the acquiring the pose of the robot in the global coordinate system specifically includes:
- the pose of the robot in the global coordinate system is determined.
- the determining the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system specifically includes:
- the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system determine the distance set between the human body and the robot; the distance set includes each human body in the human body and the robot respectively The distance between the connecting rods; the human body torso includes upper body torso, left big arm, right big arm, left forearm, right forearm, left thigh, right thigh, left calf and right calf;
- the movement speed of the robot is determined according to the distance between the human body and the robot.
- the determining the safety level of the human body in human-robot collaboration according to the distance between the human body and the robot and the movement speed of the robot specifically includes:
- the distance between the human body and the robot is greater than the second preset distance threshold, the distance between the human body and the robot is less than or equal to the first preset distance threshold, and the movement speed of the robot is less than the preset speed threshold, Determining that the human body is in a second safe state; the first preset distance threshold is greater than the second preset distance threshold;
- the distance between the human body and the robot is greater than a second preset distance threshold
- the distance between the human body and the robot is less than or equal to the first preset distance threshold
- the movement speed of the robot is greater than or equal to the preset speed threshold
- the first preset distance threshold is L max ; the second preset distance threshold is L max /3; the preset speed threshold L max /1.25; where L max is the abduction length of the robot The maximum value.
- a human body safety assessment system in human-machine collaboration including:
- the first acquisition module is used to acquire the pose of the human body in the global coordinate system
- the second acquisition module is used to acquire the pose of the robot in the global coordinate system
- the distance and speed determination module is used to determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system;
- the human body safety level determination module is used to determine the safety level of the human body in human-machine collaboration according to the distance between the human body and the robot and the movement speed of the robot.
- the first obtaining module specifically includes:
- the first posture relationship and the second posture relationship acquisition unit are used to acquire the first posture relationship between the human body base coordinate system and the global coordinate system and the second posture relationship between the inertial measurement unit coordinate system and the global coordinate system;
- the third posture relationship determining unit is configured to determine a third posture relationship between the basic coordinate system of the human body and the coordinate system of the inertial measurement unit according to the first posture relationship and the second posture relationship; wherein, Is the first posture relationship, Is the second posture relationship, Is the third posture relationship, G is the global coordinate system, B is the human body base coordinate system, and S is the inertial measurement unit coordinate system;
- the origin determining unit of the human body base coordinate system is used to select the ankle on the side where the human foot touches the ground when the human body is walking as the origin of the human body base coordinate system;
- the origin of the human body base coordinate system is the left ankle of the human body and the right of the human body Switch between ankles;
- the first rotation matrix acquisition unit is used to acquire the first rotation matrix measured by the first inertial measurement unit; there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left forearm, right forearm, and Left forearm, right forearm, left thigh, right thigh, left calf, right calf, left instep and right instep;
- the posture determination unit of the human body in the global coordinate system is used to determine the position of the human body according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship.
- the second acquiring module specifically includes:
- the base coordinate acquisition unit is used to acquire the coordinates of the robot base in the global coordinate system
- the second rotation matrix obtaining unit is used to obtain the second rotation matrix measured by the second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot;
- the pose determination unit of the robot in the global coordinate system is configured to determine the pose of the robot in the global coordinate system according to the coordinates of the robot base in the global coordinate system and the second rotation matrix.
- the present invention discloses the following technical effects:
- the robot and the operator wear the inertial measurement unit, the collaborative robot works according to a predetermined trajectory, and the operator cooperates with the collaborative robot.
- the inertial measurement unit collects the movement of the robot and the human body. According to the data, the distance between the human body and the robot and the speed of the robot are calculated based on the collected data. This data is used to evaluate the degree of cooperation between the collaborative robot and the human body and the safety of the personnel.
- the present invention determines the current safety state of the human body by monitoring the distance between the robot and the human body and the running speed of the robot, and makes the next work plan according to the different safety states, effectively avoiding dangerous situations and enabling the human-machine Collaboration is safer and more efficient.
- Figure 1 is a schematic diagram of a test system scenario provided by an embodiment of the present invention.
- FIG. 2 is a schematic diagram of the placement of a human inertial measurement unit provided by an embodiment of the present invention
- FIG. 3 is a sequence diagram for estimating the whole body posture when the left foot of a human body touches the ground according to an embodiment of the present invention
- FIG. 4 is a sequence diagram of estimating the whole body posture when the right foot of the human body touches the ground according to an embodiment of the present invention
- Fig. 5 is a schematic diagram of the placement of the robot inertial measurement unit provided by the embodiment of the present invention.
- the purpose of the present invention is to provide a method and system for evaluating human body safety in human-machine collaboration, so as to make human-machine collaboration safer and more efficient.
- both the robot and the operator wear an inertial measurement unit (IMU) suit.
- IMU inertial measurement unit
- the collaborative robot works according to a predetermined trajectory, and the operator cooperates with the collaborative robot.
- multiple inertial measurement units first collect the rotation matrix of the robot and the human body, then filter the rotation matrix, and then use the positive kinematics function to obtain the position information and movement posture of the robot and the human body, and finally calculate the human body and the robot Evaluation parameters such as the distance between the robot and the robot's movement speed, to evaluate the degree of cooperation between the collaborative robot and the personnel and the safety of the personnel.
- the rotation matrix is filtered to make the obtained rotation matrix more accurate, and then the positive kinematics function is used to determine the position of each joint of the human body and the posture of each torso, as well as the position of each joint of the robot and the posture of each link, thereby obtaining The position information and movement posture of the robot and the human body, and finally the evaluation parameters such as the distance between the human body and the robot and the movement speed of the robot are calculated, and the degree of cooperation between the collaborative robot and the personnel and the safety of the personnel are evaluated.
- the present invention is a method for evaluating human body safety in human-machine collaboration, including:
- S3 Determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system.
- S4 Determine the safety level of the human body in the human-robot collaboration according to the distance between the human body and the robot and the movement speed of the robot.
- S1 specifically includes:
- the established human base coordinate system is consistent with the posture of the global coordinate system.
- the posture relationship between the basic coordinate system of the human body and the global coordinate system is expressed as
- the posture relationship between the inertial measurement unit coordinate system and the global coordinate system is expressed as
- the posture relationship between the basic coordinate system of the human body and the coordinate system of the inertial measurement unit is expressed as Through the transformation between coordinate systems:
- S15 Determine the pose of the human body in the global coordinate system according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship.
- the placement position of the human inertial measurement unit is shown in Figure 2.
- the first inertial measurement unit and the second inertial measurement unit used are both XSENS MTwAwinda, and the ankle at rest when walking is selected as the origin of the basic coordinate system of the human body.
- the origin of the basic coordinate system of the human body is switched between the left and right feet.
- the position of the pelvis is calculated by the ankle position, and then the posture of each torso of the whole body is calculated according to the position of the pelvis; 5 inertial measurement units are placed on the upper body, respectively.
- the position of the inertial measurement unit placed on the human body is not fixed. Changes.
- each inertial measurement unit is associated with a body part with a predefined coordinate system. Use it for real-time motion capture.
- the posture of the human body The length of the limbs of the human body is determined and known. After the inertial measurement unit is calibrated, it is placed on the torso of the human body. The initial state is when the human body is upright and stationary. When a person walks, he always keeps one foot touching the ground, and the ankle on that side is taken as the origin of the basic coordinate system of the human body. When the human body is stationary, the rotation matrix between the coordinate system of each inertial measurement unit and its reference coordinate system is the unit matrix; When the human body moves, through the quaternion ( ⁇ 1 , ⁇ 2 , ⁇ 3 , ⁇ 4 ) returned by the inertial measurement unit, the posture and position information of each torso of the body can be obtained in real time.
- the sequence of calculating the whole body posture when the left foot touches the ground is shown in Fig. 3, and the sequence of calculating the whole body posture when the right foot touches the ground is shown in Fig. 4.
- the left ankle human body base coordinate system (left ankle coordinate system) is used as the reference coordinate system of the left calf. It is known that when the human body is stationary, the coordinates of the left knee in the human body base coordinate system are
- the rotation matrix R ⁇ 1 represented by the quaternion measured by the first inertial measurement unit at the left calf is:
- the coordinate system is established with the left knee as the origin of the coordinate system, and the posture of the coordinate system is consistent with the basic coordinate system of the human body, and this coordinate system is used as the reference coordinate system for the movement of the left thigh inertial measurement unit.
- the rotation matrix between the coordinate system of the left thigh inertial measurement unit and the coordinate system of the left knee be the unit matrix.
- the coordinates of the left hip joint are The posture and position information of the left thigh can be obtained in real time through the rotation matrix R ⁇ 2 represented by the quaternion returned by the left thigh inertial measurement unit.
- the coordinate system is established with the left hip joint as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body. Assuming that the posture of the pelvis does not change during the movement of the person, the position of the pelvis in the coordinate system of the left hip joint is fixed At the same time, the position of the pelvis in the basic coordinate system of the human body can be obtained.
- the coordinate system is established with the center of the pelvis as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the position of the right hip joint in the pelvic coordinate system is fixed, and the right hip joint can be obtained in the basic coordinate system of the human body. s position.
- the distance from the left hip joint to the pelvis and the distance from the right hip joint to the pelvis of the same person are already available. According to the distance and the coordinates of the left hip joint position, the pelvic coordinates and the coordinates of the right hip joint can be obtained.
- the coordinate system is established with the right hip joint as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the right hip joint coordinate system is used as the reference coordinate system of the right thigh inertial measurement unit.
- the right thigh inertial measurement unit coordinates are set
- the rotation matrix between the right hip joint coordinate system and the right hip joint coordinate system is the unit matrix.
- the rotation matrix represented by the quaternion returned by the right thigh inertial measurement unit can be used to obtain the right thigh posture and position in real time According to the coordinate transformation, the coordinates of the right knee position in the basic coordinate system of the human body are obtained.
- the coordinate system is established with the right knee as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the coordinate system of the right knee is used as the reference coordinate system of the right calf inertial measurement unit.
- the coordinate system of the right calf inertial measurement unit and The rotation matrix between the right knee coordinate system is the unit matrix.
- the rotation matrix represented by the quaternion returned by the right calf inertial measurement unit can be used to obtain the right calf posture and position information in real time, according to the coordinates Transform to obtain the position coordinates of the right ankle in the basic coordinate system of the human body.
- the pelvic coordinate system is used as the upper body torso reference coordinate system.
- the rotation matrix between the upper body torso inertial measurement unit coordinate system and the pelvic coordinate system is the unit matrix.
- the upper body The rotation matrix represented by the quaternion returned by the torso inertial measurement unit can obtain the posture and position information of the upper body torso in real time.
- the shoulder position coordinates in the basic coordinate system of the human body can be obtained.
- the coordinate system is established with the shoulder as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the shoulder coordinate system is used as the reference coordinate system of the boom movement, and the rotation matrix represented by the quaternion returned by the boom inertial measurement unit ,
- the posture and position information of the forearm can be obtained in real time, and the position coordinates of the elbow in the basic coordinate system of the human body can be obtained according to the coordinate transformation.
- the coordinate system is established with the elbow as the origin of the coordinate system.
- the posture of the coordinate system is consistent with the basic coordinate system of the human body.
- the elbow coordinate system is used as the reference coordinate system for the forearm movement, which is expressed by the quaternion returned by the forearm inertial measurement unit.
- the rotation matrix can obtain the posture and position information of the forearm in real time, and obtain the position coordinates of the wrist in the basic coordinate system of the human body according to the coordinate transformation.
- the complete posture of the human body in the basic coordinate system of the human body and the position coordinates of each joint are obtained.
- the complete posture of the human body in the global coordinate system and the position coordinates of each joint can be obtained.
- S2 specifically includes:
- S21 Obtain the coordinates of the robot base in the global coordinate system; the base is the base on which the robot touches the ground. Specifically, the position of the robot base in the global coordinate system is fixed, and the center of the base is the origin of the global coordinate system, and the posture of the coordinate system is consistent with the global coordinate system. The base coordinate system is established, and the center of the base is in the global coordinate system. The coordinates below are obtained from actual measurements.
- S22 Obtain a second rotation matrix measured by a second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot.
- IMU1 is placed on the base of the robot, and the remaining 5 IMUs are placed on each link of the robot.
- the remaining 5 IMUs are IMU2, IMU3, IMU4, IMU5, and IMU6.
- S23 Determine the pose of the robot in the global coordinate system according to the coordinates of the robot base in the global coordinate system and the second rotation matrix.
- the placement position of the inertial measurement unit on the robot is shown in Figure 5.
- the example of the present invention selects a 6-degree-of-freedom manipulator, and places an inertial measurement unit on the base and each link to obtain the posture of the manipulator. information.
- the above-mentioned method of obtaining the posture of the upper body of the human body is also applicable to obtaining the posture of the mechanical arm, and will not be repeated. In this way, the posture of the robot in the global coordinate system is obtained.
- S3 specifically includes:
- S31 Determine a set of distances between the human body and the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system; the distance set includes each torso in the human body.
- the distance between the connecting rod and the robot; the human body torso includes the upper body torso, the left big arm, the right big arm, the left forearm, the right forearm, the left thigh, the right thigh, the left calf and the right calf.
- S32 Select the minimum value in the distance set as the distance between the human body and the robot.
- S33 Determine the movement speed of the robot according to the distance between the human body and the robot.
- the torso of the human body and the links of the robotic arm are regarded as cylinders in space, and the shortest distance between the cylinders is solved by mathematical formulas.
- each part of the torso of the human body is regarded as a cylinder, and each connecting rod of the robot is regarded as a cylinder, and the shortest distance between the cylinders is solved by a mathematical formula.
- H x b- x a
- I y b -y a
- J z b- z a
- K X d- x c
- L y d -y c
- M z d- z c
- intersection point F(x F ,y F ,z F ) of the common perpendicular and the straight line AB can be obtained.
- the distance between the two cylinders is the difference between the distance between the central axes of the two cylinders and the radii of the two cylinders, that is, the distance between the central axes of the two cylinders minus the radii of the two cylinders.
- S4 specifically includes:
- the distance threshold and the speed threshold are determined according to the abduction distance of the robot, the length of the installed tool, the working performance of the robot, and a priori experience.
- the first preset distance threshold is L max
- the second preset distance threshold is L max /3
- L max is the maximum abduction length of the robot
- the second preset distance threshold is one third of the maximum abduction length of the robot, that is, 0.33L max
- the reaction ability parameter of a normal person is 1.25 seconds. That is, it takes 0.5 seconds to find that there is a target in the front to reflect the brain, and it takes 0.75 seconds to take measures from the brain to the hands and feet.
- the current safety state of the human body can be determined by monitoring the distance between the robot and the human body and the running speed of the robot, and make the next work plan according to different safety states, effectively avoiding dangerous situations. Make human-machine collaboration safer and more efficient.
- the present invention also provides a human body safety assessment system in human-machine collaboration, including:
- the first acquisition module is used to acquire the pose of the human body in the global coordinate system.
- the second acquisition module is used to acquire the pose of the robot in the global coordinate system.
- the distance and speed determination module is used to determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system.
- the human body safety level determination module is used to determine the safety level of the human body in human-machine collaboration according to the distance between the human body and the robot and the movement speed of the robot.
- the first acquisition module specifically includes:
- the first posture relationship and the second posture relationship acquisition unit are used to acquire the first posture relationship between the human body base coordinate system and the global coordinate system and the second posture relationship between the inertial measurement unit coordinate system and the global coordinate system.
- the third posture relationship determining unit is configured to determine a third posture relationship between the basic coordinate system of the human body and the coordinate system of the inertial measurement unit according to the first posture relationship and the second posture relationship; wherein, Is the first posture relationship, Is the second posture relationship, Is the third posture relationship, G is the global coordinate system, B is the human body base coordinate system, and S is the inertial measurement unit coordinate system.
- the origin determination unit of the human body base coordinate system is used to select the ankle on the side where the human foot touches the ground as the origin of the human body base coordinate system when the human body is walking; the origin of the human body base coordinate system is the left ankle of the human body and the right of the human body Switch between ankles.
- the first rotation matrix acquisition unit is used to acquire the first rotation matrix measured by the first inertial measurement unit; there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left forearm, and right forearm of the human body. Left forearm, right forearm, left thigh, right thigh, left calf, right calf, left instep and right instep.
- the posture determination unit of the human body in the global coordinate system is used to determine the position of the human body according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship.
- the first acquisition module specifically includes:
- the calibration unit is used to calibrate the inertial measurement unit to obtain the coordinate transformation matrix between the inertial measurement unit coordinate system and its corresponding human body coordinate system.
- the data receiving unit is used to receive the quaternion and angular velocity returned by the inertial measurement unit.
- the pose acquisition unit is used to obtain the posture and position coordinates of the human body in the basic coordinate system of the human body according to the obtained angular velocity and quaternion of each inertial measurement unit.
- the coordinate conversion unit is used to convert the position coordinates of the human body in the basic human body coordinate system into the position coordinates of the human body in the global coordinate system.
- the second acquisition module specifically includes:
- the base coordinate acquisition unit is used to acquire the coordinates of the robot base in the global coordinate system.
- the second rotation matrix obtaining unit is used to obtain the second rotation matrix measured by the second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot.
- the pose determination unit of the robot in the global coordinate system is configured to determine the pose of the robot in the global coordinate system according to the coordinates of the robot base in the global coordinate system and the second rotation matrix.
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Manipulator (AREA)
Abstract
Description
本申请要求于2019年12月11日提交中国专利局、申请号为201911262776.X、发明名称为“人机协作中人体安全评估方法及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 11, 2019, the application number is 201911262776.X, and the invention title is "Human Body Safety Evaluation Method and System in Human-Machine Cooperation", the entire content of which is incorporated by reference Incorporated in this application.
本发明涉及人机协作领域,特别是涉及在协作型机器人与人协作过程中的人体安全评估方法及系统。The present invention relates to the field of human-machine cooperation, in particular to a method and system for human body safety assessment in the process of collaborative robot and human cooperation.
机器人行业的快速发展对人与机器人密切协作提出了新要求,逐渐催生出协作型机器人。传统工业机器人设计有围栏隔离,在机器人工作时不允许工作人员进入,或者在工作人员进入时,机器人必须停止工作,这种方法不仅浪费工作空间,而且降低了整体的工作效率。而协作型机器人,可以实现与人协同工作,不再需要防护栏进行隔离,将人的“知识、分析、决策”能力与机器人的“力量、精度、可重复性”结合在一起。协作型机器人与人共同处于同一工作空间,协作等级不断加强,二者紧密协调,不仅节省了工作空间,而且大大提高了工作效率,并且在确保人员安全的前提下,机器人能够自主提高技能,实现与人自然交互协作。The rapid development of the robotics industry has put forward new requirements for the close collaboration between humans and robots, and gradually gave birth to collaborative robots. Traditional industrial robots are designed with fence isolation. Workers are not allowed to enter when the robot is working, or the robot must stop working when the worker enters. This method not only wastes working space, but also reduces the overall work efficiency. Collaborative robots can work collaboratively with humans, without the need for barriers to isolate them, and combine human "knowledge, analysis, and decision-making" capabilities with robots' "power, precision, and repeatability". Collaborative robots and humans are in the same working space. The level of collaboration is continuously strengthened. The two are closely coordinated, which not only saves working space, but also greatly improves work efficiency. On the premise of ensuring the safety of personnel, robots can independently improve their skills and achieve Naturally interact and collaborate with people.
根据阿西莫夫机器人三定律,不管何种机器人,在任何情况和环境下都不应伤害人类及机器人自身,所以安全性是机器人在人类生产生活领域应用的首要问题和强制性约束,但机器人本身并没有安全意识,人与机器人协同工作时如果发生碰撞,处于弱势地位的操作人员安全隐患相对较大,所以必须针对协作机器人可能出现的各个风险点,进行充分的安全评估,制定相应的保护措施来确保操作人员的安全。According to Asimov’s Three Laws of Robotics, no matter what kind of robot, it should not harm humans and the robot itself under any situation and environment. Therefore, safety is the primary problem and mandatory constraint for the application of robots in the field of human production and life. There is no sense of safety in itself. If a collision occurs when humans and robots work together, operators in a disadvantaged position will have relatively greater safety risks. Therefore, it is necessary to conduct adequate safety assessments and formulate corresponding protections for each possible risk point of collaborative robots. Measures to ensure the safety of operators.
目前存在的人机协作中人体安全评估方法,只通过计算机器人与人体之间的距离来判断人体的安全状况,而忽略机器人的运动速度这一重要参数对人体安全的影响,造成了人机协作中人体安全评估不准确、特定风险无法排查等现象。The existing human-machine safety assessment methods in human-machine collaboration only judge the safety of the human body by calculating the distance between the robot and the human body, while ignoring the impact of the robot's movement speed, an important parameter, on human safety, resulting in human-machine collaboration. China's human safety assessment is inaccurate, and specific risks cannot be investigated.
发明内容Summary of the invention
本发明提供一种人机协作中人体安全评估方法及系统,在人机协作中 使人机协作更安全更高效。The present invention provides a method and system for evaluating human body safety in man-machine collaboration, which makes man-machine collaboration safer and more efficient in man-machine collaboration.
为实现上述目的,本发明提供一种人机协作中人体安全评估方法,包括:In order to achieve the above objective, the present invention provides a human body safety assessment method in human-machine collaboration, including:
获取人体在全局坐标系下的位姿;Get the pose of the human body in the global coordinate system;
获取机器人在全局坐标系下的位姿;Obtain the pose of the robot in the global coordinate system;
根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离以及机器人的运动速度;Determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system;
根据所述人体与机器人之间的距离和所述机器人的运动速度,确定人机协作中人体的安全等级。According to the distance between the human body and the robot and the movement speed of the robot, the safety level of the human body in the human-robot collaboration is determined.
可选的,所述获取人体在全局坐标系下的位姿,具体包括:Optionally, the acquiring the pose of the human body in the global coordinate system specifically includes:
获取人体基坐标系与全局坐标系之间的第一姿态关系 以及惯性测量单元坐标系与全局坐标系之间的第二姿态关系 Obtain the first posture relationship between the human base coordinate system and the global coordinate system And the second attitude relationship between the inertial measurement unit coordinate system and the global coordinate system
根据所述第一姿态关系和所述第二姿态关系确定人体基坐标系与惯性测量单元坐标系之间的第三姿态关系 其中, 为第一姿态关系, 为第二姿态关系, 为第三姿态关系,G为全局坐标系,B为人体基坐标系,S为惯性测量单元坐标系; Determine the third posture relationship between the human body base coordinate system and the inertial measurement unit coordinate system according to the first posture relationship and the second posture relationship among them, Is the first posture relationship, Is the second posture relationship, Is the third posture relationship, G is the global coordinate system, B is the human body base coordinate system, and S is the inertial measurement unit coordinate system;
选取人体行走时,人体脚触地所在侧的脚踝为所述人体基坐标系的原点;所述人体基坐标系的原点在人体的左脚踝和人体的右脚踝之间切换;When the human body is selected to walk, the ankle on the side where the human foot touches the ground is the origin of the human body base coordinate system; the origin of the human body base coordinate system is switched between the human body's left ankle and the human body's right ankle;
获取利用第一惯性测量单元测量的第一旋转矩阵;所述第一惯性测量单元为多个,分别设置于人体的上身躯干、左大臂、右大臂、左小臂、右小臂、左大腿、右大腿、左小腿、右小腿、左脚背和右脚背;Obtain the first rotation matrix measured by the first inertial measurement unit; there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left forearm, right forearm, left forearm, right forearm, and left of the human body. Thigh, right thigh, left calf, right calf, left instep and right instep;
根据所述人体基坐标系的原点、所述第一旋转矩阵和所述第三姿态关系,确定人体在全局坐标系下的位姿。According to the origin of the basic coordinate system of the human body, the first rotation matrix and the third posture relationship, the posture of the human body in the global coordinate system is determined.
可选的,所述根据所述人体基坐标系的原点、所述第一旋转矩阵和所述第三姿态关系,确定人体在全局坐标系下的位姿,具体包括:Optionally, the determining the pose of the human body in the global coordinate system according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship specifically includes:
在开始运动之前,人体保持校准姿势,校准过程为:在所有的第一惯性测量单元上进行,每个所述第一惯性测量单元都与一个具有预定义的坐标系的身体部分相关联,将关联后的第一惯性测量单元用于实时运动捕捉中;Before starting to move, the human body maintains a calibration posture. The calibration process is carried out on all the first inertial measurement units, each of which is associated with a body part with a predefined coordinate system. The associated first inertial measurement unit is used in real-time motion capture;
获取人体在人体基坐标系下的位姿:人体肢体长度是确定已知的,将关联后的第一惯性测量单元放置在人体的上身躯干,以人体直立静止时为初始状态;人在行走时,总会保持一只脚触地,取该侧脚踝为人体基坐标系原点,人体静止时,令每个第一惯性测量单元坐标系与参照坐标系之间的第一旋转矩阵为单位矩阵,人体运动时,通过第一惯性测量单元返回的四元数(ε 1,ε 2,ε 3,ε 4),实时得到人体每一躯干的姿态以及位置信息; Obtain the position and posture of the human body in the basic coordinate system of the human body: the length of the human body limb is determined and known, and the first inertial measurement unit after the association is placed on the upper torso of the human body, and the initial state is when the human body is upright and stationary; when the human is walking , Always keep one foot touching the ground, and take that side ankle as the origin of the human body base coordinate system. When the human body is stationary, let the first rotation matrix between each first inertial measurement unit coordinate system and the reference coordinate system be the identity matrix, When the human body moves, through the quaternion (ε 1 , ε 2 , ε 3 , ε 4 ) returned by the first inertial measurement unit, the posture and position information of each torso of the human body can be obtained in real time;
左脚触地时,左脚踝人体基坐标系作为左小腿的参照坐标系,已知人体静止时,在人体基坐标系中左膝盖的坐标为 通过左小腿处的第一惯性测量单元测量的第一旋转矩阵R ε1为: When the left foot touches the ground, the base coordinate system of the left ankle is used as the reference coordinate system of the left calf. It is known that when the human body is stationary, the coordinates of the left knee in the base coordinate system of the human body are The first rotation matrix R ε1 measured by the first inertial measurement unit at the left calf is:
则人体姿态发生变换后的左膝盖坐标为:P′ L1=R ε1P L1; Then the coordinates of the left knee after the transformation of the human body posture is: P′ L1 = R ε1 P L1 ;
以左膝盖为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,并以左膝盖为坐标系原点建立的坐标系作为左大腿处的第一惯性测量单元运动的参照坐标系;人体静止时,令左大腿处的第一惯性测量单元坐标系与左膝盖坐标系之间的第一旋转矩阵为单位矩阵,在左膝盖坐标系中,左髋关节的坐标为 通过左大腿处的第一惯性测量单元传回的四元数表示的第一旋转矩阵R ε2,实时得到左大腿的姿态以及位置信息; The coordinate system is established with the left knee as the origin of the coordinate system, and the posture of the coordinate system is consistent with the basic coordinate system of the human body, and the coordinate system established with the left knee as the origin of the coordinate system is used as the reference coordinate system for the movement of the first inertial measurement unit at the left thigh; When at rest, let the first rotation matrix between the first inertial measurement unit coordinate system at the left thigh and the left knee coordinate system be the identity matrix. In the left knee coordinate system, the coordinates of the left hip joint are Obtain the posture and position information of the left thigh in real time through the first rotation matrix R ε2 expressed by the quaternion returned by the first inertial measurement unit at the left thigh;
则人体姿态发生变换后的左髋关节坐标为:P′ L2=R ε2P L2; Then the coordinates of the left hip joint after the posture of the human body is transformed are: P′ L2 = R ε2 P L2 ;
根据所述人体姿态发生变换后的左髋关节坐标和所述人体姿态发生变换后的左膝盖坐标,得到左髋关节在人体基坐标系下的坐标:P″ L2=P′ L1+P′ L2; According to the coordinates of the left hip joint after the transformation of the human body posture and the coordinates of the left knee after the transformation of the human body posture, the coordinates of the left hip joint in the basic human body coordinate system are obtained: P″ L2 = P′ L1 + P′ L2 ;
以左髋关节为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,假设人在移动过程中,盆骨的姿态不发生变化,则盆骨在左髋关节坐 标系中的位置固定,同时得盆骨在人体基坐标系中的位置;The coordinate system is established with the left hip joint as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. Assuming that the posture of the pelvis does not change during the movement of the person, the position of the pelvis in the coordinate system of the left hip joint is fixed , And get the position of the pelvis in the basic coordinate system of the human body at the same time;
以盆骨中心作为坐标系的原点建立坐标系,坐标系姿态与人体基坐标系一致,右髋关节在盆骨坐标系中的位置固定不变,得到右髋关节在人体基坐标系中的位置;The coordinate system is established with the center of the pelvis as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The position of the right hip joint in the pelvic coordinate system is fixed, and the position of the right hip joint in the basic coordinate system of the human body is obtained. ;
以右髋关节为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,以右髋关节坐标系作为右大腿处第一惯性测量单元的参照坐标系,人体静止时,令右大腿处第一惯性测量单元坐标系与右髋关节坐标系之间的第一旋转矩阵为单位矩阵,在右髋关节坐标系中,通过右大腿处的第一惯性测量单元传回的四元数表示的第一旋转矩阵,实时得到右大腿的姿态以及位置信息,根据坐标变换,获得人体基坐标系下右膝盖位置坐标;The coordinate system is established with the right hip joint as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The coordinate system of the right hip joint is used as the reference coordinate system of the first inertial measurement unit at the right thigh. The first rotation matrix between the coordinate system of the first inertial measurement unit and the coordinate system of the right hip joint is the unit matrix. In the coordinate system of the right hip joint, it is represented by the quaternion returned by the first inertial measurement unit at the right thigh. The first rotation matrix obtains the posture and position information of the right thigh in real time, and obtains the position coordinates of the right knee in the basic coordinate system of the human body according to the coordinate transformation;
以右膝盖为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,以右膝盖坐标系作为右小腿处第一惯性测量单元的参照坐标系,人体静止时,令右小腿处第一惯性测量单元坐标系与右膝盖坐标系之间的第一旋转矩阵为单位矩阵,在右膝盖坐标系中,通过右小腿处的第一惯性测量单元传回的四元数表示的第一旋转矩阵,得到右小腿的姿态以及位置信息,根据坐标变换,获得人体基坐标系下右脚踝位置坐标;The coordinate system is established with the right knee as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The coordinate system of the right knee is used as the reference coordinate system of the first inertial measurement unit at the right calf. When the human body is stationary, the right calf is the first The first rotation matrix between the inertial measurement unit coordinate system and the right knee coordinate system is the unit matrix. In the right knee coordinate system, the first rotation matrix expressed by the quaternion returned by the first inertial measurement unit at the right calf , Obtain the posture and position information of the right calf, and obtain the position coordinates of the right ankle in the basic coordinate system of the human body according to the coordinate transformation;
右脚触地时,以右脚踝为原点,建立人体基坐标系,腿关节坐标系建立方法同上;When the right foot touches the ground, use the right ankle as the origin to establish the basic coordinate system of the human body. The method of establishing the coordinate system of the leg joints is the same as above;
同时,以盆骨坐标系作为上身躯干的参照坐标系,人体静止时,令上身躯干惯性测量单元坐标系与盆骨坐标系之间的第一旋转矩阵为单位矩阵,在盆骨坐标系中,通过上身躯干处第一惯性测量单元传回的四元数表示的第一旋转矩阵,实时得到上身躯干的姿态以及位置信息,根据坐标变换,获得人体基坐标系下的肩膀位置坐标;At the same time, the pelvic coordinate system is used as the reference coordinate system of the upper body torso. When the human body is stationary, the first rotation matrix between the upper body torso inertial measurement unit coordinate system and the pelvic coordinate system is the identity matrix. In the pelvic coordinate system, Through the first rotation matrix represented by the quaternion returned by the first inertial measurement unit of the upper body torso, the posture and position information of the upper body torso are obtained in real time, and the shoulder position coordinates in the basic coordinate system of the human body are obtained according to the coordinate transformation;
以肩膀为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,并将肩膀坐标系作为大臂运动的参照坐标系,通过大臂处第一惯性测量单元传回的四元数表示的第一旋转矩阵,实时得到大臂的姿态以及位置信息,根据坐标变换,获得人体基坐标系下手肘的位置坐标;The coordinate system is established with the shoulder as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body, and the shoulder coordinate system is used as the reference coordinate system for the movement of the boom, which is expressed by the quaternion returned by the first inertial measurement unit at the boom The first rotation matrix of, obtains the posture and position information of the boom in real time, and obtains the position coordinates of the elbow in the basic coordinate system of the human body according to the coordinate transformation;
以手肘为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,并将手肘坐标系作为小臂运动的参照坐标系,通过小臂处第一惯性测量单元传回的四元数表示的第一旋转矩阵,实时得到小臂的姿态以及位置信 息,根据坐标变换,获得人体基坐标系下手腕的位置坐标;The coordinate system is established with the elbow as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The elbow coordinate system is used as the reference coordinate system for the forearm movement, and the quaternion is returned by the first inertial measurement unit at the forearm. The first rotation matrix represented by the number, obtains the posture and position information of the forearm in real time, and obtains the position coordinates of the wrist in the basic coordinate system of the human body according to the coordinate transformation;
从而获得人体在人体基坐标系下的完整姿态以及各个关节的位置坐标;通过人体基坐标系和全局坐标系之间的第三姿态关系,得到全局坐标系下的人体完整姿态以及各个关节的位置坐标。In order to obtain the complete posture of the human body in the human body base coordinate system and the position coordinates of each joint; through the third posture relationship between the human base coordinate system and the global coordinate system, the complete posture of the human body and the position of each joint in the global coordinate system are obtained coordinate.
可选的,所述获取机器人在全局坐标系下的位姿,具体包括:Optionally, the acquiring the pose of the robot in the global coordinate system specifically includes:
获取全局坐标系下机器人基座的坐标;Obtain the coordinates of the robot base in the global coordinate system;
获取利用第二惯性测量单元测量的第二旋转矩阵;所述第二惯性测量单元为多个,分别设置于机器人的基座和连杆上;Acquiring a second rotation matrix measured by a second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot;
根据所述全局坐标系下机器人基座的坐标和所述第二旋转矩阵,确定机器人在全局坐标系下的位姿。According to the coordinates of the robot base in the global coordinate system and the second rotation matrix, the pose of the robot in the global coordinate system is determined.
可选的,所述根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离以及机器人的运动速度,具体包括:Optionally, the determining the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system specifically includes:
根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离集合;所述距离集合中包括人体中每个人体躯干分别与机器人连杆之间的距离;所述人体躯干包括上身躯干、左大臂、右大臂、左小臂、右小臂、左大腿、右大腿、左小腿和右小腿;According to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system, determine the distance set between the human body and the robot; the distance set includes each human body in the human body and the robot respectively The distance between the connecting rods; the human body torso includes upper body torso, left big arm, right big arm, left forearm, right forearm, left thigh, right thigh, left calf and right calf;
选取所述距离集合中最小值作为人体与机器人之间的距离;Selecting the minimum value in the distance set as the distance between the human body and the robot;
根据所述人体与机器人之间的距离确定机器人的运动速度。The movement speed of the robot is determined according to the distance between the human body and the robot.
可选的,所述根据所述人体与机器人之间的距离和所述机器人的运动速度,确定人机协作中人体的安全等级,具体包括:Optionally, the determining the safety level of the human body in human-robot collaboration according to the distance between the human body and the robot and the movement speed of the robot specifically includes:
当所述人体与机器人之间的距离大于第一预设距离阈值且所述机器人的运动速度小于预设速度阈值时,确定人体处于第一安全状态;When the distance between the human body and the robot is greater than the first preset distance threshold and the movement speed of the robot is less than the preset speed threshold, determining that the human body is in the first safe state;
当所述人体与机器人之间的距离大于第一预设距离阈值且机器人速度大于或等于预设速度阈值时,确定人体处于第二安全状态;When the distance between the human body and the robot is greater than the first preset distance threshold and the robot speed is greater than or equal to the preset speed threshold, determining that the human body is in the second safe state;
当所述人体与机器人之间的距离大于第二预设距离阈值且所述人体与机器人之间的距离小于或等于第一预设距离阈值且所述机器人的运动速度小于预设速度阈值时,确定人体处于第二安全状态;所述第一预设距离阈值大于所述第二预设距离阈值;When the distance between the human body and the robot is greater than the second preset distance threshold, the distance between the human body and the robot is less than or equal to the first preset distance threshold, and the movement speed of the robot is less than the preset speed threshold, Determining that the human body is in a second safe state; the first preset distance threshold is greater than the second preset distance threshold;
当所述人体与机器人之间的距离大于第二预设距离阈值且所述人体与机器人之间的距离小于或等于第一预设距离阈值且所述机器人的运动速度大于或等于预设速度阈值时,确定人体处于第二危险状态;When the distance between the human body and the robot is greater than a second preset distance threshold, the distance between the human body and the robot is less than or equal to the first preset distance threshold, and the movement speed of the robot is greater than or equal to the preset speed threshold At the time, it is determined that the human body is in the second dangerous state;
当所述人体与机器人之间的距离小于或等于第二预设距离阈值且所述机器人的运动速度小于预设速度阈值时,确定人体处于第二危险状态;When the distance between the human body and the robot is less than or equal to the second preset distance threshold and the movement speed of the robot is less than the preset speed threshold, it is determined that the human body is in the second dangerous state;
当所述人体与机器人之间的距离小于或等于第二预设距离阈值且所述机器人的运动速度大于或等于预设速度阈值时,确定人体处于第一危险状态。When the distance between the human body and the robot is less than or equal to the second preset distance threshold and the movement speed of the robot is greater than or equal to the preset speed threshold, it is determined that the human body is in the first dangerous state.
可选的,所述第一预设距离阈值为L max;所述第二预设距离阈值为L max/3;所述预设速度阈值L max/1.25;其中,L max为机器人外展长度的最大值。 Optionally, the first preset distance threshold is L max ; the second preset distance threshold is L max /3; the preset speed threshold L max /1.25; where L max is the abduction length of the robot The maximum value.
一种人机协作中人体安全评估系统,包括:A human body safety assessment system in human-machine collaboration, including:
第一获取模块,用于获取人体在全局坐标系下的位姿;The first acquisition module is used to acquire the pose of the human body in the global coordinate system;
第二获取模块,用于获取机器人在全局坐标系下的位姿;The second acquisition module is used to acquire the pose of the robot in the global coordinate system;
距离和速度确定模块,用于根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离以及机器人的运动速度;The distance and speed determination module is used to determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system;
人体安全等级确定模块,用于根据所述人体与机器人之间的距离和所述机器人的运动速度,确定人机协作中人体的安全等级。The human body safety level determination module is used to determine the safety level of the human body in human-machine collaboration according to the distance between the human body and the robot and the movement speed of the robot.
可选的,所述第一获取模块具体包括:Optionally, the first obtaining module specifically includes:
第一姿态关系和第二姿态关系获取单元,用于获取人体基坐标系与全局坐标系之间的第一姿态关系以及惯性测量单元坐标系与全局坐标系之间的第二姿态关系;The first posture relationship and the second posture relationship acquisition unit are used to acquire the first posture relationship between the human body base coordinate system and the global coordinate system and the second posture relationship between the inertial measurement unit coordinate system and the global coordinate system;
第三姿态关系确定单元,用于根据所述第一姿态关系和所述第二姿态关系确定人体基坐标系与惯性测量单元坐标系之间的第三姿态关系;其中, 为第一姿态关系, 为第二姿态关系, 为第三姿态关系,G为全局坐标系,B为人体基坐标系,S为惯性测量单元坐标系; The third posture relationship determining unit is configured to determine a third posture relationship between the basic coordinate system of the human body and the coordinate system of the inertial measurement unit according to the first posture relationship and the second posture relationship; wherein, Is the first posture relationship, Is the second posture relationship, Is the third posture relationship, G is the global coordinate system, B is the human body base coordinate system, and S is the inertial measurement unit coordinate system;
人体基坐标系原点确定单元,用于选取人体行走时,人体脚触地所在 侧的脚踝为所述人体基坐标系的原点;所述人体基坐标系的原点在人体的左脚踝和人体的右脚踝之间切换;The origin determining unit of the human body base coordinate system is used to select the ankle on the side where the human foot touches the ground when the human body is walking as the origin of the human body base coordinate system; the origin of the human body base coordinate system is the left ankle of the human body and the right of the human body Switch between ankles;
第一旋转矩阵获取单元,用于获取利用第一惯性测量单元测量的第一旋转矩阵;所述第一惯性测量单元为多个,分别设置于人体的上身躯干、左大臂、右大臂、左小臂、右小臂、左大腿、右大腿、左小腿、右小腿、左脚背和右脚背;The first rotation matrix acquisition unit is used to acquire the first rotation matrix measured by the first inertial measurement unit; there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left forearm, right forearm, and Left forearm, right forearm, left thigh, right thigh, left calf, right calf, left instep and right instep;
人体在全局坐标系下位姿确定单元,用于根据所述人体基坐标系的原点、所述第一旋转矩阵和所述第三姿态关系。The posture determination unit of the human body in the global coordinate system is used to determine the position of the human body according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship.
可选的,所述第二获取模块具体包括:Optionally, the second acquiring module specifically includes:
基座坐标获取单元,用于获取全局坐标系下机器人基座的坐标;The base coordinate acquisition unit is used to acquire the coordinates of the robot base in the global coordinate system;
第二旋转矩阵获取单元,用于获取利用第二惯性测量单元测量的第二旋转矩阵;所述第二惯性测量单元为多个,分别设置于机器人的基座和连杆上;The second rotation matrix obtaining unit is used to obtain the second rotation matrix measured by the second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot;
机器人在全局坐标系下位姿确定单元,用于根据所述全局坐标系下机器人基座的坐标和所述第二旋转矩阵,确定机器人在全局坐标系下的位姿。The pose determination unit of the robot in the global coordinate system is configured to determine the pose of the robot in the global coordinate system according to the coordinates of the robot base in the global coordinate system and the second rotation matrix.
根据本发明提供的具体实施例,本发明公开了以下技术效果:According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects:
本发明通过设置的测试环境,机器人和操作人员均穿戴惯性测量单元,协作型机器人按照预定轨迹进行工作,操作人员与协作型机器人进行协作,在整个过程中,惯性测量单元采集机器人与人体的运动数据,根据采集到的数据计算人体和机器人之间的距离及机器人的运动速度,以此数据来评估协作型机器人与人体的协作程度及对人员的安全性。In the present invention, through the set test environment, the robot and the operator wear the inertial measurement unit, the collaborative robot works according to a predetermined trajectory, and the operator cooperates with the collaborative robot. In the whole process, the inertial measurement unit collects the movement of the robot and the human body. According to the data, the distance between the human body and the robot and the speed of the robot are calculated based on the collected data. This data is used to evaluate the degree of cooperation between the collaborative robot and the human body and the safety of the personnel.
本发明在人机协作过程中,通过监控机器人与人体之间的距离和机器人的运行速度确定当前人体的安全状态,根据不同安全状态做出下一步工作计划,有效避免危险情况发生,使人机协作更安全更高效。In the process of human-machine cooperation, the present invention determines the current safety state of the human body by monitoring the distance between the robot and the human body and the running speed of the robot, and makes the next work plan according to the different safety states, effectively avoiding dangerous situations and enabling the human-machine Collaboration is safer and more efficient.
说明书附图Attached drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the embodiments. Obviously, the drawings in the following description are only some of the present invention. Embodiments, for those of ordinary skill in the art, without creative labor, other drawings can be obtained based on these drawings.
图1为本发明实施例所提供的测试系统场景示意图;Figure 1 is a schematic diagram of a test system scenario provided by an embodiment of the present invention;
图2为本发明实施例所提供的人体惯性测量单元放置示意图;2 is a schematic diagram of the placement of a human inertial measurement unit provided by an embodiment of the present invention;
图3为本发明实施例所提供的人体左脚触地时全身姿态推算顺序图;FIG. 3 is a sequence diagram for estimating the whole body posture when the left foot of a human body touches the ground according to an embodiment of the present invention;
图4为本发明实施例所提供的人体右脚触地时全身姿态推算顺序图;4 is a sequence diagram of estimating the whole body posture when the right foot of the human body touches the ground according to an embodiment of the present invention;
图5为本发明实施例所提供的机器人惯性测量单元放置示意图。Fig. 5 is a schematic diagram of the placement of the robot inertial measurement unit provided by the embodiment of the present invention.
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
本发明的目的是提供一种人机协作中人体安全评估方法及系统,在人机协作中使人机协作更安全更高效。The purpose of the present invention is to provide a method and system for evaluating human body safety in human-machine collaboration, so as to make human-machine collaboration safer and more efficient.
为使本发明的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本发明作进一步详细的说明。In order to make the above-mentioned objects, features and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.
本发明通过设置的测试环境,机器人和操作人员均穿戴惯性测量单元(Inertialmeasurement unit,简称IMU)套装,如图1所示,协作型机器人按照预定轨迹进行工作,操作人员与协作型机器人进行协作,在整个过程中,多个惯性测量单元首先采集机器人和人体的旋转矩阵,之后对旋转矩阵进行滤波处理,然后利用正运动学函数,获取机器人和人体的位置信息及运动姿态,最后计算人体和机器人之间的距离及机器人的运动速度等评价参数,评估协作型机器人与人员的协作程度及对人员的安全性。具体的,对旋转矩阵进行滤波处理,使获取的旋转矩阵更加准确,然后利用正运动学函数确定人体各个关节的位置和各个躯干的姿态以及机器人各个关节的位置和各个连杆的姿态,从而获取机器人和人体的位置信息及运动姿态,最后计算人体和机器人之间的距离及机器人的运动速度等评价参数,评估协作型机器人与人员的协作程度及对人员的安全性。In the present invention, through the set test environment, both the robot and the operator wear an inertial measurement unit (IMU) suit. As shown in Fig. 1, the collaborative robot works according to a predetermined trajectory, and the operator cooperates with the collaborative robot. In the whole process, multiple inertial measurement units first collect the rotation matrix of the robot and the human body, then filter the rotation matrix, and then use the positive kinematics function to obtain the position information and movement posture of the robot and the human body, and finally calculate the human body and the robot Evaluation parameters such as the distance between the robot and the robot's movement speed, to evaluate the degree of cooperation between the collaborative robot and the personnel and the safety of the personnel. Specifically, the rotation matrix is filtered to make the obtained rotation matrix more accurate, and then the positive kinematics function is used to determine the position of each joint of the human body and the posture of each torso, as well as the position of each joint of the robot and the posture of each link, thereby obtaining The position information and movement posture of the robot and the human body, and finally the evaluation parameters such as the distance between the human body and the robot and the movement speed of the robot are calculated, and the degree of cooperation between the collaborative robot and the personnel and the safety of the personnel are evaluated.
本发明一种人机协作中人体安全评估方法,包括:The present invention is a method for evaluating human body safety in human-machine collaboration, including:
S1,获取人体在全局坐标系下的位姿。S1, obtain the pose of the human body in the global coordinate system.
S2,获取机器人在全局坐标系下的位姿。S2: Obtain the pose of the robot in the global coordinate system.
S3,根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离以及机器人的运动速度。S3: Determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system.
S4,根据所述人体与机器人之间的距离和所述机器人的运动速度,确定人机协作中人体的安全等级。S4: Determine the safety level of the human body in the human-robot collaboration according to the distance between the human body and the robot and the movement speed of the robot.
S1具体包括:S1 specifically includes:
S11,获取人体基坐标系与全局坐标系之间的第一姿态关系 以及惯性测量单元坐标系与全局坐标系之间的第二姿态关系 S11. Obtain the first posture relationship between the human base coordinate system and the global coordinate system And the second attitude relationship between the inertial measurement unit coordinate system and the global coordinate system
S12,根据所述第一姿态关系和所述第二姿态关系确定人体基坐标系与惯性测量单元坐标系之间的第三姿态关系 其中, 为第一姿态关系, 为第二姿态关系, 为第三姿态关系,G为全局坐标系,B为人体基坐标系,S为惯性测量单元坐标系。 S12. Determine a third posture relationship between the human body base coordinate system and the inertial measurement unit coordinate system according to the first posture relationship and the second posture relationship among them, Is the first posture relationship, Is the second posture relationship, Is the third posture relationship, G is the global coordinate system, B is the human body base coordinate system, and S is the inertial measurement unit coordinate system.
具体的,获取人体基坐标系与全局坐标系之间的姿态关系 时,简单起见,所建立的人体基坐标系与全局坐标系姿态一致。人体基坐标系与全局坐标系中的姿态关系表示为 惯性测量单元坐标系与全局坐标系之间的姿态关系表示为 人体基坐标系与惯性测量单元坐标系之间的姿态关系表示为 通过坐标系之间的变换: Specifically, obtain the posture relationship between the basic coordinate system of the human body and the global coordinate system For simplicity, the established human base coordinate system is consistent with the posture of the global coordinate system. The posture relationship between the basic coordinate system of the human body and the global coordinate system is expressed as The posture relationship between the inertial measurement unit coordinate system and the global coordinate system is expressed as The posture relationship between the basic coordinate system of the human body and the coordinate system of the inertial measurement unit is expressed as Through the transformation between coordinate systems:
可得 Available
S13,选取人体行走时,人体脚触地所在侧的脚踝为所述人体基坐标系的原点;所述人体基坐标系的原点在人体的左脚踝和人体的右脚踝之间切换。S13: When the human body is walking, the ankle on the side where the human foot touches the ground is selected as the origin of the human body base coordinate system; the origin of the human body base coordinate system is switched between the human body's left ankle and the human body's right ankle.
S14,获取利用第一惯性测量单元测量的第一旋转矩阵;所述第一惯性测量单元为多个,分别设置于人体的上身躯干、左大臂、右大臂、左小臂、右小臂、左大腿、右大腿、左小腿、右小腿、左脚背和右脚背。S14. Obtain a first rotation matrix measured by a first inertial measurement unit; there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left big arm, right big arm, left forearm, and right forearm of the human body , Left thigh, right thigh, left calf, right calf, left instep and right instep.
S15,根据所述人体基坐标系的原点、所述第一旋转矩阵和所述第三姿态关系,确定人体在全局坐标系下的位姿。S15: Determine the pose of the human body in the global coordinate system according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship.
具体的,人体惯性测量单元的放置位置如图2所示,使用的第一惯性测量单元和第二惯性测量单元均为XSENS MTwAwinda,选取行走时静止一侧脚踝为人体的基坐标系原点,人行走时,人体基坐标系原点在左右脚之间切换,首先通过脚踝位置推算出盆骨的位置,再根据盆骨位置推算全身各躯干的位姿;上半身放置5块惯性测量单元,分别置于上身躯干、左 右大臂(左大臂和右大臂)和左右小臂(左小臂和右小臂),用于获取上半身的位姿信息;下半身放置6块惯性测量单元,分别置于左右大腿(左大腿和右大臂)、左右小腿(左小腿和右小腿)和左右脚背(左脚背和右脚背),用于获取下半身的位姿信息,放置在人体上的惯性测量单元位置固定不发生变化。Specifically, the placement position of the human inertial measurement unit is shown in Figure 2. The first inertial measurement unit and the second inertial measurement unit used are both XSENS MTwAwinda, and the ankle at rest when walking is selected as the origin of the basic coordinate system of the human body. When walking, the origin of the basic coordinate system of the human body is switched between the left and right feet. First, the position of the pelvis is calculated by the ankle position, and then the posture of each torso of the whole body is calculated according to the position of the pelvis; 5 inertial measurement units are placed on the upper body, respectively. Upper torso, left and right arms (left and right arms) and left and right forearms (left forearms and right forearms), used to obtain the posture information of the upper body; 6 inertial measurement units are placed on the lower body, placed on the left and right respectively Thigh (left thigh and right upper arm), left and right calf (left calf and right calf) and left and right instep (left instep and right instep) are used to obtain posture information of the lower body. The position of the inertial measurement unit placed on the human body is not fixed. Changes.
在开始运动之前,受试者(人体)保持校准姿势,这个校准过程是在所有的惯性测量单元上进行的,其中每个惯性测量单元都与一个具有预定义的坐标系的身体部分相关联,将其用于实时运动捕捉中。Before starting the exercise, the subject (human body) maintains a calibration posture. This calibration process is carried out on all inertial measurement units, where each inertial measurement unit is associated with a body part with a predefined coordinate system. Use it for real-time motion capture.
获取人体的姿态,人体肢体长度是确定已知的,对惯性测量单元进行标定之后放置在人体身躯干上,以人体直立静止时为初始状态。人在行走时,总会保持一只脚触地,取该侧脚踝为人体基坐标系原点,人体静止时,令每个惯性测量单元坐标系与其参照坐标系之间的旋转矩阵为单位矩阵;人体运动时,通过惯性测量单元返回的四元数(ε 1,ε 2,ε 3,ε 4),可以实时得到身体每一躯干的姿态以及位置信息。左脚触地时全身姿态的推算顺序如图3所示,右脚触地时全身姿态的推算顺序如图4所示。 Obtain the posture of the human body. The length of the limbs of the human body is determined and known. After the inertial measurement unit is calibrated, it is placed on the torso of the human body. The initial state is when the human body is upright and stationary. When a person walks, he always keeps one foot touching the ground, and the ankle on that side is taken as the origin of the basic coordinate system of the human body. When the human body is stationary, the rotation matrix between the coordinate system of each inertial measurement unit and its reference coordinate system is the unit matrix; When the human body moves, through the quaternion (ε 1 , ε 2 , ε 3 , ε 4 ) returned by the inertial measurement unit, the posture and position information of each torso of the body can be obtained in real time. The sequence of calculating the whole body posture when the left foot touches the ground is shown in Fig. 3, and the sequence of calculating the whole body posture when the right foot touches the ground is shown in Fig. 4.
现以左脚触地为例,来说明完整人体姿态获取的过程:Now take the left foot touching the ground as an example to illustrate the process of obtaining a complete body posture:
左脚踝人体基坐标系(左脚踝坐标系)作为左小腿的参照坐标系,已知人体静止时,在人体基坐标系中左膝盖的坐标为 通过左小腿处的第一惯性测量单元测量的四元数表示的旋转矩阵R ε1为: The left ankle human body base coordinate system (left ankle coordinate system) is used as the reference coordinate system of the left calf. It is known that when the human body is stationary, the coordinates of the left knee in the human body base coordinate system are The rotation matrix R ε1 represented by the quaternion measured by the first inertial measurement unit at the left calf is:
则人体姿态发生变换后的左膝盖坐标为:P′ L1=R ε1P L1。 Then the coordinate of the left knee after the posture of the human body is transformed is: P′ L1 =R ε1 P L1 .
以左膝盖为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,并以此坐标系作为左大腿惯性测量单元运动的参照坐标系。人体静止时,令左大腿惯性测量单元坐标系与左膝盖坐标系之间的旋转矩阵为单位 矩阵,在左膝盖坐标系中,左髋关节的坐标为 通过左大腿惯性测量单元传回的四元数表示的旋转矩阵R ε2,可以实时得到左大腿的姿态以及位置信息。 The coordinate system is established with the left knee as the origin of the coordinate system, and the posture of the coordinate system is consistent with the basic coordinate system of the human body, and this coordinate system is used as the reference coordinate system for the movement of the left thigh inertial measurement unit. When the human body is stationary, let the rotation matrix between the coordinate system of the left thigh inertial measurement unit and the coordinate system of the left knee be the unit matrix. In the coordinate system of the left knee, the coordinates of the left hip joint are The posture and position information of the left thigh can be obtained in real time through the rotation matrix R ε2 represented by the quaternion returned by the left thigh inertial measurement unit.
则人体姿态发生变换后的左髋关节坐标为:P′ L2=R ε2P L2。 Then the coordinates of the left hip joint after the posture of the human body is transformed are: P′ L2 =R ε2 P L2 .
同时可得左髋关节相对于人体基坐标系的坐标:P″ L2=P′ L1+P′ L2。 At the same time, the coordinates of the left hip joint relative to the basic coordinate system of the human body can be obtained: P″ L2 = P′ L1 + P′ L2 .
以左髋关节为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,假设人在移动过程中,盆骨的姿态不发生变化,则盆骨在左髋关节坐标系中的位置固定,同时可得盆骨在人体基坐标系中的位置。The coordinate system is established with the left hip joint as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. Assuming that the posture of the pelvis does not change during the movement of the person, the position of the pelvis in the coordinate system of the left hip joint is fixed At the same time, the position of the pelvis in the basic coordinate system of the human body can be obtained.
以盆骨中心为坐标系的原点建立坐标系,坐标系姿态与人体基坐标系一致,右髋关节在盆骨坐标系中的位置固定不变,同时可得右髋关节在人体基坐标系中的位置。同一个人体左髋关节到盆骨的距离,右髋关节到盆骨的距离是已经的,根据距离和左髋关节位置坐标,则能求出盆骨坐标和右髋关节坐标。The coordinate system is established with the center of the pelvis as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The position of the right hip joint in the pelvic coordinate system is fixed, and the right hip joint can be obtained in the basic coordinate system of the human body. s position. The distance from the left hip joint to the pelvis and the distance from the right hip joint to the pelvis of the same person are already available. According to the distance and the coordinates of the left hip joint position, the pelvic coordinates and the coordinates of the right hip joint can be obtained.
以右髋关节为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,以右髋关节坐标系作为右大腿惯性测量单元的参照坐标系,人体静止时,令右大腿惯性测量单元坐标系与右髋关节坐标系之间的旋转矩阵为单位矩阵,在右髋关节坐标系中,通过右大腿惯性测量单元传回的四元数表示的旋转矩阵,可以实时得到右大腿的姿态以及位置信息,根据坐标变换,获得人体基坐标系下的右膝盖位置坐标。The coordinate system is established with the right hip joint as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The right hip joint coordinate system is used as the reference coordinate system of the right thigh inertial measurement unit. When the human body is stationary, the right thigh inertial measurement unit coordinates are set The rotation matrix between the right hip joint coordinate system and the right hip joint coordinate system is the unit matrix. In the right hip joint coordinate system, the rotation matrix represented by the quaternion returned by the right thigh inertial measurement unit can be used to obtain the right thigh posture and position in real time According to the coordinate transformation, the coordinates of the right knee position in the basic coordinate system of the human body are obtained.
以右膝盖为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,以右膝盖坐标系作为右小腿惯性测量单元的参照坐标系,人体静止时,令右小腿惯性测量单元坐标系与右膝盖坐标系之间的旋转矩阵为单位矩阵,在右膝盖坐标系中,通过右小腿惯性测量单元传回的四元数表示的旋转矩阵,可以实时得到右小腿的姿态以及位置信息,根据坐标变换,获得人体基坐标系下的右脚踝位置坐标。The coordinate system is established with the right knee as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The coordinate system of the right knee is used as the reference coordinate system of the right calf inertial measurement unit. When the human body is stationary, the coordinate system of the right calf inertial measurement unit and The rotation matrix between the right knee coordinate system is the unit matrix. In the right knee coordinate system, the rotation matrix represented by the quaternion returned by the right calf inertial measurement unit can be used to obtain the right calf posture and position information in real time, according to the coordinates Transform to obtain the position coordinates of the right ankle in the basic coordinate system of the human body.
右脚触地时,以右脚脚踝为原点,建立人体基坐标系,腿关节坐标系建立方法同上。When the right foot touches the ground, use the ankle of the right foot as the origin to establish the basic coordinate system of the human body. The method for establishing the coordinate system of the leg joints is the same as above.
同时,以盆骨坐标系作为上身躯干的参照坐标系,人体静止时,令上 身躯干惯性测量单元坐标系与盆骨坐标系之间的旋转矩阵为单位矩阵,在盆骨坐标系中,通过上身躯干惯性测量单元传回的四元数表示的旋转矩阵,可以实时得到上身躯干的姿态以及位置信息,根据坐标变换,获得人体基坐标系下的肩膀位置坐标。At the same time, the pelvic coordinate system is used as the upper body torso reference coordinate system. When the human body is stationary, the rotation matrix between the upper body torso inertial measurement unit coordinate system and the pelvic coordinate system is the unit matrix. In the pelvic coordinate system, the upper body The rotation matrix represented by the quaternion returned by the torso inertial measurement unit can obtain the posture and position information of the upper body torso in real time. According to the coordinate transformation, the shoulder position coordinates in the basic coordinate system of the human body can be obtained.
以肩膀为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,并将肩膀坐标系作为大臂运动的参照坐标系,通过大臂惯性测量单元传回的四元数表示的旋转矩阵,可以实时得到大臂的姿态以及位置信息,根据坐标变换,获得人体基坐标系下手肘的位置坐标。The coordinate system is established with the shoulder as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The shoulder coordinate system is used as the reference coordinate system of the boom movement, and the rotation matrix represented by the quaternion returned by the boom inertial measurement unit , The posture and position information of the forearm can be obtained in real time, and the position coordinates of the elbow in the basic coordinate system of the human body can be obtained according to the coordinate transformation.
以手肘为坐标系原点建立坐标系,坐标系姿态与人体基坐标系一致,并将手肘坐标系作为小臂运动的参照坐标系,通过小臂惯性测量单元传回的四元数表示的旋转矩阵,可以实时得到小臂的姿态以及位置信息,根据坐标变换,获得人体基坐标系下手腕的位置坐标。The coordinate system is established with the elbow as the origin of the coordinate system. The posture of the coordinate system is consistent with the basic coordinate system of the human body. The elbow coordinate system is used as the reference coordinate system for the forearm movement, which is expressed by the quaternion returned by the forearm inertial measurement unit. The rotation matrix can obtain the posture and position information of the forearm in real time, and obtain the position coordinates of the wrist in the basic coordinate system of the human body according to the coordinate transformation.
从而获得人体在人体基坐标系下的完整姿态以及各个关节的位置坐标。通过人体基坐标系和全局坐标系之间的变换矩阵,可以得到全局坐标系下的人体完整姿态以及各个关节的位置坐标。In this way, the complete posture of the human body in the basic coordinate system of the human body and the position coordinates of each joint are obtained. Through the transformation matrix between the human base coordinate system and the global coordinate system, the complete posture of the human body in the global coordinate system and the position coordinates of each joint can be obtained.
S2具体包括:S2 specifically includes:
S21,获取全局坐标系下机器人基座的坐标;所述基座为机器人触地的基座。具体的,全局坐标系下机器人基座的位置固定不变,以基座中心点为全局坐标系原点,坐标系姿态与全局坐标系一致,建立基座坐标系,基座中心点在全局坐标系下的坐标由实际测量获得。S21: Obtain the coordinates of the robot base in the global coordinate system; the base is the base on which the robot touches the ground. Specifically, the position of the robot base in the global coordinate system is fixed, and the center of the base is the origin of the global coordinate system, and the posture of the coordinate system is consistent with the global coordinate system. The base coordinate system is established, and the center of the base is in the global coordinate system. The coordinates below are obtained from actual measurements.
S22,获取利用第二惯性测量单元测量的第二旋转矩阵;所述第二惯性测量单元为多个,分别设置于机器人的基座和连杆上。如图5所示,IMU1放置在机器人基座上,其余5个IMU放置在机器人各个连杆上,其余5个IMU分别为IMU2、IMU3、IMU4、IMU5和IMU6。S22: Obtain a second rotation matrix measured by a second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot. As shown in Figure 5, IMU1 is placed on the base of the robot, and the remaining 5 IMUs are placed on each link of the robot. The remaining 5 IMUs are IMU2, IMU3, IMU4, IMU5, and IMU6.
S23,根据所述全局坐标系下机器人基座的坐标和所述第二旋转矩阵,确定机器人在全局坐标系下的位姿。S23: Determine the pose of the robot in the global coordinate system according to the coordinates of the robot base in the global coordinate system and the second rotation matrix.
具体的,机器人上的惯性测量单元放置位置如图5所示,本发明实例选取6自由度机械臂,在基座和每个连杆上分别放置一个惯性测量单元,用于获取机械臂的姿态信息。上述提到的获得人体上半身姿态的方法同样适用于机械臂姿态的获取,不再赘述。以此,获得全局坐标系下机器人的 姿态。Specifically, the placement position of the inertial measurement unit on the robot is shown in Figure 5. The example of the present invention selects a 6-degree-of-freedom manipulator, and places an inertial measurement unit on the base and each link to obtain the posture of the manipulator. information. The above-mentioned method of obtaining the posture of the upper body of the human body is also applicable to obtaining the posture of the mechanical arm, and will not be repeated. In this way, the posture of the robot in the global coordinate system is obtained.
S3具体包括:S3 specifically includes:
S31,根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离集合;所述距离集合中包括人体中每个人体躯干分别与机器人连杆之间的距离;所述人体躯干包括上身躯干、左大臂、右大臂、左小臂、右小臂、左大腿、右大腿、左小腿和右小腿。S31: Determine a set of distances between the human body and the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system; the distance set includes each torso in the human body. The distance between the connecting rod and the robot; the human body torso includes the upper body torso, the left big arm, the right big arm, the left forearm, the right forearm, the left thigh, the right thigh, the left calf and the right calf.
S32,选取所述距离集合中最小值作为人体与机器人之间的距离。S32: Select the minimum value in the distance set as the distance between the human body and the robot.
S33,根据所述人体与机器人之间的距离确定机器人的运动速度。S33: Determine the movement speed of the robot according to the distance between the human body and the robot.
将人体各部分躯干以及机械臂的各个连杆视为空间中的圆柱体,利用数学公式求解圆柱体间的最短距离。具体的,将人体每部分身体躯干各视为一个圆柱体,机器人的每个连杆各视为一个圆柱体,利用数学公式求解圆柱间的最短距离。The torso of the human body and the links of the robotic arm are regarded as cylinders in space, and the shortest distance between the cylinders is solved by mathematical formulas. Specifically, each part of the torso of the human body is regarded as a cylinder, and each connecting rod of the robot is regarded as a cylinder, and the shortest distance between the cylinders is solved by a mathematical formula.
首先求出两个圆柱体中轴线之间的距离,问题转换为求解空间中两条线段之间的距离。以任意两条线段为例,人体上的一条线段AB,其中A和B的坐标分别为A(x a,y a,z a)和B(x b,y b,z b),机械臂上的一条线段CD,其中C和D的坐标分别为C(x c,y c,z c)和D(x d,y d,z d)。 First find the distance between the central axes of the two cylinders, and the problem is converted to the distance between the two line segments in the solution space. Take any two line segments as an example, a line segment AB on the human body, where the coordinates of A and B are A (x a , y a , z a ) and B (x b , y b , z b ), respectively, on the robot arm A line segment CD of, where the coordinates of C and D are C (x c , y c , z c ) and D (x d , y d , z d ), respectively.
定义中间变量:H、I、J、K、L、M、N、O、P和Q,令H=x b-x a,I=y b-y a,J=z b-z a,K=x d-x c,L=y d-y c,M=z d-z c, Define intermediate variables: H, I, J, K, L, M, N, O, P, and Q, let H = x b- x a , I = y b -y a , J = z b- z a , K = X d- x c , L = y d -y c , M = z d- z c ,
可以得到直线AB与直线CD之间的公垂线方程:N·x-0·y+P·z+Q=0,令 The common perpendicular equation between the line AB and the line CD can be obtained: N·x-0·y+P·z+Q=0, so
可得公垂线与直线CD的交点E(x E,y E,z E),其中x E=K·k′+x c,y E=L·k′+y c,z E=M·k′+z c。 Obtain the intersection point E(x E ,y E ,z E ) of the common vertical line and the straight line CD, where x E =K·k′+x c , y E =L·k′+y c , z E =M· k′+z c .
同理可得公垂线与直线AB的交点F(x F,y F,z F)。 In the same way, the intersection point F(x F ,y F ,z F ) of the common perpendicular and the straight line AB can be obtained.
若点E存在于线段CD上,点F存在于线段AB上,则线段AB与线段CD间的最短距离为:If point E exists on line segment CD and point F exists on line segment AB, the shortest distance between line segment AB and line segment CD is:
若点E不存在于线段CD上或点F不存在于线段AB上时,则使min{L AC,L AD,L BC,L BD}为直线AB与线段CD间的最短距离。 If the point E does not exist on the line segment CD or the point F does not exist on the line segment AB, let min{L AC , L AD , L BC , L BD } be the shortest distance between the line AB and the line segment CD.
则两个圆柱体之间的距离为两个圆柱中轴线之间的距离与两个圆柱体的半径之差,即两个圆柱中轴线之间的距离减去两个圆柱体的半径。Then the distance between the two cylinders is the difference between the distance between the central axes of the two cylinders and the radii of the two cylinders, that is, the distance between the central axes of the two cylinders minus the radii of the two cylinders.
分别计算人体各部分躯干与机器人各个连杆之间的距离,搜索距离的最小值作为人体和机器人之间的距离。根据已知的机器人末端连杆的位置,对时间进行微分获得机器人的运动速度。Calculate the distance between the torso of each part of the human body and each link of the robot, and the minimum value of the search distance is used as the distance between the human body and the robot. According to the known position of the end link of the robot, the time is differentiated to obtain the movement speed of the robot.
S4具体包括:S4 specifically includes:
S41,当所述人体与机器人之间的距离大于第一预设距离阈值且所述机器人的运动速度小于预设速度阈值时,确定人体处于第一安全状态,即视人体处于安全状态。S41: When the distance between the human body and the robot is greater than a first preset distance threshold and the movement speed of the robot is less than a preset speed threshold, it is determined that the human body is in a first safe state, that is, the human body is considered to be in a safe state.
S42,当所述人体与机器人之间的距离大于第一预设距离阈值且机器人速度大于或等于预设速度阈值时,确定人体处于第二安全状态,即视人体处于相对安全状态。S42: When the distance between the human body and the robot is greater than the first preset distance threshold and the robot speed is greater than or equal to the preset speed threshold, it is determined that the human body is in a second safe state, that is, the human body is considered to be in a relatively safe state.
S43,当所述人体与机器人之间的距离大于第二预设距离阈值且所述人体与机器人之间的距离小于或等于第一预设距离阈值且所述机器人的运动速度小于预设速度阈值时,确定人体处于第二安全状态,即视人体处于相对安全状态,其中,所述第一预设距离阈值大于所述第二预设距离阈值。S43: When the distance between the human body and the robot is greater than a second preset distance threshold, the distance between the human body and the robot is less than or equal to the first preset distance threshold, and the movement speed of the robot is less than the preset speed threshold When it is determined that the human body is in a second safe state, that is, the human body is considered to be in a relatively safe state, wherein the first preset distance threshold is greater than the second preset distance threshold.
S44,当所述人体与机器人之间的距离大于第二预设距离阈值且所述人体与机器人之间的距离小于或等于第一预设距离阈值且所述机器人的运动速度大于或等于预设速度阈值时,确定人体处于第二危险状态,即视人体处于相对危险状态。S44, when the distance between the human body and the robot is greater than a second preset distance threshold, the distance between the human body and the robot is less than or equal to the first preset distance threshold, and the movement speed of the robot is greater than or equal to a preset distance At the speed threshold, it is determined that the human body is in the second dangerous state, that is, the human body is considered to be in a relatively dangerous state.
S45,当所述人体与机器人之间的距离小于或等于第二预设距离阈值且所述机器人的运动速度小于预设速度阈值时,确定人体处于第二危险状态,即视人体处于相对危险状态。S45: When the distance between the human body and the robot is less than or equal to a second preset distance threshold and the movement speed of the robot is less than the preset speed threshold, it is determined that the human body is in a second dangerous state, that is, the human body is considered to be in a relatively dangerous state .
S46,当所述人体与机器人之间的距离小于或等于第二预设距离阈值且所述机器人的运动速度大于或等于预设速度阈值时,确定人体处于第一危险,即视人体处于危险状态。S46: When the distance between the human body and the robot is less than or equal to the second preset distance threshold and the movement speed of the robot is greater than or equal to the preset speed threshold, it is determined that the human body is in the first danger, that is, the human body is in a dangerous state .
具体的,根据机器人的外展距离、所安装的工具的长度、机器人的工作性能以及先验经验来确定距离阈值和速度阈值,本发明实施例中所述第一预设距离阈值为L max,所述第二预设距离阈值为L max/3,所述预设速度阈值L max/1.25。其中,L max为机器人外展长度的最大值,第二预设距离阈值为机器人可外展长度的最大值的三分之一,即0.33L max,而正常人的反应能力参数为1.25秒,即发现前方有目标反映到大脑需0.5秒,从大脑反应到手、脚后并采取措施需0.75秒。 Specifically, the distance threshold and the speed threshold are determined according to the abduction distance of the robot, the length of the installed tool, the working performance of the robot, and a priori experience. In the embodiment of the present invention, the first preset distance threshold is L max , The second preset distance threshold is L max /3, and the preset speed threshold L max /1.25. Among them, L max is the maximum abduction length of the robot, the second preset distance threshold is one third of the maximum abduction length of the robot, that is, 0.33L max , and the reaction ability parameter of a normal person is 1.25 seconds. That is, it takes 0.5 seconds to find that there is a target in the front to reflect the brain, and it takes 0.75 seconds to take measures from the brain to the hands and feet.
通过上述方法,可以在人机协作过程中,通过监控机器人与人体之间的距离和机器人的运行速度确定当前人体的安全状态,根据不同安全状态做出下一步工作计划,有效避免危险情况发生,使人机协作更安全更高效。Through the above method, in the process of human-machine collaboration, the current safety state of the human body can be determined by monitoring the distance between the robot and the human body and the running speed of the robot, and make the next work plan according to different safety states, effectively avoiding dangerous situations. Make human-machine collaboration safer and more efficient.
本发明还提供了一种人机协作中人体安全评估系统,包括:The present invention also provides a human body safety assessment system in human-machine collaboration, including:
第一获取模块,用于获取人体在全局坐标系下的位姿。The first acquisition module is used to acquire the pose of the human body in the global coordinate system.
第二获取模块,用于获取机器人在全局坐标系下的位姿。The second acquisition module is used to acquire the pose of the robot in the global coordinate system.
距离和速度确定模块,用于根据所述人体在全局坐标系下的位姿和所述机器人在全局坐标系下的位姿,确定人体与机器人之间的距离以及机器人的运动速度。The distance and speed determination module is used to determine the distance between the human body and the robot and the movement speed of the robot according to the pose of the human body in the global coordinate system and the pose of the robot in the global coordinate system.
人体安全等级确定模块,用于根据所述人体与机器人之间的距离和所述机器人的运动速度,确定人机协作中人体的安全等级。The human body safety level determination module is used to determine the safety level of the human body in human-machine collaboration according to the distance between the human body and the robot and the movement speed of the robot.
优选的,所述第一获取模块具体包括:Preferably, the first acquisition module specifically includes:
第一姿态关系和第二姿态关系获取单元,用于获取人体基坐标系与全局坐标系之间的第一姿态关系以及惯性测量单元坐标系与全局坐标系之间的第二姿态关系。The first posture relationship and the second posture relationship acquisition unit are used to acquire the first posture relationship between the human body base coordinate system and the global coordinate system and the second posture relationship between the inertial measurement unit coordinate system and the global coordinate system.
第三姿态关系确定单元,用于根据所述第一姿态关系和所述第二姿态关系确定人体基坐标系与惯性测量单元坐标系之间的第三姿态关系;其 中, 为第一姿态关系, 为第二姿态关系, 为第三姿态关系,G为全局坐标系,B为人体基坐标系,S为惯性测量单元坐标系。 The third posture relationship determining unit is configured to determine a third posture relationship between the basic coordinate system of the human body and the coordinate system of the inertial measurement unit according to the first posture relationship and the second posture relationship; wherein, Is the first posture relationship, Is the second posture relationship, Is the third posture relationship, G is the global coordinate system, B is the human body base coordinate system, and S is the inertial measurement unit coordinate system.
人体基坐标系原点确定单元,用于选取人体行走时,人体脚触地所在侧的脚踝为所述人体基坐标系的原点;所述人体基坐标系的原点在人体的左脚踝和人体的右脚踝之间切换。The origin determination unit of the human body base coordinate system is used to select the ankle on the side where the human foot touches the ground as the origin of the human body base coordinate system when the human body is walking; the origin of the human body base coordinate system is the left ankle of the human body and the right of the human body Switch between ankles.
第一旋转矩阵获取单元,用于获取利用第一惯性测量单元测量的第一旋转矩阵;所述第一惯性测量单元为多个,分别设置于人体的上身躯干、左大臂、右大臂、左小臂、右小臂、左大腿、右大腿、左小腿、右小腿、左脚背和右脚背。The first rotation matrix acquisition unit is used to acquire the first rotation matrix measured by the first inertial measurement unit; there are multiple first inertial measurement units, which are respectively arranged on the upper torso, left forearm, and right forearm of the human body. Left forearm, right forearm, left thigh, right thigh, left calf, right calf, left instep and right instep.
人体在全局坐标系下位姿确定单元,用于根据所述人体基坐标系的原点、所述第一旋转矩阵和所述第三姿态关系。The posture determination unit of the human body in the global coordinate system is used to determine the position of the human body according to the origin of the basic coordinate system of the human body, the first rotation matrix, and the third posture relationship.
具体的,在本发明实施例中,所述第一获取模块具体包括:Specifically, in the embodiment of the present invention, the first acquisition module specifically includes:
标定单元,用于对惯性测量单元进行标定,得到惯性测量单元坐标系与其对应人体坐标系之间的坐标变换矩阵。The calibration unit is used to calibrate the inertial measurement unit to obtain the coordinate transformation matrix between the inertial measurement unit coordinate system and its corresponding human body coordinate system.
数据接收单元,用于接收惯性测量单元返回的四元数和角速度。The data receiving unit is used to receive the quaternion and angular velocity returned by the inertial measurement unit.
位姿获取单元,用于根据所得各个惯性测量单元的角速度以及四元数,得到人体在人体基坐标系下的姿态及位置坐标。The pose acquisition unit is used to obtain the posture and position coordinates of the human body in the basic coordinate system of the human body according to the obtained angular velocity and quaternion of each inertial measurement unit.
坐标转换单元,用于将所述人体在人体基坐标系下的位置坐标转换为人体在全局坐标系下的位置坐标。The coordinate conversion unit is used to convert the position coordinates of the human body in the basic human body coordinate system into the position coordinates of the human body in the global coordinate system.
优选的,所述第二获取模块具体包括:Preferably, the second acquisition module specifically includes:
基座坐标获取单元,用于获取全局坐标系下机器人基座的坐标。The base coordinate acquisition unit is used to acquire the coordinates of the robot base in the global coordinate system.
第二旋转矩阵获取单元,用于获取利用第二惯性测量单元测量的第二旋转矩阵;所述第二惯性测量单元为多个,分别设置于机器人的基座和连杆上。The second rotation matrix obtaining unit is used to obtain the second rotation matrix measured by the second inertial measurement unit; there are multiple second inertial measurement units, which are respectively arranged on the base and the connecting rod of the robot.
机器人在全局坐标系下位姿确定单元,用于根据所述全局坐标系下机器人基座的坐标和所述第二旋转矩阵,确定机器人在全局坐标系下的位姿。The pose determination unit of the robot in the global coordinate system is configured to determine the pose of the robot in the global coordinate system according to the coordinates of the robot base in the global coordinate system and the second rotation matrix.
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的 都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的系统而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。The various embodiments in this specification are described in a progressive manner. Each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. As for the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant information can be referred to the description of the method part.
本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处。综上所述,本说明书内容不应理解为对本发明的限制。Specific examples are used in this article to illustrate the principles and implementation of the present invention. The descriptions of the above examples are only used to help understand the methods and core ideas of the present invention; at the same time, for those of ordinary skill in the art, according to the present invention There will be changes in the specific implementation and scope of application. In summary, the content of this specification should not be construed as a limitation to the present invention.
Claims (10)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911262776.XA CN110978064B (en) | 2019-12-11 | 2019-12-11 | Human safety assessment method and system in human-machine collaboration |
| CN201911262776.X | 2019-12-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021114666A1 true WO2021114666A1 (en) | 2021-06-17 |
Family
ID=70092202
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2020/102934 Ceased WO2021114666A1 (en) | 2019-12-11 | 2020-07-20 | Human body safety evaluation method and system in human-machine collaboration |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110978064B (en) |
| WO (1) | WO2021114666A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114706403A (en) * | 2022-04-19 | 2022-07-05 | 广西大学 | A system and method for human-machine cooperation and prevention of human-machine collision based on infrared camera and positioning recognition pad |
| CN114886567A (en) * | 2022-05-12 | 2022-08-12 | 苏州大学 | Method for calibrating hands and eyes of surgical robot with telecentric motionless point constraint |
| CN115457440A (en) * | 2022-09-09 | 2022-12-09 | 北京理工大学 | Monocular video-based method for evaluating skiing gyration level |
| CN118918614A (en) * | 2024-10-10 | 2024-11-08 | 浙江大学 | Human body posture estimation method and device integrating human body intelligent modeling |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110978064B (en) * | 2019-12-11 | 2022-06-24 | 山东大学 | Human safety assessment method and system in human-machine collaboration |
| CN112936268A (en) * | 2021-01-30 | 2021-06-11 | 埃夫特智能装备股份有限公司 | Cooperative robot safety control system |
| CN112957033B (en) * | 2021-02-01 | 2022-10-18 | 山东大学 | Human body real-time indoor positioning and motion posture capturing method and system in man-machine cooperation |
| CN113066337B (en) * | 2021-04-20 | 2025-05-06 | 上海松鼠课堂人工智能科技有限公司 | A practical teaching method for chemical experiments based on virtual reality scenes |
| CN114714358A (en) * | 2022-04-18 | 2022-07-08 | 山东大学 | Method and system for teleoperation of mechanical arm based on gesture protocol |
| CN114757293B (en) * | 2022-04-27 | 2024-09-27 | 山东大学 | Human-machine integration risk warning method and system based on motion recognition and human-machine distance |
| CN114952854B (en) * | 2022-06-16 | 2024-07-09 | 山东大学 | Human body collision object docking method and system based on man-machine cooperation |
| CN115407750B (en) * | 2022-08-12 | 2023-11-21 | 北京津发科技股份有限公司 | Evaluation method and system for decision-making capability of man-machine collaborative intelligent system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4798461A (en) * | 1985-07-08 | 1989-01-17 | Bertin & Cie. | System for monitoring the geometry of a mechanical structure |
| CN103386683A (en) * | 2013-07-31 | 2013-11-13 | 哈尔滨工程大学 | Kinect-based motion sensing-control method for manipulator |
| CN106153077A (en) * | 2016-09-22 | 2016-11-23 | 苏州坦特拉自动化科技有限公司 | A kind of initialization of calibration method for M IMU human motion capture system |
| CN108527370A (en) * | 2018-04-16 | 2018-09-14 | 北京卫星环境工程研究所 | The man-machine co-melting safety control system of view-based access control model |
| CN108527305A (en) * | 2018-04-11 | 2018-09-14 | 南京理工大学 | A kind of hot line robot force feedback master-slave control method and system based on virtual reality technology |
| CN110978064A (en) * | 2019-12-11 | 2020-04-10 | 山东大学 | Human safety assessment method and system in human-machine collaboration |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105252532B (en) * | 2015-11-24 | 2017-07-04 | 山东大学 | The method of the flexible gesture stability of motion capture robot collaboration |
| GB2559020B (en) * | 2016-11-28 | 2021-11-03 | Faro Tech Inc | Noncontact safety sensor and method of operation |
| CN108247654A (en) * | 2018-02-05 | 2018-07-06 | 遨博(北京)智能科技有限公司 | A kind of control method of robot, device and system |
| CN109822579A (en) * | 2019-04-10 | 2019-05-31 | 江苏艾萨克机器人股份有限公司 | Vision-based collaborative robot safety control method |
| CN110238831B (en) * | 2019-07-23 | 2020-09-18 | 青岛理工大学 | Robot teaching system and method based on RGB-D image and teaching device |
-
2019
- 2019-12-11 CN CN201911262776.XA patent/CN110978064B/en active Active
-
2020
- 2020-07-20 WO PCT/CN2020/102934 patent/WO2021114666A1/en not_active Ceased
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4798461A (en) * | 1985-07-08 | 1989-01-17 | Bertin & Cie. | System for monitoring the geometry of a mechanical structure |
| CN103386683A (en) * | 2013-07-31 | 2013-11-13 | 哈尔滨工程大学 | Kinect-based motion sensing-control method for manipulator |
| CN106153077A (en) * | 2016-09-22 | 2016-11-23 | 苏州坦特拉自动化科技有限公司 | A kind of initialization of calibration method for M IMU human motion capture system |
| CN108527305A (en) * | 2018-04-11 | 2018-09-14 | 南京理工大学 | A kind of hot line robot force feedback master-slave control method and system based on virtual reality technology |
| CN108527370A (en) * | 2018-04-16 | 2018-09-14 | 北京卫星环境工程研究所 | The man-machine co-melting safety control system of view-based access control model |
| CN110978064A (en) * | 2019-12-11 | 2020-04-10 | 山东大学 | Human safety assessment method and system in human-machine collaboration |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114706403A (en) * | 2022-04-19 | 2022-07-05 | 广西大学 | A system and method for human-machine cooperation and prevention of human-machine collision based on infrared camera and positioning recognition pad |
| CN114886567A (en) * | 2022-05-12 | 2022-08-12 | 苏州大学 | Method for calibrating hands and eyes of surgical robot with telecentric motionless point constraint |
| CN114886567B (en) * | 2022-05-12 | 2023-06-23 | 苏州大学 | A Hand-Eye Calibration Method for Surgical Robots with Telecentric Fixed Point Constraints |
| CN115457440A (en) * | 2022-09-09 | 2022-12-09 | 北京理工大学 | Monocular video-based method for evaluating skiing gyration level |
| CN115457440B (en) * | 2022-09-09 | 2025-10-17 | 北京理工大学 | Method for evaluating skiing rotation level based on monocular video |
| CN118918614A (en) * | 2024-10-10 | 2024-11-08 | 浙江大学 | Human body posture estimation method and device integrating human body intelligent modeling |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110978064B (en) | 2022-06-24 |
| CN110978064A (en) | 2020-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021114666A1 (en) | Human body safety evaluation method and system in human-machine collaboration | |
| Valero et al. | Musculoskeletal disorders in construction: A review and a novel system for activity tracking with body area network | |
| EP3173191B1 (en) | Method for estimating posture of robotic walking aid | |
| WO2018196227A1 (en) | Evaluation method, device, and system for human motor capacity | |
| US20200178851A1 (en) | Systems and methods for tracking body movement | |
| Palani et al. | Real-time joint angle estimation using mediapipe framework and inertial sensors | |
| Jung et al. | Kinematic analysis of a 5-DOF upper-limb exoskeleton with a tilted and vertically translating shoulder joint | |
| Maurice | Virtual ergonomics for the design of collaborative robots | |
| Rakhodaei et al. | Path planning of the hybrid parallel robot for ankle rehabilitation | |
| CN114224325A (en) | Gait analysis system and method for calculating joint moment and angle by using inertial sensor | |
| CN110675936A (en) | Fitness compensation assessment method and system based on OpenPose and binocular vision | |
| Hwang et al. | A novel end-effector robot system enabling to monitor upper-extremity posture during robot-aided planar reaching movements | |
| CN107320106B (en) | Device for measuring gravity center position of human body during hand-held standing | |
| JP2016206081A (en) | Operation inference device and operation inference method | |
| Seo et al. | Motion data-driven unsafe pose identification through biomechanical analysis | |
| KR20160118678A (en) | Workload estimation and job rotation scheduling for Work-related Musculoskeletal Disorders prevention | |
| Brüggemann et al. | Coupled human-machine tele-manipulation | |
| Lu et al. | Gait-Event-Based human intention recognition approach for lower limb | |
| Padua et al. | A Framework for Casualty Manipulation with Biomechanical Joint-Level Reaction Analysis | |
| KR102053383B1 (en) | Apparatus for measuring user's movements to measure lumbar load in real time | |
| Chang et al. | A research on the postural stability of a person wearing the lower limb exoskeletal robot by the HAT model | |
| Liu et al. | Configuration comparison and design of an upper limb exoskeleton for robot teleoperation | |
| Wang et al. | Analysis and Research on Hand Maintenance Action Based on Binocular Stereo Vision | |
| Ceccarelli | The historical development of CaTraSys, a cable system | |
| Zhang et al. | Safety evaluation method of physical human-robot collaboration based on human upper limb model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20900179 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20900179 Country of ref document: EP Kind code of ref document: A1 |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20900179 Country of ref document: EP Kind code of ref document: A1 |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07/03/2023) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20900179 Country of ref document: EP Kind code of ref document: A1 |