JP2017220017A - Work inspection device and work inspection method - Google Patents

Abstract

An object of the present invention is to provide a work inspecting apparatus and a work inspecting method capable of easily and inexpensively and simply inspecting the correctness of work at a lower cost than before. A camera (103) for capturing a moving image (102) by photographing a worker (101), a body part of the worker (101) and a posture of the worker (101) are specified for each frame based on the moving image (102). The operation of the worker 101 is specified based on the posture of the worker 101, and the operation of the worker 101 is compared with the correct operation of the worker 101 in which the operation of the worker 101 is recorded in advance. Is determined that the worker 101 has performed the work correctly when the operator and the correct operation of the worker 101 do not match. And a work inspection device 100 including the unit 104. [Selection diagram] FIG.

Description

  The present invention relates to a work inspection apparatus and a work inspection method for inspecting work accuracy.

  For example, when assembling a transmission of a car through a screw tightening operation using a tightening tool, by checking mechanically without human intervention whether an operator has correctly performed the screw tightening operation, It is desirable to completely eliminate the occurrence of defective products due to human error.

  However, since it is technically difficult to mechanically check whether or not an operator has correctly performed the screw tightening operation without human intervention, conventionally, a substitute operation associated with the screw tightening operation has not been performed. It is estimated whether or not the worker has correctly performed the screw tightening operation by mechanically determining whether or not the inspector has performed the operation without human intervention.

  Specifically, before carrying out the screw tightening work, pay attention to the fact that the worker picks up the tightening tool, and the operation that the worker picks up the tightening tool is used as the substitute operation. If the worker performs the substitute operation mechanically without human intervention and the worker performs the substitute operation, the worker assumes that the screw tightening operation has been correctly performed, and the worker performs the substitute operation. If not, the worker is assumed to have not performed the screw tightening work correctly.

JP 2000-111450 A JP 2012-048510 A JP2013-13236A JP 2002-310617 A Utility Model Registration No. 3198723

  However, for example, if the worker picks up the tightening tool but forgets to perform the screw tightening operation, if the worker performs a substitute operation, the worker correctly performs the screw tightening operation. Since it is unconditionally estimated that it has been carried out, it cannot be said that the correctness of the work is always inspected accurately.

  In addition, after performing the screw tightening work, the worker can carry out the screw tightening work by marking himself / herself to indicate that the screw tightening work has been performed correctly or by monitoring the torque signal of the tightening tool. Although it is also confirmed whether or not it was carried out, there is no way of knowing exactly what and where it was tightened by what procedure, and because it is an inspection according to the good-good theory to the last, it is caused by human error It is difficult to completely eliminate the occurrence of defective products.

  Furthermore, it is also possible to mechanically inspect the correctness of work without human intervention by attaching a mark that can be detected to both the tightening tool and the work target part and tracking the mark. There is a problem in that it costs money to mark both the fastening tool and the work target part.

  Accordingly, an object of the present invention is to provide a work inspection apparatus and a work inspection method capable of easily and accurately inspecting the correctness / incorrectness of work more accurately and cheaply than before.

  The present invention captures a worker and obtains a moving image, specifies each body part of the worker for each frame based on the moving image, specifies the posture of the worker, and The worker's movement is identified based on the posture of the worker, and the movement of the worker is compared with the correct movement of the worker recorded in advance, and the movement of the worker matches the correct movement of the worker. A processing unit that determines that the worker has correctly performed the work and determines that the worker has not correctly performed the work when the operation of the worker does not match the correct operation of the worker; A work inspection apparatus is provided.

  It is desirable to further include a warning unit that prompts the worker to correct the work when it is determined that the worker has not performed the work correctly.

  The present invention also includes a step of photographing a worker to obtain a movie, a step of identifying each body part of the worker for each frame based on the movie, and a step of identifying the posture of the worker, Identifying the operation of the worker based on the posture of the worker for each frame, comparing the operation of the worker with the correct operation of the worker recorded in advance, the operation of the worker, and the If the worker's correct operation matches the worker's operation, it is determined that the worker has correctly performed the operation. If the worker's operation does not match the worker's correct operation, the worker correctly performs the operation. And a step of determining that the operation has not been performed.

  Preferably, the method further includes a step of prompting the worker to correct the work when the worker determines that the work has not been performed correctly.

  ADVANTAGE OF THE INVENTION According to this invention, the work inspection apparatus and work inspection method which can test | inspect the correctness of a work | work correctly correctly and cheaply easily can be provided.

It is the schematic explaining the structure of the work inspection apparatus of this invention. It is a flowchart explaining the procedure of the work inspection method of this invention. It is the schematic explaining the procedure of the work inspection method of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

  As shown in FIG. 1, a work inspection apparatus 100 according to an embodiment of the present invention includes a camera 103 that captures a worker 101 to obtain a moving image 102, and each body of the worker 101 for each frame based on the moving image 102. A part (for example, head, torso, forearm, thigh, and / or lower leg) is specified and the posture of the worker 101 is specified, and the operation of the worker 101 is specified based on the posture of the worker 101 for each frame. Then, the operation of the worker 101 is compared with the correct operation of the worker 101 recorded in advance, and when the operation of the worker 101 matches the correct operation of the worker 101, it is determined that the worker 101 has correctly performed the operation. And a processing unit 104 that determines that the worker 101 did not correctly perform the operation when the operation of the worker 101 does not match the correct operation of the worker 101.

  The work of the worker 101 includes, for example, a screw tightening work using a tightening tool that is performed in the process of assembling an automobile transmission.

  The camera 103 is configured to record the work performed by the worker 101 in real time by photographing the work space S in which the worker 101 is working. The number of cameras 103 may be two or more so that the work performed by the worker 101 can be photographed in detail. The camera 103 is configured to output the moving image 102 to the processing unit 104 in real time.

  Furthermore, the camera 103 may be configured to acquire depth information in the moving image frame using infrared rays. Thereby, each body part of the worker 101 can be specified more accurately three-dimensionally.

  The processing unit 104 identifies each body part of the worker 101 for each frame, compares the operation of the worker 101 with the correct operation of the worker 101 recorded in advance, and determines whether the worker 101 has correctly performed the operation. It is configured to execute a program for determining whether or not.

  The correct operation of the worker 101 is recorded based on the moving image 102 obtained by photographing the worker 101 performing the correct operation in advance in the same procedure. Information regarding the correct operation of the worker 101 is stored as data in the storage unit 105.

  In addition, the work inspection apparatus 100 preferably further includes a warning unit 106 that prompts the worker 101 to correct the work when the worker 101 determines that the work has not been performed correctly.

  As a result, it is possible to immediately notify the worker 101 of an error in the operation and to correct the operation immediately, and it is possible to correct the operation immediately. It can be shortened and the cost for correction can be reduced.

  As shown in FIG. 2, in the work inspection method M100 according to the embodiment of the present invention, in the first step S101, the worker 101 photographs the work space S in which the worker 101 is working with the camera 103. In addition, the work being performed is recorded in real time and the moving image 102 is output to the processing unit 104 in real time.

  In the next step S102, the processing unit 104 specifies each body part (for example, the head, torso, forearm, thigh, and / or lower leg) of the worker 101 for each frame based on the moving image 102 and the worker 101. Identify the posture.

  Specifically, as shown in FIG. 3, first, the head 107, the torso 108, the forearm 109, the thigh 110, and / or the lower leg 111, etc. of the worker 101 are specified for each frame based on the moving image 102 (FIG. 3). (Upper stage), and identifies the posture of the worker 101 based on those positions (lower stage in FIG. 3).

  In the next step S103, the operation of the worker 101 is specified based on the posture of the worker 101 for each frame. Specifically, the posture change of the worker 101, that is, the operation of the worker 101 is specified by comparing the posture of the worker 101 in the front and back frames.

  In the next step S104, the operation of the worker 101 is compared with the correct operation of the worker 101 recorded in advance, and if the operation of the worker 101 matches the correct operation of the worker 101, the process proceeds to step S105. If the operation of the worker 101 does not match the correct operation of the worker 101, the process proceeds to step S106.

  Here, the term “matching” includes not only the case where they completely match, but also the case where they match within a certain range so as to be able to absorb the error in operation of each worker 101.

  By this comparison, for example, it is possible to accurately determine whether or not the tightening tool has been picked up and the screw tightening operation has been actually performed by picking up the tightening tool. In other words, it is possible to know in detail in what procedure the specific parts located at the specified location were tightened using the specific tools at the specified location, and whether they are correct. Whether or not can be accurately determined.

  In step S105, since the operation of the worker 101 and the correct operation of the worker 101 coincide with each other, it is determined that the worker 101 has correctly performed the work and the work is performed via the warning unit 106. Person 101 is informed and the inspection of the correctness of the work is completed.

  In step S106, since the operation of the worker 101 and the correct operation of the worker 101 do not match, it is determined that the worker 101 has not performed the work correctly, and the worker 101 is warned to that effect in step S107. A warning is given via the unit 106.

  For example, if the worker 101 tries to carry out another work without performing a specific work, and the worker 101 continues to work and presses the push button for completing the work, the worker 101 can be removed through the display or the like. Can be instructed to work again, and can be instructed to redo the work. In some cases, the order of a series of operations may be important. For example, when operations A, B, and C need to be performed in order, operation B is performed before operation C is performed. Otherwise, the product performance may not be maintained. Therefore, when the predetermined work is not performed in the predetermined order, the warning unit 106 can warn and give a correction instruction.

  At the same time as the warning, it is possible to take measures to stop the outflow to the subsequent process of the product being worked on. Further, not only a warning but also the worker 101 can be notified of the work redo. It is also possible to warn the worker 101 through a display or sound, such as which procedure is wrong or what part is mistaken from the operation of the worker 101.

  As described above, according to the present invention, each body part of the worker 101 is specified for each frame without using a mark or the like based on the moving image 102 obtained by photographing the worker 101, and the worker 101 The posture of the worker 101 is identified based on the posture of the worker 101 for each frame, and the motion of the worker 101 is compared with the correct motion of the worker 101 recorded in advance. If the worker 101 and the correct operation of the worker 101 match, it is determined that the worker 101 has correctly performed the work. If the worker 101 does not match the correct operation of the worker 101, the worker 101 performs the work. In order to determine that the operation has not been performed correctly, for example, even if the operator picks up the tightening tool but forgets to perform the screw tightening operation, the correctness of the operation can be accurately inspected.

  Moreover, since it is possible not to inspect according to the good belief theory but to mechanically inspect the correctness of the work without human intervention, it is possible to completely eliminate the occurrence of defective products due to human error.

  Furthermore, there is no need to place a detectable mark on the tightening tool or the work target part, and it is possible to determine whether the work is correct or not simply by following the movement of the worker 101 based on the moving image 102. There is an advantage that it can be applied to any line.

  In addition, since the work of the worker 101 can be monitored in real time, a work instruction can be issued to the worker 101 or a warning can be promptly given when a mistake is made. Therefore, a work error can be detected simultaneously with the occurrence of the error, so that time or money loss can be minimized.

  Therefore, according to the present invention, it is possible to provide a work inspection device and a work inspection method capable of easily and accurately inspecting the correctness / incorrectness of work more accurately and cheaply than before.

DESCRIPTION OF SYMBOLS 100 Work inspection apparatus 101 Worker 102 Animation 103 Camera 104 Processing part 105 Storage part 106 Warning part 107 Head 108 Torso 109 Forearm 110 Thigh 111 Lower leg S Work space

Claims (4)

A camera that shoots workers to get videos,
Identify each body part of the worker for each frame based on the video and identify the posture of the worker, identify the operation of the worker based on the posture of the worker for each frame, Compared with the correct operation of the worker recorded in advance the operation of the worker, when the operation of the worker and the correct operation of the worker match, it is determined that the worker has correctly performed the operation, A processing unit that determines that the worker did not correctly perform the operation when the operation of the worker and the correct operation of the worker do not match;
A work inspection device characterized by comprising: The work inspection apparatus according to claim 1, further comprising: a warning unit that prompts the worker to correct the work when the worker determines that the work has not been performed correctly. Taking a picture of a worker to get a video,
Identifying each body part of the worker for each frame based on the video and identifying the posture of the worker;
Identifying the movement of the worker based on the posture of the worker for each frame;
Comparing the movement of the worker with the correct movement of the worker previously recorded;
When the operation of the worker matches the correct operation of the worker, it is determined that the worker has correctly performed the operation, and when the operation of the worker does not match the correct operation of the worker, Determining that the worker did not perform the work correctly;
A work inspection method characterized by comprising: The work inspection method according to claim 3, further comprising: urging the worker to correct the work when it is determined that the worker did not correctly perform the work.

Images