WO2024034302A1 - 工具システム、作業対象特定方法及びプログラム - Google Patents
工具システム、作業対象特定方法及びプログラム Download PDFInfo
- Publication number
- WO2024034302A1 WO2024034302A1 PCT/JP2023/025174 JP2023025174W WO2024034302A1 WO 2024034302 A1 WO2024034302 A1 WO 2024034302A1 JP 2023025174 W JP2023025174 W JP 2023025174W WO 2024034302 A1 WO2024034302 A1 WO 2024034302A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- work
- tool
- unit
- processing
- detection unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
- B25B23/00—Details of, or accessories for, spanners, wrenches, screwdrivers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
- B25B21/00—Portable power-driven screw or nut setting or loosening tools; Attachments for drilling apparatus serving the same purpose
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
- B25B21/00—Portable power-driven screw or nut setting or loosening tools; Attachments for drilling apparatus serving the same purpose
- B25B21/02—Portable power-driven screw or nut setting or loosening tools; Attachments for drilling apparatus serving the same purpose with means for imparting impact to screwdriver blade or nut socket
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
- B25B23/00—Details of, or accessories for, spanners, wrenches, screwdrivers
- B25B23/14—Arrangement of torque limiters or torque indicators in wrenches or screwdrivers
- B25B23/147—Arrangement of torque limiters or torque indicators in wrenches or screwdrivers specially adapted for electrically operated wrenches or screwdrivers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25F—COMBINATION OR MULTI-PURPOSE TOOLS NOT OTHERWISE PROVIDED FOR; DETAILS OR COMPONENTS OF PORTABLE POWER-DRIVEN TOOLS NOT PARTICULARLY RELATED TO THE OPERATIONS PERFORMED AND NOT OTHERWISE PROVIDED FOR
- B25F5/00—Details or components of portable power-driven tools not particularly related to the operations performed and not otherwise provided for
Definitions
- the present disclosure relates to a tool system, a work target identification method, and a program. More specifically, the present disclosure relates to a tool system including a portable tool, a work target identification method, and a program.
- Patent Document 1 discloses a tool system including a portable tool.
- the tool includes an imaging section arranged to take an image of a work object during work, and a identifying section.
- the identification unit performs pattern matching processing on the captured image captured by the imaging unit using a plurality of reference images corresponding to a plurality of work objects as template data, and identifies a set work object, which is a work object in which a tool is set. identifies which one of the multiple work targets is the work target.
- the tool is configured not to operate the drive unit even if the tool is operated when the set work target specified by the identification unit does not match the work order in the standard work procedure.
- An object of the present disclosure is to provide a tool system, a work target identification method, and a program that can reduce power consumption.
- a tool system includes a portable tool, an imaging section, a processing section, and a work start detection section.
- the tool has a drive section that operates with power supplied from a power source.
- the imaging unit is mounted on the tool and photographs a work target of the tool.
- the processing unit performs image processing on the captured image taken by the imaging unit, and performs identification processing to determine whether the work target matches any of one or more pre-registered objects.
- the work start detection unit detects that work on the work target has started in a state where the work target has been identified as one of the one or more objects by the identification process.
- the processing unit stops image processing of the captured image in the specific processing when the work start detection unit detects the start of work.
- a work target identification method includes a identification processing step and a work start detection step.
- an imaging unit mounted on a portable tool performs image processing on a captured image of the work object, and the work object matches one of one or more objects registered in advance. Specify whether or not.
- the tool has a drive section that operates using power from a power source.
- the work start detection step it is detected that work on the work target has started in a state where the work target has been identified as one of the one or more objects in the identification processing step.
- image processing of the captured image in the specific processing step is stopped.
- a program according to one aspect of the present disclosure is a program for causing a computer system to execute the work target identification method.
- FIG. 1 is a block diagram of a tool system according to one embodiment.
- FIG. 2 is an external perspective view of the tool system as seen from the front.
- FIG. 3 is an external perspective view of the tool system as seen from the rear.
- FIG. 4 is a sequence diagram showing an example of the operation of the above tool system.
- FIG. 5 is a flowchart showing an example of the operation of the tool system.
- FIG. 6 is a flowchart showing an example of the operation of the tool system.
- FIG. 7 is a flowchart showing an example of the operation of the tool system.
- the tool system 1 includes a portable tool 2, an imaging section 5, a processing section 35, and a work start detection section 300.
- the tool 2 has a drive section 24 that operates with power supplied from a power source.
- the imaging unit 5 is mounted on the tool 2 and photographs the work target of the tool 2.
- the processing unit 35 performs specific processing.
- the identification process is a process of performing image processing on the captured image taken by the imaging unit 5 and identifying whether or not the work target matches any of one or more pre-registered objects.
- the work start detection unit 300 detects that work on the work target has started in a state where the work target has been identified as one of one or more objects by the identification process.
- the processing unit 35 stops image processing of the captured image in the specific process.
- the tool 2 included in the tool system 1 has a drive unit 24 including, for example, a motor.
- the drive unit 24 is operated by power (electric power, etc.) from a power source such as the battery pack 201, for example.
- This type of tool 2 includes various types of tools, such as an impact wrench, a nut runner, an oil pulse wrench, a driver (including an impact driver), a drill, or a drill driver.
- the "object" of the tool 2 in the present disclosure refers to an object or part (location) on which work is performed using the tool 2.
- the "object" of the tool 2 includes a workpiece to which a fastening part is attached or a workpiece to which processing such as drilling is performed, and may also include a fastening part attached to a workpiece in the work of tightening a fastening part. Since the tool 2 can be used for multiple types of work, a plurality of objects for multiple types of work using the tool 2 are registered in advance in the tool system 1 of this embodiment.
- the "work object" of the tool 2 is an object prepared in a state where work using the tool 2 can be performed.
- a target object such as a tightening part such as a bolt
- one of the plurality of objects (tightening parts) is in a state where the tightening work can be performed.
- the object (tightening parts) prepared in the above is the work target of the tool 2.
- the work object photographed by the imaging unit 5 mounted on the tool 2 is one of the plurality of objects registered in advance in the tool 2 that is prepared to be ready for work using the tool 2. This is the object on which work will be performed.
- the object to which the tool 2 is set is sometimes referred to as a "setting work object.”
- the state in which the tool 2 is set on the object means a state in which the tool 2 is prepared to work on the object.
- the state in which the tool 2 is set on the target object refers not only to the state in which the tool 2 is in contact with the target object, but also the state in which the tool 2 is about to hit the target object, that is, the state in which the tool 2 is in contact with the target object. This includes the state of being close to each other.
- the state in which the tool 2 is set on the object is , the state in which the tightening part held by the tip tool of tool 2 is hitting the target object (workpiece), or the state in which the tightening part held by the tip tool of tool 2 is about to hit the target object (workpiece). May include. In other words, when the tool 2 is set on the object, the tool 2 may be in contact with the object or may be away from it. In addition, below, the case where the object of work using the tool 2 is a workpiece
- a portion of the workpiece to which a tightening component is attached may be referred to as a "tightening target location.”
- the tightening component is a bolt
- the screw hole into which the tightening component is tightened and the area around the screw hole are the locations to be tightened.
- each of the multiple screw holes in one workpiece and the places around the screw holes are the parts to be tightened, and one workpiece
- Each of the plurality of tightening target locations in is the target of work using the tool 2.
- the “captured image” in the present disclosure is an image obtained by imaging by the imaging unit 5, and includes a still image (still image) and a moving image (moving image).
- "video” includes images composed of a plurality of still images (frames) obtained by time-lapse photography or the like.
- the captured image does not have to be the data output from the imaging unit 5 itself.
- the captured image may be subjected to appropriate data compression, conversion to other data formats, processing to cut out a portion of the image captured by the imaging unit 5, focus adjustment, brightness adjustment, contrast adjustment, etc. as necessary. It may be processed.
- the captured image is, for example, a full-color moving image.
- installed in the present disclosure refers to both built-in (including a mode in which it is integrated so that it cannot be separated) and externally mounted (including a mode in which it is removably fixed using a coupler etc.) including. That is, the imaging unit 5 mounted on the tool 2 may be built into the tool 2 or may be externally attached to the tool 2.
- the tool 2 of this embodiment has an imaging section 5 built therein.
- the tool system 1 includes a processing section 35 and a work start detection section 300.
- the processing unit 35 performs image processing of the image photographed by the imaging unit 5 to perform specifying processing to specify whether the work target matches any of one or more pre-registered objects. Then, when the work start detection unit 300 detects the start of work in a state where the work target is identified as matching one of one or more pre-registered objects through the identification process, the processing unit 35 performs one of the identification processes. Stop image processing of an image.
- the tool system 1 is used, for example, on an assembly line in which workpieces (objects) are assembled in a factory.
- the tool 2 included in the tool system 1 is a tightening tool such as an impact wrench used for tightening tightening parts (for example, bolts or nuts). More specifically, in this embodiment, there are multiple locations to be tightened for one workpiece, and the user uses the tool 2 to tighten each of the multiple locations in one work space. Assume a case where parts are to be installed.
- the tool system 1 includes a tool 2 and a work target identification system 10 that identifies a work target of the tool 2.
- the tool 2 includes a control section 3a, a drive section 24, an impact mechanism 25, a notification section 211, and a battery pack 201 (see FIG. 1).
- the tool 2 is an electric tool that operates the drive unit 24 using electrical energy.
- the tool 2 is an impact wrench. With such a tool 2, it is possible to perform a mounting operation in which a fastening component is attached to a work object.
- the tool 2 uses the battery pack 201 as a power source and operates the drive unit 24 with the power (electrical energy) supplied from the battery pack 201.
- the battery pack 201 is included as a component of the tool 2, but it is not essential that the battery pack 201 is included as a component of the tool 2. It doesn't have to be included.
- the tool 2 further includes a body 20, as shown in FIGS. 2 and 3.
- the body 20 accommodates a drive section 24 and an impact mechanism 25.
- the control section 3a and the notification section 211 are also accommodated in the body 20.
- the body 20 of the tool 2 has a body portion 21, a grip portion 22, and a mounting portion 23.
- the body portion 21 is formed into a cylindrical shape (in this case, a cylindrical shape).
- the grip portion 22 protrudes from a portion of the circumferential surface of the body portion 21 along the normal direction (radial direction of the body portion 21).
- the mounting portion 23 is provided so that the battery pack 201 can be removably mounted thereon. In other words, the body part 21 and the mounting part 23 are connected by the grip part 22.
- At least a drive section 24 is housed in the body section 21.
- the drive unit 24 has a motor.
- the drive unit 24 is configured to operate using electric power supplied to the motor from the battery pack 201 as a power source.
- An output shaft 241 protrudes from one end surface of the body portion 21 in the axial direction.
- the output shaft 241 rotates around a rotation axis Ax ⁇ b>1 along the protruding direction of the output shaft 241 in accordance with the operation of the drive unit 24 . That is, the drive unit 24 drives the output shaft 241 to rotate the output shaft 241 around the rotation axis Ax1. In other words, when the drive unit 24 operates, torque acts on the output shaft 241 and the output shaft 241 rotates.
- a cylindrical socket 242 for rotating a fastening component (for example, a bolt or nut) is removably attached to the output shaft 241.
- the socket 242 rotates together with the output shaft 241 around the rotation axis Ax1.
- the size of the socket 242 attached to the output shaft 241 is appropriately selected by the user according to the size of the tightening part.
- a socket anvil can be attached to the output shaft 241 instead of the socket 242.
- the socket anvil is also removably attached to the output shaft 241.
- a bit for example, a driver bit or a drill bit
- a bit can be attached via the socket anvil.
- the tool 2 has the impact mechanism 25 as described above.
- the impact mechanism 25 applies impact force in the rotational direction to the output shaft 241 when the tightening torque (work value) exceeds a predetermined level. This allows the tool 2 to apply a larger tightening torque to the tightening parts.
- the grip part 22 is a part that the user grips when performing work.
- the grip portion 22 is provided with a trigger switch 221 (operation button) and a forward/reverse changeover switch 222.
- the trigger switch 221 is a switch for controlling the operation of the drive unit 24 on/off.
- the trigger switch 221 has an initial position and an on position, and the drive unit 24 operates when the trigger switch 221 is pushed or pulled to the on position by the user. Further, the trigger switch 221 can adjust the amount of operation of the drive unit 24, that is, the rotation speed of the output shaft 241, according to the amount of retraction (the amount of operation).
- the forward/reverse selector switch 222 is a switch that switches the rotation direction of the output shaft 241 between forward rotation and reverse rotation.
- the mounting portion 23 is formed into a flat rectangular parallelepiped shape.
- a battery pack 201 is removably mounted on one surface of the mounting section 23 on the side opposite to the grip section 22 .
- the battery pack 201 has a resin case 202 formed into a rectangular parallelepiped shape. Case 202 houses a storage battery (for example, a lithium ion battery). The battery pack 201 supplies power to the drive unit 24, the control unit 3a, the notification unit 211, the work target identification system 10, and the like.
- a storage battery for example, a lithium ion battery.
- the mounting section 23 is provided with an operation panel 231.
- the operation panel 231 includes, for example, a plurality of pushbutton switches 232 and a plurality of LEDs (Light Emitting Diodes) 233.
- LEDs Light Emitting Diodes
- the mounting section 23 is provided with a light emitting section 234 for photographing.
- the light emitting section 234 includes, for example, an LED.
- the light emitting unit 234 emits light toward the work target during work using the tool 2.
- the light emitting section 234 can be turned on/off by operating the operation panel 231. Further, the light emitting section 234 may be automatically turned on when the trigger switch 221 is turned on.
- the notification unit 211 is composed of, for example, an LED.
- the notification section 211 is provided at the end of the trunk section 21 of the body 20 opposite to the output shaft 241 so that the user can easily see the notification section 211 during work (see FIG. 3).
- the tool 2 has at least an operation mode and a registration mode as operation modes.
- the operation mode is an operation mode when the user performs work using the tool 2.
- the registration mode is an operation mode for generating a reference image corresponding to a work object using the tool 2.
- the operation mode may be switched, for example, based on an operation on a push button switch 232 on the operation panel 231, or may be switched on the basis of an operation on a trigger switch 221, a dip switch, etc. that is separate from the operation panel 231. It's okay to be hurt.
- the “reference image” is an image generated based on a captured image generated by the imaging unit 5.
- a plurality of reference images may correspond to a plurality of work objects in a one-to-one manner, or a plurality of reference images may correspond to one work object in a one-to-many manner. Further, each of the plurality of work objects may be associated with a plurality of reference images depicting each work object at various angles or sizes.
- the control unit 3a mainly includes, for example, a microcontroller having one or more processors and one or more memories.
- the microcontroller realizes the function of the control unit 3a by executing programs stored in one or more memories using one or more processors.
- the program may be pre-recorded in a memory, or may be provided recorded on a non-temporary recording medium such as a memory card, or may be provided through a telecommunications line.
- the above program is a program for causing one or more processors to function as the control unit 3a.
- the control unit 3a has functions such as a drive control unit 31, a notification control unit 36, and a torque determination unit 37.
- the control unit 3a enters a sleep state if no operation input is made to the trigger switch 221 or the operation panel 231 for a certain period of time.
- the control unit 3a is activated when an operation input is made to the trigger switch 221 or the operation panel 231 during the sleep state.
- the drive control section 31 controls the drive section 24. Specifically, the drive control unit 31 operates the drive unit 24 to rotate the output shaft 241 at a rotation speed based on the amount of retraction of the trigger switch 221 and in the rotation direction set by the forward/reverse switch 222. let When the drive control section 31 drives the drive section 24, the control section 3a outputs a drive signal indicating that the drive section 24 has been driven to the control section 3b.
- the drive control section 31 controls the drive section 24 so that the tightening torque becomes the torque setting value.
- the drive control section 31 has a torque estimating function that estimates the magnitude of the tightening torque.
- the drive control unit 31 estimates the magnitude of the tightening torque based on the rotation speed of the drive unit 24 (motor), etc. until the estimated value of the tightening torque reaches the seating determination level. .
- the drive control unit 31 estimates the magnitude of the tightening torque based on the number of impacts of the impact mechanism 25.
- the drive control unit 31 determines that the tightening torque has reached the torque setting value and stops the drive unit 24 (motor). Thereby, the tool 2 can tighten the tightening parts with the tightening torque according to the torque setting value.
- the torque estimation function of the drive control unit 31 may, for example, calculate the estimated value of the tightening torque using a torque sensor, or estimate the tightening torque based on the current value flowing through the drive unit 24 (motor). You can also find the value.
- the notification control unit 36 controls the notification unit 211. It is preferable that the notification control unit 36 lights up the notification unit 211 in different manners depending on whether the determination result of the specific process by the processing unit 35 is a mismatch or the determination result by the processing unit 35 is a match. For example, the notification control unit 36 lights up the notification unit 211 in red when the determination result of the processing unit 35 is inconsistent, and lights up the notification unit 211 in green when the determination result of the processing unit 35 matches. Thereby, by visually observing the lighting state of the notification unit 211, the user can recognize whether the work target matches any of the plurality of objects registered in advance.
- the notification control unit 36 may turn on the notification unit 211 when the trigger switch 221 is pulled in a state where the determination result of the processing unit 35 is inconsistent. In this way, since the tool system 1 includes the notification unit 211 that notifies the results of the specific processing, the user can grasp the results of the specific processing.
- the “work procedure” in the present disclosure means a work procedure using the tool 2.
- the work procedure indicates the order of operations of the one or more work objects in the work step.
- the work procedure is information indicating one or more work instructions in one work process together with their order.
- the work procedure indicates which work object the work to be performed from now on corresponds to among one or more work objects in one work process, and the number of the work in one work process. .
- the order in which tasks are to be performed on a plurality of work objects in one work is defined in a work procedure. Note that if it is not essential to perform the work in accordance with the order of the work procedure regarding multiple work objects in one work, the processing unit 35 does not need to determine whether or not the work steps are out of order; What is necessary is to determine whether or not the object matches any of a plurality of objects registered in advance.
- the torque determination unit 37 is configured to determine whether the tightening torque when the tightening component is attached to the tightening target location is normal.
- the torque determination unit 37 determines whether the tightening torque is normal based on a work instruction defined in the work procedure.
- the work instruction defined in the work procedure includes a target torque value corresponding to the work object.
- the torque determination unit 37 compares the target torque value included in the work instruction with the tightening torque estimated by the torque estimation function to determine whether the work is being performed with the tightening torque according to the work instruction. can be determined.
- the torque determining unit 37 determines that the tightening torque is normal, for example, when the drive control unit 31 stops the drive unit 24 due to the number of strikes of the impact mechanism 25 reaching the threshold number of times. Furthermore, if the drive control unit 31 stops the drive unit 24 by, for example, turning off the trigger switch 221 before the number of hits of the impact mechanism 25 reaches the threshold number, the torque determination unit 37 determines that the tightening torque is Determined as insufficient (not normal). Further, the torque determination unit 37 performs a result storage process in which the determination result is stored in the result storage unit 43 in association with the tightening target location. Note that when the control unit 3a determines that the work on the work target is completed based on the determination result of the torque determination unit 37, it may output a work completion signal to the work target identification system 10 to notify the work completion signal. .
- the work target identification system 10 includes the above-described imaging section 5, the control section 3b, the storage section 4, the tool motion detection section 26, the distance measurement section 27, and the press detection section 28.
- the control section 3b, the storage section 4, the imaging section 5, the tool motion detection section 26, the distance measurement section 27, and the press detection section 28 are housed in the body 20 of the tool 2.
- the imaging section 5 and the distance measuring section 27 are housed in the body section 21.
- the press detection section 28 is housed on the back side of the grip section 22 (a section of the grip section 22 on the opposite side to the section where the trigger switch 221 is arranged).
- the control section 3b, the storage section 4, and the tool motion detection section 26 are housed in the grip section 22 or the mounting section 23.
- the imaging unit 5 is mounted on the tool 2.
- the imaging unit 5 photographs the work object and generates a captured image.
- the imaging unit 5 generates data as a captured image.
- the imaging unit 5 is, for example, a camera having an imaging element and a lens.
- the imaging section 5 is housed in the body 20 (body section 21) of the tool 2.
- the imaging unit 5 is mounted toward the distal end side of the output shaft 241 so as to image the work object during work using the tool 2. Thereby, when working with the tool 2, an image of the work object is captured and a captured image is obtained by the imaging unit 5.
- the imaging section 5 is arranged at the distal end of the body section 21 toward the distal end side (socket 242) of the output shaft 241 so that the socket 242 attached to the output shaft 241 falls within the imaging range.
- the optical axis of the imaging unit 5 is arranged along the rotation axis Ax1 of the output shaft 241.
- the imaging unit 5 is arranged such that its optical axis is located within a predetermined distance from the rotation axis Ax1 of the output shaft 241, and the rotation axis Ax1 and the optical axis are substantially parallel. Note that it is not essential for the imaging unit 5 to generate a captured image so that the socket 242 attached to the output shaft 241 falls within the imaging range.
- the imaging unit 5 only needs to be capable of generating a captured image for identifying the target of the setting work.
- the "captured image for specifying the workpiece to be set” is an image generated by the imaging unit 5 photographing the workpiece while the tool 2 is set on the workpiece to be worked on. It is assumed that the captured image in the present disclosure shows a work object (work) to which the tool 2 is set. Note that the captured image may be any image that can identify the target of the setting work, and the target of the work to which the tool 2 is set does not need to be included in the imaging range of the captured image.
- the tool motion detection unit 26 detects the movement or posture of the tool 2.
- the tool motion detection section 26 includes, for example, a motion sensor 261 such as an acceleration sensor and a gyro sensor.
- the tool motion detection section 26 is housed in the body 20 (grip section 22 or mounting section 23) of the tool 2.
- the tool motion detection unit 26 includes a three-axis acceleration sensor and a three-axis gyro sensor as the motion sensor 261.
- the three-axis acceleration sensor detects acceleration in each of three axes orthogonal to each other, and outputs an electrical signal corresponding to the acceleration.
- a three-axis gyro sensor detects angular velocity around each of three mutually orthogonal axes, and outputs an electrical signal according to the angular velocity.
- the tool motion detection unit 26 can detect, for example, the direction of gravity based on the output of an acceleration sensor, and detect the orientation of the tool 2 with respect to the direction of gravity. Furthermore, the tool motion detection unit 26 can detect the angular velocity of the tool 2 when it moves with rotation, or the rotation angle of the tool 2 from the integral result of the angular velocity, based on the output of the gyro sensor. As an example, in the tool motion detection unit 26, the orientation of the tool 2 is such that the direction of protrusion of the grip part 22 from the body part 21 is downward (in the direction of gravity), and the direction of the protrusion of the grip part 22 from the body part 21 is upward.
- the "attitude of the tool 2" in the present disclosure is, for example, the orientation of the tool 2 determined by rotation angles (for example, roll angle, pitch angle, and yaw angle) around each of three axes with respect to the direction of gravity.
- the tool motion detection section 26 detects the motion and posture of the tool 2 based on the output of the motion sensor 261 (acceleration sensor and gyro sensor), and uses the detection results as motion information regarding the motion and posture of the tool 2 to the control section 3b. output to the set detection section 34.
- the distance measurement unit 27 measures the distance between the tool 2 and the workpiece.
- the distance measurement unit 27 includes a distance sensor 271 such as a RADAR (Radio Detection and Ranging), a LiDAR (Light Detection and Ranging), or an ultrasonic sensor. LiDAR is, for example, an infrared sensor.
- the distance measuring section 27 is housed in the body 20 (body section 21) of the tool 2. Specifically, like the imaging section 5, it is arranged at the distal end of the body section 21 toward the distal end side (socket 242) of the output shaft 241.
- the distance measuring section 27 includes an ultrasonic sensor.
- An ultrasonic sensor is a time-of-time sensor that measures the distance to a workpiece (work object) by measuring the time it takes to emit ultrasonic waves and receive the ultrasonic waves reflected by the workpiece (work object). It is a flight-type distance sensor. The ultrasonic sensor outputs an electrical signal according to the measured distance.
- the distance measurement unit 27 detects the distance between the workpiece (work target) and the tool 2 based on the output of the distance sensor 271.
- the distance measurement section 27 outputs the detection result to the set detection section 34 of the control section 3b as distance information regarding the distance between the tool 2 and the work object.
- the press detection unit 28 detects the press state in which the tool 2 is pressed against the workpiece.
- the press detection section 28 is housed on the back side of the body 20 (grip section 22) of the tool 2.
- the pressure detection unit 28 according to the present embodiment includes a pressure sensor 281 using a metal strain gauge, a semiconductor strain gauge, or the like, for example.
- the pressure sensor 281 detects pressure applied to the back side of the grip portion 22 and outputs an electrical signal according to the detected pressure.
- the pressure detection unit 28 detects that the tool 2 is pressed against the workpiece based on the output of the pressure sensor 281.
- the force applied to the back side of the grip part 22 when the tool 2 is pressed against the work object by the user is the force applied to the back side of the grip part 22 when the user is carrying the tool 2, for example. bigger. Therefore, the press detection unit 28 detects that the tool 2 is pressed against the work target when the pressure detected by the pressure sensor 281 is equal to or higher than the first threshold pressure.
- the press detection section 28 outputs the detection result to the set detection section 34 of the control section 3b as press information of the tool 2.
- the control unit 3b mainly includes, for example, a microcontroller having one or more processors and one or more memories.
- the microcontroller realizes the function of the control unit 3b by executing programs stored in one or more memories using one or more processors.
- the program may be pre-recorded in a memory, or may be provided recorded on a non-temporary recording medium such as a memory card, or may be provided through a telecommunications line.
- the above program is a program for causing one or more processors to function as the control unit 3b.
- the control unit 3b has functions such as an imaging control unit 32, a stability determination unit 33, a set detection unit 34, a processing unit 35, a registration unit 38, a drive detection unit 39, and a work start detection unit 300.
- the control unit 3b enters a sleep state if no operation input is made to the trigger switch 221 or the operation panel 231 for a certain period of time.
- the control unit 3b is activated when an operation input is made to the trigger switch 221 or the operation panel 231 during the sleep state.
- the imaging control section 32 is configured to control the imaging section 5.
- the imaging control unit 32 of this embodiment causes the imaging unit 5 to start the imaging operation when the control unit 3b is activated.
- the stability determining unit 33 determines whether the captured image generated by the imaging unit 5 is stable.
- the stability determination unit 33 performs stability determination processing to determine whether the captured image is stable based on a plurality of frames included in the captured image when the tool 2 is in the operation mode.
- “the captured image is stable” includes the fact that the tool 2 is set on the work target and the image capturing unit 5 is captured without shaking.
- “the captured image is stable” includes that the image is captured in a stable state with imaging controls such as AE (Automatic Exposure) and AWB (Auto White Balance) of the imaging unit 5.
- the stability determining unit 33 calculates the degree of dissimilarity of a plurality of frames, and determines that the captured image is stable when the degree of dissimilarity is less than or equal to a threshold value. Specifically, the stability determination unit 33 calculates the degree of difference between the latest frame included in the captured image and the frame immediately before (past) the latest frame. In the following description, the latest frame included in the captured image may be referred to as the first frame. Further, the frame immediately before the latest frame is sometimes referred to as a second frame. The stability determination unit 33 calculates the difference between the luminance value (density value, gradation value) of the specific area in the first frame and the luminance value (density value, gradation value) of the specific area in the second frame.
- the stability determination unit 33 calculates the degree of difference using, for example, SSD (Sum of Squared Difference) or SAD (Sum of Absolute Difference).
- SSD Serial of Squared Difference
- SAD Sud of Absolute Difference
- the specific area in the first frame and the second frame is, for example, an area defined in advance by coordinates within the captured image. The coordinates of the specific area in the first frame and the second frame are the same. Further, the number of specific regions in the first frame and the second frame may be one or more, but it is desirable to have a plurality of specific regions in order to improve the accuracy of stability determination processing.
- the stability determining unit 33 compares the degree of dissimilarity with a threshold value, and determines that the captured image is stable when the degree of dissimilarity is less than or equal to the threshold value. When the stability determination unit 33 determines that the captured image is stable, it outputs stability information to the set detection unit 34 and the processing unit 35. Note that the stability determining unit 33 does not determine that the captured image is stable when the degree of difference is greater than the threshold value. If the stability determination unit 33 does not determine that the captured image is stable, it does not output stability information to the set detection unit 34 and the processing unit 35.
- the drive detection unit 39 detects the operating state of the drive unit 24.
- the drive detection unit 39 detects that the drive unit 24 is being driven, for example, based on a drive signal input from the control unit 3a.
- the drive detection section 39 detects that the drive section 24 is being driven, it outputs drive information to the work start detection section 300 and the processing section 35 .
- the set detection unit 34 detects the state in which the tool 2 is set on the work target.
- the set detection unit 34 according to the present embodiment performs a process of detecting whether the tool 2 is set as a work target when the tool 2 is in the operation mode.
- the set detection unit 34 is based on the motion information output from the tool motion detection unit 26, the distance information output from the distance measurement unit 27, and the pressing information output from the pressure detection unit 28. , detects the state in which the tool 2 is set on the work target.
- the set detection unit 34 detects whether the tool 2 is set on the work target based on the operation information output from the tool operation detection unit 26.
- the set detection section 34 detects a state in which the tool 2 is set on a work target when the posture of the tool 2 detected by the tool motion detection section 26 is a predetermined posture.
- the "predetermined posture" in the present disclosure refers to, for example, a posture in which, when the posture of the tool 2 and the reference posture are compared, the angular difference between the posture of the tool 2 and the reference posture is less than or equal to a threshold value.
- the “reference posture” refers to, for example, a posture of the tool 2 in which the direction in which the grip portion 22 protrudes from the body portion 21 is downward (in the direction of gravity).
- the set detection unit 34 according to the present embodiment has an average angular difference between the rotation angle around each of the three axes detected by the tool motion detection unit 26 and the rotation angle around the three axes in the reference posture of 5 degrees or less.
- the set detection unit 34 has an average angular difference of 5 between the rotation angle around each of the three axes detected by the tool motion detection unit 26 and the rotation angle around the three axes of the reference posture. If the temperature is less than or equal to 1.5 degrees, the state in which the tool 2 is set on the work target is detected.
- the set detection unit 34 determines that the average difference in angle between the rotation angle around each of the three axes detected by the tool motion detection unit 26 and the rotation angle around the three axes in the reference posture is 5 degrees or less. may be one of a plurality of conditions for detecting the state in which the tool 2 is set to a work target. Note that the reference posture can be changed as appropriate depending on the orientation of the workpiece to be worked on.
- the set detection unit 34 detects whether the tool 2 is set on the work target based on the distance information output from the distance measurement unit 27. Specifically, the set detection unit 34 detects whether the tool 2 is set to the work target when the distance between the tool 2 and the work target detected by the distance measurement unit 27 is within a preset range. Detects the state in which it is present. Note that the set detection unit 34 detects that the distance between the tool 2 and the work target is within a preset range based on a plurality of conditions for detecting the state in which the tool 2 is set on the work target. It may be one.
- the distance between the tool 2 and the work object is within a preset range means that the distance between the tool 2 and the work object detected by the distance measurement unit 27 is calculated from the reference distance. This means that the absolute value of the subtracted value is less than or equal to the threshold distance.
- the "reference distance” is a distance that serves as a reference for the set detection unit 34 to detect the state in which the tool 2 is set on the work target.
- the reference distance is, for example, the distance between the tool 2 and the work object detected by the distance measuring unit 27 when capturing the reference image, and is associated with the reference image.
- the reference distance may be a distance slightly larger than the distance between the distance sensor 271 included in the distance measuring section 27 and the tip of the socket 242.
- the absolute value of the value obtained by subtracting the distance between the tool 2 and the workpiece detected by the distance measurement unit 27 from the reference distance may be simply referred to as a "distance difference.”
- the set detection unit 34 detects whether or not the tool 2 is set on the work target based on the pressing information output from the pressure detection unit 28. Specifically, the set detection unit 34 determines whether the tool 2 is set to the work target when the value of the pressure applied to the back side of the grip unit 22, which is detected by the pressure detection unit 28, is equal to or higher than a first threshold pressure. detect the state in which The set detection unit 34 detects that the value of the pressure applied to the back side of the grip unit 22 is equal to or higher than the first threshold pressure based on a plurality of conditions for detecting the state in which the tool 2 is set on the work target. It may be one of the following.
- the set detection unit 34 detects whether the tool 2 is set to the work target based on the amount of retraction of the trigger switch 221. Specifically, when the trigger switch 221 is pressed halfway by the user, the set detection unit 34 detects that the tool 2 is set to the work target.
- “half-pressed” refers to a state in which the trigger switch 221 is located between the initial position and the on position. Specifically, “half-pressed” refers to a state in which the trigger switch 221 is located approximately halfway between the initial position and the on position.
- the set detection unit 34 detects the state in which the tool 2 is set to the work target when the trigger switch 221 is located between the initial position and the on position.
- the set detection unit 34 may detect a state in which the trigger switch 221 is located between the initial position and the on position based on a plurality of conditions for detecting a state in which the tool 2 is set to the work target. It may be one of the following.
- the set detection unit 34 detects that the tool 2 is stable when stability information is acquired from the stability determination unit 33, that is, when the stability determination unit 33 determines that the captured image is stable. Detects the state set for the work target. Alternatively, the set detection unit 34 uses the fact that the stability determination unit 33 has determined that the captured image is stable as one of the plurality of conditions for detecting the state in which the tool 2 is set on the work target. Good too.
- the set detection unit 34 When the set detection unit 34 detects that the tool 2 is set on the work target, it outputs set detection information to the processing unit 35. Note that the set detection unit 34 does not output set detection information to the processing unit 35 when it does not detect that the tool 2 is set on the work target.
- the set detection unit 34 of this embodiment detects that the tool 2 has a predetermined attitude, the distance difference is less than or equal to a threshold distance, and the value of the pressure applied to the back side of the grip portion 22 is greater than or equal to the first threshold pressure.
- the stability determining unit 33 determines that the captured image is stable and the trigger switch 221 is pressed halfway, it is detected that the tool 2 is set on the work target.
- the set detection unit 34 of this embodiment does not detect the state in which the tool 2 is set on the work target when the posture of the tool 2 is not a predetermined posture.
- the set detection unit 34 of this embodiment does not detect the state in which the tool 2 is set to the work target when the distance difference is larger than the threshold distance.
- the set detection unit 34 of this embodiment does not detect the state in which the tool 2 is set on the work target when the value of the pressure applied to the back side of the grip unit 22 is smaller than the first threshold pressure. Moreover, the set detection unit 34 of this embodiment does not detect the state in which the tool 2 is set on the work target when the stability determination unit 33 does not determine that the captured image is stable. Moreover, the set detection unit 34 of this embodiment does not detect the state in which the tool 2 is set to the work target when the trigger switch 221 is not pressed halfway.
- the work start detection unit 300 detects whether the tool 2 has started working on the work target.
- the work start detection unit 300 determines whether the tool 2 has started working on the work target while the tool 2 is in the operation mode and the set detection unit 34 has detected that the tool 2 is set on the work target. Performs a detection process to determine whether or not it is true.
- the work start detection unit 300 detects that the work has started based on an input signal from an operation button operated at the start of the work.
- the work start detection unit 300 can detect that the work has started.
- an operation button for example, there is a trigger switch 221 for operating the drive unit 24 with an operation amount corresponding to the amount of retraction.
- the operation button is not limited to the trigger switch 221, and may be configured with a button different from the trigger switch 221.
- the operation button may be realized by, for example, a push button switch provided at a position that is touched by the user's hand when the user performs work using the tool 2.
- the work start detection unit 300 detects that the tool 2 has started work on the work target. good.
- the work start detection unit 300 may detect that the work has started based on the detection result of the drive detection unit 39, and since the drive unit 24 is operating, it can be determined that the work on the work object has started. can be detected reliably.
- the work start detection unit 300 detects that work on the work target has started. It's okay. Since the pressed state continues after the work target is specified in the identification process, the work start detection unit 300 can determine that work on the work target has started. Further, when the pressure detected by the pressure sensor 281 of the press detection unit 28 becomes equal to or higher than a predetermined second threshold pressure while the tool 2 is set on the work target, the work start detection unit 300 detects that the tool 2 is set on the work target. It may also be detected that work has started.
- the second threshold pressure is a pressure generated when performing a fastening operation using the tool 2, and the second threshold pressure is set to a higher pressure than the first threshold pressure.
- the work start detection unit 300 receives drive information from the drive detection unit 39 while the tool 2 is set on the work target, the trigger switch 221 is operated to the on position by the user, or If the value of the pressure applied to is equal to or higher than the second threshold pressure, it may be detected that work on the work object has started.
- the processing unit 35 Upon receiving at least one of the stability information output from the stability determination unit 33 and the set detection information output from the set detection unit 34, the processing unit 35 according to the present embodiment performs a predetermined process based on the captured image. Execute processing. In other words, the processing unit 35 executes the identification process based on the captured image when there is a high possibility that the work target can be identified. If the processing unit 35 starts the identification process too early, not only will the work target not be identified, but it will take about 0.5 seconds to 1.0 seconds for the processing unit 35 to execute the identification process, which may cause problems for the user. The specific process may not be started at the timing when the user holds the tool 2.
- the processing unit 35 of the present embodiment can execute the identification processing when there is a high possibility that the work target can be identified, that is, at the optimal timing when the user holds the tool 2, so that the identification processing can be completed easily. The possibility of delays can be reduced. Further, since the specific processing can be executed based on the captured image in which the imaging control such as the AE of the imaging unit 5 and the AWB are stable, the accuracy of the specific processing can be improved.
- the processing unit 35 performs a predetermined process based on the captured image. No processing is performed.
- the processing unit 35 intermittently performs a specifying process for specifying a setting work target to which the tool 2 is set among a plurality of work targets.
- the processing unit 35 has a function of specifying the set work target that appears in the captured image.
- the processing unit 35 performs image processing to compare the captured image of the imaging unit 5 with a plurality of reference images, and identifies the set work target shown in the captured image from among the plurality of objects.
- the plurality of reference images are stored in the storage section 4 (image storage section 41).
- “intermittent” includes not only the meaning of occurring at fixed time intervals, but also the meaning of occurring at non-fixed time intervals.
- performing the specific processing intermittently includes not only the meaning of performing the specific processing at regular intervals, but also the meaning of performing the specific processing at non-constant intervals.
- the processing unit 35 performs pattern recognition processing on the captured image using a plurality of reference images corresponding to a plurality of objects as template data, and specifies a set work target. That is, the processing unit 35 identifies the set work target shown in the captured image by comparing the captured image with a plurality of reference images corresponding to the plurality of objects.
- pattern recognition processing refers to image processing that recognizes what an object appears in an image based on the shape of the object shown in the image. Examples of this type of pattern recognition processing include pattern matching processing, processing for recognizing objects in images using a learned model created by machine learning, and the like.
- the pattern matching process referred to here is a process of comparing template data and a comparison target (such as a captured image) using template data as described above.
- a machine learning method an appropriate algorithm may be used, for example, a deep learning algorithm may be used.
- the processing unit 35 executes at least one of restricting the operation of the driving unit 24 and notifying when the identified work target does not correspond to the work instructions defined in the work procedure. In short, the processing unit 35 determines whether the work target (set work target) identified by the processing unit 35 corresponds to a work instruction defined in a preset work procedure. That is, the processing section 35 determines whether the work object specified by the processing section 35 matches the work object that is the object of the work instructed by the work instruction included in the work procedure.
- the processing unit 35 extracts data of the work procedure corresponding to the set work target from the procedure storage unit 44 of the storage unit 4. Then, the processing unit 35 determines whether or not the work target that is the target of the current work instruction specified by the work procedure extracted from the procedure storage unit 44 matches the identified work target. If the two match, the processing unit 35 determines that the identified work target corresponds to the work instruction defined in the work procedure. If the two do not match, the processing unit 35 determines that the identified work target does not correspond to the work instruction specified in the work procedure.
- the processing unit 35 controls the restriction of the operation of the drive unit 24 and the notification. Do at least one of them.
- “Notification” in the present disclosure includes not only direct notification to the user by the notification unit 211 of the tool system 1, but also indirect notification to the user via an external terminal (for example, a mobile terminal, etc.) .
- the processing unit 35 determines that the work instruction does not correspond to the specified work procedure, the processing unit 35 does not operate the drive unit 24 even if the trigger switch 221 is pulled. In other words, only when the processing section 35 determines that the identified work object corresponds to the work instruction defined in the work procedure, the operation of the drive section 24 is permitted. Therefore, even if the tool 2 is set on a work target that is out of the work procedure, the drive section 24 remains stopped, making the tightening work impossible. Thereby, it is possible to prevent work from being performed in an incorrect work procedure. When the processing unit 35 determines that the identified work target does not correspond to the work instructions specified in the work procedure, the processing unit 35 may lock the trigger switch 221 so that it cannot be pulled.
- the processing unit 35 determines that the identified work target does not correspond to the work instructions specified in the work procedure, the processing unit 35 causes the notification control unit 36 to operate the notification unit 211.
- the notification unit 211 functions as a user notification unit that notifies the user that the tool 2 is set on a work target that is outside the work procedure.
- the processing unit 35 when the processing unit 35 receives at least one of the stability information output from the stability determination unit 33 and the set detection information output from the set detection unit 34, the processing unit 35 performs predetermined processing on at least the setting work target. Execute specific processing to be specified. Further, as a predetermined process, the processing unit 35 executes a procedure determination process that compares the identified work target with a work instruction defined in the work procedure and determines the correspondence between the two. Further, as a result of the procedure determination process, if the work target does not correspond to the work instruction, the processing section 35 executes at least one of limiting the operation of the driving section 24 and notifying the operation.
- the processing unit 35 stops image processing of the captured image in the identification process.
- the processing unit 35 suppresses the power consumption of the tool 2 by stopping the image processing of the captured image in the identification process. can do.
- the processing unit 35 may stop the identification process and also stop the imaging process by the imaging unit 5. .
- the processing unit 35 performs a specifying process and sets the work content regarding the work target specified in the specifying process (for example, setting of target torque value, etc.) may be stopped. This can reduce the possibility that the setting of the work content for the work object will be erroneously changed during the work using the tool 2.
- the registration unit 38 When the operation mode of the tool 2 is the registration mode, the registration unit 38 performs an image registration process of storing a plurality of reference images in the image storage unit 41 of the storage unit 4, and stores a plurality of target torque values in the torque storage of the storage unit 4. Torque registration processing to be stored in the unit 42 is performed.
- the registration unit 38 stores, for example, a still image generated by imaging the work object by the imaging unit 5 in the image storage unit 41 as a reference image.
- the trigger switch 221 also functions as a shutter button.
- the imaging section 5 generates a still image.
- the registration unit 38 stores this still image in the image storage unit 41 as a reference image.
- the storage unit 4 is composed of, for example, a semiconductor memory, and has the functions of an image storage unit 41, a torque storage unit 42 (target value storage unit), a result storage unit 43, and a procedure storage unit 44.
- the image storage section 41, the torque storage section 42, the result storage section 43, and the procedure storage section 44 are configured with one memory in this embodiment, they may be configured with a plurality of memories.
- the storage unit 4 may be a recording medium such as a memory card that is removably attached to the tool 2.
- the storage unit 4 may be realized by a data server on the network.
- the image storage unit 41 stores a plurality of reference images in association with a plurality of objects.
- the torque storage unit 42 stores a plurality of target torque values (target values) in one-to-one correspondence with a plurality of objects.
- the target torque value is a target value of tightening torque when attaching a tightening component to a corresponding object.
- the result storage unit 43 stores a plurality of objects (work targets) and determination results of a plurality of tightening target locations by the torque determination unit 37 in association with each other. Further, it is preferable that the result storage unit 43 stores the determination result of the torque determination unit 37 by adding a time stamp indicating the work time. This makes it possible to distinguish the determination results of a plurality of tightening target locations in each of a plurality of objects (workpieces to be worked on) on the assembly line.
- the procedure storage unit 44 stores data on one or more work procedures.
- the work procedure refers to a work procedure using the tool 2, and is, for example, data that defines in which order the work is to be performed on a plurality of objects in one work.
- each workpiece A1 has two tightening points, and here, each of the two tightening points (first and second tightening points) in one workpiece A1 is second object). It is assumed that the user uses the tool 2 to attach a fastening part to each object. Note that in the following description, an example will be described in which work is performed on a plurality of work objects in an order determined by a work procedure, but work on a plurality of work objects may be performed in an arbitrary order.
- the tool 2 is in an initial state where the image registration process and torque registration process by the registration unit 38 have not been performed. That is, in the tool 2 in the initial state, the image storage section 41 and the torque storage section 42 store the first and second reference images corresponding to the first and second objects, and the first and second reference images, respectively. target torque value is not stored.
- the user sets the operation mode of the tool 2 to registration mode (S1).
- the user operates the operation panel 231 to input the torque value of the tightening torque when attaching the tightening part to the first object (the first tightening target location in the workpiece A1) (S2).
- the drive control unit 31 sets the input torque value as a torque setting value for the first object.
- the user sets the tool 2 on the first object (work object), pulls the trigger switch 221, and performs a tightening operation to attach the tightening part to the first object (S3).
- the first object to be worked on is photographed, and a still image of the first object is generated.
- the registration unit 38 performs registration processing (image registration processing and torque registration processing) (S4). Specifically, the registration unit 38 stores the still image of the first object generated during the tightening operation in step S3 in the image storage unit 41 as a first reference image corresponding to the first object. performs image registration processing. Further, during the tightening work in step S3, the registration unit 38 registers the torque setting value when the tightening part is attached to the first object, which is the work target, to the first torque setting value corresponding to the first object. Torque registration processing is performed to store the target torque value in the torque storage unit 42. That is, the first target torque value is stored in correspondence with the first reference image.
- the processing unit 35 executes the procedure determination process
- the target torque value is registered as being included in the work instruction in the registration process.
- the registration unit 38 registers the work procedure so that the work instruction for instructing the work on the first object becomes the first work instruction in the work procedure.
- the registration unit 38 registers a work instruction that instructs work on a first object as a work whose work order is "first" in the work procedure, and this work instruction includes a first goal. Contains torque values.
- the torque determination unit 37 stores a first determination result as to whether or not the tightening torque is normal when the tightening component is attached to the first object, in association with the first object.
- a result storage process is performed to store the result in the unit 43 (S5).
- the user sequentially performs the tightening work on the second object using the same work procedure as when the first object is the work object. Specifically, the user operates the operation panel 231 to input the torque value of the tightening torque when attaching the tightening part to the second object (S6), and then attaches the tool 2 to the second object. In the set state, a tightening operation is performed to attach the tightening component to the second object (S7). At this time, a still image of the second object to be worked on is generated, and the registration unit 38 performs registration processing (image registration processing and torque registration processing) (S8).
- registration processing image registration processing and torque registration processing
- the registration unit 38 registers a work instruction that instructs work on the second object as the "second" work in the work procedure, and this work instruction includes a second target torque value. .
- the torque determination section 37 performs a result storage process of storing the second determination result as to whether or not the tightening torque in the tightening operation in step S7 is normal in the result storage section 43 (S9).
- the user Since the registration process for all objects (tightening target locations) in the workpiece A1 has been completed, the user operates the operation panel 231 to switch the operation mode of the tool 2 from the registration mode to the operation mode (S10).
- the registration mode ends when the operation mode of the tool 2 is switched from the registration mode to the operation mode.
- the processes shown in FIGS. 5 to 7 are processes that are executed by the tool system 1 every time a frame of a captured image captured by the imaging unit 5 is updated.
- the set detection section 34 acquires motion information from the tool motion detection section 26 (S21).
- the set detection unit 34 checks whether the (operational) state of the processing unit 35 is in the state St0 (S22).
- the "state St0" of the present disclosure is a state in which the processing unit 35 is in an idle state and specific processing is not started.
- the “state St1” of the present disclosure is a state in which the processing unit 35 is in a standby state, and although the specific processing has not been started, there is a possibility that the specific processing will be started.
- “State St2” in the present disclosure is a state in which the processing unit 35 is executing specific processing.
- the set detection unit 34 compares the acceleration of the tool 2 with the acceleration threshold T1 based on the operation information (S23).
- the acceleration threshold T1 in this embodiment is approximately zero.
- the threshold value T1 is set to a value smaller than the minimum value of acceleration that is expected to occur when the tool 2 is moving. That is, the set detection unit 34 checks whether the tool 2 is moving at all. In other words, the set detection unit 34 checks whether the tool 2 is not placed on a desk, floor, or the like. It is clear that the state in which the tool 2 is placed on a desk, floor, etc. is not the state in which the tool 2 is set on a work target.
- the set detection unit 34 compares the acceleration of the tool 2 with the acceleration threshold T3 based on the motion information (S24).
- the acceleration threshold T3 in this embodiment is a value larger than the threshold T1, and is set to a value close to the acceleration of the tool 2 when the user moves with the tool 2 (the tool 2 is swung around by the user). has been done. It is clear that a state in which the user is moving with the tool 2 or swinging the tool 2 is not a state in which the tool 2 is set as a work target.
- the set detection unit 34 compares the angular difference between the posture of the tool 2 and the reference posture with the angular difference threshold T5 based on the motion information. (S25).
- the angular difference threshold T5 in this embodiment is, for example, 10 degrees. If the angular difference between the posture of the tool 2 and the reference posture is smaller than the threshold T5 (S25: Yes), the LED of the light emitting unit 234 for photographing is turned on (S26). Then, the state of the processing unit 35 becomes the state St1, that is, the standby state (S27), and the process proceeds to step S65 in FIG. 7.
- step S22 if the state of the processing unit 35 is not the state St0, that is, if the state of the processing unit 35 is the state St1 or the state St2 (S22: No), the set detection unit 34 detects the state based on the operation information. , the acceleration of the tool 2 is compared with an acceleration threshold T2 (S31). If the acceleration of the tool 2 is greater than the threshold T2 (S31: Yes), the set detection unit 34 compares the acceleration of the tool 2 with the acceleration threshold T4 based on the motion information (S32).
- the set detection unit 34 compares the angular difference between the orientation of the tool 2 and the reference orientation with the angular difference threshold T6 based on the motion information ( S33). If the orientation of the tool 2 and the reference orientation are smaller than the angular difference threshold T6 (S33: Yes), the process proceeds to step S41 in FIG. 6. Note that if the acceleration of the tool 2 is less than the threshold T2 (S31: No), if the acceleration of the tool 2 is more than the threshold T4 (S32: No), or if the angular difference between the posture of the tool 2 and the reference posture is the threshold If it is T6 or more (S33: No), the process proceeds to step S34.
- acceleration thresholds T1 and T2 in this embodiment are set to have hysteresis, and the threshold T2 is a smaller value than the threshold T1.
- the acceleration thresholds T3 and T4 are set to have hysteresis, and the threshold T4 is larger than the threshold T3.
- the angle difference thresholds T5 and T6 are set to have hysteresis, and the threshold T6 is larger than the threshold T5.
- the stability determination unit 33 checks the latest frame (first frame) in the captured image (S41). Further, the set detection section 34 obtains distance information from the distance measurement section 27 (S42), and obtains pressing information from the press detection section 28 (S43). Next, the set detection unit 34 checks whether the state of the processing unit 35 is in state St1 (S44). When the state of the processing unit 35 is the state St1 (S44: Yes), the set detection unit 34 compares the angular difference between the posture of the tool 2 and the reference posture with the angular difference threshold T7 based on the operation information. (S45).
- the angular difference threshold T7 in this embodiment is, for example, 5 degrees.
- the stability determination unit 33 determines whether the latest frame of the captured image and the frame immediately before (past) the latest frame The degree of difference from frame 2) is calculated. Then, the stability determining unit 33 compares the degree of dissimilarity calculated by the stability determining unit 33 with a threshold value T9 of the degree of dissimilarity (S46). If the degree of difference calculated by the stability determining section 33 is smaller than the threshold T9 (S46: Yes), the stability determining section 33 outputs stability information to the set detecting section 34 and the processing section 35.
- the set detection unit 34 calculates a distance difference based on the distance information, and compares the distance difference with the threshold distance T11 (S47). If the distance difference is smaller than the threshold distance T11 (S47: Yes), the set detection unit 34 compares the pressure applied to the back side of the grip unit 22 with the threshold pressure T13 based on the pressing information (S48). . If the pressure applied to the back side of the grip section 22 is greater than the threshold pressure T13 (S48: Yes), the set detection section 34 checks whether the trigger switch 221 is pressed halfway (S49). If the trigger switch 221 is pressed halfway (S49: Yes), the set detection section 34 outputs set detection information to the processing section 35. Then, the state of the processing unit 35 becomes state St2, that is, a state in which the processing unit 35 is executing a specific process (S50), and the process proceeds to step S61 in FIG. 7.
- step S44 if the state of the processing unit 35 is not the state St1, that is, if it is the state St2 (S44: No), the set detection unit 34 detects the attitude of the tool 2 and the reference attitude based on the operation information. The angle difference is compared with an angle difference threshold T8 (S51). If the angular difference between the posture of the tool 2 and the reference posture is smaller than the threshold T8 (S51: Yes), the stability determination unit 33 calculates the degree of difference between the first frame and the second frame. Then, the stability determining unit 33 compares the degree of dissimilarity calculated by the stability determining unit 33 with a threshold value T10 of the degree of dissimilarity (S52).
- the stability determining section 33 If the degree of difference calculated by the stability determining section 33 is smaller than the threshold T10 (S52: Yes), the stability determining section 33 outputs stability information to the set detecting section 34 and the processing section 35.
- the set detection unit 34 calculates a distance difference based on the distance information, and compares the distance difference with the threshold distance T12 (S53). If the distance difference is smaller than the threshold distance T12 (S53: Yes), the set detection unit 34 compares the pressure applied to the back side of the grip unit 22 with the threshold pressure T14 based on the pressing information (S54). If the pressure applied to the back side of the grip section 22 is greater than the threshold pressure T14 (S54: Yes), the set detection section 34 checks whether the trigger switch 221 is pressed halfway (S55). If the trigger switch 221 is pressed halfway (S55: Yes), the set detection section 34 outputs set detection information to the processing section 35. The process then proceeds to step S61 in FIG.
- the angle difference thresholds T7 and T8 in this embodiment are set to have hysteresis, and the threshold T8 is larger than the threshold T7.
- the dissimilarity thresholds T9 and T10 are set to have hysteresis, and the threshold T10 is larger than the threshold T9.
- the threshold distances T11 and T12 are set to have hysteresis, and the threshold distance T12 has a larger value than the threshold distance T11.
- the threshold pressures T13 and T14 are set to have hysteresis, and the threshold pressure T14 has a smaller value than the threshold pressure T13.
- the processing unit 35 Upon receiving at least one of the stability information output from the stability determination unit 33 and the set detection information output from the set detection unit 34, the processing unit 35 executes specific processing based on the captured image (S61 ). Then, the processing unit 35 checks whether the set work target has been identified and whether the identified work target is in accordance with the work procedure (S62). If the processing unit 35 is able to identify the setting work target and the identified work target complies with the work procedure (S62: Yes), the state of the motor shifts to state St4 (S63).
- State St4 of the present disclosure is a state in which when the trigger switch 221 is pulled by the user and the trigger switch 221 is turned on, the motor included in the drive unit 24 rotates. After the state of the motor shifts to state St4, the process proceeds to step S65.
- step S62 if the processing unit 35 is unable to identify the setting work target, or if the identified work target does not follow the work procedure (S62: No), the state of the motor shifts to state St3. (S64). After the state of the motor shifts to state St3, the process proceeds to step S65.
- step S65 the processing unit 35 determines whether the state in which the tool 2 does not move continues for a predetermined period of time based on the motion information output from the tool motion detection unit 26 (S65). If the state in which the tool 2 does not move continues for a predetermined period of time, the processing unit 35 maintains the current state St1 or St2. On the other hand, if the state in which the tool 2 does not move continues for a predetermined period of time, the processing section 35 sets the state of the processing section 35 to state St0 (S66), and sets the state in which no specific processing is started. In this way, the processing section 35 stops the specific processing when the movement of the tool 2 detected by the tool motion detection section 26 continues for a predetermined period of time or less.
- the processing unit 35 stops the specific process to move the tool 2. Power consumption of the system 1 can be reduced.
- the work start detection unit 300 starts work on the work target based on the operation signal of the trigger switch 221. This is detected (S68), and a work start detection signal is output to the processing section 35.
- the processing unit 35 sets the state of the processing unit 35 to state St0, and sets the state to a locked state in which the specific processing is stopped (S69).
- the processing section 35 may set the state of the processing section 35 to the state St0, and may continue the locked state in which the specific processing is stopped for a certain period of time (predetermined stop time).
- the work start detection unit 300 may detect that work on the work target has started when the press detection unit 28 detects a pressed state in a state where the work target has been specified. Further, when the drive detection unit 39 detects that the drive unit 24 (motor) is operating (rotating) with the work target identified, the work start detection unit 300 determines that work on the work target has started. May be detected.
- the work start detection unit 300 detects that work on the work object has started based on one or more of the operation signal of the trigger switch 221, the detection signal of the press detection unit 28, and the detection signal of the drive detection unit 39. may be detected.
- the processing unit 35 has stopped image processing of the captured image in the specific process, and by stopping some of the functions of the processing unit 35, the power consumption of the tool 2 can be reduced. Note that when the work start detection unit 300 detects the start of work, the processing unit 35 may further stop the photographing operation by the imaging unit 5, and the power consumption of the tool 2 can be further reduced.
- the processing unit 35 checks whether the state of the motor is in the state St4 (S70). If the state is St4 (S70: Yes), the processing unit 35 permits the tightening operation in which the motor of the drive unit 24 rotates, and the tightening operation is performed by rotating the motor (S71). At this time, the drive control section 31 of the tool 2 controls the drive section 24 so that the target torque value corresponding to the specified work object becomes the torque setting value. The process ends when the tightening operation is completed.
- the processing unit 35 detects whether the work on the work target has been completed (S73). For example, when the processing unit 35 detects that the state of pressing the tool 2 against the work object has ended based on the pressure detected by the pressure detection unit 28 (S73: Yes), the processing unit 35 releases the locked state that stops the specific process. (S74), and the operation ends. That is, when the press detection unit 28 detects that the pressing state has ended after stopping the specific processing, the processing unit 35 releases the locked state that stops the specific processing. When the pressing state ends, the work on the work object has been completed, so the processing section 35 can restart the identification process of identifying a new work object. In addition, after stopping the specific processing, the locked state continues until the pressing state ends, so by stopping the specific processing while the work is being performed on the work target, the power consumption of the tool system 1 can be reduced. can be reduced.
- the processing unit 35 stops the specific processing after a predetermined stop time has elapsed from the timing at which it is detected that the state of pressing the tool 2 against the work object has ended based on the pressure detected by the pressure detection unit 28.
- the locked state may be released. That is, the processing unit 35 may release the locked state in which the specific processing is stopped when a predetermined stopping time has elapsed after stopping the specific processing. Thereby, the power consumption of the tool system 1 can be reduced by stopping the specific processing during the stop period when there is a high possibility that work is being performed on the work object.
- step S73 when the drive detection unit 39 detects that the drive unit 24 (motor) has stopped operating (rotating), the processing unit 35 may detect that the work on the work object has been completed. In this case, the processing unit 35 releases the locked state in which the specific process is stopped after a certain period of time (stopping time) has elapsed from the timing at which the stoppage of the drive unit 24 is detected or from the timing at which the stoppage of the drive unit 24 is detected. Bye. That is, when the drive detection unit 39 detects that the operation of the drive unit 24 has stopped after stopping the specific processing, the processing unit 35 may release the locked state in which the specific processing is stopped.
- stopping time a certain period of time
- the processing section 35 can restart the identification process of identifying a new work object. Further, after stopping the specific processing, the locked state continues until the drive unit 24 stops operating, so by stopping the specific processing while the work is being performed on the work object, the tool system 1 can be Power consumption can be reduced.
- step S73 when a work completion signal indicating that the work on the work object has been completed is input from the tool 2 to the processing section 35, the processing section 35 may detect that the work on the work object has been completed. . In this case, the processing unit 35 only needs to release the locked state in which the specific process is stopped after the timing at which the work completion signal is input or after a certain period of time (stop time) has elapsed from the timing at which the work completion signal was input. . That is, when the processing unit 35 receives a work completion signal from the tool 2 that notifies the completion of the work after stopping the specific processing, it is sufficient to release the locked state in which the specific processing is stopped.
- the processing unit 35 releases the locked state when the work completion signal is input, it is possible to restart the identification process for identifying a new work target.
- the locked state continues until the work completion signal is input, so by stopping the specific processing while the work is being performed on the work target, the tool system 1 is consumed. Power can be reduced.
- step S70 if the state of the motor is not in the state St4 in step S70, that is, if it is in the state St3 (S70: No), the processing unit 35 performs a warning operation such as lighting the notification unit 211 in red (S72), and performs an operation. finish. Note that the motor included in the drive unit 24 does not rotate.
- a work target identification method includes a identification processing step and a work start detection step.
- the imaging unit 5 mounted on the portable tool 2 performs image processing on a captured image of the work object, and the work object matches one of one or more pre-registered objects. Specify whether or not.
- the tool 2 has a drive section 24 that operates using power from a power source.
- the work start detection step it is detected that work on the work target has started in a state where the work target has been identified as one of one or more objects in the identification processing step.
- a program is a program for causing a computer system to execute the above-described work target identification method.
- the imaging unit 5 may be of a stereo camera type, and the distance between the imaging unit 5 and the work object may be measured based on the image captured by the imaging unit 5. Then, the set detection unit 34 detects that the tool 2 is set on the work target when the absolute value of the value obtained by subtracting the distance between the imaging unit 5 and the work target from the reference distance is less than or equal to the threshold value. It may also be detected.
- the processing unit 35 When the processing unit 35 performs the specific processing, it may perform rotation correction or distortion correction on at least one of the captured image and the reference image based on the operation information.
- “Distortion correction” in the present disclosure refers to correcting a captured image by partially expanding or contracting the captured image (reference image) by an arbitrary amount. For example, the processing unit 35 can obtain a captured image in which the rectangular object appears as a rectangle by performing distortion correction on the captured image in which the rectangular object appears as a trapezoid.
- Predetermined posture means that the angular difference between the rotation angle around any one of the three axes of the posture of the tool 2 detected by the tool motion detection unit 26 and the rotation angle of the reference posture is less than or equal to a threshold value. It may be a posture.
- the set detection section 34 determines whether the work target is set on the tool 2 based on the detection results of the tool motion detection section 26, distance measurement section 27, and press detection section 28. However, based on one or more of the tool movement detection section 26, distance measurement section 27, and press detection section 28, it is detected whether or not the work target is set on the tool 2. May be detected. That is, it is not essential that the tool 2 include all of the tool motion detection section 26, distance measurement section 27, and pressure detection section 28, but one of the tool motion detection section 26, distance measurement section 27, and pressure detection section 28 It is sufficient to have one or more.
- the set detection section 34 may detect whether or not the work object is set on the tool 2 based on the detection result of the tool motion detection section 26, and in this case, the distance measurement section 27 and The press detection section 28 can be omitted as appropriate.
- the processing unit 35 if the set work target specified by the specific process does not match the next work target determined in the work procedure, the processing unit 35 operates the drive unit 24 even if the trigger switch 221 is pulled.
- the processing section 35 is configured not to do so, the operation of the processing section 35 is not limited to this. For example, if it is not essential to perform the work in accordance with the order of the work procedure for a plurality of work objects in one work, the processing unit 35 determines whether or not the order of the set work objects deviates from the work procedure. There is no need to do so, and the drive unit 24 may be operated in response to the operation of the trigger switch 221 to perform work on the set work target.
- the posture (motion information) of the tool 2 detected by the tool motion detection section 26 is also stored in the storage section 4 (image storage) in association with the reference image generated by the imaging section 5. 41).
- the reference image and the attitude of the tool 2 are registered in association with each other, so in the operation mode, if the captured image and the attitude of the tool 2 are specified, the processing unit 35 associates the captured image with the attitude of the tool 2. What is necessary is to compare the reference image and the captured image. Alternatively, the attitude of the tool 2 associated with the reference image may be used as the reference attitude.
- the distance between the tool 2 and the work object detected by the distance measurement unit 27 is used as the reference distance, and the reference image generated by the imaging unit 5 is used. It may also be stored in the storage unit 4 (image storage unit 41). Furthermore, in the image registration process in the registration mode, the pressure applied to the grip part 22 (press information) detected by the pressure detection part 28 is also stored in association with the reference image generated by the imaging part 5. It may be stored in the unit 4 (image storage unit 41).
- the stability determination unit 33 may calculate the degree of coincidence (degree of similarity) between the first frame and the second frame, and determine whether the captured image is stable.
- the stability determination unit 33 uses, for example, NCC (Normalized Cross-Correlation) to calculate the degree of coincidence between the first frame and the second frame.
- the stability determination unit 33 performs stability determination processing
- the brightness value of the specific area in the first frame and the movement of the specific area in the second frame and one or more frames before (past) the second frame are used.
- the degree of difference may be calculated by comparing the averaged luminance values.
- the stability determination unit 33 may perform stability determination processing on the first frame by performing pattern recognition processing using other frames including the second frame as template data.
- the main body that executes the tool system 1 or the work target identification method in the present disclosure includes a computer system.
- a computer system mainly consists of a processor and a memory as hardware.
- the processor executes the program recorded in the memory of the computer system, the function as the main body for executing the tool system 1 or the work target identification method in the present disclosure is realized.
- the program may be pre-recorded in the memory of the computer system, may be provided through a telecommunications line, or may be recorded on a non-transitory storage medium readable by the computer system, such as a memory card, optical disc, hard disk drive, etc. may be provided.
- a processor in a computer system is comprised of one or more electronic circuits including semiconductor integrated circuits (ICs) or large scale integrated circuits (LSIs).
- the integrated circuits such as IC or LSI referred to herein have different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration).
- FPGAs Field-Programmable Gate Arrays
- logic devices that can reconfigure the connections inside the LSI or reconfigure the circuit sections inside the LSI, may also be used as processors. Can be done.
- the plurality of electronic circuits may be integrated into one chip, or may be provided in a distributed manner over a plurality of chips.
- a plurality of chips may be integrated into one device, or may be distributed and provided in a plurality of devices.
- the computer system herein includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including semiconductor integrated circuits or large-scale integrated circuits.
- the tool system 1 it is not an essential configuration for the tool system 1 that multiple functions of the tool system 1 are concentrated in one housing, and the constituent elements of the tool system 1 are distributed and provided in multiple housings. You can leave it there. Furthermore, at least some of the functions of the tool system 1 may be realized by cloud (cloud computing) or the like.
- the imaging section 5 is not limited to the torso section 21 of the body 20, and may be provided, for example, on the mounting section 23 of the body 20, the battery pack 201, or the like. Similarly, the arrangement of the control units 3a, 3b, storage unit 4, etc. can also be changed as appropriate. Further, the tool 2 may include the imaging section 5.
- the work target identification system 10 may be attached externally to the tool 2.
- the control section 3a of the tool 2 and the control section 3b of the work target identification system 10 may be directly electrically connected, or may communicate with each other via a communication section.
- the communication department is configured to use a wireless communication device that is compliant with standards such as Wi-Fi (registered trademark), Bluetooth (registered trademark), ZigBee (registered trademark), or low-power radio that does not require a license (specified low-power radio), for example.
- a wireless communication method may also be adopted.
- the work target identification system 10 may include a power source different from the battery pack 201, and the power source different from the battery pack 201 may be used as the power source for the imaging unit 5, the control unit 3b, and the like.
- the stability determination unit 33 may output stability information only to the set detection unit 34.
- the processing unit 35 Even if the processing unit 35 does not receive the stability information output from the stability determination unit 33, as long as it receives the set detection information output from the set detection unit 34, it can perform predetermined processing including specific processing. good.
- the application of the tool system 1 is not limited to an assembly line for assembling workpieces in a factory, but may be used in other applications.
- the tool 2 is an impact wrench, but the tool 2 is not limited to an impact wrench, and may be, for example, a nut runner or an oil pulse wrench. Further, the tool 2 may be, for example, a driver (including an impact driver) used for tightening a screw (tightening component). In this case, instead of the socket 242, a bit (such as a driver bit) is attached to the tool 2.
- the tool 2 is not limited to a configuration in which the power source is the battery pack 201, but may be configured in a configuration in which the power source is an AC power source (commercial power source). Further, the tool 2 is not limited to an electric tool, but may be an air tool having an air motor (drive unit) that operates with compressed air (power) supplied from an air compressor as a power source.
- each of the plurality of tightening target parts in one workpiece is the work target, but the work target is a module, a component, or a product having a plurality of tightening target parts. etc. may be used.
- the work target is a module etc. that has multiple tightening locations
- the target torque values corresponding to the multiple tightening locations in one work target may be the same value or different values. It's okay.
- the notification unit 211 is not limited to a light emitting unit such as an LED, but may be realized by an image display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. Further, the notification unit 211 may perform notification (presentation) by means other than display, and may include, for example, a speaker or a buzzer that generates sound (including audio). In this case, it is preferable that the notification control unit 36 causes the notification unit 211 to generate different sounds depending on whether the determination result of the processing unit 35 is inconsistent and when the processing unit 35 has specified the setting work target.
- the notification unit 211 may be realized by a vibrator that generates vibrations, a transmitter that transmits a notification signal to an external terminal (such as a mobile terminal) of the tool 2, or the like. Furthermore, the notification unit 211 may have two or more functions such as display, sound, vibration, and communication.
- the storage unit 4 may store data on predetermined work procedures for a plurality of work targets.
- the processing unit 35 selects a reference image to be used for specific processing from among the plurality of reference images based on the work procedure. Specifically, the processing unit 35 preferentially selects, from among the plurality of reference images, the reference image corresponding to the work target whose work procedure is the most recent. The most recent work target is the work target scheduled to be worked on next after the last identified work target.
- the processing unit 35 performs image processing to compare the selected reference image with the captured image as template data. That is, the processing unit 35 predicts the set work target appearing in the captured image based on the work procedure and selects the reference image. This makes it possible to reduce the time required for the processing unit 35 to identify the set work target shown in the captured image.
- the tool system (1) of the first aspect includes a portable tool (2), an imaging section (5), a processing section (35), and a work start detection section (300).
- the tool (2) has a drive section (24) that operates with power supplied from a power source.
- the imaging unit (5) is mounted on the tool (2) and photographs the work target of the tool (2).
- the processing unit (35) performs image processing on the image taken by the imaging unit (5), and performs specific processing to determine whether the work target matches any of one or more pre-registered objects. conduct.
- the work start detection unit (300) detects that work on the work target has started in a state where the work target has been identified as one of one or more objects by the identification process. When the work start detection unit (300) detects the start of work, the processing unit (35) stops image processing of the captured image in the specific process.
- the tool (2) when the tool (2) has started working on the work object, there is no need to perform the identification process for identifying the work object, so by stopping the image processing of the captured image in the identification process, the tool (2) Power consumption of the system (1) can be reduced.
- the processing unit (35) when the work start detection unit (300) detects the start of work, the processing unit (35) further controls the photographing operation by the imaging unit (5). make it stop.
- the power consumption of the tool system (1) can be further reduced by stopping the imaging operation of the imaging unit (5) when the tool (2) has started working on the work object. .
- the tool system (1) of the third aspect further includes a notification unit (211) that notifies the result of the specific process in the first or second aspect.
- the user of the tool (2) can grasp the result of the specific process.
- the work start detection unit (300) performs the following operations based on the input signal from the operation button operated at the start of the work. Detects that work has started.
- the work start detection unit (300) can detect the start of the work based on the user operating the operation button at the start of the work.
- the operation button includes a trigger switch (221) for operating the drive unit (24) with an amount of operation corresponding to the amount of retraction.
- the work start detection unit (300) can detect the start of the work based on the user operating the trigger switch (221) at the start of the work.
- the tool system (1) of the sixth aspect in any one of the first to fifth aspects, further includes a press detection section (28) that detects a press state in which the tool (2) is pressed against the work target. Be prepared.
- the work start detection unit (300) detects that the work has started when the press detection unit (28) detects a pressed state after the work target is specified in the identification process.
- the work start detection section (300) detects the start of the work based on the result of the pressure detection section (28) detecting the pressing state in which the tool (2) is pressed against the work object. can do.
- the tool system (1) of the seventh aspect in any one of the first to sixth aspects, further includes a drive detection section (39) that detects the operating state of the drive section (24).
- the work start detection section (300) detects that the work has started based on the detection result of the drive detection section (39).
- the work start detection section (300) can detect the start of work based on the operating state of the drive section (24).
- the tool system (1) of the eighth aspect in any one of the first to seventh aspects, further includes a tool motion detection section (26) that detects movement of the tool (2).
- the processing unit (35) stops the specific processing when the movement of the tool (2) detected by the tool movement detection unit (26) continues for a predetermined period of time or less.
- the processing unit (35) stops the specific process when a predetermined stopping time has elapsed after stopping the specific process. Release the locked state.
- the power consumption of the tool system (1) can be reduced by stopping the specific processing during a period when there is a high possibility that work on the work object is being performed.
- the tool system (1) of the tenth aspect in any one of the first to ninth aspects, further includes a press detection section (28) that detects a press state in which the tool (2) is pressed against the work object. Be prepared.
- the processing section (35) releases the locked state that stops the specific processing.
- the power consumption of the tool system (1) can be reduced by stopping the specific processing while the work is being performed on the work target.
- the tool system (1) of the eleventh aspect in any one of the first to tenth aspects, further includes a drive detection section (39) that detects the operating state of the drive section (24).
- a drive detection section (39) detects that the operation of the drive unit (24) has stopped after stopping the specific process
- the processing unit (35) releases the locked state that stops the specific process.
- the power consumption of the tool system (1) can be reduced by stopping the specific processing while the work is being performed on the work target.
- the processing unit (35) notifies the completion of the work from the tool (2) after stopping the specific process.
- the work completion signal is input, the locked state that stops the specific process is released.
- the power consumption of the tool system (1) can be reduced by stopping the specific processing while the work is being performed on the work target.
- the work target identification method of the thirteenth aspect includes a identification processing step and a work start detection step.
- the identification processing step the imaging unit (5) mounted on the portable tool (2) processes the captured image of the work target, and the work target is determined to be one or more pre-registered targets. Specify whether it matches any of them.
- the tool (2) has a drive section (24) that operates with power from a power source.
- the work start detection step it is detected that work on the work target has started in a state where the work target has been identified as one of one or more objects in the identification processing step.
- image processing of the captured image in the specific processing step is stopped.
- the tool (2) when the tool (2) has started working on the work object, there is no need to perform the identification process for identifying the work object, so by stopping the image processing of the captured image in the identification process, the tool (2) Power consumption of the system (1) can be reduced.
- the program of the fourteenth aspect is a program for causing a computer system to execute the work target identification method of the thirteenth aspect.
- the tool (2) when the tool (2) has started working on the work object, there is no need to perform the identification process for identifying the work object, so by stopping the image processing of the captured image in the identification process, the tool (2) Power consumption of the system (1) can be reduced.
- various configurations (including modified examples) of the tool system (1) according to the embodiment can be realized by a work target identification method, a (computer) program, a non-temporary recording medium on which the program is recorded, etc. It is possible to convert
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Details Of Spanners, Wrenches, And Screw Drivers And Accessories (AREA)
- Portable Power Tools In General (AREA)
- General Factory Administration (AREA)
Abstract
Description
(1)概要
まず、本実施形態に係る工具システム1の概要について、図1を参照して説明する。
以下、本実施形態に係る工具システム1の詳細な構成について、図1~図3を参照して説明する。
本実施形態に係る工具システム1は、例えば、工場におけるワーク(対象物)の組立作業を行う組立ラインに用いられる。特に、本実施形態では一例として、工具システム1が備える工具2は、例えば、インパクトレンチ等の、締付部品(例えば、ボルト又はナット等)の締め付けに用いられる締付工具である。より詳細には、本実施形態では、1つのワークに対して締付対象箇所が複数あり、ユーザが、1つの作業スペースにおいて、工具2を用いて、複数の締付対象箇所の各々に締付部品を取り付けるケースを想定する。
図1に示すように、本実施形態に係る工具システム1は、工具2と、工具2の作業対象を特定する作業対象特定システム10とを備える。
まず、本実施形態に係る工具システム1における工具2の構成について、図1~図3を参照して説明する。工具2は、制御部3aと、駆動部24と、インパクト機構25と、通知部211と、電池パック201とを有している(図1参照)。
次に、作業対象特定システム10の構成について、図1~図3を参照して説明する。作業対象特定システム10は、上述した撮像部5と、制御部3bと、記憶部4と、工具動作検知部26と、距離測定部27と、押圧検知部28とを有している。
以下、本実施形態に係る工具システム1の動作について、図4~7を参照して説明する。
まず、工具システム1の登録モードの動作例について、図4を参照して説明する。ここでは、工具2は、登録部38による画像登録処理及びトルク登録処理が行われていない初期状態である。つまり、初期状態にある工具2においては、画像記憶部41及びトルク記憶部42に、それぞれ、第1~第2の対象物に対応する第1~第2の基準画像、及び第1~第2の目標トルク値が記憶されていない。
次に、工具システム1の運用モードの動作例について、図5~図7を参照して説明する。
上記実施形態は、本開示の様々な実施形態の一つに過ぎない。上記実施形態は、本開示の目的を達成できれば、設計等に応じて種々の変更が可能である。本開示において説明する各図は、模式的な図であり、各図中の各構成要素の大きさ及び厚さそれぞれの比が、必ずしも実際の寸法比を反映しているとは限らない。
以上説明した実施形態等から、以下の態様が開示されている。
2 工具
5 撮像部
24 駆動部
26 工具動作検知部
28 押圧検知部
35 処理部
39 駆動検知部
211 通知部
221 トリガスイッチ
300 作業開始検知部
Claims (14)
- 動力源から供給される動力で動作する駆動部を有する可搬型の工具と、
前記工具に搭載されて、前記工具の作業対象を撮影する撮像部と、
前記撮像部が撮影した撮像画像の画像処理を行い、前記作業対象が、予め登録された1以上の対象物のいずれかと一致するか否かを特定する特定処理を行う処理部と、
前記特定処理により前記作業対象が前記1以上の対象物のいずれかと特定された状態で、前記作業対象に対する作業が開始したことを検知する作業開始検知部、を備え、
前記処理部は、前記作業開始検知部が作業の開始を検知すると、前記特定処理における前記撮像画像の画像処理を停止する、
工具システム。 - 前記処理部は、前記作業開始検知部が作業の開始を検知すると、前記撮像部による撮影動作を更に停止させる、
請求項1に記載の工具システム。 - 前記特定処理の結果を通知する通知部を更に備える、
請求項1又は2に記載の工具システム。 - 前記作業開始検知部は、前記作業の開始時に操作される操作ボタンからの入力信号に基づいて、前記作業が開始したことを検知する、
請求項1~3のいずれか1項に記載の工具システム。 - 前記操作ボタンは、引込量に応じた動作量で前記駆動部を動作させるためのトリガスイッチを含む、
請求項4に記載の工具システム。 - 前記工具が前記作業対象に押し当てられている押圧状態を検知する押圧検知部を更に備え、
前記作業開始検知部は、前記特定処理で前記作業対象が特定された後に、前記押圧検知部が押圧状態を検知すると、前記作業が開始したことを検知する、
請求項1~5のいずれか1項に記載の工具システム。 - 前記駆動部の動作状態を検知する駆動検知部を更に備え、
前記作業開始検知部は、前記駆動検知部の検知結果に基づいて、前記作業が開始したことを検知する、
請求項1~6のいずれか1項に記載の工具システム。 - 前記工具の動きを検知する工具動作検知部を更に備え、
前記処理部は、前記工具動作検知部が検知した前記工具の動きが所定値以下である状態が所定時間継続した場合、前記特定処理を停止する、
請求項1~7のいずれか1項に記載の工具システム。 - 前記処理部は、前記特定処理を停止してから所定の停止時間が経過すると、前記特定処理を停止するロック状態を解除する、
請求項1~8のいずれか1項に記載の工具システム。 - 前記工具が前記作業対象に押し当てられている押圧状態を検知する押圧検知部を更に備え、
前記処理部は、前記特定処理を停止した後で、前記押圧状態が終了したことを前記押圧検知部が検知すると、前記特定処理を停止するロック状態を解除する、
請求項1~9のいずれか1項に記載の工具システム。 - 前記駆動部の動作状態を検知する駆動検知部を更に備え、
前記処理部は、前記特定処理を停止した後で、前記駆動部の動作が停止したことを前記駆動検知部が検知すると、前記特定処理を停止するロック状態を解除する、
請求項1~10のいずれか1項に記載の工具システム。 - 前記処理部は、前記特定処理を停止した後で、前記工具から前記作業の完了を通知する作業完了信号が入力されると、前記特定処理を停止するロック状態を解除する、
請求項1~11のいずれか1項に記載の工具システム。 - 動力源からの動力により動作する駆動部を有する可搬型の工具に搭載されている撮像部が作業対象を撮影した撮像画像の画像処理を行い、前記作業対象が、予め登録された1以上の対象物のいずれかと一致するか否かを特定する特定処理ステップと、
前記特定処理ステップにより前記作業対象が前記1以上の対象物のいずれかと特定された状態で、前記作業対象に対する作業が開始したことを検知する作業開始検知ステップ、とを含み、
前記作業開始検知ステップで作業の開始を検知すると、前記特定処理ステップにおける前記撮像画像の画像処理を停止する、
作業対象特定方法。 - コンピュータシステムに、請求項13に記載の作業対象特定方法を実行させるための
プログラム。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23852285.8A EP4570437A4 (en) | 2022-08-10 | 2023-07-06 | TOOL SYSTEM, WORK TARGET IDENTIFICATION METHOD, AND PROGRAM |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2022128299A JP2024025113A (ja) | 2022-08-10 | 2022-08-10 | 工具システム、作業対象特定方法及びプログラム |
| JP2022-128299 | 2022-08-10 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024034302A1 true WO2024034302A1 (ja) | 2024-02-15 |
Family
ID=89851389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2023/025174 Ceased WO2024034302A1 (ja) | 2022-08-10 | 2023-07-06 | 工具システム、作業対象特定方法及びプログラム |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4570437A4 (ja) |
| JP (1) | JP2024025113A (ja) |
| WO (1) | WO2024034302A1 (ja) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140259599A1 (en) * | 2013-03-15 | 2014-09-18 | Honda Motor Co., Ltd. | Torque gun with vision system |
| US20200342237A1 (en) * | 2019-04-24 | 2020-10-29 | Würth International Ag | Method for the Emergency Shutdown of Hand-Guided Tools, and Hand-Guided Tool |
| JP2021074811A (ja) * | 2019-11-06 | 2021-05-20 | パナソニックIpマネジメント株式会社 | 工具システム、工具管理方法及びプログラム |
| JP2021175593A (ja) | 2016-12-28 | 2021-11-04 | パナソニックIpマネジメント株式会社 | 工具システム |
| JP2022012046A (ja) * | 2020-06-30 | 2022-01-17 | パナソニックIpマネジメント株式会社 | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム |
| JP2022017963A (ja) * | 2020-07-14 | 2022-01-26 | パナソニックIpマネジメント株式会社 | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム |
-
2022
- 2022-08-10 JP JP2022128299A patent/JP2024025113A/ja active Pending
-
2023
- 2023-07-06 WO PCT/JP2023/025174 patent/WO2024034302A1/ja not_active Ceased
- 2023-07-06 EP EP23852285.8A patent/EP4570437A4/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140259599A1 (en) * | 2013-03-15 | 2014-09-18 | Honda Motor Co., Ltd. | Torque gun with vision system |
| JP2021175593A (ja) | 2016-12-28 | 2021-11-04 | パナソニックIpマネジメント株式会社 | 工具システム |
| US20200342237A1 (en) * | 2019-04-24 | 2020-10-29 | Würth International Ag | Method for the Emergency Shutdown of Hand-Guided Tools, and Hand-Guided Tool |
| JP2021074811A (ja) * | 2019-11-06 | 2021-05-20 | パナソニックIpマネジメント株式会社 | 工具システム、工具管理方法及びプログラム |
| JP2022012046A (ja) * | 2020-06-30 | 2022-01-17 | パナソニックIpマネジメント株式会社 | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム |
| JP2022017963A (ja) * | 2020-07-14 | 2022-01-26 | パナソニックIpマネジメント株式会社 | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4570437A4 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2024025113A (ja) | 2024-02-26 |
| EP4570437A1 (en) | 2025-06-18 |
| EP4570437A4 (en) | 2025-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7142247B2 (ja) | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム | |
| JP7496562B2 (ja) | 工具システム | |
| JP7486071B2 (ja) | 工具システム、工具、基準画像生成方法及びプログラム | |
| JP7458018B2 (ja) | 工具システム、工具管理方法及びプログラム | |
| JP7336669B2 (ja) | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム | |
| WO2022004133A1 (ja) | 工具システム、工具、作業対象特定システム、作業対象特定方法及びプログラム | |
| US12240093B2 (en) | Tool system, tool management method, and program | |
| WO2024034302A1 (ja) | 工具システム、作業対象特定方法及びプログラム | |
| WO2021090650A1 (ja) | 工具システム、基準画像生成方法及びプログラム | |
| WO2022259687A1 (ja) | 工具システム、判定システム、判定方法及びプログラム | |
| JP2023113486A (ja) | 撮像システム、工具システム、設定方法及びプログラム | |
| JP2024075313A (ja) | 工具システム、制御方法及びプログラム | |
| WO2021090649A1 (ja) | 工具システム、工具管理方法及びプログラム | |
| JP2023149065A (ja) | 判定システム、判定方法及びプログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23852285 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023852285 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023852285 Country of ref document: EP Effective date: 20250310 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023852285 Country of ref document: EP |