JP6961641B2 - Construction machinery attachment management system and management server - Google Patents

Description

The present invention relates to a management system and a management server for a construction machine attachment, and more particularly to a management server having a database for storing various information about attachments attached to the construction machine and a management system including the same.

In construction machines such as hydraulic excavators and wheel loaders, there are various types of attachments such as buckets, breakers, and cutters depending on the work application. As the attachment, in addition to the genuine product made by the construction machine maker, a commercially available product or a modified product made by the attachment maker may be used. However, some attachments on the market and modified products do not meet the specifications of the body of construction machinery. The operation of construction machinery is generally controlled using control parameters optimized for vehicle body specifications. If the specifications such as the dimensions and weight of the attachment do not conform to the vehicle body specifications (if they are significantly different from the specifications of the genuine attachment), the optimum control parameters will differ from the control parameters optimized for the genuine product. It becomes. If the attachments of commercial products or modified products are operated using the control parameters optimized for genuine products as they are, there is a concern that operability and work efficiency will decrease.

When a service worker tries to improve these defects by repairing, it is necessary for the manufacturer to identify the attachment used for each construction machine, grasp various information of the attachment, and then identify the cause of the defect. However, it is a very time-consuming task for the manufacturer to grasp the specification information such as the manufacturer, model, weight, and dimensions of the attachment mounted on the construction machine, which is a heavy burden on the service staff.

As a technique for identifying an attachment attached to a construction machine, for example, there is one described in Patent Document 1. The attachment recognition device described in Patent Document 1 is attached by collating the feature amount of the attachment extracted based on the detection results of the attitude sensor and the distance sensor with the feature amount of the reference attachment stored in advance in the database. It recognizes the attachment that is being used.

JP-A-2017-157016

However, it is difficult to collect information other than the shape and type of the attachment by the technique described in Patent Document 1. Therefore, in addition to the shape and type of the attachment, a new method for collecting identification information for identifying the attachment such as the model and manufacturer of the attachment without undue effort is required.

Further, in Patent Document 1, since the attachment recognition work is performed in the vehicle body, it is difficult for the manufacturer to manage the mounting status of the attachments of each vehicle body.

The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to collect identification information of attachments attached to each construction machine without spending excessive effort to collect various information of attachments. It is to provide a management system and a management server of a construction machine attachment capable of constructing a database that can be managed by the manufacturer.

The present application includes a plurality of means for solving the above problems, and to give an example thereof, the present application has a database for storing a plurality of types of information regarding attachments including identification information for identifying attachments mounted on construction machines. Construction including a management server, an image data acquisition device configured to acquire image data of an attachment to be identified and transmit it to the management server, and an information processing device capable of exchanging information with the management server. In the machine attachment management system, the management server acquires the identification information of the attachment to be identified based on the image data of the attachment to be identified transmitted from the image data acquisition device, and the acquired identification information is stored in the database. It is characterized in that the attachment to be identified is identified by collating with the above, and the database is updated according to the collation result.

According to the present invention, the management server identifies the attachment to be identified by acquiring the identification information based on the image data of the attachment to be identified transmitted from the image data acquisition device and collating it with the database, and the collation result. Since the database is updated according to the above, it is possible to construct a database in which the identification information of the attachments attached to each construction machine can be collected without undue effort and various information of the attachments can be managed on the manufacturer side.
Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.

It is a block diagram which shows one Embodiment of the management system of the construction machine attachment of this invention. It is a perspective view which shows the structure of the bucket of an example of the attachment which is the management object of one Embodiment of the construction machine attachment management system of this invention. It is a figure which shows an example of the name plate attached to the attachment which is the management object of one Embodiment of the construction machine attachment management system of this invention. It is a block diagram of the hardware of the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a functional block diagram of the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the whole image of the attachment to be identified acquired by the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the name plate / stamped image of the attachment to be identified acquired by the image data acquisition apparatus which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is a figure which shows an example of the maker logo image of the attachment to be identified acquired by the image data acquisition apparatus which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is a figure which shows an example of the damage image of the attachment to be identified acquired by the image data acquisition apparatus which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is a flowchart which shows an example of the processing procedure for the acquisition of the image data of the attachment to be identified in the image data acquisition apparatus which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is a figure which shows an example of the machine body information screen of a construction machine displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the display screen for taking an image of the whole attachment displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is a figure which shows an example of the input screen of the presence / absence of a name plate / stamp which is displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the display screen for image | imaging of the name plate / stamp which is displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the input screen of presence / absence of a maker logo displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the display screen for image | imaging of the maker logo displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the input screen of the presence or absence of the damaged part displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the display screen for image | imaging of the damaged part displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a block diagram of the hardware of the management server which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a functional block diagram of the management server which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the structure of the information stored in the attachment information database in the management server which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is a flowchart which shows an example of the processing procedure for identification of the attachment in the management server which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a flowchart which shows an example of the detailed processing procedure of step S30 of the flowchart diagram shown in FIG. It is explanatory drawing which shows the processing of the attachment identification part of the management server which constitutes a part of one Embodiment of the management system of the construction machine attachment of this invention. It is a figure which shows an example of the confirmation screen of the information about the attachment to be identified displayed on the image data acquisition apparatus which constitutes a part of one Embodiment of the construction machine attachment management system of this invention. It is explanatory drawing which shows the information which can be exchanged between the management server and the computer (client) in one Embodiment of the management system of the construction machine attachment of this invention.

Hereinafter, embodiments of the management system and management server of the construction machine attachment of the present invention will be described with reference to the drawings.

[One Embodiment]
First, the configuration of an embodiment of the construction machine attachment management system of the present invention will be described with reference to FIG. FIG. 1 is a configuration diagram showing an embodiment of a management system for a construction machine attachment of the present invention. In the present embodiment, a hydraulic excavator will be described as an example of a construction machine.

In FIG. 1, the hydraulic excavator 100 is shipped from a factory of a construction machine manufacturer (construction machine maker) and operates at a work site such as civil engineering work, demolition work, and completion work. In FIG. 1, only one hydraulic excavator 100 is shown for the sake of simplification of the drawing, but in reality, a plurality of hydraulic excavators 100 are operating at various work sites. The hydraulic excavator 100 includes a self-propellable lower traveling body 101, an upper swivel body 102 mounted on the lower traveling body 101, and a working device 103 provided on the front side of the upper swivel body 102. The work device 103 is rotatably attached to the boom 105 rotatably attached to the upper swing body 102, the arm 106 rotatably attached to the tip of the boom 105, and the tip of the arm 106. It is composed of an attachment 110.

Each hydraulic excavator 100 can be equipped with different types of attachments 110 depending on the work content. The attachment 110 includes a bucket mainly used for excavation (shown in FIG. 1), a skeleton bucket capable of sieving rubble, a slope bucket for slope creation, a cutter and a breaker used for demolition work, and the like. There are a wide variety of things. In addition to the genuine product manufactured by the construction machine manufacturer for the construction machine, the attachment 110 includes a commercially available product manufactured by a manufacturer other than the construction machine manufacturer. The construction machine 100 operating at the work site may be equipped with an attachment 110 other than the genuine product, depending on the request of the customer who uses the construction machine 100 or the like. Therefore, it is required that the construction machine maker side grasps various information about the attachment 110 mounted on the construction machine 100, for example, the type, the manufacturer, the model, and the like.

Therefore, the construction machine attachment management system (hereinafter referred to as a management system) according to the present embodiment is a database that can be managed by the construction machine manufacturer by collecting various information of the attachment 110 mounted on each construction machine 100. Is constructed, and various information of the attachment 110 stored in the database is provided to the persons concerned with the construction machine 100. The management system acquires image data of the management server 10 having a database 20 that stores various information about the construction machine 100 including the information of the attachment 110 and the attachment 110 to be identified attached to the construction machine 100, and the management server 10 It includes an image data acquisition device 50 to be transmitted to, a management server 10, and a computer (client) 80 as an information processing device capable of exchanging various information of the construction machine 100. The computer 80 is used by, for example, a designer or a service worker of a construction machine maker, an operator of the construction machine 100, a construction manager, or the like. The details of the persons concerned with the construction machine 100 that can use the computer 80 and the information that can be browsed thereof will be described later.

The management server 10 is managed by a construction machine maker, and is installed in, for example, a management center 1. The management center 1 is also called a base station and is installed at the head office, branch offices, production factories, etc. of a construction machine manufacturer. The management server 10 can also be installed in a data center that specializes in server operation and maintenance.

The management center 1 is connected to the wireless communication antenna 121 via a dedicated line 131, for example. The image data acquisition device 50 can be connected to the wireless communication antenna 121 by wireless communication 132 via the mobile communication base station 122, and can be connected to the management center 1 via the Internet line 133, for example. Further, the image data acquisition device 50 can be connected to the hydraulic excavator 100 by wireless communication 134. The computer 80 can be connected to the management center 1 via the Internet line 133. The construction machine 100 can be connected to the wireless communication antenna 121 from the satellite communication 135 via the communication satellite 123.

Next, the attachment that is the management target of the embodiment of the construction machine attachment management system of the present invention will be described with reference to FIGS. 2 and 3. FIG. 2 is a perspective view showing a bucket structure of an example of an attachment that is a management target of an embodiment of the construction machine attachment management system of the present invention. FIG. 3 is a diagram showing an example of a name plate attached to an attachment to be managed according to an embodiment of the construction machine attachment management system of the present invention.

As shown in FIG. 2, for example, the bucket, which is an example of the attachment 110, has a bottom plate 111 curved from the bottom side toward the opening side, side plates 112 provided on both the left and right sides of the bottom plate 111, and one side of the bottom plate 111. A plurality of claws 113 provided on the edge edge at intervals in the arrangement direction of the side plates 112, and a pin provided at the other end of the bottom plate 111 and connecting the arm 106 (see FIG. 1) and the attachment 110 (FIG. 1). It is provided with a hinge 114 into which (not shown) is inserted.

A name plate 115 is attached to the attachment 110, for example. The name plate 115 is a character string in which various information related to the attachment 110, such as identification information for identifying the attachment 110 and physical information indicating the physical characteristics of the attachment 110, is written. The identification information includes the manufacturer, model, serial number, and the like. Physical information includes capacity, weight, dimensions, and the like. On the name plate 115, for example, as shown in FIG. 3, in order from the top, a character string 115a indicating a capacity, a character string 115b indicating a weight, a character string 115c indicating a model, and a character string 115d indicating a serial number are written. The character string (information) written on the name plate 115 shown in FIG. 3 is composed of only alphanumeric characters, but is composed of character strings including Japanese and other languages and symbols in addition to alphanumeric characters. It is also possible.

Instead of the name plate 115, a label on which various information of the attachment 110 is written may be attached. Further, instead of the name plate 115, there is also a case where various information of the attachment 110 is directly engraved on a member such as the bottom plate 111 or the side plate 112 of the attachment 110. That is, the name plate, the label, and the stamp function as a character string information display unit in which a character string indicating various information such as identification information and physical information of the attachment 110 is written.

Next, an image data acquisition device that constitutes a part of an embodiment of the construction machine attachment management system of the present invention will be described. First, the hardware configuration of the image data acquisition device will be described with reference to FIG. FIG. 4 is a configuration diagram of the hardware of the image data acquisition device.

The image data acquisition device 50 is configured to acquire image data of the attachment 110 (see FIG. 1) to be identified attached to the construction machine and transmit it to the management server 10 (see FIG. 1). The image data acquisition device 50 includes, for example, a microcomputer 51, a communication module 52, an image pickup module 53, a user interface 54, and a GPS sensor 55 as its hardware configuration.

The microcomputer 51 has a storage device 57 composed of RAM, ROM, and the like, and a processing device (for example, a CPU) 58. The storage device 57 stores in advance programs and various information necessary for the calculation of the processing device 58. The storage device 57 may be configured to include a magnetic storage device such as a hard disk drive in place of or in addition to the semiconductor memory of the ROM and RAM. The processing device 58 appropriately reads a program and various information from the storage device 57, and executes processing according to the program.

The communication module 52 transmits and receives various information to and from the management server 10 via the mobile communication base station 122 (see FIG. 1) and the wireless communication antenna 121 (see FIG. 1). Further, various information is transmitted to and received from the management server 10 via the Internet line 133 (see FIG. 1). Further, various information is transmitted and received to and from the construction machine by wireless communication 134.

The image pickup module 53 directly takes an image of the attachment 110 to be identified and acquires the image data of the attachment 110, for example, a camera. The image data acquisition device omits the image pickup module 53 and takes in the image data of the attachment 110 imaged by the external image pickup device into the storage device 57 via an external storage medium (for example, a USB memory or an SD memory card). Such a configuration is also possible.

The user interface 54 is a part for exchanging information between a user (a service worker or the like who operates the image data acquisition device 50) and the microcomputer 51. The user interface 54 includes, for example, a touch panel and operation buttons that combine a display device that displays various screens and an input device that allows input from the user.

The GPS (Global Positioning System) sensor 55 includes an antenna 55a that receives signals from GPS satellites. The GPS sensor 55 calculates the position coordinates of the antenna 55a in the earth coordinate system based on the time difference between the signals received from a plurality of GPS satellites.

As the image data acquisition device 50, for example, a smartphone or a tablet terminal can be used. It is also possible to use a system in a construction machine equipped with a microcomputer and a communication function.

Next, the function of the image data acquisition device will be described with reference to FIGS. 5 to 9. FIG. 5 is a functional block diagram of the image data acquisition device. FIG. 6 is a diagram showing an example of an entire image of the attachment to be identified acquired by the image data acquisition device. FIG. 7 is a diagram showing an example of a name plate / stamped image of an attachment to be identified acquired by an image data acquisition device. FIG. 8 is a diagram showing an example of a maker logo image of the attachment to be identified acquired by the image data acquisition device. FIG. 9 is a diagram showing an example of a damaged image of the attachment to be identified acquired by the image data acquisition device.

Each function of the image data acquisition device 50 described below is realized by executing a program of a predetermined application on the microcomputer 51. In FIG. 5, the image data acquisition device 50 includes an aircraft information acquisition unit 61, an overall image acquisition unit 62, a name plate / stamped image acquisition unit 63, a maker logo image acquisition unit 64, and a damaged image acquisition unit 65. It has a configuration that functions as an information acquisition unit 66, a time information acquisition unit 67, a storage unit 69, and an information transmission processing unit 71.

The machine information acquisition unit 61 acquires machine information indicating various information about the machine of the construction machine 100 to which the attachment 110 to be identified is attached from the construction machine 100 via the communication module 52 (see FIG. 4) and stores it. It is to be temporarily stored in 69. Further, the aircraft information acquisition unit 61 displays the aircraft information acquired from the construction machine 100 on the display device of the user interface 54 (see FIG. 4). Specific processing will be described later.

The overall image acquisition unit 62 acquires and acquires the image data of the entire image by capturing the entire image of the attachment 110 to be identified via the imaging module 53 (see FIG. 4) based on a predetermined operation of the user. The image data of the entire image is temporarily stored in the storage unit 69. The whole image is an image showing the whole shape of the attachment to be identified, for example, the whole image 621 shown in FIG. Specific processing will be described later.

The name plate / stamped image acquisition unit 63 determines whether or not the attachment 110 to be identified has the name plate 115 or stamped based on the input operation of the user. In addition, when it is determined that the name plate 115 or the stamp is present, the name plate / stamp image of the attachment 110 to be identified is imaged via the image pickup module 53 based on a predetermined operation of the user. The image data of the image is acquired, and the image data of the acquired name plate / stamped image is temporarily stored in the storage unit 69. The name plate / stamped image is an image of a character string information display unit on which a character string indicating various information of the attachment 110 such as a name plate, a label, and a stamp is written. For example, the name plate / stamped image shown in FIG. Image 631. Specific processing will be described later.

The maker logo image acquisition unit 64 determines whether or not the attachment 110 to be identified has the maker logo based on the input operation of the user. In addition, when it is determined that the maker logo is present, the image data of the maker logo image is acquired and acquired by capturing the maker logo image of the attachment 110 to be identified via the image pickup module 53 based on the predetermined operation of the user. The image data of the maker logo image is temporarily stored in the storage unit 69. The maker logo image is an image of a logo on which characters, symbols, figures, etc. indicating an attachment manufacturer shown on the attachment 110 are described, and is, for example, the maker logo image 641 shown in FIG. Specific processing will be described later.

The damaged image acquisition unit 65 determines whether or not the attachment 110 to be identified has a damaged portion based on a user input operation. In addition, when it is determined that there is a damaged part, the image data of the damaged image is acquired and acquired by capturing the damaged image of the attachment 110 to be identified via the imaging module 53 based on a predetermined operation of the user. The image data of the damaged image is temporarily stored in the storage unit 69. The damaged image is an image of a damaged portion of the attachment 110, and is, for example, a damaged image 651 including a crack 651a and a claw defect 651b shown in FIG. Specific processing will be described later.

The position information acquisition unit 66 acquires position coordinates (position information) via the GPS sensor 55 when each image acquisition unit 62, 63, 64, 65 captures each image 621, 631, 641, 651, respectively. The acquired position information is associated with the image data of the images 621, 631, 641, and 651 captured by the image acquisition units 62, 63, 64, and 65, and temporarily stored in the storage unit 69. That is, the position information acquisition unit 66 acquires the position coordinates of the imaging locations of the images 621, 631, 641, and 651, and links the position information of the imaging locations to the image data of the images 621, 631, 641, and 651. It is something to attach.

The time information acquisition unit 67 acquires the current time when each image acquisition unit 62, 63, 64, 65 captures each image 621, 631, 641, 651, respectively, and each acquired time information is acquired by each image acquisition unit. It is associated with the image data of each of the images 621, 631, 641, and 651 captured by 62, 63, 64, and 65, and temporarily stored in the storage unit 69. That is, the time information acquisition unit 67 acquires the imaging time of each image 621, 631, 641, 651, and associates the imaging time with the image data of each image 621, 631, 641, 651. The time information acquisition unit 67 can acquire the current time from the mobile communication base station 122 via the communication module 52, for example. Further, when it is desired to acquire the time with higher accuracy, it is also possible to acquire the current time sent from the communication satellite 123 via the communication module 52. It is also possible to acquire the current time based on an internal timer (not shown) built in the processing device 58 (see FIG. 4).

The information transmission processing unit 71 transfers the image data of the entire image 621, the name plate / stamped image 631, the maker logo image 641, and the attachment 110 to be identified of the damaged image 651 temporarily stored in the storage unit 69 to the attachment 110. Is transmitted to the management server 10 via the communication module 52 together with the machine information of the construction machine 100 equipped with the above. In addition, position information indicating the imaging location and time information indicating the imaging time are added to each image data to be transmitted.

The image data acquisition device 50 further includes the function of the information correction unit 72. The information correction unit 72 obtained the information about the identification target attachment 110 transmitted from the management server 10 by the management server 10 by the process described later based on the image data of the identification target attachment 110 transmitted by the image data acquisition device 50. The result) is corrected via the user's operation, and the corrected information is transmitted (replied) to the management server 10 via the communication module 52. Specific processing will be described later.

Next, FIGS. 5 and 10 to 18 show an example of a processing procedure for acquiring the image data of the attachment in the image data acquisition device constituting a part of the embodiment of the management system of the construction machine attachment of the present invention. Will be described using. FIG. 10 is a flowchart showing an example of a processing procedure for acquiring image data of an attachment to be identified in an image data acquisition device that constitutes a part of an embodiment of a construction machine attachment management system of the present invention. ..

The time to acquire the image of each attachment 110 is, for example, at the time of periodic inspection or replacement of the attachment 110. A service worker who performs periodic inspections of the attachment 110 performs a predetermined operation on the image data acquisition device 50, so that the image data acquisition device 50 acquires the image data of the attachment 110 to be identified and transmits it to the management server 10. (The image data acquisition device 50 starts a predetermined process).

First, in the image data acquisition device 50 shown in FIG. 5, the aircraft information acquisition unit 61 acquires the aircraft information of the construction machine 100 from the construction machine 100, and the acquired aircraft information is displayed on the display device of the user interface 54 (see FIG. 4). It is displayed as an aircraft information screen (step S11 shown in FIG. 10). FIG. 11 is a diagram showing an example of a construction machine body information screen displayed on an image data acquisition device that constitutes a part of an embodiment of a construction machine attachment management system of the present invention. The machine information screen 611 shown in FIG. 11 includes a machine information display unit 611a showing machine information of a model, a machine number, and an operating time. The aircraft information screen 611 also includes a panel 611b called "Attachment Registration". The service worker who operates the image data acquisition device 50 can confirm the aircraft information of the construction machine 100 to which the attachment 110 is attached by confirming the aircraft information screen 611. When the panel 611b of the "attachment registration" of the aircraft information screen 611 is touch-operated by the service personnel, the aircraft information acquisition unit 61 shown in FIG. 5 temporarily stores the aircraft information acquired from the construction machine 100. Remember in.

Further, when the panel 611b of the "attachment registration" is operated by the service staff, the process for acquiring various image data of the attachment 110 to be identified is started. Specifically, the overall image acquisition unit 62 of the image data acquisition device 50 waits in a state in which shooting is possible, and displays a first display screen that prompts the acquisition of the entire image of the attachment 110. FIG. 12 is a diagram showing an example of a display screen for capturing an image of the entire attachment displayed on the image data acquisition device. The first display screen 622 shown in FIG. 12 includes the notation "Please take an image of the entire attachment". When the service worker performs a predetermined operation while the first display screen 622 is displayed, the overall image acquisition unit 62 shown in FIG. 5 captures the entire image 621 (see FIG. 6) of the attachment 110 and images of the overall image 621. Data is acquired (step S12 shown in FIG. 10). Further, the acquired image data of the entire image 621 is temporarily stored in the storage unit 69.

When the entire image 621 of the overall image acquisition unit 62 is captured, the position information acquisition unit 66 acquires the position coordinates from the GPS sensor 55, and the acquired position coordinates are linked to the image data of the overall image 621 as the shooting position information. It is stored in the storage unit 69. In addition, the time information acquisition unit 67 acquires the current time from the mobile communication base station 122, associates the acquired current time with the image data of the entire image 621 as shooting time information, and stores it in the storage unit 69.

Next, the name plate / stamped image acquisition unit 63 of the image data acquisition device 50 determines the name plate 115 of the attachment 110 and the presence / absence of stamping based on the input of the service staff (step S13 shown in FIG. 10). Specifically, the name plate / stamped image acquisition unit 63 displays on the display device a first input screen on which it is possible to input a name plate 115 or a determination as to whether or not the attachment 110 has a stamp. FIG. 13 is a diagram showing an example of an input screen for the presence / absence of a name plate / stamp displayed on the image data acquisition device. The first input screen 632 shown in FIG. 13 has a display 632a indicating "Is there a name plate or stamp on the attachment?" Contains 632c. When the selection panel 632b of "Yes (stamping / name plate photography)" is touch-operated by the service personnel on the first input screen 632, the name plate / stamping image acquisition unit 63 has the name plate 115 or stamping on the attachment 110. (YES) is determined. On the other hand, when the "No" selection panel 632c is touch-operated, the name plate / stamped image acquisition unit 63 determines that the attachment 110 has no name plate 115 and no stamp (NO).

If YES is determined in step S13, the name plate / stamped image acquisition unit 63 waits in a state in which shooting is possible, and displays a second display screen prompting the acquisition of the name plate / stamped image of the attachment 110. FIG. 14 is a diagram showing an example of a display screen for capturing an image of a name plate / stamp displayed on an image data acquisition device. The second display screen 633 shown in FIG. 14 includes the notation "Please take a picture of the name plate or stamp". When the service worker performs a predetermined operation while the second display screen 633 is displayed, the name plate / stamped image acquisition unit 63 captures the name plate / stamped image 631 (see FIG. 7) of the attachment 110 and the name plate / stamped image. The image data of the engraved image 631 is acquired (step S14 shown in step FIG. 10). Information to the effect that the name plate / stamped image 631 is added to the image data of the image captured after the input of "Yes" by the touch operation via the first input screen 632 of the service worker. Further, the acquired image data of the name plate / stamped image 631 is temporarily stored in the storage unit 69, and the process proceeds to step S15. On the other hand, if NO is determined in step S13, the process of the name plate / stamped image acquisition unit 63 is completed without capturing the name plate / stamped image 631, and the process proceeds to step S15.

In the position information acquisition unit 66 and the time information acquisition unit 67 shown in FIG. 5, when the name plate / stamped image acquisition unit 63 images the name plate / stamped image 631, the overall image acquisition unit 62 captures the entire image 621. Similar to the case of imaging, the position coordinates and the current time are associated with the image data of the name plate / stamped image 631 and stored in the storage unit 69.

Next, the maker logo image acquisition unit 64 of the image data acquisition device 50 determines the presence or absence of the maker logo based on the input of the service staff (step S15 shown in FIG. 10). Specifically, the maker logo image acquisition unit 64 displays on the display device a second input screen on which it is possible to input a determination as to whether or not the attachment 110 has the maker logo. FIG. 15 is a diagram showing an example of an input screen for the presence / absence of the maker logo displayed on the image data acquisition device. The second input screen 642 shown in FIG. 15 includes a display 642a indicating "Does the attachment have a maker logo?" And selection panels 642b and 642c indicating "Yes (photographing the maker logo)" and "No". When the selection panel 642b of "Yes (maker logo shooting)" is touch-operated by the service personnel on the second input screen 642, the maker logo image acquisition unit 64 determines that the attachment 110 has the maker logo (YES). On the other hand, when the "No" selection panel 642c is touch-operated, the maker logo image acquisition unit 64 determines that the attachment 110 does not have the maker logo (NO).

If YES is determined in step S15, the maker logo image acquisition unit 64 waits in a state in which shooting is possible, and displays a third display screen prompting the acquisition of the maker logo image of the attachment 110. FIG. 16 is a diagram showing an example of a display screen for capturing the maker logo displayed on the image data acquisition device. The third display screen 643 shown in FIG. 16 includes the notation "Please take a picture of the maker logo". When the service worker performs a predetermined operation while the third display screen 643 is displayed, the maker logo image acquisition unit 64 captures the maker logo image 641 (see FIG. 8) of the attachment 110 and acquires the image data of the maker logo image 641. (Step S16 shown in FIG. 10). Information indicating that the image is the maker logo image 641 is added to the image data of the image captured after the input of "Yes" by the touch operation via the second input screen 642 of the service worker. Further, the acquired image data of the maker logo image 641 is temporarily stored in the storage unit 69, and the process proceeds to step S17. On the other hand, if NO is determined in step S15, the process of the maker logo image acquisition unit 64 is completed without capturing the maker logo image 641, and the process proceeds to step S17.

The position information acquisition unit 66 and the time information acquisition unit 67 shown in FIG. 5 are similar to the case where the overall image acquisition unit 62 images the entire image 621 when the maker logo image acquisition unit 64 captures the maker logo image 641. , The position coordinates and the current time are associated with the image data of the maker logo image 641 and stored in the storage unit 69.

Subsequently, the damaged image acquisition unit 65 of the image data acquisition device 50 determines the presence or absence of the damaged portion based on the input of the service staff (step 17). Specifically, the damaged image acquisition unit 65 displays on the display device a third input screen on which it is possible to input a determination as to whether or not the attachment 110 has a damaged portion. FIG. 17 is a diagram showing an example of an input screen for the presence or absence of a damaged portion displayed on the image data acquisition device. The third input screen 652 shown in FIG. 17 includes a display 652a indicating "Is there a damaged part in the attachment?" And selection panels 652b and 652c marked "Yes (photographed damaged part)" and "No". There is. When the selection panel 652b of "Yes (photographed damaged portion)" is touch-operated by the service personnel on the third input screen 652, the damaged image acquisition unit 65 determines that the attachment 110 has a damaged portion (YES). On the other hand, when the "No" selection panel 652c is touch-operated, the damaged image acquisition unit 65 determines that the attachment 110 has no damaged portion (NO).

If YES is determined in step S17, the damaged image acquisition unit 65 waits in a state in which shooting is possible, and displays a fourth display screen prompting the acquisition of the damaged image of the attachment 110. FIG. 18 is a diagram showing an example of a display screen for capturing an image of a damaged portion displayed on the image data acquisition device. The fourth display screen 653 shown in FIG. 18 includes the notation "Please take a picture of the damaged part". When the service worker performs a predetermined operation while the fourth display screen 653 is displayed, the damaged image acquisition unit 65 captures the damaged image 651 (see FIG. 9) of the attachment 110 and acquires the image data of the damaged image 651. (Step S18 shown in FIG. 10). Information indicating that the image is damaged image 651 is added to the image data of the image captured after the input of "Yes" by the touch operation via the third input screen 652 of the service worker. Further, the acquired image data of the damaged image 651 is temporarily stored in the storage unit 69, and the process proceeds to step S19. On the other hand, if NO is determined in step S17, the process of the damaged image acquisition unit 65 is completed without capturing the damaged image 651, and the process proceeds to step S19.

The position information acquisition unit 66 and the time information acquisition unit 67 shown in FIG. 5 are similar to the case where the overall image acquisition unit 62 images the entire image 621 when the damaged image acquisition unit 65 images the damaged image 651. , The position coordinates and the current time are associated with the image data of the damaged image 651 and stored in the storage unit 69.

Then, the information transmission processing unit 71 of the image data acquisition device 50 obtains each image data of the entire image 621 of the attachment 110, the name plate / stamped image 631, the maker logo image 641, and the damaged image 651 stored in the storage unit 69. It is transmitted to the management server 10 together with the machine information of the construction machine 100 equipped with the attachment 110 to be identified (step S19 shown in FIG. 10). To each image data, the position information of the imaging location acquired by the position information acquisition unit 66 and the time information of the imaging time acquired by the time information acquisition unit 67 are added.

As described above, in the present embodiment, the image data of the entire image 621 of the attachment 110 to be identified, the name plate / stamped image 631, the maker logo image 641, and the damaged image 651 are acquired and transmitted to the management server 10. The image data acquisition device 50 is configured.

Next, a management server that constitutes a part of an embodiment of the management system for the construction machine attachment of the present invention will be described. First, the hardware configuration of the management server will be described with reference to FIG. FIG. 19 is a configuration diagram of the hardware of the management server.

The management server 10 includes an input interface 11, a storage device 12, a processing device 13, and an output interface 14 as its hardware configuration.

The input interface 11 inputs various image data of the attachment 110 to be identified, which is transmitted from the image data acquisition device 50, together with the machine body information of the construction machine. Further, the input interface 11 inputs an information viewing request transmitted from the computer (client) 80 on the side related to the construction machine. The information browsing request requests browsing of the information stored in the database 20 of the management server 10.

The storage device 12 is composed of a semiconductor memory such as a RAM or a ROM, a magnetic memory such as a hard disk drive, or the like. The storage device 12 stores a database 20 composed of various information related to the construction machine including the information of the attachment 110. Further, the storage device 12 stores in advance a predetermined program for acquiring the identification information of the attachment 110 based on the image data of the attachment 110 to be identified and updating the database 20.

The processing device 13 has, for example, a CPU (Central Processing Unit) 16 and a GPU (Graphics Processing Unit) 17. The GPU 17 is an arithmetic processing device dedicated to image processing, and is controlled by the CPU 16. The processing device 13 can also be configured to include a GPGPU in which the GPU 17 has the main calculation function of the CPU 16. The processing device 13 processes various image data of the attachment 110 to be identified according to a predetermined program read from the storage device 12.

The output interface 14 outputs the processing result of the processing device 13 to the image data acquisition device 50. Further, the output interface 14 outputs information as a response to the information viewing request of the computer 80 to the computer 80.

Next, the function of the management server will be described with reference to FIG. FIG. 20 is a functional block diagram of the management server.

Each function of the management server 10 described below is realized by executing a predetermined program by the processing device 13 (see FIG. 19) including the CPU 16 and the GPU 17. In FIG. 20, the management server 10 acquires the identification information of the attachment 110 based on the database 20 that stores various information about the construction machine and the various image data of the attachment 110 to be identified transmitted from the image data acquisition device 50. It is provided with an attachment identification unit 30 that collates the acquired identification information with the database 20 to identify the attachment 110 to be identified.

The database 20 includes an aircraft information database (hereinafter referred to as an aircraft information DB) 21 for storing the aircraft information of the construction machine and an attachment information database (hereinafter referred to as attachment information) for storing a plurality of types of information regarding the attachment 110 mounted on the construction machine. It has 22 (called DB). The machine information DB 21 includes, for example, model information of a construction machine, machine number information, and operating time information. The attachment information DB 22 is constructed so that it can be managed by the construction machine maker side by various information of the attachment 110 collected based on various image data and the like transmitted from the image data acquisition device 50. The details of the configuration of the attachment information DB 22 will be described later, but the attachment information DB 22 includes the identification information 24 of the attachment 110, the physical information 25, and the like.

The attachment identification unit 30 has an identification information recognition unit 31 and an identification information estimation unit 32. The identification information recognition unit 31 identifies the identification information of the attachment 110 from the image data of the "name plate / stamped image 631 (see FIG. 7)" among the various image data of the attachment 110 to be identified transmitted from the image data acquisition device 50. Recognize. Further, the recognized identification information is collated with the attachment information DB 22 to identify the attachment 110 to be identified, and the attachment information DB 22 is updated according to the collation result. The identification information estimation unit 32 includes "overall image 621 (see FIG. 6)" and "maker logo image 641 (see FIG. 8)" among various image data of the attachment 110 to be identified transmitted from the image data acquisition device 50. The identification information of the attachment 110 is estimated from the image data using the trained model 34. Further, the estimated identification information is collated with the attachment information DB 22 to identify the attachment 110 to be identified, and the attachment information DB 22 is updated according to the collation result. The trained model 34 used in the identification information estimation unit 32 uses, for example, image data of various images of the attachment 110 as training data, and is a machine learning algorithm using a multi-layer neural network such as a convolutional neural network (CNN). A trained model generated by.

Further, the attachment identification unit 30 transmits the identification information of the attachment 110 to be identified acquired based on various image data transmitted from the image data acquisition device 50 to the image data acquisition device 50. Details of the processing of the attachment identification unit 30 will be described later.

The management server 10 further includes a model update unit 40. The model update unit 40 causes the neural network to further learn various image data of the attachment 110 to be identified transmitted from the image data acquisition device 50, thereby causing the trained model 34 used in the identification information estimation unit 32 to learn. Update.

Next, the details of the configuration of the attachment information DB in the management server constituting a part of the embodiment of the construction machine attachment management system of the present invention will be described with reference to FIG. FIG. 21 is a diagram showing an example of the configuration of information stored in the attachment information DB of the management server.

As shown in FIG. 21, the attachment information DB 22 relates to specification information 23 indicating various information regarding the specifications of the attachment 110, image information 26 composed of a plurality of types of images of the attachment 110, and services of the attachment 110. It is classified into service information 27 showing various information, sales information 28 showing various information regarding the sale of the attachment 110, and imaging time information 29 indicating the time when each image of the attachment 110 is captured. The various information shown below is linked to each other.

The specification information 23 is composed of identification information 24 indicating information for identifying the attachment 110 and physical information 25 indicating the physical characteristics of the attachment 110. The identification information 24 includes type information 241 indicating the type of the attachment 110 such as a bucket, a cutter, and a breaker, manufacturer information 242 indicating the manufacturer of the attachment 110, and model information 243 indicating the model of the attachment 110. .. The physical information 25 includes weight information 251 indicating the weight of the attachment 110, capacity information 252 indicating the capacity of the attachment 110, and dimensional information 253 indicating the dimensions of the attachment 110.

The image information 26 includes the entire image information 261, the name plate / stamped image information 262, the maker logo image information 263, and the damaged image information 264. The overall image information 261 is a collection of image data of the overall image 621 (see FIG. 6) of the attachment 110. The name plate image information 262 is an accumulation of image data of the name plate / stamped image 631 (see FIG. 7). The maker logo image information 263 is a collection of image data of the maker logo image 641 (see FIG. 8). The damaged image information 264 is a storage of image data of the damaged image 651 (see FIG. 9). The service information 27 includes damage presence / absence information 271, usage location information 272, user information 273, work mode warning information 274, and contract. Contains information 275. The damage presence / absence information 271 indicates the presence / absence of a damaged portion of the attachment 110. The usage location information 272 indicates the position coordinates obtained by capturing each image of the attachment 110, and is assumed to be the location where the attachment is used. User information 273 indicates a contractor who is using a construction machine. The work mode warning information 274 is information indicating work that cannot be performed when, for example, an attachment 110 of a type other than the attachment specified by a law is used. The contract information 275 is information on the contract guaranteed by the construction machine maker, for example, the risk and the guarantee range when a non-genuine attachment made by the construction machine maker is used.

The sales information 28 includes price information 281, inventory information 282, and seller information 283. The price information 281 indicates the selling price and the rental price of the attachment 110. The inventory information 282 indicates the inventory of the attachment 110 for sale or rental. The seller information 283 indicates a sales company or a rental company of the attachment 110.

Next, an example of the attachment identification processing procedure in the management server constituting a part of the embodiment of the construction machine attachment management system of the present invention will be described with reference to FIGS. 20 and 22 to 24. FIG. 22 is a flowchart showing an example of a processing procedure for identifying attachments on the management server. FIG. 23 is a flowchart showing an example of a detailed processing procedure in step S30 of the flowchart shown in FIG. FIG. 24 is an explanatory diagram showing processing of the attachment identification unit of the management server.

When the management server 10 shown in FIG. 20 receives various image data of the attachment 110 to be identified transmitted from the image data acquisition device 50, the attachment identification unit 30 of the management server 10 is transmitted from the image data acquisition device 50. It is determined whether or not the image data of the name plate / stamped image 631 is included in the various image data (step S21 shown in FIG. 22). In the present embodiment, as described in the description of the processing of the image data acquisition device 50, the image data transmitted from the image data acquisition device 50 includes "overall image 621 (see FIG. 6)" and "name plate. Information indicating which of the "stamped image 631 (see FIG. 7)", "maker logo image 641 (see FIG. 8)", and "damaged image 651 (see FIG. 9)" is added is added. Based on this additional information, the attachment identification unit 30 determines whether or not the image data of the name plate / stamped image 631 is included. If it is determined that the name plate / stamped image 631 is included (YES), the process proceeds to step S22. If it is determined that the name plate / stamped image 631 is not included (NO), the process proceeds to step S30. Details of step S30 will be described later.

In step S22, the identification information recognition unit 31 of the attachment identification unit 30 acquires the model information of the attachment 110 to be identified by recognizing the character string indicating the model from the image data of the name plate / stamped image 631. Specifically, as shown in FIG. 24, the identification information recognition unit 31 uses optical character recognition (OCR) to obtain the name plate 115 from the input image data of the name plate / stamped image 631. Recognize the character string indicating the model number described in. In the example shown in FIG. 24, the name plate 115 (see FIG. 3) in which the character string 115a indicating the capacity, the character string 115b indicating the weight, the character string 115c indicating the model, and the character string 115d indicating the serial number are written in this order from the top. When the name plate / stamped image 631 is input to the identification information recognition unit 31, "01234567" is output as the type recognition result 31a of the OCR of the identification information recognition unit 31.

As the OCR, a conventional OCR or AI-OCR can be used. However, when using the conventional OCR, it is necessary to specify in advance the correspondence between the arrangement order of a plurality of character strings written on the name plate or the stamp and various information of the attachment. On the other hand, when AI-OCR is used, since AI-OCR automatically determines the correspondence between the arrangement order of a plurality of character strings and various information of attachments, it is not necessary to specify the correspondence in advance.

Next, the identification information recognition unit 31 collates the model information of the recognition result 31a with the model information 243 of the identification information 24 in the attachment information DB 22, and determines whether or not the model information of the recognition result 31a is already registered in the attachment information DB 22. Judgment (step S23 shown in FIG. 22). As a result of the collation, if it is determined that the model information of the recognition result 31a is already registered in the attachment information DB 22 (YES), the process proceeds to step S24. On the other hand, if it is determined as a result of collation that the model information of the recognition result 31a is not registered in the attachment information DB 22 (NO), the process proceeds to step S27.

If YES is determined in step S23, the identification information recognition unit 31 newly registers various image data of the attachment 110 to be identified in the attachment information DB 22 (step S24 shown in FIG. 22). Further, as shown in FIG. 24, the identification information recognition unit 31 includes type information 241, manufacturer information 242, and weight information associated with the model information already registered in the attachment information DB 22 in step S22. Specification information 23 such as 251 and capacity information 252 is extracted from the attachment information DB 22 (step S25 shown in FIG. 22).

Subsequently, the attachment identification unit 30 transmits the model information acquired in step S22 and the specification information 23 associated with the model information to the image data acquisition device 50 (step S26 shown in FIG. 22), and the attachment identification unit 30 Ends the processing of. In this case, the attachment 110 to be identified can be identified by the model information acquired in step S22, the type information 241 associated with the model information, and the manufacturer information 242.

On the other hand, if NO is determined in step S23, the identification information estimation unit 32 of the attachment identification unit 30 estimates the type of attachment 110 (bucket, cutter, breaker, etc.) from the image data of the entire image 621 of the attachment 110 (FIG. 22). Step S27) shown in. Specifically, as shown in FIG. 24, the identification information estimation unit 32 estimates the type of the attachment 110 from the input image data of the entire image 621 of the attachment 110 by using the type discrimination learned model 35. .. The type discrimination-learned model 35 is a model generated so as to estimate the type information of the attachment 110 by machine learning using the entire image 621 of a large number of attachments 110 as training data. In the example shown in FIG. 24, when the entire image 621 is input to the type discrimination trained model 35, the “bucket” is output as the type discrimination result 35a.

Next, the identification information estimation unit 32 estimates the manufacturer of the attachment 110 from the image data of the manufacturer logo image 641 of the attachment 110 (step S28 shown in FIG. 22). Specifically, as shown in FIG. 24, the identification information estimation unit 32 estimates the manufacturer of the attachment 110 from the input image data of the manufacturer logo image 641 by using the manufacturer discrimination-learned model 36. The type discrimination learning model 35 is a model generated so as to estimate the manufacturer information of the attachment 110 by machine learning using the manufacturer logo images 641 of a large number of attachments 110 as learning data. In the example shown in FIG. 24, when the maker logo image 641 is input to the maker discrimination learned model 36, "... Co., Ltd." is output as the maker discrimination result 36a.

It is also possible to reverse the order of steps S27 and S28. The estimation results (type discrimination result 35a and manufacturer discrimination result 36a) obtained in steps S27 and S28 are temporarily stored in the storage device 12 (see FIG. 19).

Next, the attachment identification unit 30 newly registers the model information (type information recognized from the image data of the name plate / stamped image 631) acquired in step S22, and attaches various image data of the attachment 110 to be identified. Newly registered in the information DB 22 (step S29 shown in FIG. 22). At this time, the attachment identification unit 30 associates the newly registered model information with the type information 241 and the manufacturer information 242 of the estimation results in steps S27 and S28. As a result, the attachment 110 to be identified can be identified by the newly registered model information, the type information 241 of the estimation result, and the manufacturer information 242.

Subsequently, the attachment identification unit 30 transmits the model information newly registered in the attachment information DB 22, the type information of the attachment 110 of the estimation result, and the manufacturer information to the image data acquisition device 50 (step S26 shown in FIG. 22). The process of the attachment identification unit 30 is completed.

When the attachment identification unit 30 determines NO in step S21 and proceeds to step S30, the attachment identification unit 30 determines the attachment 110 to be identified based on the image data of the entire image 621 of the attachment 110 and the maker logo image 641. Identify and update the attachment information DB 22.

Specifically, as shown in FIG. 23, the identification information estimation unit 32 of the attachment identification unit 30 estimates the type (bucket, cutter, breaker, etc.) of the attachment 110 from the image data of the entire image 621 of the attachment 110 (step S31). ). Specifically, as shown in FIG. 24 in the same manner as in step S27, the identification information estimation unit 32 estimates the type of the attachment 110 from the overall image 621 of the attachment 110 using the type discrimination-learned model 35. In the example shown in FIG. 24, the type discrimination result 35a is a "bucket".

Next, the identification information estimation unit 32 estimates the manufacturer of the attachment 110 from the image data of the manufacturer logo image 641 of the attachment 110 (step S32 shown in FIG. 23). Specifically, as shown in FIG. 24 in the same manner as in step S28, the identification information estimation unit 32 estimates the manufacturer of the attachment 110 from the manufacturer logo image 641 using the manufacturer discrimination-learned model 36. In the example shown in FIG. 24, the manufacturer determination result 36a is "... Co., Ltd.".

It is also possible to reverse the order of steps S31 and S32. The type estimation result 35a and the manufacturer estimation result 36a obtained in steps S31 and S32 are temporarily stored in the storage device 12.

Next, the identification information estimation unit 32 collates the type information of the estimation result and the manufacturer information with the attachment information DB 22, and determines whether or not there is a model candidate for the attachment 110 (step S33 shown in FIG. 23). For example, when the type estimation result 35a is "bucket" and the manufacturer estimation result 36a is "... corporation", the model of the attachment 110 that matches both conditions is extracted from the attachment information DB 22 as a model candidate. .. If, as a result of the collation, a single or a plurality of model candidates can be extracted from the attachment information DB 22, it is determined that the model candidates exist (YES), and the process proceeds to step S34. On the other hand, if the model candidate cannot be extracted from the attachment information DB 22 as a result of the collation, it is determined that the model candidate does not exist (NO), and the process proceeds to step S36.

If YES is determined in step S33, the identification information estimation unit 32 newly registers various image data of the attachment 110 to be identified in the attachment information DB 22 (step S34 shown in FIG. 23). In this case, the attachment 110 to be identified can be identified by the model candidate extracted from the attachment information DB 22, the type information 241 of the estimation result of steps S31 and S32, and the manufacturer information 242. Subsequently, the identification information estimation unit 32 transmits the model candidate, the type information of the estimation result, and the manufacturer information to the image data acquisition device 50 (step S35 shown in FIG. 23), and ends the process of the attachment identification unit 30.

On the other hand, when it is determined as NO in step S33, the identification information estimation unit 32 issues a new model and newly registers it in the attachment information DB 22, and also registers various image data of the attachment 110 to be identified in the attachment information DB 22. Newly registered (step S36 shown in FIG. 23). At this time, the identification information estimation unit 32 associates the newly registered model information with the type information 241 and the manufacturer information 242 of the estimation result in steps S31 and S32. As a result, the attachment 110 to be identified can be identified by the newly registered model information, the type information 241 of the estimation result, and the manufacturer information 242.

Subsequently, the attachment identification unit 30 transmits a collation result indicating that the model candidate does not exist to the image data acquisition device 50 (step S37 shown in FIG. 23), and ends the process of the attachment identification unit 30.

In the present embodiment, the attachment identification unit 30 recognizes a character string from the image data of the name plate / stamped image 631 of the attachment 110 transmitted from the image data acquisition device 50 and acquires the model information of the identification information of the attachment 110. do. Further, the attachment identification unit 30 collates the acquired model information with the attachment information DB 22 to identify the attachment to be identified, and updates the attachment information DB 22 according to the collation result.

Further, in the present embodiment, the attachment 110 is identified by estimation using the learned model 34 of the attachment identification unit 30 from the image data of the entire image 621 of the attachment 110 and the maker logo image 641 transmitted from the image data acquisition device 50. Acquires type information and manufacturer information, which are information. Further, the attachment identification unit 30 collates the acquired type information and manufacturer information with the attachment information DB 22 to identify the attachment to be identified, and updates the attachment information DB 22 according to the collation result.

In this way, the management server 10 automatically constructs the attachment information DB 22 by collecting the identification information of the attachment 110 based on various image data transmitted from the image data acquisition device 50. Therefore, excessive labor is not spent on the construction of the attachment information DB 22 that can be managed by the construction machine maker.

Next, an example of a processing procedure for correcting the identification result of the attachment to be identified by the management server constituting one embodiment of the construction machine attachment management system of the present invention will be described with reference to FIGS. 5 and 25. FIG. 25 is a diagram showing an example of a confirmation screen of various information of the attachment to be identified displayed on the image data acquisition device. In the present embodiment, the identification result by the attachment identification unit 30 of the management server 10 is presented to the user (service worker) who operates the image data acquisition device 50, and when there is an error in the identification result, the image data acquisition device 50 is used. It is to be corrected through.

The information correction unit 72 of the image data acquisition device 50 shown in FIG. 5 displays a confirmation screen showing the identification result of the attachment 110 to be identified transmitted from the management server 10 on the display device. As shown in FIG. 25, for example, the confirmation screen 721 includes an image unit 721a showing an image of the attachment 110 (for example, the entire image 621 and the maker logo image 641) transmitted by the image data acquisition device 50 to the management server 10, and the management server 10. It is composed of an identification result table 721b showing the identification result (for example, the type, manufacturer, model, etc. of the attachment 110) by the attachment identification unit 30 of the above. The confirmation screen 721 includes a correction panel 721c for making corrections to each information described in the identification result table 721b, an input panel 721d for inputting information to the identification result table 721b, and correction information or input. It includes a confirmation panel 721f for confirming the information and transmitting it to the management server 10. That is, the image data acquisition device 50 receives the correction and input of the information by the operation of the correction panel 721c and the input panel 721d by the user, and transfers the received correction information and the input information to the management server 10 by the operation of the confirmation panel 721f by the user. Send. The management server 10 modifies the attachment information DB 22 based on the input information or the modification information transmitted from the image data acquisition device 50.

In the present embodiment, the confirmation screen 721 simultaneously shows the image acquired by the image data acquisition device 50 and the identification result of the attachment 110 to be identified by the management server 10, so that the identification result of the image data acquisition device 50 When the user determines that there is an error, the user can correct the identification result of the management server 10 to the correct information by operating the correction panel 721c. Further, when it is desired to additionally input physical information such as weight, size, and capacity of the attachment 110 and service information such as the user of the attachment 110 that cannot be acquired from the image data, the user operates the input panel 721d. You can enter with. If the information to be added to the identification result table 721b of the confirmation screen 721 is unknown, it is not necessary to input the information.

Next, the relationship of information transfer between the management server and the computers (clients) of each related party in one embodiment of the construction machine attachment management system of the present invention will be described with reference to FIG. 26. FIG. 26 is an explanatory diagram showing information that can be exchanged between the management server and the computer (client) in one embodiment of the management system for the construction machine attachment of the present invention.

Construction machine service staff 81, construction machine 100 operator 82, construction machine manager 83, construction machine manufacturer (designer, etc.) 84, attachment manufacturer 85, attachment 110 rental company 86, etc. The computer (client) used by the persons concerned with the attachment 110 of the construction machine can access the database 20 of the management server 10 via the Internet line 133, and can browse various information of the construction machine 100 stored in the database 20. Is. When the computers of the parties 81, 82, 83, 84, 85, 86 send an information browsing request to the management server 10 via the Internet line 133, the management server 10 allows the parties 81, 82, 83, 84 to permit. , 85, 86 computers are returned from the attachment information DB 22 according to the information viewing request. The computers of the parties 81, 82, 83, 84, 85, and 86 can view the information in the attachment information DB 22 of the management server 10 within a preset range, and can view the information within a preset range. Information can be entered within.

The viewable range of the attachment information DB 22 of each related party 81, 82, 83, 84, 85, 86 is as follows, for example. The management server 10 can provide the service information 27 and the sales information 28 stored in the attachment information DB 22 (see FIG. 21) to the service staff 81 and the construction manager 83. As a result, the service worker 81 and the construction manager 83 grasp the damage presence / absence information 271 of the attachment 110, the usage location information 272 (the imaging location of the damaged image 651 of the attachment 110), and the user information 273 included in the service information 27. be able to. Further, the price at the time of replacement or the price at the time of rental of the attachment 110 can be grasped from the price information 281 of the sales information 28. In addition, the service worker 81 and the construction manager 83 can receive the damaged image information 264 and the imaging time information 29.

Further, the management server 10 can provide the work mode warning information 274 of the service information 27 to the operator 82. The operator 82 is notified, for example, of possible risks after replacement of the attachment 110.

Further, the management server 10 can provide the physical information 25 and the service information 27 stored in the attachment information DB 22 to the designer of the construction machine manufacturer 84. As a result, the designer can use the type information 241 and the overall image information 261 (which type) in addition to the user information 272 (who is the user) and the place of use information 273 (where they are used) included in the service information 27. (Whether the attachment is used), the imaging time information 29 can be grasped.

Further, the management server 10 can provide the sales information 28 stored in the attachment information DB 22 to the rental company 86. The rental company 86 can grasp the rental price of the attachment 110.

On the other hand, the range in which information can be input to the attachment information DB 22 of the computer of each related party 81, 82, 83, 84, 85, 86 is as follows, for example. The service worker 81 and the operator 82 can input physical information and service information to the attachment information DB 22. The construction machine manufacturing industry 84 and the attachment manufacturer 85 can input insufficient physical information among the information associated with the model information 243, for example, dimensional information for which accurate information cannot be obtained from image data. It is also possible to input the selling price, inventory, sales information of the seller, etc. of the attachment 110. The construction manager 83 can input information that cannot be provided by the service worker 81 or the operator 82, for example, model information or the manufacturer of the attachment 110. The rental company 86 can input sales information such as rental price, inventory, and delivery date information of the attachment 110.

It is also possible to newly register the image data of the attachment 110 acquired from the attachment catalog published by the attachment manufacturer 85 and the image data of the attachment 110 owned by the construction machine manufacturer 84 in the attachment information DB 22 of the management server 10. It is possible.

According to one embodiment of the construction machine attachment management system and management server of the present invention described above, the management server 10 identifies identification information based on the image data of the attachment 110 to be identified transmitted from the image data acquisition device 50. Is acquired and collated with the attachment information DB (database) 22 to identify the attachment 110 to be identified, and the attachment information DB (database) 22 is updated according to the collation result. It is possible to construct an attachment information DB (database) 22 that can collect 110 identification information without spending excessive labor and manage various types of attachment information on the manufacturer side.

Further, in the present embodiment, the management server acquires the model information of the attachment 110 to be identified by recognizing the character string from the image data of the attachment 110 to be identified, and the acquired model information is referred to as the attachment information DB 22. It is configured to newly register the acquired model information in the attachment information DB 22 when it is determined that the acquired model information is not registered in the attachment information DB 22 by collation. In this configuration, since the model information of the attachment 110 to be identified can be directly acquired from the image data, it is easy to collect the identification information of the attachment 110.

Further, in the present embodiment, the management server 10 uses the trained model 34 generated by machine learning using the image data of the attachment 110 as training data to identify the attachment to be identified from the image data of the attachment 110 to be identified. The type information of 110 and the manufacturer information of the attachment 110 are estimated, the estimated type information and the manufacturer information are collated with the attachment information DB 22 to determine the presence or absence of a model candidate of the attachment 110 to be identified, and the attachment 110 to be identified. When there is no type candidate of, new type information is issued to the attachment 110 to be identified and newly registered in the attachment information DB 22. With this configuration, even if the character string cannot be recognized from the image data, the model candidate of the attachment 110 to be identified can be extracted from the attachment information DB 22 based on the image data.

Further, in the present embodiment, the management server 10 updates the trained model 34 by using the image data of the attachment 110 to be identified transmitted from the image data acquisition device 50. Thereby, the estimation accuracy of the trained model 34 can be improved.

Further, in the present embodiment, the identification information acquired by the management server 10 is transmitted to the image data acquisition device 50, and the image data acquisition device 50 displays the identification information transmitted from the management server 10. Then, the input of the correction information for correcting the displayed identification information is accepted by the user operation, the received correction information is transmitted to the management server 10, and the management server 10 attaches based on the correction information transmitted from the image data acquisition device 50. The identification information stored in the information DB 22 is modified. In this configuration, since the identification information acquired by the management server 10 is displayed on the image data acquisition device 50, the user on the transmitting side of the image data of the attachment 110 to be identified can be made to determine the correctness of the identification information. Further, if the identification information is incorrect, the attachment information DB 22 is corrected, so that the accuracy of the information stored in the attachment information DB 22 can be ensured.

[Other embodiments]
The present invention is not limited to the above-described embodiment, and includes various modifications. The above-described embodiments have been described in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the described configurations. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.

For example, in one embodiment of the construction machine attachment management system of the present invention described above, the image data acquisition device 50 is displayed so as to notify the service personnel by displaying the machine information acquired from the construction machine 100 on the display device. The configured example is shown. However, it is also possible to configure the image data acquisition device so as to notify the service personnel of the aircraft information acquired from the construction machine 100 by voice.

Further, in the above-described embodiment, an example in which a model generated by using a machine learning algorithm using a neural network is used as the trained model 34 of the identification information estimation unit 32 has been described. However, as the trained model 34 of the identification information estimation unit 32, it was generated by using another machine learning algorithm that does not need to prepare a large amount of image data for learning, which is different from the machine learning algorithm using the neural network. It is possible to use a trained model.

10 ... Management server, 22 ... Attachment information DB (database), 30 ... Attachment identification unit, 34 ... Learned model, 40 ... Model update unit, 50 ... Image data acquisition device, 54 ... User interface, 80 ... Computer (information processing) Equipment), 100 ... Construction machinery, 110 ... Attachment

Claims (6)

A management server that has a database that stores multiple types of information about attachments, including identification information for identifying attachments mounted on construction machinery.
An image data acquisition device configured to acquire image data of the attachment to be identified and send it to the management server.
In a construction machine attachment management system including the management server and an information processing device capable of exchanging information.
The management server
Based on the image data of the attachment to be identified transmitted from the image data acquisition device, the identification information of the attachment to be identified is acquired, and the identification information of the attachment to be identified is acquired.
The acquired identification information is collated with the database to identify the attachment to be identified.
A construction machine attachment management system characterized in that the database is configured to be updated according to the collation result. In the construction machine attachment management system according to claim 1,
The identification information in the database includes type information indicating the type of attachment.
The management server
By recognizing the character string from the image data of the attachment to be identified, the model information of the attachment to be identified is acquired.
Management of construction machine attachments, which comprises collating the acquired model information with the database and newly registering the acquired model information in the database when it is determined that the acquired model information is not registered in the database. system. In the construction machine attachment management system according to claim 1,
The identification information of the database includes type information indicating the types of attachments associated with each other, type information indicating the type of attachment, and manufacturer information indicating the manufacturer of the attachment.
The management server
Using the trained model generated by machine learning using the image data of the attachment as training data, the type information of the attachment to be identified and the manufacturer information of the attachment are estimated from the image data of the attachment to be identified.
The estimated type information and manufacturer information are collated with the database to determine the presence or absence of a model candidate for the attachment to be identified. A construction machine attachment management system characterized by issuing various model information and newly registering it in the database. In the construction machine attachment management system according to claim 3,
The management server is a construction machine attachment management system characterized in that the trained model is updated using the image data of the attachment to be identified transmitted from the image data acquisition device. In the construction machine attachment management system according to claim 1,
The management server transmits the acquired identification information to the image data acquisition device, and the management server transmits the acquired identification information to the image data acquisition device.
The image data acquisition device is
The identification information sent from the management server is displayed, and the identification information is displayed.
Correct the displayed identification information Accepts user-operated input of correction information and accepts
Send the received correction information to the management server,
The management server is a construction machine attachment management system characterized in that the database is modified based on the modification information transmitted from the image data acquisition device. In a management server that has a database that stores multiple types of information about attachments, including identification information for identifying attachments mounted on construction machinery.
The management server
Based on the image data of the attachment to be identified transmitted from the image data acquisition device, the identification information of the attachment to be identified is acquired, and the identification information of the attachment to be identified is acquired.
The acquired identification information is collated with the database to identify the attachment to be identified.
A management server for construction machinery attachments, characterized in that it is configured to update the database according to the collation results.

Images