JP2016169595A - Work machine ambient monitoring device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a periphery monitoring device for a work machine, capable of monitoring an area in front of the work machine without being obstructed by a front work machine.SOLUTION: A periphery monitoring device for a work machine including a front work machine and a machine main body comprising an operator cab comprises: an imaging device that includes a first imaging unit provided on the machine main body on one side of the front work machine and a second imaging unit provided on the machine main body on the other side of the front work machine and images an area in front of the work machine including part of the machine main body; an image generation device for performing viewpoint conversion on an image acquired by the imaging device to one from an overhead view to generate a virtual viewpoint image; and a display device for displaying the virtual viewpoint image generated by the image generation device. The display device has a partial image, which indicates the operator cab, arranged at a position corresponding to the operator cab in the virtual viewpoint image and overlaps the partial image and part of the virtual viewpoint image corresponding to the operator cab to display the overlapped image.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a surrounding monitoring device for a work machine.

  2. Description of the Related Art Conventionally, some work machines such as hydraulic excavators are equipped with a camera for monitoring the surroundings of the machine body (see, for example, Patent Document 1). Patent Document 1 discloses a monitoring camera device in which a front monitoring camera is provided at a lower portion of a boom of a front attachment pivotally attached to a hydraulic excavator.

Japanese Utility Model Publication No. 7-20354

  However, in the device described in Patent Document 1, since the front monitoring camera is provided at the lower part of the boom, depending on the operation position of the front attachment, the image of the front area captured by the front monitoring camera is blocked by the front attachment. It will be.

  According to the first aspect of the present invention, there is provided a work machine surrounding monitoring device having a front work machine and a machine main body, the operator main body being provided in the machine main body, the machine main body on one side of the front work machine. And a second imaging unit provided on the machine main body on the other side of the front work machine, and a front area of the work machine including a part of the machine main body. An image pickup device that picks up an image, an image generation device that generates a virtual viewpoint image by converting the image acquired by the image pickup device into an upper viewpoint, and the virtual viewpoint image generated by the image generation device are displayed. A partial image representing the cab in the virtual viewpoint image at a position corresponding to the cab in the virtual viewpoint image, and a portion of the virtual viewpoint image corresponding to the cab. Wherein the virtual viewpoint image by superposing the partial image displayed.

  ADVANTAGE OF THE INVENTION According to this invention, the surroundings monitoring apparatus of the working machine which can monitor the front area | region of a working machine without being obstruct | occluded by a front working machine irrespective of the operating condition of a front working machine can be provided.

FIG. 1 is a side view of a hydraulic excavator equipped with a surrounding monitoring device according to a first embodiment of the present invention. FIG. 2 is a front view of the excavator shown in FIG. FIG. 3 is a top view of the excavator shown in FIG. FIG. 4 is a top view schematically showing the cab. FIG. 5 is a block diagram showing the configuration of the surroundings monitoring apparatus according to the first embodiment. FIG. 6 is a top view schematically showing the excavator and the surroundings. FIG. 7 is a diagram illustrating an example of a surrounding image of the hydraulic excavator displayed on the display monitor. FIG. 8 is a diagram illustrating an example of a surrounding image of the hydraulic excavator displayed on the display monitor. FIGS. 9A and 9B are a top view schematically showing the surroundings when the excavator is turning, and an example of an image around the excavator displayed on the display monitor. FIGS. 10A and 10B are a top view schematically showing a surrounding state when the excavator advances, and an example of a surrounding image of the excavator displayed on the display monitor. FIG. 11 is a side view of a hydraulic excavator equipped with a surrounding monitoring apparatus according to the second embodiment of the present invention. 12 is a front view of the excavator shown in FIG. 13 is a top view of the excavator shown in FIG. FIG. 14 is a block diagram showing the configuration of the surroundings monitoring apparatus according to the second embodiment. FIG. 15 is a top view schematically showing the excavator and the surroundings. FIGS. 16A and 16B are examples of images taken by the left front camera and the right front camera. FIG. 17 is a diagram illustrating an example of a surrounding image of the hydraulic excavator displayed on the display monitor.

<< First Embodiment >>
Hereinafter, a surroundings monitoring device according to a first embodiment of the present invention will be described in detail with reference to the drawings. In the first embodiment, a case where a surrounding monitoring device is mounted on a large hydraulic excavator as a work machine will be described as an example. 1 is a side view of a hydraulic excavator 10 equipped with a surrounding monitoring device according to a first embodiment of the present invention, FIG. 2 is a front view of the hydraulic excavator 10 shown in FIG. 1, and FIG. 3 is shown in FIG. 1 is a top view of a hydraulic excavator 10. FIG. In FIG. 1, the illustration of the front working machine (front attachment) of the excavator 10 is omitted.

  The excavator 10 includes a lower traveling body 13 having a pair of crawlers 11 and 12, and an upper revolving body 14 provided on the lower traveling body 13 so as to be able to swivel. The upper swing body 14 includes an upper step portion 14a and a lower step portion 14b. In FIG. 3, the hatched portion corresponds to the lower step portion 14b. A cab 15 is provided on the front left side of the upper swing body 14, and a front work machine 19 including a boom 16, an arm 17, and a bucket 18 is provided at the front center of the upper swing body 14. A portion of the excavator 10 excluding the front working machine 19 is a machine body of the excavator 10.

  The crawlers 11 and 12 of the lower traveling body 13 are each driven by a traveling motor (not shown). The upper turning body 14 turns with respect to the lower traveling body 13 by a turning motor (not shown) provided at the center thereof. The boom 16, the arm 17 and the bucket 18 are moved up and down (rotated) by expansion and contraction of a boom cylinder, an arm cylinder and a bucket cylinder (not shown). Each of these motors and each cylinder is driven by pressure oil from a hydraulic pump provided in the engine compartment of the upper swing body 14.

  FIG. 4 is a top view schematically showing the inside of the cab 15. As shown in FIG. 4, the cab 15 includes a driver's seat 20, console boxes 21 a and 21 b provided on the left and right sides of the driver seat 20, and travel pedals 23 a and 23 b provided on the floor in front of the driver seat 20. And a controller 110 provided behind the driver's seat 20 and a display device 120 provided on the front left side of the driver's seat 20. The console boxes 21a and 21b are provided with operation levers 22a and 22b that are operated by an operator in order to drive the front work machine 19 and to turn the upper swing body 14. The operation levers 22a and 22b are configured to be swingable in the front-rear and left-right directions. The travel pedals 23a and 23b are depressed in the front-rear direction by an operator to drive and control the crawlers 11 and 12. The travel pedals 23a and 23b are provided with operation levers 24a and 24b for travel.

  FIG. 5 is a block diagram showing a configuration of the surroundings monitoring apparatus 100 according to the first embodiment. The surrounding monitoring device 100 includes a controller 110, a display device 120, and an imaging device 130. The imaging device 130 is a device for acquiring an image of the entire periphery of the excavator 10, and includes a left front side camera 131, a right front camera 132, a right side camera 133, and a rear camera 134.

  The left front side camera 131 is installed in the lower left front part of the cab 15 and is configured to be able to image a region from the front left side to the left side of the excavator 10 as indicated by a broken line in FIGS. Has been. The imaging area of the left front side camera 131 is set so as to include a part of the excavator 10. In other words, the left front side camera 131 is configured to be able to capture an image directly below the cab 15 that is a blind spot for the operator. The right front camera 132 is installed in the right front portion of the upper swing body 14, and is configured to be able to image the front right region of the excavator 10 as indicated by a broken line in FIG. The imaging area of the right front camera 132 is set so as to include a part of the excavator 10. As a result, when the excavator 10 is facing forward as shown in FIG. 3, some of the crawlers 11 and 12 of the lower traveling body 13 are also included in the image captured by the left front side camera 131 and the right front camera 132. It will be included (see FIG. 7).

  The right side camera 133 is installed on the right side portion of the upper swing body 14 and is configured to be able to image a right side region of the excavator 10. The rear camera 134 is installed at the rear part of the upper swing body 14 and is configured to be able to image a region behind the hydraulic excavator 10. In addition, each camera 131 to 134 has an angle of view and an optical axis direction set so that a part of the imaging region overlaps as shown by a broken line in FIGS. 1 and 2, for example. Images of the entire periphery of the excavator 10 can be acquired by 131 to 134.

  As shown in FIG. 2, the left front side camera 131 and the right front camera 132 position the left side of the front work machine 19 so that the left front area and the right front area of the front work machine 19 are respectively imaged. It is installed at each position on the right side. Thereby, the front area of the hydraulic excavator 10 can be imaged by the left front side camera 131 and the right front camera 132 without being blocked by the front work machine 19 regardless of the operating state and the operation posture of the front work machine 19. . The right front camera 132 is disposed near the front work machine 19 in the right front portion of the excavator 10 in order to capture an area on the right front side of the excavator 10. On the other hand, the left front side camera 131 captures the left side area in addition to the left side area in front of the excavator, so that the left end of the left front portion of the excavator 10, that is, the farthest position from the front work machine 19 is used. Has been placed.

  As shown in FIG. 3, the left front side camera 131, the right front camera 132, the right side camera 133, and the rear camera 134 capture an image including the immediate area of the excavator 10 that becomes a blind spot from the operator in the cab 15. Therefore, it is arranged at a position that is the outermost edge of the upper swing body 14. In addition, since the images captured by the cameras 131 to 134 are combined as will be described later, the cameras 131 to 134 are arranged at substantially the same height in the upper stage portion 14a of the upper swing body 14. However, since the lower step portion 14b of the upper swing body 14 has a portion protruding outward from the upper step portion 14a, the left front side camera 131, the right front camera 132, and the rear camera 134 are the outermost edges of the lower step portion 14b. It is supported by extension bars 131a, 132a, 134a so as to be arranged at a position corresponding to the outermost edge of the upper swing body 14.

  Image data of the surrounding image of the excavator 10 captured by the cameras 131 to 134 is input to the controller 110.

  The controller 110 is an electronic control unit composed of a CPU and CPU peripheral components such as a ROM and a RAM, and controls the entire periphery monitoring device 100. The controller 110 configures an image correction processing unit 111, an image conversion unit 112, an image composition processing unit 113, and a display screen setting unit 114, for example, depending on the software form of the CPU. The controller 110 performs viewpoint conversion on the image data input from the imaging device 130 so as to become the upper viewpoint, and displays the virtual viewpoint image on the display device 120. The image correction processing unit 111, the image conversion unit 112, and the image composition processing unit 113 constitute an image generation apparatus. The control in the controller 110 will be described later.

The display device 120 includes a display monitor 121 that is an image display unit including a liquid crystal panel, for example, and a screen switching operation member 122. Characters and images are displayed on the display monitor 121 in accordance with signals from the controller 110. The screen switching operation member 122 is an operation member that is operated by an operator to switch the display screen displayed on the display monitor 121, and includes, for example, a switch.
Next, virtual viewpoint image generation and display control in the surroundings monitoring apparatus 100 will be described. Here, image data from the rear camera 134 will be described as an example. First, image data input from the rear camera 134 is input to the image correction processing unit 111. The image correction processing unit 111 performs image correction such as aberration correction, contrast correction, and color tone correction based on camera optical system parameters on the image data, and improves the image quality of the input image.

  The image conversion unit 112 generates a virtual viewpoint image based on the image data input from the image correction processing unit 111. As indicated by a one-dot chain line in FIG. 1, the angle formed by the optical axis of the rear camera 134 with respect to the ground contact surface L of the excavator 10 is θ. That is, an image having an angle θ with respect to the ground plane L is obtained from the rear camera 134. The image conversion unit 112 performs coordinate conversion on the image data obtained from the rear camera 134 so that the optical axis of the virtual viewpoint VF with the ground plane L as a virtual plane is vertical, thereby creating a virtual viewpoint image. Thereby, the camera image from obliquely above with an angle θ with respect to the ground plane L is converted into a virtual viewpoint image from the upper viewpoint, that is, an overhead image.

  The image conversion unit 112 similarly performs coordinate conversion on image data obtained from the left front side camera 131, the right front camera 132, and the right side camera 133 to create a virtual viewpoint image.

  The image composition processing unit 113 is a virtual viewpoint left front side image based on the image data of the left front side camera 131, a virtual viewpoint right front image based on the image data of the right front camera 132, and a virtual viewpoint based on the image data of the right side camera 133. The right side image and the virtual viewpoint rear image based on the image data of the rear camera 134 are combined to generate a virtual viewpoint image corresponding to the bird's-eye view image of the entire periphery of the excavator 10. Note that the image composition processing unit 113 rotates the image data obtained from the right-side camera 133 by 90 degrees in the right direction, and rotates the image data obtained from the rear camera 134 by 180 degrees to compose the image data.

  The display screen setting unit 114 sets a display range when displaying the virtual viewpoint image generated by the image composition processing unit 113 in accordance with a signal from the image switching operation member 122. On the display monitor 121 of the display device 120, a virtual viewpoint image of the entire periphery of the excavator 10 is displayed in accordance with a signal from the controller 110. The virtual viewpoint image displayed on the display monitor 121 is sequentially updated based on the image data input from the imaging device 130.

  Below, the image displayed on the display apparatus 120 is demonstrated. FIG. 6 schematically shows the excavator 10 and the surroundings. FIG. 7 shows a display example of the display device 120 in the situation as shown in FIG. As shown in FIG. 6, a dump truck 50 a is stopped in front of the excavator 10, and a dump truck 50 b is stopped on the left side of the excavator 10.

  On the display monitor 121, a work machine image 60 in which a plan view of the excavator 10 is made into a graphic is displayed at the center position. The work machine image 60 is an illustration corresponding to the upper swing body 14 of the excavator 10. In the work machine image 60, a cab frame image 61 is displayed at a position corresponding to the cab 15, and a front frame image 62 is displayed at a position corresponding to the front work machine 19. The cab frame image 61 is a rectangular frame-shaped illustration representing the outer shape of the cab 15. Similarly, the front frame image 62 is a rectangular frame-shaped illustration representing the outer shape of the front work machine 19. The frame images 61 and 62 are partial images representing a part of the excavator 10.

  Around the work machine image 60, a virtual viewpoint image 70 obtained by performing viewpoint conversion based on the image data of each camera 131 to 134 is displayed. As described above, the virtual viewpoint image 70 includes the virtual viewpoint left front side image 71 based on the image data of the left front side camera 131, the virtual viewpoint right front image 72 based on the image data of the right front camera 132, and the right side camera 133. The virtual viewpoint right side image 73 based on the image data and the virtual viewpoint rear image 74 based on the image data of the rear camera 134 are configured. As illustrated in FIG. 7, the virtual viewpoint image 70 includes a part of the crawler 11 captured by the left front side camera 131 and a part of the crawler 12 captured by the right front camera 132.

  Between the virtual viewpoint left front side image 71 and the virtual viewpoint right front image 72, between the virtual viewpoint right front image 72 and the virtual viewpoint right side image 73, and between the virtual viewpoint right side image 73 and the virtual viewpoint rear image 74. Between the virtual viewpoint rear image 74 and the virtual viewpoint left front image 71, boundary lines 75, 76, 77, and 78 as display area boundaries are displayed, respectively.

  By displaying the virtual viewpoint image 70 in this way, on the display monitor 121, the direction actually present when the subject imaged by each of the cameras 131 to 134 is looked down from above around the hydraulic excavator 10 and Displayed in position (distance). In the display example of FIG. 7, the dump truck 50a that exists in front of the excavator 10 and the dump truck 50b that exists on the left side are displayed at positions corresponding to the direction and position that actually exist with the excavator 10 as the center. ing. Further, some of the crawlers 11 and 12 of the hydraulic excavator 10 are also displayed at positions corresponding to directions and positions that actually exist around the hydraulic excavator 10, more specifically, the upper swing body 14.

  As shown in FIG. 7, in the virtual viewpoint image 70, the cab frame image 61 and the front frame image 62 are displayed so as to overlap each other, but the cab frame image 61 and the front frame image 62 are frame-shaped illustrations. Therefore, the virtual viewpoint image 70 where the frame images 61 and 62 are superimposed, that is, the virtual viewpoint image inside the frame is also visible. Therefore, for example, the visibility of a part of the crawler 11 existing immediately below the cab 15 and the vicinity thereof is not hindered by the cab image 61.

  FIG. 8 shows another display example of the display monitor 121. In the display example of FIG. 8, a specific range is cut out and displayed as a display image from the virtual viewpoint image generated by the image composition processing unit 113. As described above, the display image, that is, the display range can be switched by the operator operating the screen switching operation member 122 of the display device 120. By operating the screen switching operation member 122, it is possible to switch and display the virtual viewpoint image of the maximum range generated by the image composition processing unit 113 and the display image of the range corresponding to the working radius of the excavator 10, for example. it can.

  Below, the effect | action of the surroundings monitoring apparatus 100 in the operation | movement maintenance of the hydraulic shovel 10 is demonstrated.

  FIGS. 9A and 9B are a top view schematically showing a surrounding state when the excavator 10 turns, and a display example of the display monitor 121. FIG. FIG. 9A shows a state where the excavator 10 turns rightward from the state shown in FIG. Since the work machine image 60 is fixed and displayed at the center position of the display monitor 121, the display image of the display monitor 121 shown in FIG. The surrounding image, that is, the virtual viewpoint image 70 appears to rotate in the direction opposite to the turning direction. When the excavator 10 facing forward turns in the right direction as indicated by an arrow, the front work machine 19 may come into contact with the front dump truck 50a. Further, the rear end portion of the hydraulic excavator 10 may collide with the dump truck 50b. In the surrounding monitoring device 100, as shown in FIG. 9B, the virtual viewpoint image 70 updated in response to the turning operation of the excavator 10 is displayed on the display monitor 121. The turning operation can be safely performed while confirming the direction and position of the dump trucks 50a and 50b existing around the hydraulic excavator 10 from the display image.

  FIGS. 10A and 10B are a top view schematically showing a surrounding state when the excavator 10 moves forward, and a display example of the display monitor 121. FIG. As shown in FIG. 10A, the service car 50c is stopped at the front right of the excavator 10. There is a possibility that the service car 50c is hidden by the front work machine 19 from the operator in the cab 15 on the left front side of the excavator 10 and cannot be seen. In the surroundings monitoring apparatus 100, as shown in FIG. 10B, the virtual viewpoint image 70 that is updated corresponding to the forward movement of the excavator 10 is displayed on the display monitor 121. While confirming the direction and position where the service car 50c actually exists from the display image, the forward movement can be performed safely.

Thus, in the first embodiment described above, the following operational effects can be achieved.
(1) The surroundings monitoring device 100 is provided in the left front side camera (first imaging unit) 131 provided in the machine main body on one side of the front work machine 19 and the machine main body on the other side of the front work machine 19. A right front camera (second imaging unit) 132, and an imaging device 100 that images a front region of the excavator 10 including a part of the crawlers 11 and 12 that are a part of the machine body, and the imaging device 100. It includes a controller 110 that generates a virtual viewpoint image by converting the acquired image to have an upper viewpoint, and a display device 120 that displays the virtual viewpoint image 70 generated by the controller 110. On the display monitor 121 of the display device 120, the virtual viewpoint image 70 can be viewed through the frame images 61 and 62 through the frame images 61 and 62 representing the cab 15 and the front work machine 19 that are part of the excavator 10. Are superimposed on the virtual viewpoint image 70 and displayed. By providing one camera on each side of the front work machine 19, the operator can monitor the front area of the excavator 10 without being blocked by the front work machine 19 regardless of the operation status of the front work machine 19. . In addition, by displaying a virtual viewpoint image based on the image acquired by the imaging device 130 on the display monitor 121, the operator instantaneously determines the positional relationship with an obstacle such as the dump truck 50 a existing in the front area of the excavator 10. Can grasp. Furthermore, since the imaging device 130 images the front area so as to include a part of the crawlers 11 and 12, the status of the area immediately adjacent to the excavator 10, which is a blind spot from the operator, particularly the area immediately below the cab 15 is also displayed on the display monitor. 121 is displayed. In this way, the operator's surrounding confirmation can be assisted by the image displayed on the display monitor 121. The operator can perform a comfortable operation while grasping the situation of the front area including the immediate area of the excavator 10.

(2) The imaging area of the left front side camera 131 includes a side area on one side of the excavator 10, specifically, a left side area in addition to the front area of the excavator 10 as shown in FIG. It is configured. Thereby, it is not necessary to install a camera for imaging only one side region of the hydraulic excavator 10, and an increase in the number of components can be suppressed.

(3) The imaging device 130 of the surrounding monitoring device 100 also includes a right side camera 133 and a rear camera 134, and can capture a side region and a rear region in addition to the front region of the excavator 10. As shown in FIGS. 7 and 8, a virtual viewpoint image 70 around the entire circumference of the excavator 10 is displayed on the display monitor 121 of the display device 120. Thereby, the operator can monitor the entire periphery including the front area of the excavator 10 from the image displayed on the display monitor 121, and can perform a comfortable operation while grasping the surrounding situation of the excavator 10. Can do.

<< Second Embodiment >>
FIG. 11 is a side view of a hydraulic excavator 10A equipped with a surrounding monitoring device according to a modification of the second embodiment of the present invention, FIG. 12 is a front view of the hydraulic excavator 10A shown in FIG. 11, and FIG. 11 is a top view of the excavator 10A shown in FIG. In addition, in FIG. 11, illustration of the front working machine 19 of the excavator 10A is omitted. FIG. 14 is a block diagram showing a configuration of the surroundings monitoring apparatus 100A according to the second embodiment. In FIGS. 11-14, the same code | symbol is attached | subjected to the location which has the same function as 1st Embodiment. The second embodiment is different from the above-described first embodiment in the number of cameras that capture the periphery of the hydraulic excavator 10A and the installation positions of the cameras. Hereinafter, differences from the above-described first embodiment will be mainly described.

  The imaging device 130A that constitutes the surrounding monitoring device 100A includes five cameras 132, 133, 134, 135, and 136. Specifically, a left front camera 135 and a left side camera 136 are provided instead of the left front side camera 131 in the first embodiment described above. The left front camera 135 is set at the lower left front part of the cab 15 and is configured to be able to image the area on the left front side of the excavator 10A as shown by a broken line in FIGS. The imaging area of the left front camera 135 is set to include a part of the excavator 10A.

  The left side camera 136 is installed on the left side portion of the upper swing body 14, and is configured to be able to image the left side region of the excavator 10A. The left-side camera 136 is supported by the extension bar 136a so as to be disposed at the outermost edge of the lower step portion 14b, that is, the position corresponding to the outermost edge of the upper swing body 14.

  Unlike the first embodiment, the right front camera 132 is arranged at the outermost side of the right front portion of the upper swing body 14, that is, at the position farthest from the front work machine 19. As shown in FIG. 12, the right front camera 132 and the left front camera 135 are arranged symmetrically with respect to the front work machine 19. Further, the cameras 132 to 136 are arranged at substantially the same height in the upper stage portion 14 a of the upper swing body 14.

  Image data of the surrounding image of the hydraulic excavator 10A captured by the cameras 132 to 136 is input to the controller 110A. The controller 110A performs viewpoint conversion on the image data input from the imaging apparatus 130A and combines the image data as in the first embodiment described above, and causes the display apparatus 120 to display the image data as a virtual viewpoint image. Note that the image composition processing unit 113 synthesizes the image data obtained from the left-side camera 136 after rotating 90 degrees to the left when generating the virtual viewpoint image.

  FIG. 15 schematically shows the excavator 10A and the surroundings. FIGS. 16A and 16B show an example of an image captured by the left front camera 135 and an image captured by the right front camera 132. As shown in FIGS. 16 (a) and 16 (b), an image captured by the left front camera 135 and the right front camera 132 includes a part of the hydraulic excavator 10A together with the dump truck 50a existing in front of the hydraulic excavator 10A. Specifically, some of the crawlers 11 and 12 are included.

  The image composition processing unit 113 is the lower side of the image data, that is, the inner side in the image after composition, for the image data FL of the left front camera 135 and the image data FR of the right front camera 132 shown in FIGS. Are compressed, and the upper side of the image data, that is, the outer side of the combined image is expanded, and then the combining process is performed. Further, the image data of the right side camera 133, the image data of the rear camera 134, and the image data of the left side camera 136 are similarly subjected to compression or expansion processing and then combined.

  FIG. 17 shows a display example of the display device 120 in the situation shown in FIG. In the second embodiment, a virtual viewpoint image 70A is generated based on images obtained by the five cameras 132 to 136. Specifically, the virtual viewpoint image 70A includes a virtual viewpoint left front image 71a based on the image data of the left front camera 135, a virtual viewpoint left side image 71b based on the image data of the left side camera 136, and image data of the right front camera 132. , A virtual viewpoint right front image 73 based on the image data of the right camera 133, and a virtual viewpoint rear image 74 based on the image data of the rear camera 134. A boundary line 79 as a boundary of the display area is displayed between the virtual viewpoint left front image 71a and the virtual viewpoint left side image 71b.

  Thus, in the second embodiment described above, the following operational effects can be obtained in addition to the effects of the first embodiment described above.

  By arranging the left front camera 135 and the right front camera 132 substantially symmetrically with respect to the front work machine 19, a symmetrical image of the left front area and the right front area of the excavator 10 can be acquired.

  In the second embodiment described above, the image data of each of the cameras 132 to 136 is combined after being compressed or expanded. However, in the first embodiment, each camera is similarly combined. The image data 131 to 134 may be combined after being compressed or expanded. However, a correction process for compressing or expanding the image data is not essential as long as the images of the entire periphery of the excavators 10 and 10A can be synthesized from the image data of the cameras 131 to 136. For example, when the imaging regions of the cameras 131 to 136 partially overlap, it is possible to use the image data of one camera and not use the image data of the other camera for the overlapping range. Alternatively, in the overlapping range, the image data of one camera may be overwritten on the image data of the other camera. The correction processing in the image correction processing unit 111 is not essential.

  In the first and second embodiments described above, the entire periphery of the hydraulic excavators 10 and 10A is imaged using the cameras 131 to 136, and the upper viewpoint image of the entire periphery is displayed on the display monitor 121. Although configured, the present invention is not limited to this. For example, only the upper viewpoint image of the front area based on the image data of the left front side camera 131 or the left front camera 135 and the image data of the right front camera 132 may be displayed on the display monitor 121. In this case, for example, an image including the virtual viewpoint left front image 71a and the virtual viewpoint right front image 72 of FIG. Further, only the upper viewpoint image of the rear area based on the image data of the rear camera 134 may be displayed on the display monitor 121. An upper viewpoint image only in the front area, an upper viewpoint image only in the rear area, and an upper viewpoint image around the entire periphery may be switched and displayed.

  In the first and second embodiments described above, the cab frame image 61 and the front frame image 62 are displayed superimposed on the virtual viewpoint image 70, but the present invention is not limited to this. For example, only one of the cab frame image 61 and the front frame image 62 may be displayed. Further, the shapes of the frame images 61 and 62 are not limited to those described above. Instead of the frame images 61 and 62, an image that allows the virtual viewpoint image 70 to be seen through through is superimposed and displayed at a position corresponding to the cab 15 and the front work machine 19 in the virtual viewpoint image 70. It may be. Further, the design of the work machine image 60 is not limited to the above-described embodiment.

  In the first and second embodiments described above, the example in which the surrounding monitoring device is applied to a large hydraulic excavator as a work machine has been described. However, the present invention is not limited to this, and the surrounding monitoring devices 100 and 100A according to the present invention are used. The present invention can be similarly applied to other work machines such as small and medium-sized hydraulic excavators or cranes other than hydraulic excavators.

  Moreover, the above description is an example to the last, and unless the characteristic of this invention is impaired, this invention is not limited to embodiment and the modification which were mentioned above. It is also possible to combine the first embodiment and the second embodiment. Furthermore, other forms conceivable within the scope of the technical idea of the present invention are also included in the scope of the present invention.

10: Hydraulic excavator, 13: Lower traveling body, 14: Upper turning body, 15: Driver's cab, 19: Front work machine, 100: Ambient monitoring device, 110: Controller, 120: Display device, 130: Imaging device, 131: Left front side camera, 132: right front camera, 133: right side camera, 134: rear camera, 135: left front camera, 136: left side camera

Claims (4)

A work machine surrounding monitoring device having a front work machine and a machine body, the machine body having a cab.
A first imaging unit provided on the machine body on one side of the front work machine; and a second imaging unit provided on the machine body on the other side of the front work machine, An imaging device for imaging a front area of the work machine including a portion of
An image generation device that generates a virtual viewpoint image by performing viewpoint conversion so that the image acquired by the imaging device becomes an upper viewpoint;
A display device for displaying the virtual viewpoint image generated by the image generation device,
In the virtual viewpoint image, the display device includes a partial image representing the cab in a position corresponding to the cab, and a virtual viewpoint image and a partial image of a portion corresponding to the cab of the virtual viewpoint image A monitoring device for the surroundings of work machines. In the work machine surroundings monitoring device according to claim 1,
The imaging area of the first imaging unit is a surrounding monitoring device for a work machine, including a side area on one side of the work machine in addition to a front area of the work machine. In the surrounding monitoring apparatus of the working machine of Claim 1 or Claim 2,
In addition to the front area of the work machine, the imaging device images a side area and a rear area of the work machine,
The display device is a work machine surrounding monitoring device that displays a virtual viewpoint image of the entire periphery of the work machine. In the working machine surroundings monitoring device according to any one of claims 1 to 3,
The display device is a work machine surroundings monitoring device that displays a frame-shaped illustration representing the outer shape of the cab as the partial image.

Images