JP2012126239A - Device and method for controlling interruption image display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interruption image display control device and interruption image display control method, which can make a driver check all driving assist images superimposingly displayed on a vehicle periphery image even when an interruption image by a function which an onboard navigation system has is superimposingly displayed on the vehicle periphery image.SOLUTION: When an interruption display request is made for an interruption image during display of a vehicle periphery image and a driving assist image, a different region from a superimposing position of a driving assist image in the vehicle periphery image is identified on the basis of a display mode of the vehicle periphery image and at least a display mode of a vehicle traveling direction and a vehicle steering-wheel steering direction. In the vehicle periphery image, by superimposingly displaying a first interruption image within a specific region, the driving assist image is prevented from being hidden by the first interruption image even when an interruption display request is made for the interruption image.

Description

  The present invention relates to an interrupt image display control device and an interrupt image display control method, and in particular, a function of superimposing and displaying an interrupt image on a vehicle peripheral image generated based on a captured image of an imaging device installed in a vehicle. It is suitable for use in an interrupt image display control device having

  Conventionally, a plurality of imaging devices are installed on the front, rear, left and right of the host vehicle, and images around the host vehicle (for example, a front view image and a rear view image) generated based on the captured images captured by the plurality of imaging devices are mounted on the vehicle. Techniques for displaying on a display in a navigation device have been proposed. In addition, an image viewed from a virtual viewpoint above the own vehicle (hereinafter referred to as a top view image) is obtained by performing viewpoint conversion processing on an image around the own vehicle generated based on captured images captured by a plurality of imaging devices. A technique for generating and displaying the top view image on a display in an in-vehicle navigation device has been proposed. According to these techniques, the driver confirms the image of the vehicle surroundings and the top view image (hereinafter referred to as “vehicle surrounding images”) displayed on the display of the vehicle. It is possible to understand the positional relationship between the vehicle and the surrounding obstacles, and to drive the vehicle to prevent a collision between the vehicle and the obstacles.

  In addition, as a driving support image for supporting driving of a vehicle, for example, a technique of displaying a travel locus guide line superimposed on a top view image has been proposed. FIG. 7A shows a display example when the travel locus guide line is superimposed on the top view image. In FIG. 7A, 10 is a top view image and 20 is a host vehicle image. Reference numerals 30 and 40 denote travel locus guide lines, which indicate the vehicle width of the host vehicle, and the predicted travel locus calculated according to the traveling direction (forward) of the host vehicle and the steering direction (right direction) of the steering wheel of the host vehicle. Show.

  As another example of the driving support image, for example, a technique for displaying a vehicle width extension mark or a distance guide mark superimposed on a front view image or a rear view image has been proposed. FIG. 7B shows a display example when the vehicle width extension mark and the distance guide mark are superimposed on the rear view image. In FIG. 7B, 50 is a rear view image. Reference numerals 60 and 70 denote vehicle width extension marks, which indicate a guide of a course when the host vehicle is moved backward straight. Reference numeral 80 denotes a distance guide mark, which indicates the center position of the vehicle width extension marks 60 and 70, and the distance behind the vehicle (from the rear end of the bumper) (approximately 0.5 [m] ahead, approximately 1 [ m] ahead, about 2 [m] ahead).

  In addition, when a priority display object (for example, a moving body) exists in the rear image of the vehicle, another image (for example, a rear image after distortion correction or a rear image after viewpoint conversion) is displayed on the priority display object in the rear image. ) Has been proposed (see, for example, Patent Document 1). In addition, when an input screen for notifying an incoming call from the system is displayed on the display unit, a technique for displaying the input screen in an area that does not overlap with the area of the character input board screen that the operator is inputting has been proposed (for example, (See Patent Document 2).

International Publication No. 2008/087706 JP-A-5-313818

  By the way, when the vehicle periphery image is displayed on the display, an interrupt image by another function of the in-vehicle navigation device may be displayed superimposed on the vehicle periphery image. 8 (a) and 8 (b) show that when the vehicle peripheral images 10 and 50 shown in FIGS. 7 (a) and 7 (b) are displayed on the display, there is an incoming call by the hands-free function of the in-vehicle navigation device. An example is shown in which a telephone call notification image 90 for notifying the fact is displayed superimposed on the vehicle peripheral images 10 and 50. In FIGS. 8A and 8B, reference numeral 100 denotes a button for holding an incoming call. Reference numeral 110 denotes a button for starting a call for an incoming call.

  As shown in FIGS. 8A and 8B, conventionally, when there is an incoming call while the vehicle surrounding images 10 and 50 are being displayed, a telephone call notification image 90 is displayed at the center position of the vehicle surrounding images 10 and 50. Thus, a part of the driving support image such as the travel locus guide lines 30 and 40, the vehicle width extension marks 60 and 70, and the distance guide mark 80 is hidden. Therefore, there is a problem that the driver can only partially confirm the driving support image displayed superimposed on the vehicle surrounding images 10 and 50. Therefore, although the driving support image is displayed, the function for supporting the driving of the vehicle by the user is not sufficiently exhibited.

  The present invention has been made to solve such a problem, and even when an interrupt image by a function of the in-vehicle navigation device is displayed superimposed on the vehicle periphery image, An object of the present invention is to make it possible to confirm all the driving assistance images displayed superimposed on the vehicle periphery image.

  In order to solve the above-described problem, in the present invention, it is determined whether an interrupt image interrupt display request has occurred during display of the vehicle periphery image and the driving support image, and the interrupt image interrupt display request has occurred. Is determined based on at least the display mode among the display mode of the vehicle surrounding image, the traveling direction of the vehicle, and the steering direction of the steering wheel of the vehicle. In the vehicle peripheral image, the interrupt image is superimposed and displayed on the specified area.

  According to the present invention configured as described above, even when an interrupt image interrupt display request is generated, the driving support image is not hidden by the interrupt image. Therefore, even when an interrupt image due to the function of the in-vehicle navigation device is displayed superimposed on the vehicle periphery image, all the driving assistance images displayed superimposed on the vehicle periphery image are displayed to the driver. It can be confirmed.

It is a block diagram which shows the structural example of the vehicle periphery image display apparatus provided with the interruption image display control apparatus by this embodiment. It is a figure which shows the structural example of the area | region specific information of this embodiment. It is a figure which shows the example of display control of the interruption image by the interruption image display control apparatus of this embodiment. It is a figure which shows the example of display control of the interruption image by the interruption image display control apparatus of this embodiment. It is a figure which shows the example of display control of the interruption image by the interruption image display control apparatus of this embodiment. It is a flowchart which shows the example of display control operation | movement of the interruption image by the interruption image display control apparatus of this embodiment. It is a figure which shows the example of a display of the conventional vehicle periphery image. It is a figure which shows the example of a display of the interruption image in the conventional vehicle periphery image.

  Hereinafter, an embodiment of the present invention (hereinafter, this embodiment) will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration example of a vehicle peripheral image display device 220 including an interrupt image display control device 200 according to the present embodiment. As shown in FIG. 1, the vehicle periphery image display device 220 is connected to an imaging unit 240 and a display 260 (corresponding to the display unit of the present invention).

  The imaging unit 240 includes a plurality of imaging devices installed on the front, rear, left and right sides of the vehicle, and images a plurality of locations around the vehicle. Specifically, the imaging unit 240 includes a front camera for imaging the front of the host vehicle, a left side camera for imaging the left side of the host vehicle, a right side camera for imaging the right side of the host vehicle, and A rear camera for imaging the rear of the host vehicle is provided. The display 260 is also used for an in-vehicle navigation device (not shown), and displays various images such as a vehicle periphery image generated by the vehicle periphery image display device 220.

  Next, the internal configuration of the vehicle periphery image display device 220 will be described. The vehicle surrounding image display device 220 includes a vehicle surrounding image generation unit 360, a driving support image generation unit 380 and a vehicle surrounding image display control unit 400 in addition to the interrupt image display control device 200. The interrupt image display control device 200 includes a display mode detection unit 300, a traveling direction detection unit 320, a steering direction detection unit 340, an interrupt determination unit 420, an interrupt image generation unit 440, a region specification information storage unit 450, a region specification unit 460, and an interrupt. An image display control unit 480 is provided.

  The display mode detection unit 300 detects the display mode (any one of the front view image mode, the rear view image mode, and the top view image mode) of the vehicle surrounding image displayed on the display 260 based on the captured image captured by the imaging unit 240. . Specifically, the display mode detection unit 300 detects which display mode is selected from the front view image mode, the rear view image mode, and the top view image mode by a user operation on the operation unit (not shown). Thus, the display mode of the vehicle peripheral image is detected. Then, the display mode detection unit 300 outputs display mode information indicating the detected display mode to the vehicle surrounding image generation unit 360, the driving support image generation unit 380, and the region specification unit 460.

  The traveling direction detection unit 320 inputs gear position information indicating the gear position of the vehicle from, for example, an ECU (Electronic Control Unit) (not shown), and based on the input gear position information, the traveling direction (forward) , Stop or reverse). Then, the traveling direction detection unit 320 outputs traveling direction information indicating the detected traveling direction to the driving assistance image generation unit 380 and the region specifying unit 460.

  The steering direction detection unit 340 acquires steering angle information indicated by the output of a steering angle sensor mounted on the vehicle from the ECU, and based on this steering angle information, the steering direction of the vehicle steering wheel (straight direction, left direction, and right direction). One of the directions) is detected. For example, the steering direction detection unit 340 detects the steering direction of the steering wheel of the vehicle, with 5 degrees on the left and right as the straight direction, 5 degrees on the left with the left direction, and 5 degrees on the right with the right direction. Then, the steering direction detection unit 340 outputs the steering direction information indicating the detected steering direction to the driving assistance image generation unit 380 and the region specification unit 460.

  The vehicle peripheral image generation unit 360 generates a vehicle peripheral image from the captured image captured by the imaging unit 240 based on the display mode information output from the display mode detection unit 300. Then, the vehicle surrounding image generation unit 360 outputs the generated vehicle surrounding image data to the vehicle surrounding image display control unit 400.

  For example, when the display mode indicated by the display mode information is the front view image mode, the vehicle surrounding image generation unit 360 generates a front view image as the vehicle surrounding image based on the captured image captured by the front camera. Further, when the display mode indicated by the display mode information is the rear view image mode, the vehicle surrounding image generation unit 360 generates a rear view image based on the captured image captured by the rear camera as the vehicle surrounding image.

  In addition, when the display mode indicated by the display mode information is the top view image mode, the vehicle surrounding image generation unit 360 uses all the imaging devices (front camera, left side camera, By performing viewpoint conversion processing on the surrounding images (front view image, left side view image, right side view image, rear view image) generated based on the captured images captured by the right side camera and the rear camera) A top view image viewed from a virtual viewpoint above the vehicle is generated.

  The driving assistance image generation unit 380 displays at least the display mode information output from the display mode detection unit 300, the traveling direction information output from the traveling direction detection unit 320, and the steering direction information output from the steering direction detection unit 340. A driving support image for supporting driving of the vehicle is generated based on the mode information. Then, the driving assistance image generation unit 380 outputs the generated driving assistance image data to the vehicle surrounding image display control unit 400.

  For example, when the display mode indicated by the display mode information is the front view image mode, the driving assistance image generation unit 380 uses the vehicle width extension mark that indicates a guide of the course when the host vehicle is moved straight forward as the driving assistance image. In addition, a distance guide mark indicating the center position of the vehicle width extension mark and the distance in front of the host vehicle (from the front end of the bumper) is generated. In addition, when the display mode indicated by the display mode information is the rear view image mode, the driving support image generation unit 380 displays, as the driving support image, a vehicle width extension mark that indicates a guide of the course when the host vehicle is moved backward straight, A distance guide mark indicating the center position of the vehicle width extension mark and the distance behind the host vehicle (from the rear end of the bumper) is generated. It should be noted that the vehicle width extension mark and the distance guide mark in the rear view image mode are displayed up to a farther distance from the host vehicle than the vehicle width extension mark and the distance guide mark in the front view image mode.

  When the display mode indicated by the display mode information is the top view image mode, the driving support image generation unit 380 indicates the vehicle width of the host vehicle as the driving support image, and the traveling direction of the host vehicle (the traveling direction information). And a travel locus guide line indicating a predicted travel locus calculated according to the steering direction of the steering wheel of the host vehicle (identified by the steering direction information).

  The vehicle peripheral image display control unit 400 is generated by the vehicle peripheral image generation unit 360 based on the vehicle peripheral image data output from the vehicle peripheral image generation unit 360 and the driving support image data output from the driving support image generation unit 380. Control is performed so that the driving assistance image generated by the driving assistance image generation unit 380 is superimposed on the vehicle periphery image displayed and displayed on the display 260.

  The interrupt determination unit 420 determines whether or not an interrupt image interrupt display request is generated by another function of an in-vehicle navigation device (not shown) while the vehicle peripheral image display control unit 400 displays the vehicle peripheral image and the driving support image. Determine. In the present embodiment, the interruption image by other functions of the in-vehicle navigation device is a call arrival notification image for notifying that a call has been received by the hands-free function.

  When the interrupt determination unit 420 determines that an interrupt image interrupt display request has occurred, the interrupt determination unit 420 notifies the interrupt image generation unit 440, the region specifying unit 460, and the interrupt image display control unit 480 to that effect. On the other hand, the interrupt determination unit 420 does not notify anything when it is determined that an interrupt image interrupt display request has not occurred.

  When the interrupt image generation unit 440 receives a notification to the effect that an interrupt image interrupt display request has been generated from the interrupt determination unit 420, the interrupt image generation unit 440 and the first interrupt image data (corresponding to the interrupt image data of the present invention) Second interrupt image data having a larger amount of information than that of the interrupt image data. In the present embodiment, the interrupt image generation unit 440 generates a call incoming notification image that displays a call incoming party as the first interrupt image. The interrupt image generation unit 440 also includes a second incoming call notification as a second interrupt image that further includes a button for holding the incoming call and a button for starting a call to the incoming call. Generate an image. The first interrupt image is smaller in size than the second interrupt image. The second incoming call notification image corresponds to the conventional incoming call notification image described with reference to FIGS. The interrupt image generation unit 440 outputs the generated first interrupt image data and second interrupt image data to the interrupt image display control unit 480.

  The area specifying information storage unit 450 stores area specifying information for the area specifying unit 460 to specify an area different from the superimposed position of the driving support image in the vehicle surrounding image displayed by the vehicle surrounding image display control unit 400. . This area specifying information is information defined by the user and stored in advance in the area specifying information storage unit 450.

  FIG. 2 is a diagram illustrating a configuration example of area specifying information according to the present embodiment. As shown in FIG. 2, the region specifying information includes at least a display mode detected by the display mode detection unit 300, a traveling direction detected by the traveling direction detection unit 320, and a steering direction detected by the steering direction detection unit 340. This is information in which the display mode is associated with a region different from the superimposed position of the driving support image in the vehicle peripheral image. The region different from the superimposed position of the driving support image is a region that exists at a position where the user who has seen the vehicle peripheral image can clearly identify the driving support image and the first interrupt image.

For example, when the display mode is the front view image mode, the region different from the superimposed position of the driving assistance image in the vehicle peripheral image is specified as “upper center” by the region specifying information. When the display mode is the rear view image mode, the region different from the superimposed position of the driving support image in the vehicle peripheral image is specified as “upper center” by the region specifying information. As described above, when the display mode is the front view image mode or the rear view image mode, the region different from the superimposed position of the driving assistance image in the vehicle peripheral image is specified based only on the display mode.

  When the display mode is the top view image mode, the region different from the superimposed position of the driving assistance image in the vehicle periphery image is detected by the traveling direction detected by the traveling direction detection unit 320 and the steering direction detection unit 340. It is specified according to the steering direction. For example, when the traveling direction is forward and the steering direction is rightward, the region different from the superimposed position of the driving assistance image in the vehicle peripheral image is identified as “lower left” by the region identifying information.

  When the notification that the interrupt display request for the interrupt image has been generated is received from the interrupt determination unit 420, the region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and displays the display mode detecting unit. Based on at least the display mode information among the display mode information output from 300, the traveling direction information output from the traveling direction detection unit 320, and the steering direction information output from the steering direction detection unit 340, the vehicle periphery image display control unit A region different from the superimposed position of the driving assistance image in the vehicle peripheral image displayed by 400 is specified. Then, the area specifying unit 460 outputs specific area information indicating the specified area to the interrupt image display control unit 480.

  When the interrupt image display control unit 480 receives a notification to the effect that an interrupt image interrupt display request has been generated from the interrupt determination unit 420, the interrupt image display control unit 480 includes a region specifying unit on the vehicle peripheral image displayed by the vehicle peripheral image display control unit 400. Control is performed so that the first interrupt image based on the first interrupt image data output from the interrupt image generation unit 440 is superimposed and displayed on the area indicated by the specific area information output from 460.

  The interrupt image display control unit 480 performs an operation of selecting the first interrupt image by a user operation on the operation unit (not shown) after displaying the first interrupt image based on the first interrupt image data. If it is performed, the second interrupt image based on the second interrupt image data instead of the first interrupt image being displayed, for example, at the center position on the vehicle peripheral image displayed by the vehicle peripheral image display control unit 400. Are controlled so as to be superimposed.

  Next, when the vehicle peripheral image and the driving support image are displayed on the display 260 by the vehicle peripheral image display control unit 400, the interrupt image display control unit 480 displays the telephone call notification image and the second telephone call notification image on the vehicle. An example of a screen that is displayed while being superimposed on a peripheral image will be described with reference to FIGS.

  FIG. 3A shows a display example when the user turns the steering wheel of the vehicle to the left while the host vehicle is moving forward by selecting the top view image mode. In FIG. 3A, 500 is a top view image, and 502 is a host vehicle image. Reference numerals 504 and 506 denote travel trajectory guide lines that indicate the vehicle width of the host vehicle and are predicted travel trajectories calculated in accordance with the traveling direction (forward direction) of the host vehicle and the steering direction (left direction) of the steering wheel of the host vehicle. Is shown. Reference numeral 508 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 504 in the top view image 500. A region different from the superimposed position of 506 (driving support image) is identified as “lower right”. Then, the interrupt image display control unit 480 displays the incoming call notification image 508 in the lower right area of the top view image 500. As a result, since the travel locus guide lines 504 and 506 are not hidden by the incoming call notification image 508, the driver confirms all of the travel locus guide lines 504 and 506 displayed superimposed on the top view image 500. Can be made.

  When the operation for selecting the incoming call notification image 508 is performed after the incoming call notification image 508 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 508 with the second telephone call. An incoming call notification image 501 is superimposed and displayed. FIG. 3B shows a display example at that time. In the second incoming call notification image 501 in FIG. 3B, reference numeral 503 denotes a button for holding the incoming call. Reference numeral 505 denotes a button for starting a call for an incoming call. As a result, the display size of the incoming call notification image 508 having a smaller amount of information than that of the second incoming call notification image 501 can be reduced, and the incoming call notification image 508 can be reduced so as not to overlap the driving support image in the top view image 500. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 3C shows a display example when the user turns the steering wheel of the vehicle to the right while the host vehicle is moving forward by selecting the top view image mode. In FIG. 3C, 510 is a top view image, and 512 is a host vehicle image. Reference numerals 514 and 516 denote travel trajectory guide lines that indicate the vehicle width of the host vehicle and are predicted travel trajectories calculated in accordance with the traveling direction (forward direction) of the host vehicle and the steering direction (right direction) of the handle of the host vehicle. Is shown. Reference numeral 518 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 514 in the top view image 510. An area different from the superimposed position of 516 (driving support image) is specified as “lower left”. Then, the interrupt image display control unit 480 displays the incoming call notification image 518 in the lower left area of the top view image 510. As a result, the travel locus guide lines 514 and 516 are not hidden by the incoming call notification image 518, so the driver confirms all the travel locus guide lines 514 and 516 displayed superimposed on the top view image 510. Can be made.

  Further, when an operation for selecting the incoming call notification image 518 is performed after the incoming call notification image 518 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 518 with the second telephone call. An incoming call notification image 511 is superimposed and displayed. FIG. 3D shows a display example at that time. In the second incoming call notification image 511 in FIG. 3D, 513 is a button for holding the incoming call. Reference numeral 515 denotes a button for starting a call for an incoming call. As a result, the display size of the incoming call notification image 518 having a smaller amount of information than that of the second incoming call notification image 511 can be reduced, and the incoming call notification image 518 is not superimposed on the driving support image in the top view image 510. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 3E shows a display example when the user turns the steering wheel of the vehicle to the left while the host vehicle is moving backward by selecting the top view image mode. In FIG. 3E, 520 is a top view image and 522 is a host vehicle image. Reference numerals 524 and 526 denote travel trajectory guide lines which indicate the vehicle width of the host vehicle and are predicted travel trajectories calculated according to the traveling direction (reverse direction) of the host vehicle and the steering direction (left direction) of the steering wheel of the host vehicle. Is shown. Reference numeral 528 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 524 in the top view image 520. An area different from the superimposed position of 526 (driving support image) is identified as “upper right”. Then, the interrupt image display control unit 480 displays the incoming call notification image 528 in the upper right area of the top view image 520. As a result, the travel path guide lines 524 and 526 are not hidden by the incoming call notification image 528, so the driver confirms all of the travel path guide lines 524 and 526 displayed superimposed on the top view image 520. Can be made.

  Further, when an operation for selecting the incoming call notification image 528 is performed after the incoming call notification image 528 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 528 with the second telephone call. The incoming call notification image 521 is superimposed and displayed. FIG. 3F shows a display example at that time. In the second incoming call notification image 521 in FIG. 3F, reference numeral 523 denotes a button for holding the incoming call. Reference numeral 525 denotes a button for starting a call for an incoming call. Thereby, the display size of the telephone incoming call notification image 528 having a smaller amount of information than the second telephone incoming call notification image 521 can be reduced, and the telephone incoming call notification image 528 is not overlapped with the driving support image in the top view image 520. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 3G shows a display example when the user turns the steering wheel of the vehicle to the right while the host vehicle is moving backward by selecting the top view image mode. In FIG. 3G, 530 is a top view image and 532 is a host vehicle image. Reference numerals 534 and 536 denote travel trajectory guide lines that indicate the vehicle width of the host vehicle, and are predicted travel trajectories calculated according to the traveling direction (reverse direction) of the host vehicle and the steering direction (right direction) of the handle of the host vehicle. Is shown. Reference numeral 538 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 534 in the top view image 530. An area different from the superimposed position of 536 (driving support image) is identified as “upper left”. Then, the interrupt image display control unit 480 displays the incoming call notification image 538 in the upper left area of the top view image 530. As a result, the travel path guide lines 534 and 536 are not hidden by the incoming call notification image 538, so the driver confirms all the travel path guide lines 534 and 536 displayed superimposed on the top view image 530. Can be made.

  In addition, when an operation for selecting the incoming call notification image 538 is performed after the incoming call notification image 538 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 538 with the second telephone call. An incoming call notification image 531 is superimposed and displayed. FIG. 3 (h) shows a display example at that time. In the second incoming call notification image 531 in FIG. 3H, 533 is a button for holding the incoming call. Reference numeral 535 denotes a button for starting a call for an incoming call. Thereby, the display size of the telephone incoming call notification image 538 having a smaller amount of information than the second telephone incoming call notification image 531 can be reduced, and the telephone incoming call notification image 538 is displayed so as not to be superimposed on the driving support image in the top view image 530. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 4A shows a display example when the user does not turn the steering wheel of the vehicle while the host vehicle is moving forward with the top view image mode selected. In FIG. 4A, 540 is a top view image, and 542 is a host vehicle image. Reference numerals 544 and 546 denote travel locus guide lines that indicate the vehicle width of the host vehicle, and are predicted travel tracks calculated in accordance with the traveling direction (forward direction) of the host vehicle and the steering direction (straight direction) of the steering wheel of the host vehicle. Is shown. Reference numeral 548 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 544 in the top view image 540. An area different from the superimposed position of 546 (driving support image) is specified as “bottom center”. Then, the interrupt image display control unit 480 displays the incoming call notification image 548 in the lower center area of the top view image 540. As a result, since the travel locus guide lines 544 and 546 are not hidden by the incoming call notification image 548, the driver confirms all the travel locus guide lines 544 and 546 displayed superimposed on the top view image 540. Can be made.

  In addition, when an operation for selecting the incoming call notification image 548 is performed after displaying the incoming call notification image 548, the interrupt image display control unit 480 replaces the displayed incoming call notification image 548 with the second telephone call. An incoming call notification image 541 is superimposed and displayed. FIG. 4B shows a display example at that time. In the second incoming call notification image 541 shown in FIG. 4B, reference numeral 543 denotes a button for holding the incoming call. Reference numeral 545 denotes a button for starting a telephone call for an incoming call. Thereby, the display size of the telephone incoming call notification image 548 having a smaller amount of information than the second telephone incoming call notification image 541 can be reduced, and the telephone incoming call notification image 548 is displayed so as not to be superimposed on the driving support image in the top view image 540. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 4C shows a display example when the user does not turn the steering wheel of the vehicle while the host vehicle is moving backward when the top view image mode is selected. In FIG. 4C, 550 is a top view image and 552 is a host vehicle image. Reference numerals 554 and 556 denote travel trajectory guide lines, which indicate the vehicle width of the host vehicle, and are predicted travel trajectories calculated in accordance with the traveling direction (reverse direction) of the host vehicle and the steering direction (straight direction) of the handle of the host vehicle. Is shown. Reference numeral 558 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 554 in the top view image 550. An area different from the superimposed position of 556 (driving support image) is specified as “center upper”. Then, the interrupt image display control unit 480 displays the incoming call notification image 558 in the upper center area of the top view image 550. As a result, the travel path guide lines 554 and 556 are not hidden by the incoming call notification image 558, so the driver confirms all the travel path guide lines 554 and 556 displayed superimposed on the top view image 550. Can be made.

  Further, when an operation for selecting the incoming call notification image 558 is performed after the incoming call notification image 558 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 558 with the second telephone call. An incoming call notification image 551 is superimposed and displayed. FIG. 4D is a display example at that time. In the second incoming call notification image 551 in FIG. 4D, 553 is a button for holding the incoming call. Reference numeral 555 denotes a button for starting a call for an incoming call. Thereby, the display size of the incoming call notification image 558 having a smaller amount of information than the second incoming call notification image 551 can be reduced, and the incoming call notification image 558 is displayed so as not to be superimposed on the driving support image in the top view image 550. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 4E shows a display example when the user turns the steering wheel of the vehicle to the right while the host vehicle is stopped by selecting the top view image mode. In FIG. 4E, 560 is a top view image, and 562 is a host vehicle image. Reference numerals 564 and 566 denote travel trajectory guide lines, which indicate the vehicle width of the host vehicle, and the predicted travel trajectory calculated according to the traveling direction (stop) of the host vehicle and the steering direction (right direction) of the handle of the host vehicle. Show. Reference numeral 568 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450, and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 564 in the top view image 560. An area different from the superimposed position of 566 (driving support image) is specified as “center left”. Then, the interrupt image display control unit 480 displays the incoming call notification image 568 in the center left area of the top view image 560. As a result, the travel path guide lines 564 and 566 are not hidden by the incoming call notification image 568, so that the driver confirms all of the travel path guide lines 564 and 566 displayed superimposed on the top view image 560. Can be made.

  Further, when an operation for selecting the incoming call notification image 568 is performed after the incoming call notification image 568 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 568 with the second telephone call. An incoming call notification image 561 is superimposed and displayed. FIG. 4F shows a display example at that time. In the second incoming call notification image 561 in FIG. 4F, reference numeral 563 denotes a button for holding the incoming call. Reference numeral 565 denotes a button for starting a call for an incoming call. Thereby, the display size of the incoming call notification image 568 having a smaller amount of information than that of the second incoming call notification image 561 can be reduced, and the incoming call notification image 568 is displayed so as not to be superimposed on the driving support image in the top view image 560. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 4G shows a display example when the user turns the steering wheel of the vehicle to the left while the host vehicle is stopped by selecting the top view image mode. In FIG. 4G, 570 is a top view image, and 572 is a host vehicle image. Reference numerals 574 and 576 denote travel locus guide lines, which indicate the vehicle width of the host vehicle, and the predicted travel locus calculated according to the traveling direction of the host vehicle (stopping) and the steering direction of the steering wheel of the host vehicle (left direction). Show. Reference numeral 578 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450 and based on the display mode information, the traveling direction information, and the steering direction information, the travel locus guide line 574 in the top view image 570. An area different from the superimposed position of 576 (driving support image) is specified as “center right”. Then, the interrupt image display control unit 480 displays the incoming call notification image 578 in the center right area of the top view image 570. As a result, since the travel locus guide lines 574 and 576 are not hidden by the incoming call notification image 578, the driver confirms all the travel locus guide lines 574 and 576 displayed superimposed on the top view image 570. Can be made.

  Further, when an operation for selecting the incoming call notification image 578 is performed after the incoming call notification image 578 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 578 with the second telephone call. The incoming call notification image 571 is superimposed and displayed. FIG. 4H shows a display example at that time. In the second incoming call notification image 571 shown in FIG. 4H, reference numeral 573 denotes a button for holding the incoming call. Reference numeral 575 denotes a button for starting a call for an incoming call. Thereby, the display size of the telephone incoming call notification image 578 having a smaller amount of information than the second telephone incoming call notification image 571 can be reduced, and the telephone incoming call notification image 578 is displayed so as not to be superimposed on the driving support image in the top view image 570. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 5A shows a display example when the display mode of the vehicle surrounding image is the front view image mode. In FIG. 5A, 580 is a front view image. Reference numerals 582 and 584 denote vehicle width extension marks, which indicate a guide for a course when the host vehicle is moved straight forward. Reference numeral 586 denotes a distance guide mark indicating the center position of the vehicle width extension marks 582 and 584 and the distance (about 0.5 [m] ahead) ahead of the host vehicle (from the front end of the bumper). Reference numeral 588 denotes an incoming call notification image in which an interrupt display request has occurred.

  The area specifying unit 460 refers to the area specifying information stored in the area specifying information storage unit 450, and based on the display mode information, the vehicle width extension marks 582, 584, the distance guide mark 586, etc. in the front view image 580 are displayed. An area different from the superimposed position of the driving assistance image is specified as “center upper”. Then, the interrupt image display control unit 480 displays the incoming call notification image 588 in the area on the center of the front view image 580. As a result, the driving support image of the vehicle width extension mark 582, 584 and the distance guide mark 586 is not hidden by the incoming call notification image 588, and the vehicle displayed superimposed on the front view image 580 to the driver. All of the width extension marks 582 and 584 and the distance guide mark 586 can be confirmed.

  Further, when an operation for selecting the incoming call notification image 588 is performed after displaying the incoming call notification image 588, the interrupt image display control unit 480 replaces the displayed incoming call notification image 588 with the second telephone call. An incoming call notification image 581 is superimposed and displayed. FIG. 5B shows a display example at that time. In the second incoming call notification image 581 in FIG. 5B, reference numeral 583 denotes a button for holding the incoming call. Reference numeral 585 denotes a button for starting a telephone call for an incoming call. Thereby, the display size of the telephone incoming call notification image 588 having a smaller amount of information than the second telephone incoming call notification image 581 can be reduced, and the telephone incoming call notification image 588 is displayed so as not to be superimposed on the driving support image in the front view image 580. It becomes easy to display. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  FIG. 5C shows a display example when the display mode of the vehicle surrounding image is the rear view image mode. In FIG.5 (c), 590 is a rear view image. Reference numerals 592 and 594 denote vehicle width extension marks, which indicate a guide of the course when the host vehicle is moved backward straight. Reference numeral 596 denotes a distance guide mark indicating the center position of the vehicle width extension marks 592 and 594, and a distance behind the vehicle (from the rear end of the bumper) (approximately 0.5 [m] ahead, approximately 1 [ m] ahead, about 2 [m] ahead). Reference numeral 598 denotes an incoming call notification image in which an interrupt display request has occurred.

  The region specifying unit 460 refers to the region specifying information stored in the region specifying information storage unit 450 and, based on the display mode information, drives the vehicle width extension marks 582, 594, the distance guide mark 596, and the like in the rear view image 590. A region different from the superimposition position of the support image is identified as “upper center”. Then, the interrupt image display control unit 480 displays the incoming call notification image 598 in the area above the center of the rear view image 590. As a result, the driving support image of the vehicle width extension mark 592, 594 and the distance guide mark 596 is not hidden by the incoming call notification image 598, so the vehicle width displayed superimposed on the rear view image 590 to the driver. All of the extension marks 592 and 594 and the distance guide mark 596 can be confirmed.

  Further, when an operation for selecting the incoming call notification image 598 is performed after the incoming call notification image 598 is displayed, the interrupt image display control unit 480 replaces the displayed incoming call notification image 598 with the second telephone call. An incoming call notification image 591 is superimposed and displayed. FIG. 5D shows a display example at that time. In the second incoming call notification image 591 in FIG. 5D, 593 is a button for holding the incoming call. Reference numeral 595 denotes a button for starting a call for an incoming call. Thus, the display size of the incoming call notification image 598 having a smaller amount of information than that of the second incoming call notification image 591 can be reduced, and the incoming call notification image 598 is displayed in the rear view image 590 so as not to be superimposed on the driving support image. It becomes easy to do. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  Next, an interrupt image display control operation by the interrupt image display control apparatus 200 according to the present embodiment will be described. FIG. 6 is a flowchart illustrating an example of an interrupt image display control operation performed by the interrupt image display control apparatus 200 according to the present embodiment. Step S100 in FIG. 6 starts when the vehicle periphery image display control unit 400 displays the vehicle periphery image and the driving support image on the display 260.

  First, the interrupt determination unit 420 determines whether or not an interrupt image interrupt display request has occurred during the display of the vehicle periphery image and the driving support image by the vehicle periphery image display control unit 400 (step S100). If interrupt determination unit 420 determines that an interrupt image interrupt display request has not occurred (NO in step S100), the process transitions to step S100.

  On the other hand, when interrupt determination unit 420 determines that an interrupt image interrupt display request has occurred (YES in step S100), interrupt determination unit 420 notifies interrupt image generation unit 440, region specifying unit 460, and interrupt. The image display control unit 480 is notified.

  Next, the display mode detection unit 300 detects the display mode (one of the front view image mode, the rear view image mode, and the top view image mode) of the vehicle periphery image to be displayed based on the captured image captured by the imaging unit 240. (Step S120). Then, the display mode detection unit 300 outputs display mode information indicating the detected display mode to the vehicle surrounding image generation unit 360, the driving support image generation unit 380, and the region specification unit 460.

  Next, the traveling direction detection unit 320 inputs gear position information indicating the gear position of the vehicle from, for example, an ECU (not shown), and based on the input gear position information, the traveling direction (forward, stop, and stop) of the vehicle. Any one of the backward movements) is detected (step S140). Then, the traveling direction detection unit 320 outputs traveling direction information indicating the detected traveling direction to the driving assistance image generation unit 380 and the region specifying unit 460.

  Next, the steering direction detection unit 340 inputs steering angle information indicating the steering angle of the vehicle from the ECU, and based on the input steering angle information, the steering direction of the vehicle steering wheel (straight direction, left direction and right direction). Any one) is detected (step S160). Then, the steering direction detection unit 340 outputs the steering direction information indicating the detected steering direction to the driving assistance image generation unit 380 and the region specification unit 460.

  Next, the interrupt image generation unit 440 receives a notification that an interrupt image interrupt display request has been generated from the interrupt determination unit 420, and the amount of information is greater than the first interrupt image data and the first interrupt image data. Second interrupt image data having a large size is generated (step S180). Then, the interrupt image generation unit 440 outputs the first interrupt image data and the second interrupt image data to the interrupt image display control unit 480.

  Next, the area specifying unit 460 receives a notification that an interrupt image interrupt display request has occurred from the interrupt determining unit 420, refers to the area specifying information stored in the area specifying information storage unit 450, and displays the display mode. Based on at least display mode information among display mode information output from detection unit 300, travel direction information output from travel direction detection unit 320, and steering direction information output from steering direction detection unit 340, vehicle periphery image display A region different from the superimposed position of the driving assistance image in the vehicle periphery image displayed by the control unit 400 is specified (step S200). Then, the area specifying unit 460 outputs specific area information indicating the specified area to the interrupt image display control unit 480.

  Next, the interrupt image display control unit 480 receives a notification that an interrupt image interrupt display request has been generated from the interrupt determination unit 420, and displays an area on the vehicle peripheral image displayed by the vehicle peripheral image display control unit 400. The first interrupt image based on the first interrupt image data output from the interrupt image generation unit 440 is superimposed and displayed on the area indicated by the specific area information output from the specifying unit 460 (step S220).

  Next, the interrupt image display control unit 480 determines whether or not an operation for selecting the first interrupt image has been performed by a user operation on the operation unit (not shown) (step S240). If the interrupt image display control unit 480 determines that an operation for selecting the first interrupt image has not been performed (NO in step S240), the process transitions to step S240.

  On the other hand, when the interrupt image display control unit 480 determines that the operation for selecting the first interrupt image has been performed (YES in step S240), the interrupt image display control unit 480 is operated by the vehicle surrounding image display control unit 400. For example, the second interrupt image based on the second interrupt image data is superimposed and displayed at the center position on the displayed vehicle peripheral image instead of the first interrupt image being displayed (step S260). When the process of step S260 is completed, the interrupt image display control apparatus 200 ends the process in FIG.

  As described above in detail, in the present embodiment, when an interrupt display request for an interrupt image (call incoming notification image) is generated during display of the vehicle periphery image and the driving support image, the region specifying information is referred to and the vehicle periphery A region different from the superimposed position of the driving support image in the vehicle peripheral image is specified based on at least the display mode among the image display mode, the traveling direction of the vehicle, and the steering direction of the steering wheel of the vehicle. Then, the first interruption image is superimposed and displayed on the specified area in the vehicle peripheral image.

  According to the present embodiment configured as described above, even when an interrupt display request for an interrupt image is generated, the driving support image is not hidden by the first interrupt image. Therefore, even when the first interrupt image is displayed superimposed on the vehicle surrounding image, the driver can check all the driving assistance images displayed superimposed on the vehicle surrounding image. . Therefore, the function of supporting the driving of the vehicle by the user can be sufficiently exhibited by displaying the driving assistance image.

  Further, in this embodiment, when an operation for selecting the first interrupt image is performed after the first interrupt image is displayed, information from the first interrupt image is used instead of the first interrupt image being displayed. A large amount of the second interrupt image (second incoming call notification image) is superimposed and displayed. As a result, the size of the interrupt image having a smaller amount of information than that of the second interrupt image can be reduced, and the first interrupt image can be easily displayed so as not to overlap the driving support image in the vehicle peripheral image. Furthermore, the user can perform a specific response to the interrupt display (hold the incoming call or start a call to the incoming call) at the timing intended by the user.

  In the above embodiment, an example in which the first interrupt image is a call incoming notification image by the hands-free function has been described, but the present invention is not limited to this. For example, the first interrupt image may be a road traffic information image when interrupting and displaying road traffic information provided by a road traffic information communication system (VICS: registered trademark). Further, it may be a warning display image made up of a character string such as “Please drive while visually checking the periphery of the vehicle” that is interrupted when displaying the front view image or the rear view image.

  Moreover, in the said embodiment, the area | region linked | related with display mode, advancing direction, and a steering direction in area | region specific information is only an example, and if it is an area | region different from the superimposition position of a driving assistance image, it will be arbitrary area | regions. good.

  In addition, each of the above-described embodiments is merely an example of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the gist or the main features thereof.

200 Interruption image display control device 240 Imaging unit (imaging device)
260 Display (display unit)
DESCRIPTION OF SYMBOLS 300 Display mode detection part 320 Advancing direction detection part 340 Steering direction detection part 360 Vehicle periphery image generation part 380 Driving assistance image generation part 400 Vehicle periphery image display control part 420 Interruption determination part 460 Area | region identification part 480 Interruption image display control part

Claims (3)

A vehicle peripheral image generating unit that generates a vehicle peripheral image from a captured image captured by an imaging device installed in the vehicle; a driving support image generating unit that generates a driving support image for supporting driving of the vehicle; A vehicle periphery image display control unit configured to superimpose the drive support image generated by the drive support image generation unit on the vehicle periphery image generated by the vehicle periphery image generation unit and display the superimposed image on the display unit. An interrupt image display control device used for a vehicle periphery image display device,
A display mode detection unit for detecting a display mode of the vehicle periphery image;
A traveling direction detector for detecting a traveling direction of the vehicle;
A steering direction detector for detecting a steering direction of the steering wheel of the vehicle;
An interrupt determination unit that determines whether an interrupt display request for an interrupt image has occurred during display of the vehicle periphery image and the driving support image;
When it is determined by the interrupt determination unit that an interrupt display request for the interrupt image has occurred, the display mode detected by the display mode detection unit, the traveling direction detected by the traveling direction detection unit, and the steering direction A region specifying unit for specifying a region different from the superimposed position of the driving assistance image in the vehicle peripheral image based on at least the display mode among the steering directions detected by the detecting unit;
An interrupt image display control unit that controls to display the interrupt image superimposed on the region specified by the region specifying unit on the vehicle peripheral image displayed by the vehicle peripheral image display control unit. An interrupt image display control device characterized by that. The interrupt image display control device according to claim 1,
When the interrupt image display control unit receives a user operation to select the interrupt image after displaying the interrupt image, the interrupt image display control unit replaces the interrupt image with a second interrupt having a larger amount of information and a larger size than the interrupt image. An interrupt image display control device that controls to display an image. A vehicle peripheral image generating unit that generates a vehicle peripheral image from a captured image captured by an imaging device installed in the vehicle; a driving support image generating unit that generates a driving support image for supporting driving of the vehicle; A vehicle periphery image display control unit configured to superimpose the drive support image generated by the drive support image generation unit on the vehicle periphery image generated by the vehicle periphery image generation unit and display the superimposed image on the display unit. An interrupt image display control method in a vehicle periphery image display device,
A first step of determining whether or not an interrupt image interrupt display request has occurred during display control of the vehicle peripheral image and the driving support image;
A display mode detection unit, a traveling direction detection unit, and a steering direction detection unit of the vehicle peripheral image display device respectively detect a display mode of the vehicle peripheral image, a traveling direction of the vehicle, and a steering direction of the steering wheel of the vehicle. And the steps
When it is determined in the first step that an interrupt display request for the interrupt image has occurred, the area specifying unit of the vehicle periphery image display device detects the display mode detected in the second step, the progress A third step of identifying a region different from the superimposed position of the driving assistance image in the vehicle peripheral image based on at least the display mode of the direction and the steering direction;
The interrupt image display control unit of the vehicle periphery image display device displays the interrupt image superimposed on the area specified by the third step on the vehicle periphery image displayed by the vehicle periphery image display control unit. And an interrupt image display control method characterized by comprising: a fourth step of performing control.

Images