JP2015166228A - Captured image-processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the possibility that, when captured images are inputted to the same video input terminal of an on-vehicle display system from a rear camera and a sub camera, a meaningless guide line is superimposed on an image captured by the sub camera so that a feeling of strangeness is given to a user.SOLUTION: A captured image processing device comprises: an image processing circuit 52 that processes an image captured by a sub camera 51 and then outputs the processed image as a sub camera image; and an image input circuit 54 that inputs a video signal of an image captured by a rear camera 4 and a video signal of the processed sub camera image outputted by the image processing circuit 52, to a rear video input terminal 11a of an on-vehicle display system 1. The on-vehicle display system 1 superimposes a guide line for supporting retreat of a vehicle on the image inputted into the rear video input terminal 11a and displays the image to a user. The image processing circuit 52 reduces the image captured by the sub camera 51 and outputs an image having the reduced image captured by the sub camera 5 arranged only at an upper end part thereof as the processed sub camera image.

Description

  The present invention relates to a captured image processing apparatus.

  2. Description of the Related Art Conventionally, a technique for displaying a captured image of a rear camera that is attached to a vehicle and captures a rear side from the vehicle on an in-vehicle display system is known. In addition to the rear camera, a technique for displaying a captured image of a sub camera that captures the front of a vehicle or the like on an in-vehicle display system is also known. A technique is also known in which an in-vehicle display system displays a vehicle width extension line and a predicted course line superimposed on a captured image of a rear camera (for example, see Patent Document 1).

JP 2010-221980 A

  As described above, when a rear camera and a sub camera other than the rear camera are mounted on a vehicle, a captured image may be input from the rear camera and the sub camera to the same video input terminal of the in-vehicle display system. For example, a case where an in-vehicle display system has only a video input terminal for a rear camera as a video input terminal is applicable.

  In such a case, the rear camera video input terminal of the in-vehicle display system can be selected by the user by a changeover switch or the like to input the rear camera captured image or the sub camera captured image. Can be considered.

  However, when an image is input to the in-vehicle display system from the video input terminal for the rear camera, the in-vehicle display system can detect the vehicle width extension line and the line as described above even if the input image is a captured image of the sub camera. The predicted route may be superimposed. In that case, since the captured image of the sub camera is displayed with the meaningless guide line superimposed on the captured image of the sub camera, the user feels uncomfortable.

  In view of the above, the present invention, when a captured image is input from the rear camera and the sub camera to the same video input terminal of the in-vehicle display system, a meaningless guide line is superimposed on the captured image of the sub camera, and the user feels uncomfortable. The purpose is to reduce the possibility of giving the.

  In order to achieve the above-mentioned object, the invention according to claim 1 includes a captured image of a rear camera (4) that captures the rear from the vehicle, and a sub camera (51) that captures a direction different from the rear camera from the vehicle. Is a captured image processing apparatus that inputs an image based on the captured image to the same video input terminal of the in-vehicle display system (1), and processes the captured image (60) of the sub-camera and processes the processed sub-camera image ( 62) an image processing circuit (52) to be output, a video signal of a photographed image of the rear camera, and a video signal of the processed sub-camera image output from the image processing circuit, the video of the in-vehicle display system And an image input circuit (54) for inputting to the input terminal, wherein the in-vehicle display system moves the vehicle backward relative to the image input to the video input terminal. An auxiliary guide line is superimposed and displayed to the user, and the image processing circuit reduces the captured image of the sub camera, and the processed image is arranged by limiting the reduced captured image of the sub camera to the upper end. A captured image processing apparatus that outputs a rear sub-camera image.

  Thus, the inventor of the present application examined the premise that the in-vehicle display system superimposes a backward support guide line (hereinafter simply referred to as a guide line) on the image input to the video input terminal and displays it to the user. Was added. As a result, it has been found that there are many portions where the guide line is not superimposed on the upper end due to the characteristics of the guide line. Therefore, the present inventor has conceived that in the image processing circuit, in the post-processed sub-camera image, the reduced sub-camera image is limited to the upper end.

  As a result, the guide line is not superimposed on the captured image of the sub-camera limited to the upper end in the processed sub-camera image, or even if the guide line is superimposed, the superimposed portion is in a very small area. It ’s more likely to fit. Therefore, the possibility that a meaningless guide line is superimposed on the captured image of the sub camera and the user feels uncomfortable is reduced.

  In addition, the code | symbol in the bracket | parenthesis in the said and the claim shows the correspondence of the term described in the claim, and the concrete thing etc. which illustrate the said term described in embodiment mentioned later. .

It is a lineblock diagram of the in-vehicle system concerning a 1st embodiment. 2 is a configuration diagram of an image processing circuit 52. FIG. 2 is a configuration diagram of a video switching circuit 54. FIG. It is a timing diagram showing the time-dependent change of the operating state of a vehicle-mounted system. Sub camera image 60 and processed sub camera image 62 It is a figure of the sub camera image 62 after a process displayed on the image display apparatus 12. FIG. It is a block diagram of the vehicle-mounted system which concerns on 2nd Embodiment. 2 is a configuration diagram of an image processing circuit 52. FIG. It is a timing diagram showing the time-dependent change of the operating state of a vehicle-mounted system. It is a figure which shows switching of the image displayed on the image display apparatus. It is a block diagram of the vehicle-mounted system which concerns on 3rd Embodiment. 2 is a configuration diagram of a video switching circuit 54. FIG. It is a timing diagram showing the time-dependent change of the operating state of a vehicle-mounted system.

(First embodiment)
The first embodiment of the present invention will be described below. As shown in FIG. 1, the in-vehicle system according to the present embodiment is mounted on a vehicle and includes an in-vehicle display system 1, a back gear signal output unit 3, a rear camera 4, and a captured image processing device 5.

  The in-vehicle display system 1 includes a navigation device 11 and an image display device 12. The navigation device 11 identifies the current position of the vehicle based on signals from known sensors (GPS receiver, acceleration sensor, vehicle speed sensor, yaw rate sensor, etc.) in the vehicle, and from the current position to the destination set by the user The guidance route is calculated. Further, the navigation device 11 creates a map image around the current position based on the map data, displays the map image on the image display device 12, and highlights the guidance route on the map.

  The back gear signal output unit 3 outputs an ON signal when the vehicle shift position becomes the reverse position, that is, when the drive position becomes R, and when the vehicle shift position is other than the reverse position. That is, when the drive position becomes D, N, P or the like, an off signal is output.

  The rear camera 4 is a camera that is attached to the rear (for example, the rear end) of the vehicle, captures the rear from the vehicle, and outputs an analog video signal of the captured image.

  The captured image processing apparatus 5 receives an analog video signal of an image captured by the rear camera 4 and also captures an image captured by the rear camera 4 and an in-vehicle camera (sub camera 51 described later) other than the rear camera 4. It is a device that switches between images based on images and outputs them as analog video signals.

  Here, the input terminal provided in the navigation device 11 will be described. The navigation device 11 has a rear video input terminal 11a and a REV input terminal 11b.

  The rear video input terminal 11a is originally a video input terminal intended to directly input an analog video signal of a captured image output from the rear camera 4. However, in this embodiment, the analog video signal output from the captured image processing device 5 is directly input to the rear video input terminal 11a.

  The REV input terminal 11b is a signal input terminal originally intended to be directly input with a signal output from the back gear signal output unit 3. However, in this embodiment, the pseudo back gear signal output from the captured image processing device 5 is directly input.

  Navigation in the case where the analog video signal of the captured image output from the rear camera 4 is input to the rear video input terminal 11a and the signal output from the back gear signal output unit 3 is input to the REV input terminal 11b as originally intended. The operation of the device 11 is as follows. Only when the shift position of the vehicle is the reverse position, the image captured by the rear camera 4 is displayed on the image display device 12, and when the shift position of the vehicle is other than the reverse position, that is, the drive position is D, N , P or the like, it is prohibited to display the image captured by the rear camera 4 on the image display device 12.

  In order to realize this operation, the navigation device 11 of the present embodiment transmits an image input to the rear video input terminal 11a to the image display device 12 only when the signal input to the REV input terminal 11b is on. Display. When the signal input to the REV input terminal 11b is off, the image display device 12 is prohibited from displaying an image input to the rear video input terminal 11a.

  Here, the captured image processing device 5 will be described in more detail. The captured image processing device 5 includes a sub camera 51, an image processing circuit 52, a changeover switch 53, and a video changeover circuit 54.

  The sub camera 51 is an in-vehicle camera that captures a different direction from the rear camera 4. Specifically, the sub-camera 51 is a corner clearance monitor camera (CCM camera) that is mounted near the left front end of the vehicle and captures the left front end of the vehicle and the left front viewed from the vehicle from the mounting position. . The captured image of the sub camera 51 is input to the image processing circuit 52.

  The image processing circuit 52 is a circuit that processes and outputs a captured image input from the sub camera 51, and includes an image trimming circuit 521, an illustration memory 522, and an image composition circuit 523 as shown in FIG. Yes.

  The image trimming circuit 521 performs image processing such as reduction and trimming on the captured image input from the sub camera 51, and inputs a temporary processed sub camera image obtained as a result of the image processing to the image composition circuit 523. To do.

  The illustration memory 522 is a storage medium in which image and character information to be superimposed on the temporary post-process sub-camera image is recorded in advance.

  The image composition circuit 523 reads the image and character information from the illustration memory 522, and superimposes the image and characters on the provisionally processed sub-camera image input from the image trimming circuit 521 based on the read information. To do. Then, an analog video signal of the final processed sub-camera image obtained as a result of superposition is output to the video switching circuit 54.

  The changeover switch 53 is a switch that is attached to the vicinity of the driver's seat in the passenger compartment and that can be operated by the user (that is, the driver).

  The video switching circuit 54 (corresponding to an example of an image input circuit) includes an analog switch circuit 541 and a pseudo REV output circuit 542.

  The analog switch circuit 541 has a video switch terminal 541a to which a signal corresponding to the operation content of the switch 53 is input. Then, the analog switch circuit 541 generates a processed sub-camera image input from the image composition circuit 523 and a photographed image of the rear camera 4 input from the rear camera 4 in accordance with a signal input to the video switching terminal 541a. Select only one of them.

  Then, the selected photographed image is converted into an analog video signal and input to the rear video input terminal 11 a of the navigation device 11. Specifically, the analog switch circuit 541 inputs an analog video signal of a photographed image of the rear camera 4 to the rear video input terminal 11a when the signal input to the video switching terminal 541a is off. The analog switch circuit 541 inputs an analog video signal of the processed sub-camera image to the rear video input terminal 11a when the signal input to the video switching terminal 541a is on.

  The pseudo REV output circuit 542 has a REV switching terminal 542a to which a signal corresponding to the operation content of the changeover switch 53 is input. The pseudo-REV output circuit 542 also receives a signal output from the back gear signal output unit 3. The pseudo REV output circuit 542 inputs a pseudo REV signal to the REV input terminal 11 b of the navigation device 11 in accordance with the signal input to the REV switching terminal and the signal output from the back gear signal output unit 3.

Specifically, the pseudo REV output circuit 542 is configured so that the REV of the navigation device 11 is turned on if either or both of the signal output from the back gear signal output unit 3 and the signal input to the REV switching terminal 542a are on. The signal input to the input terminal 11b is turned on. The pseudo REV output circuit 542 turns off the signal input to the REV input terminal 11b of the navigation device 11 if both the signal output from the back gear signal output unit 3 and the signal input to the REV switching terminal 542a are OFF. To do.

  The operation of the in-vehicle system configured as described above will be described below. First, in the example shown in FIG. 4, it is assumed that the shift position of the vehicle continues to be other than the reverse position (for example, the forward position, that is, the drive position D) after the time point t0. Therefore, the signal from the back gear signal output unit 3 is off.

  In the period from the time point t0 to immediately before the time point t1, since the user operates the changeover switch 53 to be turned off, the signal input to the REV switching terminal 542a is also turned off. Therefore, during this period, the pseudo REV signal (REV input in FIG. 4) input from the pseudo REV output circuit 542 to the REV input terminal 11b of the navigation device 11 also remains off. Therefore, during this period, the navigation device 11 does not display the image represented by the video signal input to the rear video input terminal 11a on the image display device 12.

  During this period, since the user operates the changeover switch 53 to be off, the signal input to the video switch terminal 541a is also off. Therefore, the signal input from the analog switch circuit 541 to the rear video input terminal 11 a is an analog video signal representing a photographed image of the rear camera 4.

  Assume that the user operates the changeover switch 53 at time t1. As a result, signals input from the changeover switch 53 to the REV switching terminal 542a and the video switching terminal 541a are turned on.

  Then, the pseudo REV signal from the pseudo REV output circuit 542 to the REV input terminal 11b is switched on, and the signal input from the analog switch circuit 541 to the rear video input terminal 11a is switched to the post-processing sub-camera image.

  The navigation device 11 displays the video signal of the processed sub-camera image input to the rear video input terminal 11a based on the fact that the pseudo REV signal input to the REV input terminal 11b is switched from OFF to ON. 12 is displayed.

  After the time t1, the user maintains the changeover switch 53 as it is. Accordingly, signals input from the changeover switch 53 to the REV switching terminal 542a and the video switching terminal 541a remain on. As a result, the navigation device 11 continues to display the video signal of the processed sub-camera image input to the rear video input terminal 11a on the image display device 12 even after the time point t1.

  Here, the post-process sub-camera image displayed on the image display device 12 after time t1 will be described with reference to FIGS. When the captured image 60 is input from the sub camera 51, the image trimming circuit 521 of the image processing circuit 52 cuts out a part 61 (portion surrounded by a broken line) from the captured image 60. Which area to cut out is fixedly determined in advance and recorded in the memory in the image trimming circuit 521, and the image trimming circuit 521 cuts out the area in accordance with this recording.

  The part removed by this cut-out is a triangular area 60a at the lower right corner of the captured image 60 and a frame area where the shortest distance to the outer periphery of the captured image 60 is within the predetermined distance s other than the triangular area 60a.

  The reason for removing the frame region is that an image near the boundary of the photographing range is relatively likely to cause image abnormality such as distortion. The reason why the triangular area 60a is removed is to efficiently prevent the backward assistance guide lines 63a to 63c described later from being superimposed on the captured image 60.

  Subsequently, the image trimming circuit 521 reduces the cut-out image 61 to about 1/2 both vertically and horizontally (see arrows in FIG. 5). Then, an image 62 in which the reduced image 61 is limited to the upper end portion (more specifically, the upper left corner) is set as a temporary processed sub-camera image 62 and output to the image composition circuit 523. In the temporary processed sub-camera image 62, a portion other than the portion where the reduced image 61 appears may be an image having no black color pattern, or some pattern may appear. The ratio of the area occupied by the image 61 in the image 62 may be, for example, 1/4 or less.

  The reduction method (reduction ratio, etc.) of the image 61 and the arrangement of the temporary processed sub-camera image 62 are fixedly determined in advance and recorded in the memory in the image trimming circuit 521. 521 performs reduction and arrangement according to this record.

  The image composition circuit 523 reads image or character information recorded in advance in the illustration memory 522, and based on the read information, the image 64 and the character 65 are temporarily processed after being input from the image trimming circuit 521. It superimposes on the sub camera image 62. Note that the overlapping position is a portion other than the portion where the reduced image 61 appears in the temporary processed sub-camera image 62. With this configuration, it is possible to improve the convenience of the processed sub-camera image 62 by using a portion other than the captured image 61 of the sub-camera 6 in the processed sub-camera image 62.

  The image 64 is an image representing the shape of the front end portion of the host vehicle so that the user can visually grasp the position of the portion shown in the image 61. The character 65 is a character notifying the user that the part shown in the image 61 is the left front part of the host vehicle. That is, these are displays for allowing the user to grasp which part of the image is reflected in the image 61.

  Then, the image composition circuit 523 outputs the final processed sub-camera image 62 obtained as a result of superimposing the image 64 and the character 65 to the video switching circuit 54.

  As described above, the video switching circuit 54 converts the final processed sub-camera image 62 into an analog video signal, and inputs the converted analog video signal to the rear video input terminal 11a.

  Then, as described above, since the pseudo REV signal input to the REV input terminal 11b is on, the navigation device 11 is based on the video signal of the final processed sub-camera image 62 input to the rear video input terminal 11a. Then, the image 62 is displayed on the image display device 12.

  However, before displaying the final post-processed sub-camera image 62 on the image display device 12, the navigation device 11 displays the backward support guide lines 63a to 63c and the tool bar 66 on the image 62 as shown in FIG. Superimpose on.

  The reverse assistance guide lines 63a to 63c are well-known guide lines for assisting the backward movement of the vehicle. Specifically, the guide line 63a is a predicted course line of the vehicle, and the guide lines 63b and 63c are vehicle width extension lines of the vehicle. The display positions of these backward assistance guide lines 63a to 63c may not change or may change according to the steering angle of the steered wheels.

  These guide lines 63a to 63c for backward assistance originally have meaning only when they are superimposed on the captured image of the rear camera 4, and were captured by the sub camera 51 having a shooting range different from that of the rear camera 4. It is positionally independent from the image. Therefore, even if the guide lines 63a to 63c are superimposed on the post-process sub-camera image 62, it is almost meaningless.

  The reason why the backward support guide lines 63a to 63c cause the processed sub-camera image 62 to display the guide lines 63a to 63c is that the navigation device 11 outputs the video signal input to the rear video input terminal 11a. This is because the guide lines 63a to 63c are superposed on the image represented by the video signal in a casual manner.

  Therefore, the navigation device 11 does not matter whether the video signal input to the REV input terminal 11b is a video signal of a captured image of the rear camera 4 or a final processed sub-camera image 62. , The backward assistance guide lines 63a to 63c are superimposed at the same position. The same applies to the toolbar 66.

  The toolbar 66 includes a course deletion button 66a. When the user operates the route deletion button 66a using an operation device (for example, a touch panel) (not shown), the navigation device 11 stops superimposing the guide lines 63a to 63c. As a result, the final processed sub-camera image 62 on which the guide lines 63a to 63c are not superimposed is displayed on the image display device 12. In this case as well, there is no change in the range 61 where the captured image 60 of the sub camera 51 is displayed in the image 62 displayed on the image display device 12.

  When the guide lines 63a to 63c are superimposed on the final post-processed sub-camera image 62, as shown in FIG. The width becomes narrower. Therefore, there are many portions where the guide line is not superimposed on the upper end portion (particularly the upper left corner and the upper right corner).

  Therefore, by limiting the display area of a part 61 cut out from the captured image 60 of the sub camera 51 in the final processed sub camera image 62 to the upper end (more specifically, the upper left corner), The guide line is not superimposed at all on the image 61, or even if it is superimposed, there is a high possibility that the overlapped part will be contained in a very small area. Moreover, since the left front end 61a (specifically, a bumper) of the vehicle is displayed in the image 61, even if there is a portion where a guide line is superimposed on the image 61, most or all of that portion is displayed. Even if the visibility is reduced, it is within the left front end portion 61a of the vehicle with little influence.

The positional relationship between the guide lines 63a to 63c and the image 61 may have all the following aspects (1) to (3).
(1) No matter how the guide lines 63a to 63c move within a preset range, the guide lines 63a to 63c are not superimposed on the image 61 at all.
(2) When the guide lines 63a to 63c move within a preset range, a small part of the guide lines 63a to 63c is superimposed on the image 61 in a certain scene (for example, when the steering is turned to the left). In another scene (for example, when the steering wheel is turned to the right), the guide lines 63a to 63c are not superimposed on the image 61 at all.
(3) No matter how the guide lines 63a to 63c move within a preset range, a small part is always superimposed on the image 61.

Further, in either of the modes (2) and (3), the following portions (a) and (b) may exist for the portion of the image 61 where the guide lines 63a to 63c are superimposed.
(A) The portion of the image 61 where the guide lines 63a to 63c are superimposed is all within the left front end 61a of the vehicle, no matter how the guide lines 63a to 63c move within a preset range.
(B) The portion of the image 61 where the guide lines 63a to 63c are superimposed is such that when the guide lines 63a to 63c move within a preset range, the guide lines 63a to 63c are in the left front end portion of the vehicle. The guide lines 63a to 63c protrude from the left front end portion 61a of the vehicle.

  As described above, even in the upper end portion of the processed sub-camera image 62, the upper right corner or the upper left corner is a place where the guide lines 63a to 63c are particularly difficult to be superimposed. Therefore, by limiting the captured image of the sub camera to the upper right corner or the upper left corner of the processed sub camera image 62, a meaningless guide line may be superimposed on the captured image of the sub camera, and the user may feel uncomfortable. Is further reduced.

(Second Embodiment)
Next, a second embodiment of the present invention will be described focusing on differences from the first embodiment. The in-vehicle system according to the present embodiment is structurally different from the first embodiment in that a signal line for a line erasing signal is connected from the navigation device 11 to the image processing circuit 52 as shown in FIG.

  As with the first embodiment, the navigation device 11 causes the image display device 12 to display the vehicle back assistance guide lines 63a to 63c superimposed on the image input to the rear video input terminal 11a. ing.

  Similarly to the first embodiment, when the user operates the course deletion button 66a, the navigation device 11 stops the superimposition of the guide lines 63a to 63c, and the final processed sub-camera image in which the guide lines 63a to 63c are not superimposed. 62 is displayed on the image display device 12. That is, the navigation device 11 displays the image input to the rear video input terminal 11a on the image display device 12 without superimposing the vehicle backward assistance guide lines 63a to 63c on the image.

  As described above, the in-vehicle display system 1 switches between the operation of displaying the user with the guide lines 63a to 63c superimposed on the image input to the rear video input terminal 11a and the operation of displaying the image on the user without being superimposed. Is possible.

  In the present embodiment, the navigation device 11 superimposes the vehicle back assistance guide lines 63a to 63c on the image input to the rear video input terminal 11a and displays it on the image display device 12. Is notified to the image processing circuit 52 by a line erasure signal.

  Specifically, the navigation device 11 displays the image input to the rear video input terminal 11a on the image display device 12 without superimposing the vehicle backward assistance guide lines 63a to 63c. This line erasure signal is turned on only when it is not, and otherwise it is turned off.

  As shown in FIG. 8, in the image processing circuit 52, this line erasure signal is input to the image trimming circuit 521. Then, the image trimming circuit 521 switches the processing method of the captured image input from the sub camera 51 according to whether or not the line erasure signal is on.

  Specifically, when the line erasing signal is off, the image trimming circuit 521 applies the same processing as in the first embodiment (see FIG. 5) to the captured image 60 and the processed sub-camera image 62 as a result thereof. Is input to the image composition circuit 523.

  Further, when the line erasing signal is on, the image trimming circuit 521 processes the entire captured image 60 input from the sub camera 51 (or the remaining portion from which the same frame area as in the first embodiment is removed) after processing. The sub-camera image 62 is input to the image composition circuit 523. That is, the area ratio occupied by the captured image 60 of the sub camera 51 in the processed sub camera image 62 is increased as compared with the case where the line erasure signal is off.

  Hereinafter, the operation of the in-vehicle system of the present embodiment will be described. First, the example shown in FIG. 9 is the same as that in the first embodiment until immediately before time t2.

  As for the line erasure signal, the input to the REV input terminal 11b is off until the time point t1, so the navigation device 11 does not display the image input to the rear video input terminal 11a on the image display device 12. Therefore, the navigation device 11 turns off the line erasure signal.

  At time t1, the signal at the REV input terminal 11b is turned on by the same operation as in the first embodiment. Then, the navigation device 11 starts to display the guide lines 63a to 63c and the tool bar 66 on the final processed sub-camera image 62 input to the rear video input terminal 11a and display them on the image display device 12, and also deletes the line. Keep the signal off.

  Therefore, the image trimming circuit 521 of the image processing circuit 52 applies the same processing as in the first embodiment (see FIG. 5) to the captured image 60 and inputs the processed sub-camera image 62 as a result to the image composition circuit 523. . As a result, the image 62 displayed on the image display device 12 is as shown in FIG. 6 as in the first embodiment. That is, the ratio of the range 61 occupied by the captured image of the sub camera 51 in the image 62 displayed on the image display device 12 remains small.

  Thereafter, when the user operates the route deletion button 66a at time t2, the navigation device 11 stops superimposing the guide lines 63a to 63c and switches on the line deletion signal.

  Then, the image trimming circuit 521 of the image processing circuit 52, based on the fact that the line erasure signal is on, the entire captured image input from the sub camera 51 (or the remaining frame area after removing the same frame area as in the first embodiment). Part) is input to the image composition circuit 523 as a temporary processed sub-camera image 62 (see the lower part of FIG. 10). The operation content of the image composition circuit 523 is the same as that of the first embodiment regardless of whether the line erasure signal is on or off. As a result, the final processed sub-camera image 62 on which the guide lines 63a to 63c are not superimposed is displayed on the image display device 12.

  As described above, the image trimming circuit 521 is based on the fact that the navigation device 11 displays the guide lines 63a to 63c on the image input to the rear video input terminal 11a without superimposing the guide lines 63a to 63c on the user. Compared to the case where the lines 63 a to 63 c are superimposed and displayed to the user, an image in which the arrangement range of the captured image of the sub camera 51 is wider is output as the processed sub camera image 62.

  In short, if the guide lines 63a to 63c are not displayed, it is not necessary to display the captured image 60 of the sub camera 51 small in order to avoid the guide lines 63a to 63c. With such an operation, when the guide lines 63a to 63c are not superimposed, the captured image 60 of the sub camera 51 is displayed in a larger size, thereby maintaining the effect of reducing the possibility of giving a sense of incongruity due to the guide line. The visibility of the captured image of the sub camera can be improved.

  From the time point t2 to immediately before the time point t3, the guide lines 63a to 63c are not displayed on the image display device 12. Therefore, the line erasure signal is kept on, and the captured image of the sub camera 51 is displayed largely on the image display device 12.

  It is assumed that the user performs a predetermined guide line return operation on the navigation device 11 at time t3. Then, due to this operation, the navigation device 11 again displays the image by superimposing the guide lines 63a to 63c on the final processed sub-camera image 62 input to the rear video input terminal 11a. Start displaying on the device 12. At the same time, the line erase signal is switched from on to off.

  Then, the image trimming circuit 521 of the image processing circuit 52 applies the same processing (see FIG. 5) from the time t1 to immediately before the time t2 to the captured image 60 based on the fact that the line erasure signal is OFF, and as a result The processed sub-camera image 62 is input to the image composition circuit 523. As a result, the image 62 displayed on the image display device 12 returns to the one shown in FIG. 6 as in the first embodiment (see the upper part of FIG. 10). That is, the ratio of the range 61 occupied by the captured image of the sub camera 51 in the image 62 displayed on the image display device 12 is reduced.

(Third embodiment)
Next, a third embodiment of the present invention will be described focusing on differences from the first embodiment. In the present embodiment, when the shift position of the vehicle changes from the reverse position (drive position R) to the forward position (drive position D), the image displayed by the image display device 12 is sub-processed from the captured image of the rear camera 4. The camera image 62 is automatically changed.

  The in-vehicle system according to the present embodiment is structurally different from the first embodiment in that a signal line for RD signals is connected from the navigation device 11 to the video switching circuit 54 as shown in FIG.

  This RD signal line is a signal line that outputs an RD signal representing a shift position (forward position, reverse position, neutral position, etc.) of the vehicle, and is connected from the navigation device 11 to the video switching circuit 54. The navigation device 11 specifies the shift position based on a known shift position sensor (not shown), and outputs an RD signal to the RD signal line according to the specified shift position.

  Further, as shown in FIG. 12, in the video switching circuit 54, this RD signal is input to the timer 543. When the shift position indicated by the input RD signal changes from the reverse position to the forward position, the timer 543 changes from the changeover switch 53 to the pseudo REV output circuit 542 and the analog switch circuit 541 for a predetermined time P from the change point. The signal of the signal line to is forcibly turned on. This signal line signal is hereinafter referred to as a switching signal. As this predetermined time P, for example, 10 seconds may be adopted. In other cases, the timer 543 does not forcibly turn on the switching signal from the selector switch 53.

  The operation of the in-vehicle system configured as described above will be described below. First, in the case illustrated in FIG. 13, it is assumed that the user does not operate the changeover switch 53 after time t5.

  During the period from time t5 to immediately before time t6, the vehicle shift position is the reverse position because of reverse parking. Therefore, the RD signal input from the navigation device 11 to the timer 543 indicates the reverse position. Accordingly, the switching signal remains off during this period. The signal output from the back gear signal output unit 3 to the pseudo REV output circuit 542 is on.

  For these reasons, during the period from time t5 to immediately before time t6, the pseudo REV signal (REV input in FIG. 13) input from the pseudo REV output circuit 542 to the REV input terminal 11b is kept on. The analog switch circuit 541 inputs a video signal of a captured image of the rear camera 4 to the rear video input terminal 11a. Therefore, the navigation device 11 causes the image display device 12 to display the guide lines 63a to 63c and the tool bar 66 superimposed on the photographed image of the rear camera 4 input to the rear video input terminal 11a.

  After that, at time t6, it is assumed that the gear position is once changed to the forward position by switching back at the time of reverse parking. Then, the shift position indicated by the RD signal changes from the reverse position to the forward position, and the signal output from the back gear signal output unit 3 is turned off.

  Thereby, the timer 543 starts to forcibly turn on the switching signal. Thereby, the pseudo REV output circuit 542 maintains the pseudo REV signal input to the REV input terminal 11b on even though the signal output from the back gear signal output unit 3 is off. The analog switch circuit 541 switches the video signal input to the rear video input terminal 11a from the video signal of the captured image of the rear camera 4 to the final video signal of the sub-camera image 62 after processing. Therefore, the navigation device 11 superimposes the guide lines 63a to 63c and the tool bar 66 on the captured image of the final processed sub-camera image 62 input to the rear video input terminal 11a and causes the image display device 12 to display the image. . This state continues until just before time t7.

  Once the gear position reaches the forward position by switching back during reverse parking or the like, the user is concerned about the vicinity of the front corner of the vehicle. Even in such a case, the post-processing sub-camera image 62 is displayed on the in-vehicle display system 1 by the operation as described above, so that convenience is improved.

  After time t6, the vehicle shift position is the forward position until just before time t8, so the RD signal does not change. However, before reaching the time point t8, the predetermined time P elapses at the time point t7 in the timer 543, and at that time, the timer 543 stops forcibly turning on the switching signal. Then, the content of the changeover signal depends only on the state of the changeover switch 53. In a state where the changeover switch 53 is not operated (off state), the changeover signal is turned off.

  Therefore, at time t7, the analog switch circuit 541 changes the video signal input to the rear video input terminal 11a from the video signal of the final processed sub-camera image 62 to the video signal of the captured image of the rear camera 4. Switch. Further, in the pseudo REV output circuit 542, since the signal from the back gear signal output unit 3 and the switching signal are both off, the signal (REV input in FIG. 13) input to the REV input terminal 11b is off. Therefore, the navigation device 11 does not cause the image display device 12 to display the image represented by the video signal input from the rear video input terminal 11a. This state continues until just before time t8.

  At time point t8, the user changes the vehicle shift position to the reverse position in order to reverse the vehicle again. Then, the shift position indicated by the RD signal changes from the forward position to the reverse position, but the output of the timer 543 does not change. Further, a signal input from the back gear signal output unit 3 to the pseudo REV output circuit 542 is turned on.

  Therefore, the pseudo REV signal input from the pseudo REV output circuit 542 to the REV input terminal 11b changes from off to on. Further, the video signal input from the analog switch circuit 541 to the rear video input terminal 11a remains the video signal of the photographed image of the rear camera 4. Therefore, the navigation device 11 causes the image display device 12 to display the guide lines 63a to 63c and the tool bar 66 superimposed on the photographed image of the rear camera 4 input to the rear video input terminal 11a. This state continues until just before time t9.

  Thereafter, at time t9, the gear position becomes the forward movement position, and the operation at this time is the same as that at time t6. Therefore, the navigation device 11 superimposes the guide lines 63a to 63c and the tool bar 66 on the captured image of the final processed sub-camera image 62 input to the rear video input terminal 11a and causes the image display device 12 to display the image. start. This state continues until just before time t10.

  At time t10, before the predetermined time P has elapsed from time t9, the shift position of the vehicle changes to the reverse position again. Then, the shift position indicated by the RD signal changes from the forward position to the reverse position, but since the predetermined time P has not elapsed, the output of the timer 543 does not change. However, the signal input from the back gear signal output unit 3 to the pseudo REV output circuit 542 is turned on.

  Therefore, the pseudo REV signal input from the pseudo REV output circuit 542 to the REV input terminal 11b remains on. Further, the video signal input from the analog switch circuit 541 to the rear video input terminal 11a remains the video signal of the captured image of the final processed sub-camera image 62. Therefore, the navigation device 11 causes the image display device 12 to display the guide lines 63a to 63c and the tool bar 66 superimposed on the final post-processed sub-camera image 62 input to the rear video input terminal 11a. This state continues until just before time t11.

  At time t11, a predetermined time P elapses from time t9. At that time, the timer 543 stops forcibly turning on the switching signal. Then, similarly to the time t7, the switching signal is turned off. Further, the signal from the back gear signal output unit 3 remains on and does not change.

  Therefore, at time t11, the analog switch circuit 541 changes the video signal input to the rear video input terminal 11a from the final processed video signal of the sub-camera image 62 to the video signal of the captured image of the rear camera 4. Switch. In the pseudo REV output circuit 542, since the signal from the back gear signal output unit 3 remains on, the signal (REV input in FIG. 13) input to the REV input terminal 11b is turned on. Therefore, the navigation device 11 causes the image display device 12 to display the guide lines 63a to 63c and the tool bar 66 superimposed on the photographed image of the rear camera 4 input to the rear video input terminal 11a. This state continues after time t11.

(Other embodiments)
In addition, this invention is not limited to above-described embodiment, In the range described in the claim, it can change suitably. Further, the above embodiments are not irrelevant to each other, and can be combined as appropriate unless the combination is clearly impossible. In each of the above-described embodiments, it is needless to say that elements constituting the embodiment are not necessarily essential unless explicitly stated as essential and clearly considered essential in principle. Yes. Further, in each of the above embodiments, when numerical values such as the number, numerical value, quantity, range, etc. of the constituent elements of the embodiment are mentioned, it is clearly limited to a specific number when clearly indicated as essential and in principle. The number is not limited to the specific number except for the case. Further, in each of the above embodiments, when referring to the shape, positional relationship, etc. of the component, etc., the shape, unless otherwise specified and in principle limited to a specific shape, positional relationship, etc. It is not limited to the positional relationship or the like. For example, the following modifications are allowed. In addition, the following modifications can select application and non-application to the said embodiment each independently. In other words, any combination of the following modifications can be applied to the above-described embodiment.

(Modification 1)
In the above embodiment, the sub camera 51 is attached in the vicinity of the left front end portion of the vehicle, and images the left front end portion of the vehicle and the left front as viewed from the vehicle from the attachment position. However, the sub camera 51 is not limited to this. For example, the sub camera 51 may be attached in the vicinity of the right front end portion of the vehicle, and from the attachment position, the right front end portion of the vehicle and the right front as viewed from the vehicle may be photographed. In this case, the image trimming circuit 521 of the image processing circuit 52 cuts out an image obtained by removing the triangular area in the lower left corner and the frame area similar to that in the first embodiment from the captured image of the sub camera 51, and cuts out the cut out image both vertically and horizontally. Reduce to about 1/2. Then, an image 62 in which the reduced image is limited to the upper end (more specifically, the upper right corner) is set as a temporary processed sub-camera image 62 and output to the image composition circuit 523. Moreover, the camera which image | photographs the front in front of the sub camera 51 and a vehicle may be sufficient, and the camera which image | photographs the side from a vehicle may be sufficient.

(Modification 2)
The vehicle may include both the sub camera 51 (sub-camera for the left front corner) in the first embodiment and the sub camera 51 (sub camera for the front right corner) in the first modification. In this case, the captured images of the left and right sub-cameras may be displayed on the image display device 12 while being limited to the upper left and upper right of the processed sub-camera image 62, respectively.

(Modification 3)
In each of the above embodiments, the analog switch circuit 541 selects only one of the post-processed sub-camera image 62 and the photographed image of the rear camera 4 according to the situation, and selects the video signal of the selected image as the rear video. The signal is input to the input terminal 11a. However, this is not necessarily the case. For example, the analog switch circuit 541 includes an image composition circuit, and the image composition circuit is used to always arrange the captured image of the sub camera 51 in the processed sub camera image 62 regardless of the state of the switching signal. You may superimpose the picked-up image of the rear camera 4 on parts other than the done part. In that case, the analog switch circuit 541 may input the resulting image to the rear video input terminal 11a as the final processed sub-camera image 62.

(Modification 4)
Further, in the above embodiment, the user can arbitrarily set the sub camera image cutout pattern, the position where the cutout image is placed, the reduction ratio at the time of placement, the image and character information in the illustration memory for superimposition, It may be possible to select from the combination patterns.

DESCRIPTION OF SYMBOLS 1 In-vehicle display system 4 Rear camera 11a Rear video input terminal 11b REV input terminal 51 Sub camera 52 Image processing circuit 54 Video switching circuit 60 Image taken by sub camera 62 Sub camera image after processing

Claims (6)

The in-vehicle display system (1) uses a captured image of the rear camera (4) that captures the rear from the vehicle and an image based on the captured image of the sub camera (51) that captures a direction different from the rear camera from the vehicle. A photographed image processing apparatus that inputs to the same video input terminal,
An image processing circuit (52) for processing a photographed image (60) of the sub-camera and outputting the processed sub-camera image (62);
An image input circuit (54) for inputting a video signal of a photographed image of the rear camera and a video signal of the processed sub-camera image output from the image processing circuit to the video input terminal of the in-vehicle display system; With
The in-vehicle display system displays the vehicle back assistance guide line superimposed on the image input to the video input terminal and displays it to the user,
The image processing circuit reduces the captured image of the sub camera, and outputs an image in which the reduced captured image of the sub camera is limited to the upper end as the processed sub camera image. Captured image processing device.   The image processing circuit reduces a captured image of the sub camera, and outputs an image in which the reduced captured image of the sub camera is limited to the upper left corner or the upper right corner as the processed sub camera image. The photographed image processing apparatus according to claim 1. The sub camera captures the left front including the left front end of the vehicle from the vehicle, and the image processing circuit reduces the captured image of the sub camera and removes the lower right corner, and results of reduction and removal An image in which the captured image of the sub camera is limited to the upper left corner is output as the processed sub camera image, or
Or
The sub camera captures a right front including the right front end of the vehicle from the vehicle, and the image processing circuit reduces a captured image of the sub camera and removes a lower left corner, and results of reduction and removal The captured image processing apparatus according to claim 2, wherein an image in which the captured image of the sub camera is limited to the upper right corner is output as the processed sub camera image.   The image processing circuit superimposes an image (64) or characters (65) for notifying the shooting direction of the sub camera on a portion other than the shot image of the sub camera in the processed sub camera image. The captured image processing apparatus according to claim 1, wherein the captured image processing apparatus outputs the captured image. The vehicle-mounted display system can be switched between an operation for displaying to the user without overlapping with an operation for displaying to the user by superimposing the backward support guide line on the image input to the video input terminal,
The image processing circuit is configured to display the in-vehicle display system on a user without superimposing the backward support guide line on an image input to the video input terminal. Compared to the case where the backward support guide line is superimposed on the image input to the video input terminal and displayed to the user, an image in which the arrangement range of the captured image of the sub-camera is widened, 5. The captured image processing apparatus according to claim 1, wherein the captured image processing apparatus outputs the processed sub-camera image. The sub-camera captures a left front of the vehicle or a right front of the vehicle from the vehicle,
The gear position of the vehicle is in the reverse position, and the image input circuit inputs a video signal including only the captured image of the rear camera among the captured image of the rear camera and the processed sub-camera image to the video input terminal. The image input circuit inputs a video signal including the processed sub-camera image to the video input terminal for a predetermined time based on a change in the gear position of the vehicle from the reverse position to the forward position. The photographed image processing apparatus according to claim 1, wherein the photographed image processing apparatus comprises:

Images