[go: up one dir, main page]

WO2014034065A1 - Dispositif d'avertissement de corps en mouvement et procédé d'avertissement de corps en mouvement - Google Patents

Dispositif d'avertissement de corps en mouvement et procédé d'avertissement de corps en mouvement Download PDF

Info

Publication number
WO2014034065A1
WO2014034065A1 PCT/JP2013/004989 JP2013004989W WO2014034065A1 WO 2014034065 A1 WO2014034065 A1 WO 2014034065A1 JP 2013004989 W JP2013004989 W JP 2013004989W WO 2014034065 A1 WO2014034065 A1 WO 2014034065A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving body
driver
recognized
attribute
warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2013/004989
Other languages
English (en)
Japanese (ja)
Inventor
宗作 重村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Publication of WO2014034065A1 publication Critical patent/WO2014034065A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634—Warning indications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/635—Region indicators; Field of view indicators

Definitions

  • the present disclosure relates to a technique for detecting a moving object existing in front of a vehicle and warning a driver.
  • a technology has been proposed in which a moving body such as a pedestrian or a bicycle is detected from an image taken in front of a vehicle and a driver is warned that a moving body exists.
  • This technology not only prevents the driver from overlooking pedestrians and the like, but also prevents the occurrence of accidents, and can reduce the burden on the driver. It has been.
  • the driver will be burdened if the warning of the existence of all these moving bodies is issued.
  • Patent Document 1 proposes a technique in which a driver's line of sight is detected and a moving body located at a position deviated from the line of sight is emphasized to display a warning to the driver.
  • the proposed technique described above has a problem that it is still difficult to reduce the burden on the driver when there are many moving objects. This is because the driver's line of sight is constantly moving, and the moving body that is highlighted and displayed in the proposed method changes one after another, which makes the driver feel annoying. Also, if a moving object is highlighted and displayed at a position outside the driver's line of sight, the driver's line of sight is naturally guided there, and attention to the part that the driver should really pay attention to is displayed. There is also a risk of scraping.
  • This disclosure is intended to provide a moving body warning device and a moving body warning method capable of warning a driver without burden even when a large number of moving bodies exist.
  • a moving body warning device that warns a driver of a vehicle that a moving body exists in front of the vehicle captures a front image that is an image of the situation in front of the vehicle.
  • a range that the driver is viewing in a range corresponding to the front image in the situation in front and a moving body detection device that detects the moving body from the front image A visual recognition range detection device for detecting a visual recognition range; a determination device that detects the moving object that is continuously present in the visual recognition range for a predetermined reference time;
  • a warning device that warns the driver of the presence of the moving body in a different manner between the unrecognized moving body that is not a recognized moving body and the recognized mobile body;
  • the recognized moving body and the unrecognized moving body can be distinguished from the warning mode, so the burden on the driver can be reduced. Further, since the warning is given to the unrecognized moving body in a mode different from that of the already-recognized moving body, it is possible to make the driver surely recognize the presence of the unrecognized moving body.
  • a moving body warning method for warning a driver of a vehicle that a moving body is present in front of the vehicle captures a front image that is an image of the situation ahead of the vehicle. And detecting the moving body from the front image, detecting a visual recognition range which is a range visually recognized by the driver in a range corresponding to the front image in the front situation, and Detecting the moving body that is continuously present within a predetermined reference time within a range, determining the moving body as an already-recognized moving body, and the unrecognized moving body that is not the already-recognized moving body; Warning the driver of the presence of the moving body is provided in a manner different from that of the recognized moving body.
  • the recognized moving body and the unrecognized moving body can be distinguished from the warning mode, so the burden on the driver can be reduced. Further, since the warning is given to the unrecognized moving body in a mode different from that of the already-recognized moving body, it is possible to make the driver surely recognize the presence of the unrecognized moving body.
  • FIG. 1 is an explanatory diagram of a vehicle equipped with the moving body warning device of the present embodiment
  • FIG. 2 is a block diagram of the mobile warning device of the present embodiment
  • FIG. 3 is a flowchart of a mobile object warning process for warning a mobile object
  • FIG. 4 is an explanatory diagram illustrating a state in which the moving object is detected from the front image
  • FIG. 5 is an explanatory diagram showing a method for determining whether or not a moving object exists in the viewing range.
  • FIG. 6 is a list diagram showing an outline of attributes to be given to the moving object.
  • FIG. 7 is a flowchart of attribute assignment processing for assigning an attribute to a mobile object.
  • FIG. 8 is a list illustrating various warning modes of the moving object,
  • FIG. 9 is an explanatory diagram illustrating the manner in which warning modes for a plurality of moving objects change,
  • FIG. 10 is a flowchart of attribute assignment processing according to a modification.
  • FIG. 1 shows a general configuration of a vehicle 1 on which a moving body warning device 10 of the present embodiment is mounted.
  • the moving body warning device 10 of the present embodiment is mounted on a front camera 12 that captures the situation in front of the vehicle 1 and a dashboard (or steering column) of the vehicle 1 so that the driver can view the vehicle from the front.
  • a driver camera 14 that captures an image of the face, a display 16 that displays the situation in front of the vehicle on the screen and displays a warning to the driver of the presence of a moving object (pedestrian, bicycle, car, etc.);
  • a control unit 18 for controlling the operation is provided.
  • "warning display” is a warning that is displayed by highlighting the marker image in some way, such as overlaying the marker image, displaying the contour with emphasis, or displaying the relevant part brighter than the surroundings. This is the display form.
  • an image of the front situation (front image) taken by the front camera 12 is displayed on the display 16, and the presence of a moving object is displayed on the display 16 as a warning.
  • the presence of the moving body may be displayed as a warning by projecting a warning image on the windshield over the driver's field of view from the dashboard of the vehicle 1 or the like.
  • an audible warning may be given by generating a warning sound or sound that informs the driver of the presence of the moving body.
  • FIG. 2 shows an internal configuration of the control unit 18 of the moving object warning device 10.
  • the control unit 18 includes a moving body detection unit 18a, a determination unit 18b, a visual range detection unit 18c, and a warning unit 18d.
  • the moving body detection unit 18a, the determination unit 18b, the visual recognition range detection unit 18c, and the warning unit 18d are conceptually classified from the inside of the control unit 18 focusing on functions, and each is physically separated. Need not exist. Also, these can be realized in hardware by an integrated circuit called a so-called LSI, or can be realized in software by a computer program. Of course, a part may be realized by hardware and the remaining part may be realized by software.
  • the moving body detection unit 18a When the moving body detection unit 18a receives the front image captured by the front camera 12, the moving body detection unit 18a detects a moving body such as a pedestrian, a bicycle, or a car.
  • the viewing range detection unit 18c detects a range (viewing range) that the driver is viewing from the driver's face image captured by the driver camera 14.
  • the determination unit 18b determines whether or not the driver recognizes the moving object for each of the moving objects detected by the moving object detection unit 18a based on the visual field range detected by the visual range detection unit 18c. .
  • the warning unit 18d displays a warning on the moving body on the screen of the display 16 based on the determination result in the determination unit 18b. At this time, by displaying a warning by the method described below, even if a plurality of moving bodies are detected from the front image, it is possible to warn the moving bodies without burdening the driver. Become.
  • the front camera 12 that captures the front image corresponds to the “imaging device” in the present disclosure
  • the moving body detection unit 18a that detects the moving body based on the front image includes the “movement” in the present disclosure.
  • the viewing range detection unit 18c of the present embodiment corresponds to the “viewing range detection device” in the present disclosure
  • the determination unit 18b corresponds to the “determination device” in the present disclosure.
  • the warning unit 18d and the display 16 correspond to the “warning device” in the present disclosure.
  • FIG 3 shows a flowchart of processing (moving body warning processing) in which the moving body warning device 10 according to the present embodiment detects a moving body existing in front of the vehicle 1 and warns the driver. This process is executed by the control unit 18 of the mobile object warning device 10.
  • a front image photographed by the front camera 12 is acquired (S100).
  • the front camera 12 has a so-called moving image shooting function, and takes a front image at a rate of 30 frames per second and outputs it to the control unit 18.
  • image data for one frame output from the front camera 12 is acquired and stored in a memory (not shown) in the control unit 18.
  • a moving object is detected from the front image (S102).
  • the moving object can be detected by a method for obtaining a difference between images or a method for obtaining a correlation between images. That is, since the front camera 12 captures the front image at a rate of 30 frames per second, the image of a certain frame is almost the same as the image of the previous frame, but only the part where the moving object is shown Will be a different image. Therefore, if a difference is taken between two images, a moving object shown in the image can be detected.
  • the moving body is shown in a certain size in the front image, and one moving body moves in substantially the same direction. Therefore, strong correlation will appear if image correlation is taken in the part where the moving object exists.
  • the moving object existing in the front image is detected by using any one of the image difference and the correlation, or by combining these.
  • FIG. 4 illustrates a state in which a moving object is detected from the front image.
  • three moving bodies A to C are detected.
  • the “viewing range” refers to a range within the field of view of the driver of the vehicle 1 and in which the driver can correctly recognize the object. That is, a human has a field of view close to 180 degrees, but can only recognize such things as “something” or “something moved” at the edge of the field of view. An object can be correctly recognized only within a predetermined solid angle range with a so-called line of sight as a central axis.
  • the viewing range refers to a range of a predetermined solid angle with this line of sight as the central axis.
  • the left and right angle (Yaw angle) of the driver's face is detected from the driver's image taken from the front using the driver camera 14, and the face direction is the direction of the line of sight. To detect the viewing range.
  • FIG. 5 conceptually shows how the driver's visible range is detected.
  • the driver is directed rightward by a Yaw angle with respect to the front front indicated by a one-dot chain line in the drawing. Accordingly, assuming that the face direction is the direction of the line of sight, the range of the angle ⁇ on each side is set as the viewing range. Therefore, in the illustrated example, only the moving body C among the moving bodies A to C exists within the viewing range.
  • the face direction in the left-right direction (Yaw angle direction) is detected, but the face direction in the up-down direction (Pitch angle direction) may also be detected.
  • the direction defined by the Yaw angle and the Pitch angle is the direction of the line of sight, within the range of the angle ⁇ vertically or horizontally, or within the range of the solid angle 2 ⁇ with the direction of the line of sight as the central axis. It is good also as a visual recognition range.
  • the face direction represents the direction of the line of sight, but the direction of the line of sight may be detected more directly by detecting the position of the driver's pupil.
  • an attribute assigning process for assigning an attribute to the detected moving object is started (S200).
  • various attributes are assigned to each detected moving object. For example, in the example shown in FIG. 4, three moving objects A to C are detected, but various attributes are assigned to each moving object.
  • a warning display mode is determined for each moving body according to the attached attribute, and the result is output to the display 16 to display the warning on the moving body for the driver (S106).
  • the process determines whether or not the driving of the vehicle 1 is finished (S108). If the driving is not finished (S108: no), the process returns to S100 to acquire a new front image, and then the series of processes described above are performed. repeat.
  • the moving object warning process of FIG. 3 also executes the above-described series of processes at a rate of 30 times per second.
  • the attribute of the moving object in the front image is updated every frame, and the manner in which the moving object is displayed as a warning on the display 16 also changes every moment.
  • C. Attribute assignment processing In the following, the details of the attribute assigning process (S200) for assigning attributes to a mobile object will be described. As preparation, an outline of attributes provided to the mobile object by the control unit 18 of this embodiment will be described in advance.
  • FIG. 6 shows a list of attributes assigned to the moving object. Of these seven attributes, attribute 1 and attribute 2 are attributes that are assigned when a moving object is detected in the front image, and the remaining five attributes (attributes 3 to 7) are attribute attributes. This attribute is given by the grant process.
  • Attribute 1 is an attribute related to the position and size of the moving object on the front image.
  • the detected moving body is surrounded by a rectangular frame, and the coordinate values of two points existing on the diagonal of the rectangular frame are used as the attribute 1.
  • the coordinate values on the images of the points a1 and a2 are the attribute 1.
  • Attribute 2 is an attribute that represents the moving direction of the moving object.
  • the attribute 2 can take a value of 0 to 7, and “0” of the attribute 2 indicates that it moves rightward on the image.
  • “1” indicates a movement in the lower right direction
  • “2” indicates a movement in the lower direction.
  • “3” indicates that the movement is in the lower left direction
  • “4” indicates that the movement is in the left direction
  • “5” indicates that the movement is in the upper left direction
  • “6” indicates that the movement is in the upward direction
  • “7” indicates that the movement is in the upper right direction.
  • the result of roughly classifying the moving direction of the moving body into eight as described above is used as attribute 2.
  • the present invention is not limited to this, and a vector representing the moving direction and moving speed of the moving body is used. It can also be used as attribute 2.
  • Attribute 3 is a flag (viewing range flag) indicating whether or not the moving body is within the driver's viewing range (see FIG. 5).
  • the viewing range flag ON indicates that the moving body is within the viewing range.
  • Attribute 4 is an attribute that indicates how many frames the moving body within the viewing range is continuously within the viewing range. If a certain moving body is continuously within the viewing range over a certain number of frames, it can be considered that the driver has recognized.
  • Attribute 5 is an attribute indicating the number of times recognized by the driver. This attribute 5 counts the number of times of recognition in response to the fact that the driver may recognize the moving body once recognized many times.
  • Attribute 6 is an attribute indicating the number of frames that have passed without the moving body in the front image being recognized even once by the driver. If the predetermined number of frames has passed without being recognized by the driver even once, the moving body is considered to be overlooked by the driver.
  • Attribute 7 is a flag (oversight flag) indicating that the moving body is overlooked by the driver.
  • the oversight flag ON indicates that the moving body is overlooked.
  • attribute 3 viewing range flag
  • attribute 7 missing flag
  • attributes 4 to 6 are set to “0”.
  • the image of the frame is supplied from the front camera 12 and is updated each time the attribute assigning process described below is executed.
  • attribute 1 and attribute 2 are updated not by the attribute assigning process but by the process of detecting the moving object in the moving object warning process (S102 in FIG. 3).
  • FIG. 7 shows a flowchart of attribute assignment processing. Prior to this process, in the moving body warning process of FIG. 3, the moving body of the front image and the driver's visual recognition range have already been detected.
  • one arbitrary moving body is selected from the detected moving bodies (S202). Then, it is determined whether or not the selected moving object is within the driver's visual recognition range (S204).
  • Whether or not the moving body is within the viewing range can be determined based on the attribute 1 of the moving body and the driver's viewing range that has been detected in advance. That is, from the attribute 1 of the moving body, it is possible to determine how much the moving body is located at the Yaw angle from the front in front of the driver. Then, if the calculated Yaw angle of the moving body is within the range of ⁇ on both sides of the Yaw angle of the driver's line of sight, it is determined that the moving body is within the driver's viewing range. (See FIG. 5).
  • the viewing range flag of attribute 3 is turned ON (S206), and "1" is added to the value of attribute 4 (S208).
  • the attribute 4 indicates the number of frames in which the moving object is continuously present in the viewing range.
  • the number of frames that are continuously within the viewing range that is, attribute 4 is set. Add “1”.
  • the viewing range flag of attribute 3 is turned off (S210), and the value of attribute 4 is initially set to “0”. (S212).
  • the attribute 4 is not the cumulative value of the number of frames in which the moving object is present in the viewing range, but the number of frames that are continuously present in the viewing range.
  • the first threshold value TH1 is a threshold value used for determining whether or not the driver has recognized the moving body.
  • the driver cannot recognize that the moving body is present in the viewable range, but the moving body continues to stay in the viewable range for a certain period of time. If so, it may be considered that the driver has recognized the moving body. This is because, if the moving object exists only within the viewing range, it may be possible that the line of sight happens to pass over the moving object, whereas the moving object remains within the viewing range for a certain period of time. The fact that the vehicle is staying is because it is considered that the driver intentionally directs his / her line of sight toward the moving body.
  • the driver intends the moving body. Can be determined (that is, recognized by the driver).
  • the first threshold value TH1 corresponds to the “reference time” in the present disclosure.
  • the attribute 5 represents the number of times that the moving body is recognized by the driver.
  • the value of the attribute 5 of the present embodiment represents the number of times recognized by the driver, it corresponds to the “determination number” in the present disclosure.
  • the oversight flag of attribute 7 is set to OFF (S220).
  • the oversight flag is a flag indicating that the moving body is overlooked by the driver. Therefore, if “1” is added to the value of attribute 5 (the number of times the moving body has been recognized by the driver) in S216, it will be unreasonable if the oversight flag is set to ON. Therefore, the oversight flag of attribute 7 is set to OFF (S220).
  • the value of attribute 4 (the number of frames in which the moving body is continuously present in the viewing range) does not reach the first threshold value TH1 (S214: no), or the moving body is within the viewing range in the first place. If the attribute 3 viewing range flag and the attribute 4 value are initialized (S210, S212), the attribute 5 value (number of times recognized by the driver) is “0”. Is determined (S222).
  • the value of attribute 6 indicates the number of frames that have passed without being recognized by the driver even once after being detected as a moving body.
  • the second threshold TH2 is set to a value larger than the first threshold TH1 described above.
  • the attribute 6 has reached the second threshold value TH2 (S226: yes)
  • the oversight flag of the attribute 7 is kept OFF.
  • attribute 6 and the attribute 7 are attributes related to a state in which the moving body has not been recognized by the driver even once, when the value of the attribute 5 is not “0” (S222: no), The processing relating to attribute 6 and attribute 7 (S224 to S228) is not necessary.
  • the second threshold value TH2 corresponds to the “missing time” in the present disclosure.
  • the moving object in which the oversight flag is set to ON corresponds to the “overlooked moving object” in the present disclosure.
  • FIG. 8 shows a list of warning display modes set according to the attributes of the moving object.
  • the warning display mode is set based on the value of attribute 5 (number of times recognized by the driver) and the setting of the oversight flag of attribute 7. Yes.
  • FIG. 8B conceptually shows how the warning display changes according to the attribute setting.
  • attribute 5 the value of attribute 5 immediately after detection is set to “0”, and the oversight flag of attribute 7 is set to OFF.
  • the mobile object is surrounded by a red rectangular frame (red frame) and a warning is displayed.
  • red frame the red frame is displayed as a thick solid line frame.
  • first threshold value TH1 “1” is added to the value of attribute 5 (see S216 in FIG. 7). Accordingly, since it can be considered that the mobile object having the attribute 5 value of “1” is recognized once by the driver, it is surrounded by a thin blue line rectangular frame (blue frame) and displayed as a warning. Compared with the red frame in the case of the attribute 5 value “0”, the color of the frame line has been changed from red to blue, and the thickness of the frame line has become thinner.
  • the blue frame is a warning display that is less noticeable than the red frame.
  • a mobile object in which “1” is added to the value of attribute 5 and the value of attribute 5 is “3” is recognized by the driver three times. Since such a moving body is considered to be sufficiently recognized by the driver, there is no need to display a warning. Therefore, no frame display (warning display) is performed for a moving object having an attribute 5 value of “3” or more.
  • the moving object having the attribute 5 value of “1” or more is considered to be a moving object already recognized by the driver (recognized moving object)
  • the blue frame (dashed blue frame)
  • the warning display mode is not so conspicuous as well as the warning display is not performed.
  • the moving object having the attribute 5 value of “0”, including the moving object with the oversight flag ON is not yet recognized by the driver (unrecognized). Therefore, the warning is displayed in a more conspicuous manner than the recognized mobile object.
  • FIG. 9 shows the manner in which the warning display mode changes for a plurality of moving bodies detected from the front image.
  • FIG. 9A illustrates an image displayed on the screen of the display 16 when a moving object is detected for the first time from the front image.
  • ten moving bodies from the moving bodies a to j are detected.
  • FIG. 9B shows an image after a predetermined time (for example, 1 to 2 seconds) has elapsed from the image of FIG. 9A.
  • a predetermined time for example, 1 to 2 seconds
  • several moving bodies here, moving bodies b, c, d, g, h
  • the value of attribute 5 is set to “1”.
  • the display mode is changed from a red frame to a blue frame.
  • FIG. 9 (c) shows an image after a predetermined time has elapsed from the image of FIG. 9 (b).
  • several more moving bodies here, moving bodies e and i
  • the warning display mode is changed from the red frame to the blue frame.
  • mobile bodies here, mobile bodies b, c, g, and h
  • mobile bodies here, mobile bodies b, c, g, and h
  • moving bodies here, moving bodies a and f
  • FIG. 9 (d) shows an image after a predetermined time has elapsed from the image of FIG. 9 (c).
  • the moving body that has not yet been recognized here, the moving body f
  • the warning display mode is changed from the red frame to the blue frame.
  • a mobile body here, mobile bodies d, e, i, j
  • a warning display mode is changed from a blue frame to a broken blue frame is recognized again among mobile bodies that have already been recognized.
  • mobile objects in this case, mobile objects b, c, g, and h
  • the moving body warning device 10 of the present embodiment even when there are a plurality of moving bodies in the front image (see FIG. 9A), the moving body recognized by the driver (recognized moving body). With respect to, the burden on the driver can be reduced by changing the manner of warning display. On the other hand, since the moving body that is not recognized by the driver (unrecognized moving body) is more noticeable than the already recognized moving body, the driver can be surely warned of the presence of the moving body. It becomes possible.
  • the burden on the driver can be further reduced by changing the warning display mode for the already-recognized moving body according to the value of the attribute 5.
  • the mode of warning display is changed according to the setting of the oversight flag of attribute 7, it is possible to more reliably warn the driver of the presence of the moving body.
  • the number of times the moving body has been recognized by the driver has been described as increasing but not decreasing.
  • the value of attribute 5 may be subtracted if the state that is not recognized by the driver continues for a long time after being recognized by the driver.
  • FIG. 10 shows a flowchart of such a modification attribute assignment process.
  • the attribute assignment process (S300) of the modification is a process executed instead of the attribute assignment process (S200) of the present embodiment described above with reference to FIG.
  • the attribute assignment process (S300) of the modification will be briefly described with the difference as a center.
  • one arbitrary moving body is selected from the detected moving bodies (S302), and the selected moving body is within the driver's viewing range. It is determined whether or not there is (S304).
  • the viewing range flag of attribute 3 is turned ON (S306), and the value of attribute 4 (continuously exists within the viewing range). “1” is added to the number of frames) (S308).
  • the viewing range flag of attribute 3 is turned off (S310), and the value of attribute 4 is initialized to “0” (S312). ).
  • attribute 6 represents the number of frames that have passed without the moving body being recognized by the driver. Therefore, in the modification, even after the moving body is recognized by the driver, the number of frames is counted by the attribute 6 if the state in which the moving body is not recognized thereafter continues.
  • the second threshold value for determining whether to subtract the value of attribute 5 is the same as the threshold value for determining whether to set the oversight flag for attribute 7 to ON. It has been described that the threshold value TH2 is used. Of course, a threshold different from the second threshold TH2 may be used as a threshold for determining whether to subtract the value of attribute 5.
  • the second threshold value TH2 used for determining whether or not to subtract the value of attribute 5 corresponds to “threshold time” in the present disclosure.
  • This disclosure includes the following aspects.
  • a moving body warning device that warns a driver of a vehicle that a moving body exists in front of the vehicle captures a front image that is an image of the situation in front of the vehicle.
  • a range that the driver is viewing in a range corresponding to the front image in the situation in front and a moving body detection device that detects the moving body from the front image A visual recognition range detection device for detecting a visual recognition range; a determination device that detects the moving object that is continuously present in the visual recognition range for a predetermined reference time;
  • a warning device that warns the driver of the presence of the moving body in a different manner between the unrecognized moving body that is not a recognized moving body and the recognized mobile body;
  • the recognized moving body and the unrecognized moving body can be distinguished from the warning mode, so the burden on the driver can be reduced. Further, since the warning is given to the unrecognized moving body in a mode different from that of the already-recognized moving body, it is possible to make the driver surely recognize the presence of the unrecognized moving body.
  • the visual recognition range detection device may detect the visual recognition range based on an image of the driver taken from the front of the driver. In this case, if a driver's image is taken from the front, the visual recognition range can be easily detected from the driver's face orientation, pupil position, and the like.
  • the moving body warning device may further include a counting device that counts the number of times that the moving body is determined to be the recognized moving body for each moving body.
  • the warning device warns the driver of the presence of the recognized mobile object in a manner corresponding to the number of determinations.
  • the degree of recognition of the driver is different between a moving body with a large number of times determined as a recognized moving body and a moving body with a small number of times. Therefore, for a recognized mobile object, if the driver is warned in a manner corresponding to the number of times of determination, it is possible to reliably warn of the existence of the mobile object while placing an excessive burden on the driver. Become.
  • the warning device may stop the warning to the driver for the already-recognized moving body whose number of determinations has reached a predetermined number.
  • the moving body that has been determined many times as the already recognized moving body is sufficiently recognized by the driver. Therefore, if the warning to the driver is stopped for the already-recognized moving body that has reached the predetermined number of times, the burden on the driver is reduced without causing the driver to overlook the presence of the moving body. be able to.
  • the moving body warning device that warns in a manner according to the number of determinations, the driver can be warned in a more appropriate manner by reducing the number of determinations as described above.
  • the determination device may detect the moving body in which the state of the unrecognized moving body continues for a predetermined oversight time and determine the moving body as an overlooked moving body.
  • the warning device warns the driver of the presence of the moving body in a manner that is different from the unrecognized moving body and the recognized mobile body. In this case, since the state of the unrecognized moving body continues over the predetermined oversight time, it is desirable that the overlooking moving body warns the driver more clearly. Therefore, the warning can be clearly given to the driver if the warning is given in a different manner from the unrecognized moving object that is not the overlooking moving object and the recognized moving object.
  • a moving body warning method for warning a driver of a vehicle that a moving body is present in front of the vehicle captures a front image that is an image of the situation ahead of the vehicle. And detecting the moving body from the front image, detecting a visual recognition range which is a range visually recognized by the driver in a range corresponding to the front image in the front situation, and Detecting the moving body that is continuously present within a predetermined reference time within a range, determining the moving body as an already-recognized moving body, and the unrecognized moving body that is not the already-recognized moving body; Warning the driver of the presence of the moving body is provided in a manner different from that of the recognized moving body.
  • the recognized moving body and the unrecognized moving body can be distinguished from the warning mode, so the burden on the driver can be reduced. Further, since the warning is given to the unrecognized moving body in a mode different from that of the already-recognized moving body, it is possible to make the driver surely recognize the presence of the unrecognized moving body.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Traffic Control Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
PCT/JP2013/004989 2012-08-31 2013-08-23 Dispositif d'avertissement de corps en mouvement et procédé d'avertissement de corps en mouvement Ceased WO2014034065A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012192593A JP2014048978A (ja) 2012-08-31 2012-08-31 移動体警告装置、および移動体警告方法
JP2012-192593 2012-08-31

Publications (1)

Publication Number Publication Date
WO2014034065A1 true WO2014034065A1 (fr) 2014-03-06

Family

ID=50182903

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/004989 Ceased WO2014034065A1 (fr) 2012-08-31 2013-08-23 Dispositif d'avertissement de corps en mouvement et procédé d'avertissement de corps en mouvement

Country Status (2)

Country Link
JP (1) JP2014048978A (fr)
WO (1) WO2014034065A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015152304A1 (fr) * 2014-03-31 2015-10-08 エイディシーテクノロジー株式会社 Dispositif d'aide à la conduite et procédé d'aide à la conduite
WO2016088227A1 (fr) * 2014-12-03 2016-06-09 日立マクセル株式会社 Dispositif et procédé d'affichage vidéo
WO2018061299A1 (fr) * 2016-09-28 2018-04-05 沖電気工業株式会社 Dispositif et procédé de traitement d'informations
CN110816408A (zh) * 2018-08-07 2020-02-21 本田技研工业株式会社 显示装置、显示控制方法及存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6333975B2 (ja) * 2014-06-03 2018-05-30 本田技研工業株式会社 車両周辺監視装置
WO2019167285A1 (fr) * 2018-03-02 2019-09-06 三菱電機株式会社 Dispositif et procédé d'aide à la conduite
JP7165532B2 (ja) * 2018-08-07 2022-11-04 本田技研工業株式会社 表示装置、表示制御方法、およびプログラム
JP2020154446A (ja) * 2019-03-18 2020-09-24 富士ゼロックス株式会社 情報処理装置、情報処理プログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0761257A (ja) * 1993-08-26 1995-03-07 Nissan Motor Co Ltd 車両用表示装置
JPH07117593A (ja) * 1993-10-21 1995-05-09 Mitsubishi Electric Corp 車両用警報装置
WO2008029802A1 (fr) * 2006-09-04 2008-03-13 Panasonic Corporation Dispositif fournissant des informations de voyage

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0761257A (ja) * 1993-08-26 1995-03-07 Nissan Motor Co Ltd 車両用表示装置
JPH07117593A (ja) * 1993-10-21 1995-05-09 Mitsubishi Electric Corp 車両用警報装置
WO2008029802A1 (fr) * 2006-09-04 2008-03-13 Panasonic Corporation Dispositif fournissant des informations de voyage

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015152304A1 (fr) * 2014-03-31 2015-10-08 エイディシーテクノロジー株式会社 Dispositif d'aide à la conduite et procédé d'aide à la conduite
JPWO2015152304A1 (ja) * 2014-03-31 2017-04-13 エイディシーテクノロジー株式会社 運転支援装置、及び運転支援システム
JP2019075150A (ja) * 2014-03-31 2019-05-16 エイディシーテクノロジー株式会社 運転支援装置、及び運転支援システム
WO2016088227A1 (fr) * 2014-12-03 2016-06-09 日立マクセル株式会社 Dispositif et procédé d'affichage vidéo
WO2018061299A1 (fr) * 2016-09-28 2018-04-05 沖電気工業株式会社 Dispositif et procédé de traitement d'informations
JP2018055320A (ja) * 2016-09-28 2018-04-05 沖電気工業株式会社 情報処理装置および情報処理方法
CN110816408A (zh) * 2018-08-07 2020-02-21 本田技研工业株式会社 显示装置、显示控制方法及存储介质
CN110816408B (zh) * 2018-08-07 2023-09-15 本田技研工业株式会社 显示装置、显示控制方法及存储介质

Also Published As

Publication number Publication date
JP2014048978A (ja) 2014-03-17

Similar Documents

Publication Publication Date Title
WO2014034065A1 (fr) Dispositif d'avertissement de corps en mouvement et procédé d'avertissement de corps en mouvement
JP5421072B2 (ja) 接近物体検知システム
JP5099451B2 (ja) 車両周辺確認装置
CN107203044A (zh) 车辆用显示装置
US10102438B2 (en) Information display device
US11807277B2 (en) Driving assistance apparatus
US20140198214A1 (en) Obstacle alert device
JP2013168063A (ja) 画像処理装置、画像表示システム及び画像処理方法
CN111347977B (zh) 车辆盲点影像显示方法、装置及系统
US20180330619A1 (en) Display device and display method for displaying pictures, and storage medium
US20200039435A1 (en) Onboard camera system for eliminating a-pillar blind areas of a mobile vehicle and image processing method thereof
US20130107050A1 (en) Obstacle alarm device
WO2017145549A1 (fr) Système d'avertissement de regard de côté et de surveillance et programme informatique
JP2010044561A (ja) 乗物搭載用監視装置
KR20180065527A (ko) 차량 후측방 경고 장치 및 이를 이용한 경고 방법
JP2017182776A (ja) 車両周辺監視装置及びコンピュータプログラム
KR20130024459A (ko) 차량의 주변 영상 디스플레이 장치 및 방법
TWI773958B (zh) 車輛盲點影像顯示方法、裝置及系統
WO2020017230A1 (fr) Dispositif de commande électronique et procédé de commande électronique
JP2005309660A (ja) 車両用右左折支援装置
JP5477394B2 (ja) 車両周辺監視装置
US9082021B2 (en) Obstacle alert device
JP4449618B2 (ja) 車両周辺監視システム
JP2018111377A (ja) ドアの開度変化検出装置及びドアの開度変化検出方法
WO2013114871A1 (fr) Dispositif d'aide à la conduite et procédé d'aide à la conduite

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13832427

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13832427

Country of ref document: EP

Kind code of ref document: A1