[go: up one dir, main page]

WO2019155557A1 - Information display control device, information display control method, and information display control program - Google Patents

Information display control device, information display control method, and information display control program Download PDF

Info

Publication number
WO2019155557A1
WO2019155557A1 PCT/JP2018/004240 JP2018004240W WO2019155557A1 WO 2019155557 A1 WO2019155557 A1 WO 2019155557A1 JP 2018004240 W JP2018004240 W JP 2018004240W WO 2019155557 A1 WO2019155557 A1 WO 2019155557A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
display control
moving body
information display
landscape
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/004240
Other languages
French (fr)
Japanese (ja)
Inventor
祐一 松本
淳 大杉
原 聡
静孝 八木
正義 福留
歩 川田
直也 橋津
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pioneer Corp
Original Assignee
Pioneer Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pioneer Corp filed Critical Pioneer Corp
Priority to PCT/JP2018/004240 priority Critical patent/WO2019155557A1/en
Publication of WO2019155557A1 publication Critical patent/WO2019155557A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages

Definitions

  • the present invention relates to an information display control device, and more particularly to an information display control device that displays information for a driver of a moving object.
  • a driving support image for supporting driving of the driver of the vehicle is displayed.
  • a belt-shaped route guidance image for guiding a route to be traveled is displayed as a driving assistance image.
  • the information display device displays the driving support image by a method of superimposing the captured image on the actual landscape or a method of superimposing the actual landscape on the actual landscape using a HUD (head-up display) or the like.
  • the present invention has been made in view of the above points, and an object of the present invention is to provide an information display device capable of displaying a driving assistance image having a high visibility and an easy-to-understand relationship with an actual road. One of them.
  • the invention according to claim 1 is an information display control device, an image acquisition unit that acquires a landscape image around a moving object, and a predetermined point around the moving object and assists the driving of the moving object
  • a display control unit that displays a driving support image to be superimposed on the landscape image on a display unit, and the display control unit is configured to support the driving support based on a distance from the moving body to the predetermined point. The height of the image display position in the landscape image is changed.
  • the invention according to claim 6 is an information display control device that displays the virtual image on a display unit that displays a virtual image superimposed on a landscape in front of the moving body, and relates to a predetermined point around the moving body.
  • a driving support image that supports driving of the moving body is displayed superimposed on the landscape, and the display position of the driving support image is high in the landscape based on the distance from the moving body to the predetermined point. It has the said display control part which changes thickness.
  • the invention according to claim 7 is an information display control method executed by an information display control device for displaying an image on a display unit, the step of acquiring a landscape image around a moving body, Displaying the driving support image related to a predetermined point and superimposing the driving support image supporting the driving of the moving body on the landscape image, and the distance from the moving body to the predetermined point. Changing the height of the position in the landscape image.
  • the invention according to claim 8 is an information display control program, wherein a computer acquires a landscape image around a moving body, and a predetermined point around the moving body and the operation of the moving body are performed. A step of displaying a driving assistance image to be supported superimposed on the landscape image, and changing a height of the display position of the driving assistance image in the landscape image based on a distance from the moving body to the predetermined point And a step of executing.
  • FIG. 6 is a flowchart illustrating an example of an information display processing routine by the information display terminal according to the first embodiment.
  • 5 is a flowchart illustrating an example of an obstacle permeation processing routine by the information display terminal according to the first embodiment.
  • It is a figure which shows an example of the screen displayed on a display part.
  • It is a figure which shows an example of the screen displayed on a display part.
  • It is a figure which shows an example of the screen displayed on a display part.
  • It is a figure which shows an example of the screen displayed on a display part.
  • It is a figure which shows an example of the screen displayed on a display part.
  • It is a figure which shows an example of the screen displayed on a display part.
  • FIG. 10 is a flowchart illustrating an example of an information display processing routine by the information display terminal according to the second embodiment.
  • FIG. 1 shows the configuration of the information display system 10 of the first embodiment.
  • the information display system 10 includes an information display terminal 10A as an information display control device and a server device 10B.
  • an example in which the information display terminal 10A is mounted on a vehicle M as a moving body will be described.
  • the information display terminal 10A and the server device 10B can transmit and receive data (communication connection) with each other via a network (communication path).
  • a communication protocol such as TCP / IP is used for the transmission / reception.
  • the network can be constructed by Internet communication including wireless communication and wired communication such as a mobile communication network and Wi-Fi (registered trademark).
  • Server device 10B can transmit and receive data to and from each of a plurality of information display terminals 10A mounted on a plurality of vehicles M.
  • FIG. 2 shows the configuration of the information display terminal 10A and the server device 10B.
  • Server device 10B transmits and receives data to and from a plurality of information display terminals (not shown) other than information display terminal 10A. Therefore, a device ID for identifying the terminal is assigned in advance to the information display terminal 10A.
  • the information display terminal 10 ⁇ / b> A includes a camera 11 as an image acquisition unit that acquires a landscape image around the vehicle M.
  • the camera 11 is mounted, for example, on the front portion of the vehicle M, and acquires a landscape image by photographing a landscape in front including the road on which the vehicle M travels.
  • the information display terminal 10A includes a terminal storage unit 12 including a storage device such as a hard disk, a flash memory, an SSD (Solid State Drive), and a RAM (Random Access Memory).
  • the terminal storage unit 12 appropriately stores a program executed in the information display terminal 10A, data necessary for the operation of the information display terminal 10A, data generated in the operation of the information display terminal 10A, and data taken from the outside.
  • the terminal storage unit 12 stores map information including information on a road on which the vehicle M travels, and information such as a driving caution point acquired from the server device 10.
  • the terminal storage unit 12 stores the image information of the landscape image taken by the camera 11 in association with information such as the date and time when the image was taken, the position of the vehicle M, and the traveling direction.
  • the terminal storage unit 11 stores the device ID of the information display terminal 10A.
  • the information display terminal 10A includes a terminal control unit 13 including a central processing unit (CPU (Central processing unit)).
  • the terminal control unit 13 performs control necessary for the operation of the information display terminal 10A. For example, the terminal control unit 13 performs a route search to the destination of the vehicle M, an information request to the server device 10B, control of operations of each unit of the information display terminal 10A, and the like.
  • the image processing unit 14 performs image processing on the landscape image captured by the camera 11. For example, the image processing unit 14 detects an obstacle located in front of the vehicle M (for example, an object existing on a road surface such as a forward vehicle) from the landscape image, and transmits the obstacle in the landscape image. The obstacle transmission process is executed. In addition, the image processing unit 14 generates a driving support image for supporting driving of the driver, and performs image processing such as superimposition of the driving support image on the landscape image and viewpoint conversion processing in the landscape image. The image processing unit 14 performs these image processes based on information acquired from the server device 10B and past landscape images stored in the terminal storage unit 12.
  • the information display terminal 10A includes a display unit 15 and a voice output unit 16 as a presentation unit that presents information to the driver of the vehicle M.
  • the display unit 15 is a display device such as a liquid crystal display or an organic EL display, and is provided so as to be visible by a driver.
  • the display unit 15 displays a landscape image around the vehicle M and a driving support image superimposed thereon under the control of the terminal control unit 13.
  • the audio output unit 16 is an acoustic device that outputs navigation information to the destination of the vehicle M and other driving support information as audio.
  • the voice output unit 14 outputs information on part of route information and information on a driving caution point.
  • the information display terminal 10A includes an operation input unit 17 including an input device such as a remote controller or a touch panel.
  • the operation input unit 17 receives an operation input from a passenger.
  • the operation input unit 17 receives an operation input such as an input requesting display of route information and an input of a destination.
  • the information display terminal 10A includes a position detection unit 18 that is a device that detects the position of the vehicle M.
  • the position detection unit 18 includes a position specifying device such as a GPS (Global Positioning System) receiver, and detects the position of the vehicle M to generate position information.
  • GPS Global Positioning System
  • the information display terminal 10 ⁇ / b> A has a terminal communication unit 19.
  • the terminal communication unit 19 is a network adapter such as a NIC (Network Interface Card) for transmitting and receiving data in accordance with an instruction from the terminal control unit 13, for example.
  • the terminal communication unit 19 as a transmission unit transmits, for example, position information of the vehicle M, device ID, route information, image information of a landscape image taken by the camera 11, and the like.
  • the terminal communication unit 19 as a receiving unit receives driving support information including information on driving caution points such as accident-prone points.
  • the server device 10B includes a server communication unit 21.
  • the server communication unit 21 is a network adapter such as a NIC, for example, and transmits and receives data to and from one or a plurality of vehicles M.
  • the server communication unit 21 as a transmission unit transmits, for example, distribution information including driving support information to the information display terminal 10A.
  • the server communication unit 21 as a receiving unit receives, for example, position information of the vehicle M, device ID, route information, image information of a landscape image, and the like from the information display terminal 10A.
  • the server device 10B includes a server storage unit 22 including a storage device such as a hard disk, a flash memory, an SSD, and a RAM.
  • the server storage unit 22 appropriately stores a program executed in the server device 10B, data necessary for the operation of the server device 10B, data generated in the operation of the server device 10B, and data taken from the outside.
  • the server storage unit 22 has a map information DB 22A.
  • the map information DB 22A stores map information including information on driving caution points such as accident-prone points.
  • the server storage unit 22 stores a landscape image DB 22B.
  • the image information of the landscape image received by the server communication unit 21 from the plurality of vehicles M includes the position information of the vehicle M, the traveling direction information, and the traveling lane (for example, right turn lane, straight lane, etc.). And information on the date and time of shooting are stored in association with each other.
  • the server device 10B includes a server control unit 23.
  • the server control unit 23 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, and the like, and functions as a computer.
  • the server control unit 23 implements various functions by reading and executing various programs stored in the server storage unit 22.
  • the server control unit 23 includes a received image storage control unit 24.
  • the received image storage control unit 24 displays the image information of the landscape image received by the server communication unit 21 from the plurality of vehicles M, such as the position information of the vehicle M, the traveling direction information, the information on the traveling lane, and the shooting date and time.
  • the scene image DB 22B of the server storage unit 22 is stored in association with the information.
  • the received image storage control unit 24 classifies the landscape images for each captured position, time zone, season, lane, and traveling direction, and stores them in the landscape image DB 22B.
  • the received image storage control unit 24 may acquire weather information around the position based on the position information of the vehicle M, classify the landscape image for each weather condition, and store it in the landscape image DB 22B. .
  • the received image storage control unit 24 performs image analysis before storing the landscape image, excludes the landscape image in which an obstacle such as a forward vehicle exists on the road surface, and stores it in the landscape image DB 22B.
  • the received image storage control unit 24 overwrites the newly acquired landscape image and overwrites the landscape image DB 22B when a landscape image having similar conditions such as the taken position, time, season, and weather information already exists.
  • the server control unit 23 includes a transmission information generation unit 25.
  • the transmission information generation unit 25 generates distribution information to be distributed (transmitted) to the information display terminal 10A.
  • the transmission information generation unit 25 acquires position information of driving caution points such as accident-prone points around the position based on the position information of the vehicle M, and generates distribution information including information on the driving caution points.
  • the transmission information generation unit 25 receives the image request information including the position information of the vehicle M, the traveling direction information, and other environmental information (for example, season, time zone, weather conditions, etc.), and the server storage unit 22
  • the landscape image stored in the landscape image DB is extracted, and distribution information including the landscape image is generated.
  • the information display processing routine RT1 executed by the information display terminal 10A will be described with reference to FIG.
  • the terminal control unit 13 of the information display terminal 10A starts an information display processing routine RT1 when, for example, an accessory power source (hereinafter referred to as ACC power source) of the vehicle M is turned on. Note that the terminal control unit 13 may start the information display processing routine RT1 by starting the engine of the vehicle M.
  • ACC power source an accessory power source
  • the position detection unit 18 acquires current position information indicating the current position of the vehicle M (step S101).
  • the terminal control unit 13 controls the terminal communication unit 19 to cause the server device 10B to transmit movement information including the current position information of the vehicle M and the route information of the scheduled travel route set in the vehicle M (step S102). .
  • the terminal communication unit 19 may transmit the movement information to the server device 10B at predetermined time intervals.
  • the terminal communication unit 19 receives the driving support information including the information on the driving caution points around the vehicle M and the route guidance information generated in the server device 10B based on the transmitted movement information (step S103).
  • the terminal control unit 13 Based on the received driving support information, the terminal control unit 13 specifies a guide point such as a driving caution point or an intersection located in the traveling direction of the vehicle M, and the current position of the vehicle M is within a predetermined distance from the guide point. It is determined whether it is within (step S104).
  • the terminal control unit 13 controls the image processing unit 14 to support driving of the moving object.
  • a sky support image for displaying the image at a position above the landscape image is generated.
  • the image processing unit 14 Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving attention point instruction image indicating a driving attention point and a route guidance image as an aerial support image (step S105).
  • step S104 determines whether there is an obstacle such as a forward vehicle on the road surface ahead of the vehicle M (step S106).
  • the terminal control unit 13 stores the landscape image captured by the camera 11 in the terminal storage unit 12 (step S107).
  • the image information of the landscape image photographed by the camera 11 may be transmitted to the server device 10B together with the position information of the vehicle M at the time of photographing, the traveling direction information, and the photographing date / time information.
  • step S106 If it is determined that there is an obstacle ahead of the vehicle M (step S106: Yes), an obstacle transmission process for generating a transparent image showing the scenery around the vehicle M while passing through a part of the obstacle (for example, the inside). Is executed (step S108).
  • FIG. 4 is a flowchart showing an obstacle permeation processing routine RT2 executed by the information display terminal 10A.
  • the terminal control unit 13 is a landscape image that does not include an obstacle photographed in the past in a photographing situation or photographing environment (for example, position, traveling direction, time zone, season, weather, etc.) corresponding to the landscape image photographed by the camera 11.
  • a landscape image hereinafter, referred to as a substitute image
  • the terminal control unit 13 reads and acquires the substitute image from the terminal storage unit 12 (step S202).
  • the terminal control unit 13 controls the terminal communication unit 19 to send an image request for requesting transmission of the substitute image to the server device 10B.
  • the image request includes the position information of the vehicle M, the traveling direction information, and information specifying the season, weather conditions, time zone, and the like.
  • landscape images taken by a plurality of vehicles M are stored in the landscape image DB 22B of the server device 10B.
  • the server device 10B extracts a corresponding landscape image as a substitute image from a plurality of landscape images stored in the landscape image DV22B, and transmits it to the information display terminal 10A.
  • the terminal storage unit 12 acquires the substitute image by receiving the image information of the substitute image from the server device 10B via the terminal communication unit 19 (step S204).
  • the image processing unit 14 aligns the landscape image photographed by the camera 11 and the substitute image (step S205). For example, the image processing unit 14 detects a characteristic object (feature part) that is included in both images in common, and performs alignment so that the degree of matching of the position of the characteristic object becomes high.
  • a characteristic object feature part
  • the image processing unit 14 detects the edge of the obstacle included in the landscape image (step S206).
  • the image processing unit 14 corresponds to a region to be superimposed on the obstacle in the landscape image captured by the camera 11 in the substitute image (that is, corresponding to the position of the obstacle in the substitute image) using the detected edge of the obstacle as a reference. Area to be trimmed (step S207).
  • the image processing unit 14 superimposes the trimmed substitute image on the landscape image, and generates a transmission image in which a part (for example, the inside) of the obstacle in the landscape image is transmitted in a pseudo manner (step S208). At that time, the image processing unit 14 generates a transmission image while changing the transmission degree of the obstacle (for example, translucent, fully transparent, etc.) according to the distance from the vehicle M to the guide point, for example.
  • a part for example, the inside
  • the image processing unit 14 generates a transmission image while changing the transmission degree of the obstacle (for example, translucent, fully transparent, etc.) according to the distance from the vehicle M to the guide point, for example.
  • the terminal control unit 13 controls the image processing unit 14 to generate a road surface support image for displaying a driving support image that supports driving of the moving body on the road surface of the landscape image.
  • the image processing unit 14 Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving attention point instruction image indicating a driving attention point and a route guidance image as a road surface support image (step S109).
  • the terminal control unit 13 controls the display unit 15 so that the camera 11 captures the sky support image generated by the image processing unit 14 in step S105 or the road surface support image generated in step S109, or the obstacle in step S108.
  • the image is superimposed and displayed on the transmission image generated by the object transmission process (step S110).
  • FIG. 5A shows an example of an image displayed on the display unit 15 in a state where the vehicle M is not approaching the guidance point (that is, when the current position of the vehicle M is not within a predetermined distance from the guidance point).
  • FIG. A driving caution point indicating image DC and a route guidance image RG indicating driving caution points such as accident-prone points are displayed as driving assistance images at positions above the landscape image. Further, the front vehicle FV of the vehicle M is displayed as it is.
  • FIG. 5B is a diagram illustrating an example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point.
  • the driving support image (the sky supporting image) displayed at the sky position in the landscape image fades out
  • the driving support image (the road surface supporting image) fades in to the position on the road surface. Displayed.
  • FIG. 5C is a diagram illustrating an example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point.
  • the front vehicle FV is detected as an obstacle, and a transmission image showing the inside of the front vehicle FV is displayed.
  • the degree of transmission of the forward vehicle FV changes according to the distance between the vehicle M and the guide point, and the forward vehicle FV is gradually transparent as the vehicle M approaches the guide point (for example, a translucent state) To be completely transparent).
  • FIG. 5D is a diagram illustrating an example of an image displayed on the display unit 15 when the vehicle M further approaches the guidance point.
  • the interior of the front vehicle FV that is an obstacle is displayed in a completely transparent state.
  • the outline image FVC which shows the outline of the front vehicle FV, for example is displayed.
  • FIG. 5E is a diagram illustrating another example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point.
  • the transmission image may be an image that transmits through a portion of the obstacle where the driving assistance image overlaps.
  • the present invention is not limited to this, and the information display terminal 10A is stored in the terminal memory.
  • the map information including the position information of the driving caution point may be stored in the unit 12, and a driving support image including the driving caution point instruction image and the route guidance image may be generated based on the map information.
  • the information display terminal 10A displays the driving support image superimposed on the landscape image when the vehicle M is away from the guide point such as the driving caution point or the intersection.
  • the driver who drives the vehicle M can visually recognize the driving assistance image regardless of the road surface condition such as the presence or absence of an obstacle, and can roughly grasp the position of the driving caution point and the route guidance information. It becomes possible.
  • the information display terminal 10A displays the driving support image superimposed on a position near the ground (for example, on the road surface) of the landscape image.
  • the driver who drives the vehicle M can specifically recognize the position of the driving caution point and the route guidance in association with the road surface.
  • the information display terminal 10A when an obstacle such as a forward vehicle is present in the traveling direction of the vehicle M, the information display terminal 10A according to the present embodiment is configured so that part of the obstacle (for example, , Inside) is displayed and a transparent image is displayed. Thereby, the driver who drives the vehicle M can recognize the position of the driving caution point and the route guidance without being obstructed by the obstacle.
  • the information display system according to the second embodiment will be described with reference to FIGS.
  • the information display system of the present embodiment differs from the information display system of the first embodiment shown in FIG. 2 in the configuration and operation of the display unit 15 of the information display terminal 10A.
  • the display unit 15 of the present embodiment is a head-up display (HUD) that displays a virtual image superimposed on the actual scenery in front of the vehicle M.
  • the display unit 15 displays a driving assistance image including a driving caution point instruction image and a route guidance image as a virtual image.
  • the display unit 15 includes a projection device 31 and a reflecting mirror 32.
  • the projection device 31 projects image light indicating the driving assistance image generated by the image processing unit 14 toward the reflecting mirror 32.
  • the image light reflected by the reflecting mirror 32 is reflected by the windshield FG of the vehicle M and enters the driver's pupil.
  • the information display processing routine RT3 executed by the information display terminal 10A of the present embodiment will be described with reference to FIG.
  • the terminal control unit 13 of the information display terminal 10A starts an information display processing routine RT3.
  • the position detection unit 18 acquires current position information indicating the current position of the vehicle M (step S301).
  • the terminal control unit 13 controls the terminal communication unit 19 to cause the server device 10B to transmit movement information including the current position information of the vehicle M and the route information of the scheduled travel route set in the vehicle M (step S302). .
  • the terminal communication unit 19 may transmit the movement information to the server device 10B at predetermined time intervals.
  • the terminal communication unit 19 receives the driving support information including the information on the driving caution points around the vehicle M and the route guidance information generated in the server device 10B based on the transmitted movement information (step S303).
  • the terminal control unit 13 Based on the received driving support information, the terminal control unit 13 specifies a guide point such as a driving caution point or an intersection located in the traveling direction of the vehicle M, and the current position of the vehicle M is within a predetermined distance from the guide point. It is determined whether it is within (step S304).
  • the terminal control unit 13 controls the image processing unit 14 to support driving of the moving object.
  • a sky support image for displaying the image at a position above the landscape image is generated.
  • the image processing unit 14 Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving caution point instruction image indicating a driving caution point and a route guidance image as an aerial support image (step S305).
  • the projection device 31 of the display unit 15 projects image light corresponding to the sky support image onto the upper end side of the reflecting mirror 32 (step S306).
  • the image light reflected on the upper end side of the reflecting mirror 32 is reflected on the upper end side of the windshield FG and enters the driver's pupil.
  • the driver visually recognizes the sky support image UG superimposed on the vicinity of the sky in front of the vehicle M through the windshield FG.
  • step S304 If it is determined in step S304 that the current position of the vehicle M is within a predetermined distance from the guidance point (step S304: Yes), the terminal control unit 13 controls the image processing unit 14 to support driving of the moving object.
  • a road surface support image for displaying the driving support image to be displayed on the road surface of the landscape image is generated.
  • the image processing unit 14 Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving attention point instruction image indicating a driving attention point and a route guidance image as a road surface support image (step S307).
  • the projection device 31 of the display unit 15 projects image light corresponding to the road surface support image onto the lower end side of the reflecting mirror 32 (step S308).
  • the image light reflected on the lower end side of the reflecting mirror 32 is reflected on the lower end side of the windshield FG and enters the driver's pupil.
  • the driver visually recognizes the road surface support image DG superimposed on the vicinity of the ground in the scenery in front of the vehicle M through the windshield FG.
  • the information display terminal 10 ⁇ / b> A allows the driving support image to be displayed at a position above the scenery in front of the vehicle M when the vehicle M is away from a guide point such as a driving caution point or an intersection.
  • a virtual image is superimposed and displayed.
  • the information display terminal 10A when the vehicle M approaches the guidance point, the information display terminal 10A according to the present embodiment superimposes a virtual image of the driving assistance image at a position near the ground (for example, on the road surface) of the scenery in front of the vehicle M. To display. Thereby, the driver who drives the vehicle M can specifically recognize the position of the driving caution point and the route guidance in association with the road surface.
  • the present invention is not limited to the above embodiment.
  • the information display terminal 10A is mounted on the vehicle M as a moving body.
  • the information display terminal 10A is not limited to a vehicle-mounted device such as a vehicle-mounted navigation device, and may be a mobile terminal or a smartphone that can execute a navigation function.
  • the target to be transmitted in the transmission image is not limited to the inside or the lower part of the obstacle, and any object that transmits at least a part of the obstacle may be used.
  • an example in which an image showing the outline of an obstacle is displayed together with the transmission image, and an example in which the lower part is transmitted while leaving the upper part of the obstacle have been described.
  • an image in which the entire obstacle is transmitted that is, an image in which the obstacle is not completely visible
  • the driving support image when the distance from the vehicle M to the guide point is equal to or greater than the predetermined distance, the driving support image is displayed at an empty position.
  • the position where the driving support image is displayed is not limited to these, and the display unit 15 is positioned at the first height position in the landscape image when the distance from the vehicle M to the guide point is equal to or greater than the predetermined distance.
  • a driving assistance image may be displayed as long as the driving assistance image is displayed at a second height lower than the first height if the driving assistance image is less than the predetermined distance. That is, the display part 15 should just change the height of the display position of a driving assistance image according to the distance from the vehicle M to a guidance point.
  • the display unit 15 In addition to changing the height of the display position of the driving support image according to the distance from the vehicle M to the guide point, the display unit 15 increases the display position of the driving support image according to the presence or absence of an obstacle. You may change the size. For example, when there is an obstacle such as a preceding vehicle in the traveling direction of the vehicle M and the distance to the guide point is equal to or greater than a predetermined distance, the display unit 15 is positioned at the first height (for example, the sky).
  • a driving assistance image is displayed, and when there is no obstacle and the distance to the guide point is equal to or greater than a predetermined distance, a second height position lower than the first height (for example, several meters from the road surface) When the distance to the guide point is less than the predetermined distance, the third height (lower than the second height) is displayed regardless of the presence or absence of obstacles.
  • a configuration in which a driving assistance image is displayed at a position on the road surface may be employed.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

Provided is an information display device that is capable of highly visibly displaying a driving assistance image such that the correlation between the image and an actual road can be easily understood. [Solution] The information display control device has: an image acquisition unit that acquires an image of scenery around a mobile body; and a display control unit that causes a display unit to display a driving assistance image which assists driving of the mobile body and which relates to a prescribed point around the mobile body, through superimposing of the driving assistance image on the scenery image, wherein the display control unit changes the height of the display position of the driving assistance image within the image of scenery on the basis of the distance from the mobile body to the prescribed point.

Description

情報表示制御装置、情報表示制御方法及び情報表示制御プログラムInformation display control device, information display control method, and information display control program

 本発明は、情報表示制御装置に関し、特に、移動体の運転者に向けた情報の表示を行う情報表示制御装置に関する。 The present invention relates to an information display control device, and more particularly to an information display control device that displays information for a driver of a moving object.

 車両等の移動体に搭載されたナビゲーション装置等の情報表示装置において、車両のドライバの運転を支援するための運転支援画像の表示が行われている。例えば、進むべきルートを案内するための帯状のルート案内画像が運転支援画像として表示される。その際、情報表示装置は、実際の風景を撮影した撮影画像に重畳する方法や、HUD(ヘッドアップディスプレイ)等により実際の風景に虚像として重畳する方法により、運転支援画像の表示を行う。 In an information display device such as a navigation device mounted on a moving body such as a vehicle, a driving support image for supporting driving of the driver of the vehicle is displayed. For example, a belt-shaped route guidance image for guiding a route to be traveled is displayed as a driving assistance image. At this time, the information display device displays the driving support image by a method of superimposing the captured image on the actual landscape or a method of superimposing the actual landscape on the actual landscape using a HUD (head-up display) or the like.

 例えば、実際の風景を撮影した撮影画像に運転支援画像を重畳して表示する場合、車両の前方に障害物等が存在すると、運転支援画像と障害物とが重なって表示され、運転注意地点の位置やルート案内がわかりづらくなる場合がある。そこで、ルート案内画像と障害物が重なって表示されることを避けるため、撮影画像内の障害物のない上空の位置にルート案内画像を表示する情報表示装置が提案されている(例えば、特許文献1)。 For example, when displaying a driving assistance image superimposed on a photographed image of an actual landscape, if an obstacle or the like is present in front of the vehicle, the driving assistance image and the obstacle are overlapped and displayed, Location and route guidance may be difficult to understand. Therefore, in order to prevent the route guidance image and the obstacle from being displayed in an overlapping manner, an information display device that displays the route guidance image at an empty position without an obstacle in the captured image has been proposed (for example, Patent Documents). 1).

特開2012-233904号公報JP 2012-233904 A

 上記したように撮影画像内の上空の位置にルート案内画像等の運転支援画像を表示した場合、運転支援画像と実際の道路との対応関係がわかりにくいということが課題の一例として挙げられる。 As described above, when a driving assistance image such as a route guidance image is displayed at a position above the captured image, it is difficult to understand the correspondence between the driving assistance image and the actual road.

 本発明は上記した点に鑑みてなされたものであり、実際の道路との対応関係がわかりやすく且つ視認性の高い運転支援画像の表示を行うことが可能な情報表示装置を提供することを目的の一つとしている。 The present invention has been made in view of the above points, and an object of the present invention is to provide an information display device capable of displaying a driving assistance image having a high visibility and an easy-to-understand relationship with an actual road. One of them.

 請求項1に記載の発明は、情報表示制御装置であって、移動体の周囲の風景画像を取得する画像取得部と、前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景画像に重畳して表示部に表示させる表示制御部と、を有し、前記表示制御部は、前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景画像内における高さを変更する、ことを特徴とする。 The invention according to claim 1 is an information display control device, an image acquisition unit that acquires a landscape image around a moving object, and a predetermined point around the moving object and assists the driving of the moving object A display control unit that displays a driving support image to be superimposed on the landscape image on a display unit, and the display control unit is configured to support the driving support based on a distance from the moving body to the predetermined point. The height of the image display position in the landscape image is changed.

 請求項6に記載の発明は、移動体の前方の風景に重畳して虚像を表示する表示部に、前記虚像を表示させる情報表示制御装置であって、前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景に重畳して表示させ、前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景内における高さを変更する前記表示制御部を有することを特徴とする。 The invention according to claim 6 is an information display control device that displays the virtual image on a display unit that displays a virtual image superimposed on a landscape in front of the moving body, and relates to a predetermined point around the moving body. In addition, a driving support image that supports driving of the moving body is displayed superimposed on the landscape, and the display position of the driving support image is high in the landscape based on the distance from the moving body to the predetermined point. It has the said display control part which changes thickness.

 請求項7に記載の発明は、表示部に画像を表示させる情報表示制御装置が実行する情報表示制御方法であって、移動体の周囲の風景画像を取得するステップと、前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景画像に重畳して表示するステップと、前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景画像内における高さを変更するステップと、を含むことを特徴とする。 The invention according to claim 7 is an information display control method executed by an information display control device for displaying an image on a display unit, the step of acquiring a landscape image around a moving body, Displaying the driving support image related to a predetermined point and superimposing the driving support image supporting the driving of the moving body on the landscape image, and the distance from the moving body to the predetermined point. Changing the height of the position in the landscape image.

 請求項8に記載の発明は、情報表示制御プログラムであって、コンピュータに、移動体の周囲の風景画像を取得するステップと、前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景画像に重畳して表示するステップと、前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景画像内における高さを変更するステップと、を実行させることを特徴とする。 The invention according to claim 8 is an information display control program, wherein a computer acquires a landscape image around a moving body, and a predetermined point around the moving body and the operation of the moving body are performed. A step of displaying a driving assistance image to be supported superimposed on the landscape image, and changing a height of the display position of the driving assistance image in the landscape image based on a distance from the moving body to the predetermined point And a step of executing.

本発明の実施例1の情報表示システムの構成の一例を示すブロック図である。It is a block diagram which shows an example of a structure of the information display system of Example 1 of this invention. 実施例1の情報表示システムの構成の一例を示すブロック図である。It is a block diagram which shows an example of a structure of the information display system of Example 1. FIG. 実施例1の情報表示端末による情報表示処理ルーチンの例を示すフローチャートである。6 is a flowchart illustrating an example of an information display processing routine by the information display terminal according to the first embodiment. 実施例1の情報表示端末による障害物透過処理ルーチンの例を示すフローチャートである。5 is a flowchart illustrating an example of an obstacle permeation processing routine by the information display terminal according to the first embodiment. 表示部に表示される画面の一例を示す図である。It is a figure which shows an example of the screen displayed on a display part. 表示部に表示される画面の一例を示す図である。It is a figure which shows an example of the screen displayed on a display part. 表示部に表示される画面の一例を示す図である。It is a figure which shows an example of the screen displayed on a display part. 表示部に表示される画面の一例を示す図である。It is a figure which shows an example of the screen displayed on a display part. 表示部に表示される画面の一例を示す図である。It is a figure which shows an example of the screen displayed on a display part. 実施例2の情報表示端末による情報表示の様子を模式的に示す図である。It is a figure which shows typically the mode of the information display by the information display terminal of Example 2. FIG. 実施例2の情報表示端末による情報表示処理ルーチンの例を示すフローチャートである。10 is a flowchart illustrating an example of an information display processing routine by the information display terminal according to the second embodiment.

 以下に本発明の好適な実施例を詳細に説明する。なお、以下の説明及び添付図面においては、実質的に同一または等価な部分には同一の参照符号を付している。 Hereinafter, preferred embodiments of the present invention will be described in detail. In the following description and the accompanying drawings, substantially the same or equivalent parts are denoted by the same reference numerals.

 図1は、実施例1の情報表示システム10の構成を示している。情報表示システム10は、情報表示制御装置としての情報表示端末10A及びサーバ装置10Bを含んでいる。本実施例においては、情報表示端末10Aが、移動体としての車両Mに搭載されている例について説明する。 FIG. 1 shows the configuration of the information display system 10 of the first embodiment. The information display system 10 includes an information display terminal 10A as an information display control device and a server device 10B. In the present embodiment, an example in which the information display terminal 10A is mounted on a vehicle M as a moving body will be described.

 情報表示端末10Aとサーバ装置10Bとは、ネットワーク(通信路)を介して相互にデータの送受信(通信接続)が可能である。例えば、当該送受信には、TCP/IP等の通信プロトコルが用いられる。また、当該ネットワークは、移動体通信網、Wi-Fi(登録商標)等の無線通信及び有線通信を含むインターネット通信により構築され得る。サーバ装置10Bは、複数の車両Mに搭載された複数の情報表示端末10Aの各々との間で相互にデータの送受信が可能である。 The information display terminal 10A and the server device 10B can transmit and receive data (communication connection) with each other via a network (communication path). For example, a communication protocol such as TCP / IP is used for the transmission / reception. In addition, the network can be constructed by Internet communication including wireless communication and wired communication such as a mobile communication network and Wi-Fi (registered trademark). Server device 10B can transmit and receive data to and from each of a plurality of information display terminals 10A mounted on a plurality of vehicles M.

 図2は、情報表示端末10A及びサーバ装置10Bの構成を示している。サーバ装置10Bは、情報表示端末10A以外の複数の情報表示端末(図示せず)と相互にデータの送受信を行う。そのため、情報表示端末10Aには、当該端末を識別するための装置IDが予め割り振られている。 FIG. 2 shows the configuration of the information display terminal 10A and the server device 10B. Server device 10B transmits and receives data to and from a plurality of information display terminals (not shown) other than information display terminal 10A. Therefore, a device ID for identifying the terminal is assigned in advance to the information display terminal 10A.

 情報表示端末10Aは、車両Mの周囲の風景画像を取得する画像取得部としてのカメラ11を有する。カメラ11は、例えば車両Mのフロント部分に搭載されており、車両Mが走行する道路を含む前方の風景を撮影して風景画像を取得する。 The information display terminal 10 </ b> A includes a camera 11 as an image acquisition unit that acquires a landscape image around the vehicle M. The camera 11 is mounted, for example, on the front portion of the vehicle M, and acquires a landscape image by photographing a landscape in front including the road on which the vehicle M travels.

 情報表示端末10Aは、ハードディスク、フラッシュメモリ、SSD(Solid State Drive)、RAM(Random Access Memory)等の記憶装置からなる端末記憶部12を有する。端末記憶部12は、情報表示端末10Aにおいて実行されるプログラム、情報表示端末10Aの動作に必要なデータ、情報表示端末10Aの動作において発生するデータ及び外部から取込まれるデータを適宜記憶する。例えば、端末記憶部12は、車両Mが走行する道路の情報を含む地図情報や、サーバ装置10から取得した運転注意地点等の情報を記憶する。また、端末記憶部12は、カメラ11が撮影した風景画像の画像情報を撮影が行われた日時、車両Mの位置及び進行方向等の情報と関連付けて記憶する。また、端末記憶部11は、情報表示端末10Aの装置IDを記憶する。 The information display terminal 10A includes a terminal storage unit 12 including a storage device such as a hard disk, a flash memory, an SSD (Solid State Drive), and a RAM (Random Access Memory). The terminal storage unit 12 appropriately stores a program executed in the information display terminal 10A, data necessary for the operation of the information display terminal 10A, data generated in the operation of the information display terminal 10A, and data taken from the outside. For example, the terminal storage unit 12 stores map information including information on a road on which the vehicle M travels, and information such as a driving caution point acquired from the server device 10. Further, the terminal storage unit 12 stores the image information of the landscape image taken by the camera 11 in association with information such as the date and time when the image was taken, the position of the vehicle M, and the traveling direction. The terminal storage unit 11 stores the device ID of the information display terminal 10A.

 情報表示端末10Aは、中央演算処理装置(CPU(Central processing Unit))等からなる端末制御部13を有する。端末制御部13は、情報表示端末10Aの動作に必要な制御を行う。例えば、端末制御部13は、車両Mの目的地までの経路探索、サーバ装置10Bへの情報要求、情報表示端末10Aの各部の動作の制御等を行う。 The information display terminal 10A includes a terminal control unit 13 including a central processing unit (CPU (Central processing unit)). The terminal control unit 13 performs control necessary for the operation of the information display terminal 10A. For example, the terminal control unit 13 performs a route search to the destination of the vehicle M, an information request to the server device 10B, control of operations of each unit of the information display terminal 10A, and the like.

 画像処理部14は、カメラ11により撮影された風景画像に対して画像処理を行う。例えば、画像処理部14は、風景画像の中から車両Mの前方に位置する障害物(例えば、前方車両等の路面上に存在する物体)を検出し、当該障害物を風景画像中において透過させる障害物透過処理を実行する。また、画像処理部14は、ドライバの運転を支援するための運転支援画像を生成し、当該運転支援画像の風景画像への重畳や風景画像内での視点変換処理等の画像処理を行う。画像処理部14は、サーバ装置10Bから取得した情報や端末記憶部12に記憶された過去の風景画像に基づいて、これらの画像処理を行う。 The image processing unit 14 performs image processing on the landscape image captured by the camera 11. For example, the image processing unit 14 detects an obstacle located in front of the vehicle M (for example, an object existing on a road surface such as a forward vehicle) from the landscape image, and transmits the obstacle in the landscape image. The obstacle transmission process is executed. In addition, the image processing unit 14 generates a driving support image for supporting driving of the driver, and performs image processing such as superimposition of the driving support image on the landscape image and viewpoint conversion processing in the landscape image. The image processing unit 14 performs these image processes based on information acquired from the server device 10B and past landscape images stored in the terminal storage unit 12.

 情報表示端末10Aは、車両Mの運転者に対して情報の提示を行う提示部としての表示部15及び音声出力部16を有する。 The information display terminal 10A includes a display unit 15 and a voice output unit 16 as a presentation unit that presents information to the driver of the vehicle M.

 表示部15は、液晶ディスプレイや有機ELディスプレイ等の表示装置であり、ドライバによって視認可能に設けられている。表示部15は、端末制御部13の制御に応じて、車両Mの周囲の風景画像及びこれに重畳された運転支援画像を表示する。 The display unit 15 is a display device such as a liquid crystal display or an organic EL display, and is provided so as to be visible by a driver. The display unit 15 displays a landscape image around the vehicle M and a driving support image superimposed thereon under the control of the terminal control unit 13.

 音声出力部16は、車両Mの目的地までのナビゲーション情報やその他の運転支援情報を音声として出力する音響機器である。例えば、音声出力部14は、経路情報の一部や運転注意地点に関する情報を音声出力する。 The audio output unit 16 is an acoustic device that outputs navigation information to the destination of the vehicle M and other driving support information as audio. For example, the voice output unit 14 outputs information on part of route information and information on a driving caution point.

 情報表示端末10Aは、リモートコントローラ又はタッチパネル等の入力機器からなる操作入力部17を有する。操作入力部17は、搭乗者からの操作入力を受け付ける。例えば、操作入力部17は、経路情報の表示を要求する入力、目的地の入力等の操作入力を受け付ける。 The information display terminal 10A includes an operation input unit 17 including an input device such as a remote controller or a touch panel. The operation input unit 17 receives an operation input from a passenger. For example, the operation input unit 17 receives an operation input such as an input requesting display of route information and an input of a destination.

 情報表示端末10Aは、車両Mの位置を検出する装置である位置検出部18を有する。位置検出部18は、例えばGPS(Global Positioning System)受信機等の位置特定装置を含み、車両Mの位置を検出して位置情報を生成する。 The information display terminal 10A includes a position detection unit 18 that is a device that detects the position of the vehicle M. The position detection unit 18 includes a position specifying device such as a GPS (Global Positioning System) receiver, and detects the position of the vehicle M to generate position information.

 情報表示端末10Aは、端末通信部19を有する。端末通信部19は、例えば端末制御部13の指示に従ってデータの送受信を行うためのNIC(Network Interface Card)等のネットワークアダプタである。送信部としての端末通信部19は、例えば車両Mの位置情報、装置ID、経路情報及びカメラ11が撮影した風景画像の画像情報等を送信する。受信部としての端末通信部19は、例えば事故多発地点等の運転注意地点の情報を含む運転支援情報等を受信する。 The information display terminal 10 </ b> A has a terminal communication unit 19. The terminal communication unit 19 is a network adapter such as a NIC (Network Interface Card) for transmitting and receiving data in accordance with an instruction from the terminal control unit 13, for example. The terminal communication unit 19 as a transmission unit transmits, for example, position information of the vehicle M, device ID, route information, image information of a landscape image taken by the camera 11, and the like. The terminal communication unit 19 as a receiving unit receives driving support information including information on driving caution points such as accident-prone points.

 続いて、サーバ装置10Bについて説明する。サーバ装置10Bは、サーバ通信部21を有する。サーバ通信部21は、例えばNIC等のネットワークアダプタであり、1又は複数の車両Mとの間でデータの送受信を行う。送信部としてのサーバ通信部21は、例えば運転支援情報を含む配信情報等を情報表示端末10Aに送信する。また、受信部としてのサーバ通信部21は、例えば車両Mの位置情報、装置ID、経路情報及び風景画像の画像情報等を情報表示端末10Aから受信する。 Subsequently, the server device 10B will be described. The server device 10B includes a server communication unit 21. The server communication unit 21 is a network adapter such as a NIC, for example, and transmits and receives data to and from one or a plurality of vehicles M. The server communication unit 21 as a transmission unit transmits, for example, distribution information including driving support information to the information display terminal 10A. In addition, the server communication unit 21 as a receiving unit receives, for example, position information of the vehicle M, device ID, route information, image information of a landscape image, and the like from the information display terminal 10A.

 サーバ装置10Bは、ハードディスク、フラッシュメモリ、SSD、RAM等の記憶装置からなるサーバ記憶部22を有する。サーバ記憶部22は、サーバ装置10Bにおいて実行されるプログラム、サーバ装置10Bの動作に必要なデータ、サーバ装置10Bの動作において発生するデータ及び外部から取込まれるデータを適宜記憶する。 The server device 10B includes a server storage unit 22 including a storage device such as a hard disk, a flash memory, an SSD, and a RAM. The server storage unit 22 appropriately stores a program executed in the server device 10B, data necessary for the operation of the server device 10B, data generated in the operation of the server device 10B, and data taken from the outside.

 サーバ記憶部22は、地図情報DB22Aを有する。地図情報DB22Aには、事故多発地点等の運転注意地点の情報を含む地図情報が格納されている。 The server storage unit 22 has a map information DB 22A. The map information DB 22A stores map information including information on driving caution points such as accident-prone points.

 また、サーバ記憶部22は、風景画像DB22Bを格納する。風景画像DB22Bには、サーバ通信部21が複数の車両Mから受信した風景画像の画像情報が、当該車両Mの位置情報、進行方向情報、走行中のレーン(例えば、右折レーン、直進レーン等)の情報及び撮影された日時の情報と関連付けて格納されている。 The server storage unit 22 stores a landscape image DB 22B. In the landscape image DB 22B, the image information of the landscape image received by the server communication unit 21 from the plurality of vehicles M includes the position information of the vehicle M, the traveling direction information, and the traveling lane (for example, right turn lane, straight lane, etc.). And information on the date and time of shooting are stored in association with each other.

 サーバ装置10Bは、サーバ制御部23を有する。サーバ制御部23は、CPU(Central Processing Unit)、ROM(Read Only Memory)、RAM等により構成され、コンピュータとして機能する。サーバ制御部23は、サーバ記憶部22に記憶された各種プログラムを読み出して実行することにより各種機能を実現する。サーバ制御部23は、受信画像記憶制御部24を含んでいる。 The server device 10B includes a server control unit 23. The server control unit 23 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, and the like, and functions as a computer. The server control unit 23 implements various functions by reading and executing various programs stored in the server storage unit 22. The server control unit 23 includes a received image storage control unit 24.

 受信画像記憶制御部24は、サーバ通信部21が複数の車両Mから受信した風景画像の画像情報を、当該車両Mの位置情報、進行方向情報、走行中のレーンの情報及び撮影された日時の情報と関連付けてサーバ記憶部22の風景画像DB22Bに記憶させる。その際、受信画像記憶制御部24は、例えば撮影された位置、時間帯、季節、レーン、進行方向毎に風景画像を分類して風景画像DB22Bに記憶させる。なお、受信画像記憶制御部24は、車両Mの位置情報に基づいて当該位置の周辺の気象情報を取得し、風景画像を気象状況毎に分類して風景画像DB22Bに記憶させるようにしても良い。 The received image storage control unit 24 displays the image information of the landscape image received by the server communication unit 21 from the plurality of vehicles M, such as the position information of the vehicle M, the traveling direction information, the information on the traveling lane, and the shooting date and time. The scene image DB 22B of the server storage unit 22 is stored in association with the information. At that time, the received image storage control unit 24 classifies the landscape images for each captured position, time zone, season, lane, and traveling direction, and stores them in the landscape image DB 22B. Note that the received image storage control unit 24 may acquire weather information around the position based on the position information of the vehicle M, classify the landscape image for each weather condition, and store it in the landscape image DB 22B. .

 また、受信画像記憶制御部24は、風景画像を記憶させる前に画像解析を行い、路面上に前方車両等の障害物が存在する風景画像は除外して風景画像DB22Bに記憶させる。また、受信画像記憶制御部24は、撮影された位置、時刻、季節、気象情報等の条件が類似する風景画像が既に存在した場合には、新たに取得した風景画像を上書きして風景画像DB22Bに記憶させる。 Further, the received image storage control unit 24 performs image analysis before storing the landscape image, excludes the landscape image in which an obstacle such as a forward vehicle exists on the road surface, and stores it in the landscape image DB 22B. The received image storage control unit 24 overwrites the newly acquired landscape image and overwrites the landscape image DB 22B when a landscape image having similar conditions such as the taken position, time, season, and weather information already exists. Remember me.

 また、サーバ制御部23は、送信情報生成部25を含んでいる。送信情報生成部25は、情報表示端末10Aに配信(送信)する配信情報を生成する。例えば、送信情報生成部25は、車両Mの位置情報に基づいて当該位置の周辺の事故多発地点等の運転注意地点の位置情報を取得し、運転注意地点の情報を含む配信情報を生成する。また、送信情報生成部25は、車両Mの位置情報、進行方向情報及びその他の環境情報(例えば、季節、時間帯、気象状況等)を含む画像要求情報の受信に応じて、サーバ記憶部22の風景画像DBに記憶されている風景画像を抽出し、当該風景画像を含む配信情報を生成する。 The server control unit 23 includes a transmission information generation unit 25. The transmission information generation unit 25 generates distribution information to be distributed (transmitted) to the information display terminal 10A. For example, the transmission information generation unit 25 acquires position information of driving caution points such as accident-prone points around the position based on the position information of the vehicle M, and generates distribution information including information on the driving caution points. In addition, the transmission information generation unit 25 receives the image request information including the position information of the vehicle M, the traveling direction information, and other environmental information (for example, season, time zone, weather conditions, etc.), and the server storage unit 22 The landscape image stored in the landscape image DB is extracted, and distribution information including the landscape image is generated.

 図3を参照しつつ、情報表示端末10Aが実行する情報表示処理ルーチンRT1について説明する。 The information display processing routine RT1 executed by the information display terminal 10A will be described with reference to FIG.

 情報表示端末10Aの端末制御部13は、例えば、車両Mのアクセサリー電源(以下、ACC電源と称する)がオンになると、情報表示処理ルーチンRT1を開始する。なお、端末制御部13は、車両Mのエンジンの始動によって情報表示処理ルーチンRT1を開始しても良い。 The terminal control unit 13 of the information display terminal 10A starts an information display processing routine RT1 when, for example, an accessory power source (hereinafter referred to as ACC power source) of the vehicle M is turned on. Note that the terminal control unit 13 may start the information display processing routine RT1 by starting the engine of the vehicle M.

 位置検出部18は、車両Mの現在位置を示す現在位置情報を取得する(ステップS101)。 The position detection unit 18 acquires current position information indicating the current position of the vehicle M (step S101).

 端末制御部13は、端末通信部19を制御して、車両Mの現在位置情報及び車両Mに設定されている進行予定経路の経路情報を含む移動情報をサーバ装置10Bに送信させる(ステップS102)。端末通信部19は、当該移動情報を所定の時間間隔おきにサーバ装置10Bに送信してもよい。 The terminal control unit 13 controls the terminal communication unit 19 to cause the server device 10B to transmit movement information including the current position information of the vehicle M and the route information of the scheduled travel route set in the vehicle M (step S102). . The terminal communication unit 19 may transmit the movement information to the server device 10B at predetermined time intervals.

 端末通信部19は、送信した移動情報に基づいてサーバ装置10Bにおいて生成された、車両Mの周辺の運転注意地点の情報やルート案内の情報を含む運転支援情報を受信する(ステップS103)。 The terminal communication unit 19 receives the driving support information including the information on the driving caution points around the vehicle M and the route guidance information generated in the server device 10B based on the transmitted movement information (step S103).

 端末制御部13は、受信した運転支援情報に基づいて、車両Mの進行方向に位置する運転注意地点や交差点等の案内地点を特定し、車両Mの現在位置が当該案内地点から所定距離の範囲内であるか否かを判定する(ステップS104)。 Based on the received driving support information, the terminal control unit 13 specifies a guide point such as a driving caution point or an intersection located in the traveling direction of the vehicle M, and the current position of the vehicle M is within a predetermined distance from the guide point. It is determined whether it is within (step S104).

 車両Mの現在位置が案内地点から所定距離の範囲内ではないと判定すると(ステップS104:No)、端末制御部13は、画像処理部14を制御して、移動体の運転を支援する運転支援画像を風景画像の上空の位置に表示するための上空支援画像を生成させる。画像処理部14は、ステップS103で受信した運転支援情報に基づいて、運転注意地点を示す運転注意地点指示画像及びルート案内画像を含む運転支援画像を上空支援画像として生成する(ステップS105)。 If it is determined that the current position of the vehicle M is not within a predetermined distance from the guidance point (step S104: No), the terminal control unit 13 controls the image processing unit 14 to support driving of the moving object. A sky support image for displaying the image at a position above the landscape image is generated. Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving attention point instruction image indicating a driving attention point and a route guidance image as an aerial support image (step S105).

 一方、車両Mの現在位置が案内地点から所定距離の範囲内であると判定すると(ステップS104:Yes)、端末制御部13は、画像処理部14を制御してカメラ11が撮影した風景画像を解析し、車両Mの前方の路面上に前方車両等の障害物があるか否かを判定する(ステップS106)。 On the other hand, if it is determined that the current position of the vehicle M is within a predetermined distance from the guidance point (step S104: Yes), the terminal control unit 13 controls the image processing unit 14 to capture a landscape image captured by the camera 11. Analysis is performed to determine whether there is an obstacle such as a forward vehicle on the road surface ahead of the vehicle M (step S106).

 車両Mの前方に障害物がないと判定すると(ステップS106:No)、端末制御部13は、カメラ11により撮影された風景画像を端末記憶部12に記憶させる(ステップS107)。同時にカメラ11により撮影された風景画像の画像情報を、撮影時の車両Mの位置情報、進行方向情報、及び撮影日時の情報と供にサーバ装置10Bに送信するようにしてもよい。 If it is determined that there is no obstacle in front of the vehicle M (step S106: No), the terminal control unit 13 stores the landscape image captured by the camera 11 in the terminal storage unit 12 (step S107). At the same time, the image information of the landscape image photographed by the camera 11 may be transmitted to the server device 10B together with the position information of the vehicle M at the time of photographing, the traveling direction information, and the photographing date / time information.

 車両Mの前方に障害物があると判定すると(ステップS106:Yes)、車両Mの周囲の風景を障害物の一部(例えば、内部)を透過しつつ示す透過画像を生成する障害物透過処理を実行する(ステップS108)。 If it is determined that there is an obstacle ahead of the vehicle M (step S106: Yes), an obstacle transmission process for generating a transparent image showing the scenery around the vehicle M while passing through a part of the obstacle (for example, the inside). Is executed (step S108).

 図4は、情報表示端末10Aが実行する障害物透過処理ルーチンRT2を示すフローチャートである。 FIG. 4 is a flowchart showing an obstacle permeation processing routine RT2 executed by the information display terminal 10A.

 端末制御部13は、カメラ11が撮影した風景画像に対応する撮影状況又は撮影環境(例えば、位置、進行方向、時間帯、季節、天候等)で、過去に撮影した障害物を含まない風景画像、または、過去にサーバ装置10Bから受信した障害物を含まない風景画像(以下、代替画像と称する)が端末記憶部12に記憶されているか否かを判定する(ステップS201)。 The terminal control unit 13 is a landscape image that does not include an obstacle photographed in the past in a photographing situation or photographing environment (for example, position, traveling direction, time zone, season, weather, etc.) corresponding to the landscape image photographed by the camera 11. Alternatively, it is determined whether or not a landscape image (hereinafter, referred to as a substitute image) that does not include an obstacle received from the server device 10B in the past is stored in the terminal storage unit 12 (step S201).

 代替画像が端末記憶部12に記憶されていると判定すると(ステップS201:Yes)、端末制御部13は、代替画像を端末記憶部12から読み出して取得する(ステップS202)。 If it is determined that the substitute image is stored in the terminal storage unit 12 (step S201: Yes), the terminal control unit 13 reads and acquires the substitute image from the terminal storage unit 12 (step S202).

 代替画像が端末記憶部12に記憶されていないと判定すると(ステップS201:No)、端末制御部13は、端末通信部19を制御して、代替画像の送信を要求する画像要求をサーバ装置10Bに送信する(ステップS203)。画像要求は、車両Mの位置情報、進行方向情報、及び季節、気象状況、時間帯等を指定する情報を含む。 If it is determined that the substitute image is not stored in the terminal storage unit 12 (step S201: No), the terminal control unit 13 controls the terminal communication unit 19 to send an image request for requesting transmission of the substitute image to the server device 10B. (Step S203). The image request includes the position information of the vehicle M, the traveling direction information, and information specifying the season, weather conditions, time zone, and the like.

 上記の通り、サーバ装置10Bの風景画像DB22Bには複数の車両Mにおいて撮影された風景画像が記憶されている。サーバ装置10Bは情報表示端末10Aからの画像要求に応じて、風景画像DV22Bに記憶されている複数の風景画像の中から対応する風景画像を代替画像として抽出し、情報表示端末10Aに送信する。端末記憶部12は、代替画像の画像情報をサーバ装置10Bから端末通信部19を介して受信することにより、代替画像を取得する(ステップS204)。 As described above, landscape images taken by a plurality of vehicles M are stored in the landscape image DB 22B of the server device 10B. In response to an image request from the information display terminal 10A, the server device 10B extracts a corresponding landscape image as a substitute image from a plurality of landscape images stored in the landscape image DV22B, and transmits it to the information display terminal 10A. The terminal storage unit 12 acquires the substitute image by receiving the image information of the substitute image from the server device 10B via the terminal communication unit 19 (step S204).

 画像処理部14は、カメラ11により撮影された風景画像と代替画像との位置合わせを行う(ステップS205)。例えば、画像処理部14は、両方の画像中に共通して含まれる特徴物(特徴となる部分)を検出し、特徴物の位置の一致度合いが高くなるように位置合わせを行う。 The image processing unit 14 aligns the landscape image photographed by the camera 11 and the substitute image (step S205). For example, the image processing unit 14 detects a characteristic object (feature part) that is included in both images in common, and performs alignment so that the degree of matching of the position of the characteristic object becomes high.

 位置合わせの完了後、画像処理部14は、風景画像に含まれる障害物のエッジを検出する(ステップS206)。 After completion of alignment, the image processing unit 14 detects the edge of the obstacle included in the landscape image (step S206).

 画像処理部14は、検出した障害物のエッジを基準として、代替画像のうち、カメラ11により撮影された風景画像中の障害物に重畳すべき領域(すなわち、代替画像における障害物の位置に対応する領域)をトリミングする(ステップS207)。 The image processing unit 14 corresponds to a region to be superimposed on the obstacle in the landscape image captured by the camera 11 in the substitute image (that is, corresponding to the position of the obstacle in the substitute image) using the detected edge of the obstacle as a reference. Area to be trimmed (step S207).

 画像処理部14は、トリミングした代替画像を風景画像に重畳し、風景画像中の障害物の一部(例えば、内部)が疑似的に透過された透過画像を生成する(ステップS208)。その際、画像処理部14は、例えば車両Mから案内地点までの距離に応じて障害物の透過度合い(例えば、半透明、全透明等)を変化させつつ、透過画像を生成する。 The image processing unit 14 superimposes the trimmed substitute image on the landscape image, and generates a transmission image in which a part (for example, the inside) of the obstacle in the landscape image is transmitted in a pseudo manner (step S208). At that time, the image processing unit 14 generates a transmission image while changing the transmission degree of the obstacle (for example, translucent, fully transparent, etc.) according to the distance from the vehicle M to the guide point, for example.

 再び図3を参照すると、端末制御部13は、画像処理部14を制御して、移動体の運転を支援する運転支援画像を風景画像の路面上に表示するための路面支援画像を生成させる。画像処理部14は、ステップS103で受信した運転支援情報に基づいて、運転注意地点を示す運転注意地点指示画像及びルート案内画像を含む運転支援画像を路面支援画像として生成する(ステップS109)。 Referring to FIG. 3 again, the terminal control unit 13 controls the image processing unit 14 to generate a road surface support image for displaying a driving support image that supports driving of the moving body on the road surface of the landscape image. Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving attention point instruction image indicating a driving attention point and a route guidance image as a road surface support image (step S109).

 端末制御部13は、表示部15を制御して、画像処理部14がステップS105で生成した上空支援画像又はステップS109で生成した路面支援画像を、カメラ11が撮影した風景画像又はステップS108の障害物透過処理で生成した透過画像に重畳して表示させる(ステップS110)。 The terminal control unit 13 controls the display unit 15 so that the camera 11 captures the sky support image generated by the image processing unit 14 in step S105 or the road surface support image generated in step S109, or the obstacle in step S108. The image is superimposed and displayed on the transmission image generated by the object transmission process (step S110).

 図5Aは、車両Mが案内地点に接近していない状態(すなわち、車両Mの現在位置が案内地点から所定距離の範囲内ではない場合)において、表示部15に表示される画像の一例を示す図である。事故多発地点等の運転注意地点を示す運転注意地点指示画像DC及びルート案内画像RGが、運転支援画像として風景画像内の上空の位置に表示される。また、車両Mの前方車両FVはそのまま表示される。 FIG. 5A shows an example of an image displayed on the display unit 15 in a state where the vehicle M is not approaching the guidance point (that is, when the current position of the vehicle M is not within a predetermined distance from the guidance point). FIG. A driving caution point indicating image DC and a route guidance image RG indicating driving caution points such as accident-prone points are displayed as driving assistance images at positions above the landscape image. Further, the front vehicle FV of the vehicle M is displayed as it is.

 図5Bは、車両Mが案内地点に接近した場合において、表示部15に表示される画像の一例を示す図である。車両Mが案内地点に接近すると、風景画像内の上空の位置に表示されていた運転支援画像(上空支援画像)がフェードアウトし、路面上の位置に運転支援画像(路面支援画像)がフェードインして表示される。 FIG. 5B is a diagram illustrating an example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point. When the vehicle M approaches the guidance point, the driving support image (the sky supporting image) displayed at the sky position in the landscape image fades out, and the driving support image (the road surface supporting image) fades in to the position on the road surface. Displayed.

 図5Cは、車両Mが案内地点に接近した場合において、表示部15に表示される画像の一例を示す図である。車両Mが案内地点に接近すると、前方車両FVが障害物として検出され、前方車両FVの内部を透過して示す透過画像が表示される。その際、前方車両FVの透過度合いは車両Mと案内地点との間の距離に応じて変化し、車両Mが案内地点に近づくにつれて前方車両FVは徐々に透けるように(例えば、半透明の状態から全透明の状態となるように)表示される。 FIG. 5C is a diagram illustrating an example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point. When the vehicle M approaches the guidance point, the front vehicle FV is detected as an obstacle, and a transmission image showing the inside of the front vehicle FV is displayed. At that time, the degree of transmission of the forward vehicle FV changes according to the distance between the vehicle M and the guide point, and the forward vehicle FV is gradually transparent as the vehicle M approaches the guide point (for example, a translucent state) To be completely transparent).

 図5Dは、車両Mがさらに案内地点に接近した場合において、表示部15に表示される画像の一例を示す図である。図5Cに示した状態よりもさらに車両Mが案内地点に接近すると、障害物である前方車両FVの内部は全透明の状態で表示される。その際、前方車両FVの位置を示すため、例えば前方車両FVの輪郭を示す輪郭画像FVCが表示される。 FIG. 5D is a diagram illustrating an example of an image displayed on the display unit 15 when the vehicle M further approaches the guidance point. When the vehicle M approaches the guidance point further than the state shown in FIG. 5C, the interior of the front vehicle FV that is an obstacle is displayed in a completely transparent state. In that case, in order to show the position of the front vehicle FV, the outline image FVC which shows the outline of the front vehicle FV, for example is displayed.

 図5Eは、車両Mが案内地点に接近した場合における、表示部15に表示される画像の他の一例を示す図である。ここでは、障害物である前方車両FVの内部を透過して輪郭を表示する代わりに、前方車両FVの上側部分を表示しつつ下側部分(路面と重なる部分)を透過する場合を例として示している。このように、透過画像は障害物のうち、運転支援画像が重なる部分を透過する画像であっても良い。 FIG. 5E is a diagram illustrating another example of an image displayed on the display unit 15 when the vehicle M approaches the guidance point. Here, instead of displaying the outline through the inside of the front vehicle FV, which is an obstacle, an example is shown in which the upper portion of the front vehicle FV is displayed and the lower portion (portion overlapping the road surface) is transmitted. ing. As described above, the transmission image may be an image that transmits through a portion of the obstacle where the driving assistance image overlaps.

 なお、ここまで、情報表示端末10Aが、サーバ装置10Bから受信した運転支援情報に基づいて、運転支援画像を生成する例を説明したが、これに限定されず、情報表示端末10Aが、端末記憶部12に運転注意地点の位置情報を含む地図情報を記憶しており、当該地図情報に基づいて運転注意地点指示画像及びルート案内画像を含む運転支援画像を生成するものであってもよい。 Heretofore, the example in which the information display terminal 10A generates the driving support image based on the driving support information received from the server device 10B has been described. However, the present invention is not limited to this, and the information display terminal 10A is stored in the terminal memory. The map information including the position information of the driving caution point may be stored in the unit 12, and a driving support image including the driving caution point instruction image and the route guidance image may be generated based on the map information.

 以上のように、本実施例の情報表示端末10Aは、車両Mが運転注意地点や交差点等の案内地点から離れている場合には、風景画像の上空の位置に運転支援画像を重畳して表示させる。これにより、車両Mを運転するドライバは、障害物の有無等の路面の状況に関わらず運転支援画像を視認することができ、運転注意地点の位置やルート案内の情報を大まかに把握することが可能となる。 As described above, the information display terminal 10A according to the present embodiment displays the driving support image superimposed on the landscape image when the vehicle M is away from the guide point such as the driving caution point or the intersection. Let Thereby, the driver who drives the vehicle M can visually recognize the driving assistance image regardless of the road surface condition such as the presence or absence of an obstacle, and can roughly grasp the position of the driving caution point and the route guidance information. It becomes possible.

 また、本実施例の情報表示端末10Aは、車両Mが案内地点に接近した場合には、風景画像の地面近傍(例えば、路面上)の位置に運転支援画像を重畳して表示させる。これにより、車両Mを運転するドライバは、運転注意地点の位置やルート案内を路面と対応付けて具体的に認識することが可能となる。 In addition, when the vehicle M approaches the guidance point, the information display terminal 10A according to the present embodiment displays the driving support image superimposed on a position near the ground (for example, on the road surface) of the landscape image. Thereby, the driver who drives the vehicle M can specifically recognize the position of the driving caution point and the route guidance in association with the road surface.

 また、本実施例の情報表示端末10Aは、前方車両等の障害物が車両Mの進行方向に存在する場合には、車両Mの案内地点への接近に応じて、障害物の一部(例えば、内部)を透過させて示す透過画像を表示させる。これにより、車両Mを運転するドライバは、障害物に妨げられることなく、運転注意地点の位置やルート案内を認識することが可能となる。 In addition, when an obstacle such as a forward vehicle is present in the traveling direction of the vehicle M, the information display terminal 10A according to the present embodiment is configured so that part of the obstacle (for example, , Inside) is displayed and a transparent image is displayed. Thereby, the driver who drives the vehicle M can recognize the position of the driving caution point and the route guidance without being obstructed by the obstacle.

 図6及び図7を参照しつつ、実施例2の情報表示システムについて説明する。本実施例の情報表示システムは、情報表示端末10Aの表示部15の構成及び動作において、図2に示した実施例1の情報表示システムと異なる。 The information display system according to the second embodiment will be described with reference to FIGS. The information display system of the present embodiment differs from the information display system of the first embodiment shown in FIG. 2 in the configuration and operation of the display unit 15 of the information display terminal 10A.

 本実施例の表示部15は、車両Mの前方の実際の風景に重畳して虚像を表示するヘッドアップディスプレイ(HUD:Head-up Display)である。表示部15は、運転注意地点指示画像及びルート案内画像を含む運転支援画像を虚像として表示する。 The display unit 15 of the present embodiment is a head-up display (HUD) that displays a virtual image superimposed on the actual scenery in front of the vehicle M. The display unit 15 displays a driving assistance image including a driving caution point instruction image and a route guidance image as a virtual image.

 図6に示すように、表示部15は、投影装置31及び反射鏡32を有する。投影装置31は、画像処理部14が生成した運転支援画像を示す画像光を反射鏡32に向けて投射する。反射鏡32で反射された画像光は、車両MのフロントガラスFGで反射してドライバの瞳に入射する。 As shown in FIG. 6, the display unit 15 includes a projection device 31 and a reflecting mirror 32. The projection device 31 projects image light indicating the driving assistance image generated by the image processing unit 14 toward the reflecting mirror 32. The image light reflected by the reflecting mirror 32 is reflected by the windshield FG of the vehicle M and enters the driver's pupil.

 図7を参照しつつ、本実施例の情報表示端末10Aが実行する情報表示処理ルーチンRT3について説明する。情報表示端末10Aの端末制御部13は、車両MのACC電源がオンになると、情報表示処理ルーチンRT3を開始する。 The information display processing routine RT3 executed by the information display terminal 10A of the present embodiment will be described with reference to FIG. When the ACC power supply of the vehicle M is turned on, the terminal control unit 13 of the information display terminal 10A starts an information display processing routine RT3.

 位置検出部18は、車両Mの現在位置を示す現在位置情報を取得する(ステップS301)。 The position detection unit 18 acquires current position information indicating the current position of the vehicle M (step S301).

 端末制御部13は、端末通信部19を制御して、車両Mの現在位置情報及び車両Mに設定されている進行予定経路の経路情報を含む移動情報をサーバ装置10Bに送信させる(ステップS302)。端末通信部19は、当該移動情報を所定の時間間隔おきにサーバ装置10Bに送信してもよい。 The terminal control unit 13 controls the terminal communication unit 19 to cause the server device 10B to transmit movement information including the current position information of the vehicle M and the route information of the scheduled travel route set in the vehicle M (step S302). . The terminal communication unit 19 may transmit the movement information to the server device 10B at predetermined time intervals.

 端末通信部19は、送信した移動情報に基づいてサーバ装置10Bにおいて生成された、車両Mの周辺の運転注意地点の情報やルート案内の情報を含む運転支援情報を受信する(ステップS303)。 The terminal communication unit 19 receives the driving support information including the information on the driving caution points around the vehicle M and the route guidance information generated in the server device 10B based on the transmitted movement information (step S303).

 端末制御部13は、受信した運転支援情報に基づいて、車両Mの進行方向に位置する運転注意地点や交差点等の案内地点を特定し、車両Mの現在位置が当該案内地点から所定距離の範囲内であるか否かを判定する(ステップS304)。 Based on the received driving support information, the terminal control unit 13 specifies a guide point such as a driving caution point or an intersection located in the traveling direction of the vehicle M, and the current position of the vehicle M is within a predetermined distance from the guide point. It is determined whether it is within (step S304).

 車両Mの現在位置が案内地点から所定距離の範囲内ではないと判定すると(ステップS304:No)、端末制御部13は、画像処理部14を制御して、移動体の運転を支援する運転支援画像を風景画像の上空の位置に表示するための上空支援画像を生成させる。画像処理部14は、ステップS103で受信した運転支援情報に基づいて、運転注意地点を示す運転注意地点指示画像及びルート案内画像を含む運転支援画像を上空支援画像として生成する(ステップS305)。 If it is determined that the current position of the vehicle M is not within a predetermined distance from the guidance point (step S304: No), the terminal control unit 13 controls the image processing unit 14 to support driving of the moving object. A sky support image for displaying the image at a position above the landscape image is generated. Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving caution point instruction image indicating a driving caution point and a route guidance image as an aerial support image (step S305).

 表示部15の投影装置31は、上空支援画像に対応する画像光を反射鏡32の上端側に投射する(ステップS306)。反射鏡32の上端側で反射した画像光は、フロントガラスFGの上端部側で反射してドライバの瞳に入射する。図6に示すように、ドライバはフロントガラスFG越しに車両Mの前方の風景の上空付近に重畳された上空支援画像UGを視認する。 The projection device 31 of the display unit 15 projects image light corresponding to the sky support image onto the upper end side of the reflecting mirror 32 (step S306). The image light reflected on the upper end side of the reflecting mirror 32 is reflected on the upper end side of the windshield FG and enters the driver's pupil. As shown in FIG. 6, the driver visually recognizes the sky support image UG superimposed on the vicinity of the sky in front of the vehicle M through the windshield FG.

 ステップS304において車両Mの現在位置が案内地点から所定距離の範囲内であると判定すると(ステップS304:Yes)、端末制御部13は、画像処理部14を制御して、移動体の運転を支援する運転支援画像を風景画像の路面上に表示するための路面支援画像を生成させる。画像処理部14は、ステップS103で受信した運転支援情報に基づいて、運転注意地点を示す運転注意地点指示画像及びルート案内画像を含む運転支援画像を路面支援画像として生成する(ステップS307)。 If it is determined in step S304 that the current position of the vehicle M is within a predetermined distance from the guidance point (step S304: Yes), the terminal control unit 13 controls the image processing unit 14 to support driving of the moving object. A road surface support image for displaying the driving support image to be displayed on the road surface of the landscape image is generated. Based on the driving support information received in step S103, the image processing unit 14 generates a driving support image including a driving attention point instruction image indicating a driving attention point and a route guidance image as a road surface support image (step S307).

 表示部15の投影装置31は、路面支援画像に対応する画像光を反射鏡32の下端側に投射する(ステップS308)。反射鏡32の下端側で反射した画像光は、フロントガラスFGの下端部側で反射してドライバの瞳に入射する。図6に示すように、ドライバはフロントガラスFG越しに車両Mの前方の風景の地面近傍に重畳された路面支援画像DGを視認する。 The projection device 31 of the display unit 15 projects image light corresponding to the road surface support image onto the lower end side of the reflecting mirror 32 (step S308). The image light reflected on the lower end side of the reflecting mirror 32 is reflected on the lower end side of the windshield FG and enters the driver's pupil. As shown in FIG. 6, the driver visually recognizes the road surface support image DG superimposed on the vicinity of the ground in the scenery in front of the vehicle M through the windshield FG.

 以上のように、本実施例の情報表示端末10Aは、車両Mが運転注意地点や交差点等の案内地点から離れている場合には、車両Mの前方の風景の上空の位置に運転支援画像の虚像を重畳して表示させる。これにより、車両Mを運転するドライバは、障害物の有無等の路面の状況に関わらず運転支援画像を視認することができ、運転注意地点の位置やルート案内の情報を大まかに把握することが可能となる。 As described above, the information display terminal 10 </ b> A according to the present embodiment allows the driving support image to be displayed at a position above the scenery in front of the vehicle M when the vehicle M is away from a guide point such as a driving caution point or an intersection. A virtual image is superimposed and displayed. Thereby, the driver who drives the vehicle M can visually recognize the driving assistance image regardless of the road surface condition such as the presence or absence of an obstacle, and can roughly grasp the position of the driving caution point and the route guidance information. It becomes possible.

 また、本実施例の情報表示端末10Aは、車両Mが案内地点に接近した場合には、車両Mの前方の風景の地面近傍(例えば、路面上)の位置に運転支援画像の虚像を重畳して表示させる。これにより、車両Mを運転するドライバは、運転注意地点の位置やルート案内を路面と対応付けて具体的に認識することが可能となる。 In addition, when the vehicle M approaches the guidance point, the information display terminal 10A according to the present embodiment superimposes a virtual image of the driving assistance image at a position near the ground (for example, on the road surface) of the scenery in front of the vehicle M. To display. Thereby, the driver who drives the vehicle M can specifically recognize the position of the driving caution point and the route guidance in association with the road surface.

 なお、本発明は上記実施形態に限定されない。例えば、上記実施例では、情報表示端末10Aが、移動体としての車両Mに搭載されている例について説明した。しかし、情報表示端末10Aは車載ナビゲーション装置のような車載装置に限定されず、ナビゲーション機能を実行可能な携帯端末やスマートフォン等であっても良い。 The present invention is not limited to the above embodiment. For example, in the above-described embodiment, an example in which the information display terminal 10A is mounted on the vehicle M as a moving body has been described. However, the information display terminal 10A is not limited to a vehicle-mounted device such as a vehicle-mounted navigation device, and may be a mobile terminal or a smartphone that can execute a navigation function.

 また、上記実施例1では、表示部15が障害物の内部や下側部分を透過して示す透過画像を表示する例について説明した。しかし、透過画像において透過する対象は障害物の内部や下側部分に限られず、障害物の少なくとも一部を透過させるものであれば良い。 In the first embodiment, the example in which the display unit 15 displays a transparent image that is transmitted through the inside and the lower part of the obstacle has been described. However, the target to be transmitted in the transmission image is not limited to the inside or the lower part of the obstacle, and any object that transmits at least a part of the obstacle may be used.

 また、上記実施例1では、透過画像とともに障害物の輪郭を示す画像を表示する例や、障害物の上側部分を残しつつ下側部分を透過させる例について説明した。しかし、これらとは異なり、障害物全体が透過された画像(すなわち、障害物が完全に見えない状態の画像)を透過画像として表示しても良い。この場合、画像処理部14による代替画像のトリミングを経ることなく、代替画像をそのまま透過画像として表示することが可能である。 In the first embodiment, an example in which an image showing the outline of an obstacle is displayed together with the transmission image, and an example in which the lower part is transmitted while leaving the upper part of the obstacle have been described. However, unlike these, an image in which the entire obstacle is transmitted (that is, an image in which the obstacle is not completely visible) may be displayed as a transmitted image. In this case, it is possible to display the substitute image as it is as a transparent image without undergoing trimming of the substitute image by the image processing unit 14.

 また、上記実施例では、車両Mから案内地点までの距離が所定距離以上である場合には上空の位置に運転支援画像を表示し、所定距離未満である場合には地面近傍(例えば、路面上)に運転支援画像を表示する場合を例として説明した。しかし、運転支援画像を表示する位置はこれらに限られず、表示部15は、車両Mから案内地点までの距離が所定距離以上である場合には、風景画像中の第1の高さの位置に運転支援画像を表示し、所定距離未満である場合には第1の高さよりも低い第2の高さの位置に運転支援画像を表示するものであれば良い。すなわち、表示部15は、車両Mから案内地点までの距離に応じて運転支援画像の表示位置の高さを変更するものであれば良い。 Further, in the above embodiment, when the distance from the vehicle M to the guide point is equal to or greater than the predetermined distance, the driving support image is displayed at an empty position. The case where the driving support image is displayed in FIG. However, the position where the driving support image is displayed is not limited to these, and the display unit 15 is positioned at the first height position in the landscape image when the distance from the vehicle M to the guide point is equal to or greater than the predetermined distance. A driving assistance image may be displayed as long as the driving assistance image is displayed at a second height lower than the first height if the driving assistance image is less than the predetermined distance. That is, the display part 15 should just change the height of the display position of a driving assistance image according to the distance from the vehicle M to a guidance point.

 また、表示部15は、車両Mから案内地点までの距離に応じて運転支援画像の表示位置の高さを変更することに加えて、障害物の有無に応じて運転支援画像の表示位置の高さを変更しても良い。例えば、表示部15は、車両Mの進行方向に前方車両等の障害物が存在し且つ案内地点までの距離が所定距離以上である場合には第1の高さ(例えば、上空)の位置に運転支援画像を表示し、障害物が存在せず且つ案内地点までの距離が所定距離以上である場合には第1の高さよりも低い第2の高さの位置(例えば、路面から数メートルの高さに浮揚した状態)で運転支援画像を表示し、案内地点までの距離が所定距離未満となった場合には障害物の有無にかかわらず第2の高さよりも低い第3の高さ(例えば、路面上)の位置に運転支援画像を表示する構成であっても良い。 In addition to changing the height of the display position of the driving support image according to the distance from the vehicle M to the guide point, the display unit 15 increases the display position of the driving support image according to the presence or absence of an obstacle. You may change the size. For example, when there is an obstacle such as a preceding vehicle in the traveling direction of the vehicle M and the distance to the guide point is equal to or greater than a predetermined distance, the display unit 15 is positioned at the first height (for example, the sky). A driving assistance image is displayed, and when there is no obstacle and the distance to the guide point is equal to or greater than a predetermined distance, a second height position lower than the first height (for example, several meters from the road surface) When the distance to the guide point is less than the predetermined distance, the third height (lower than the second height) is displayed regardless of the presence or absence of obstacles. For example, a configuration in which a driving assistance image is displayed at a position on the road surface may be employed.

10 情報表示システム
10A 情報表示端末
10B サーバ装置
11 カメラ
12 端末記憶部
13 端末制御部
14 画像処理部
15 表示部
16 音声出力部
17 操作入力部
18 位置検出部
19 端末通信部
21 サーバ通信部
22 サーバ記憶部
22A 地図情報DB
22B 風景画像DB
23 サーバ制御部
24 受信画像記憶制御部
25 送信情報生成部
31 投影装置
32 反射鏡
DESCRIPTION OF SYMBOLS 10 Information display system 10A Information display terminal 10B Server apparatus 11 Camera 12 Terminal memory | storage part 13 Terminal control part 14 Image processing part 15 Display part 16 Audio | voice output part 17 Operation input part 18 Position detection part 19 Terminal communication part 21 Server communication part 22 Server Storage unit 22A Map information DB
22B Landscape image DB
23 Server Control Unit 24 Received Image Storage Control Unit 25 Transmission Information Generation Unit 31 Projector 32 Reflector

Claims (8)

 移動体の周囲の風景画像を取得する画像取得部と、
 前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景画像に重畳して表示部に表示させる表示制御部と、
 を有し、
 前記表示制御部は、前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景画像内における高さを変更する、
 ことを特徴とする情報表示制御装置。
An image acquisition unit for acquiring a landscape image around the moving body;
A display control unit that displays a driving support image for supporting a predetermined point around the moving body and supporting the driving of the moving body on the landscape image on the display unit;
Have
The display control unit changes a height of the display position of the driving assistance image in the landscape image based on a distance from the moving body to the predetermined point.
An information display control device characterized by that.
 前記表示制御部は、前記移動体から前記所定の地点までの距離が所定距離以上である場合には、前記風景画像中の第1の高さの位置に前記運転支援画像を表示させ、
 前記移動体から前記所定の地点までの距離が所定距離未満である場合には、前記風景画像中の前記第1の高さよりも低い第2の高さの位置に前記運転支援画像を表示させる、
 ことを特徴とする請求項1に記載の情報表示制御装置。
The display control unit displays the driving assistance image at a first height position in the landscape image when the distance from the moving body to the predetermined point is equal to or greater than a predetermined distance,
When the distance from the moving body to the predetermined point is less than a predetermined distance, the driving support image is displayed at a position having a second height lower than the first height in the landscape image.
The information display control device according to claim 1.
 前記表示制御部は、前記移動体から前記所定の地点までの距離が所定距離以上である場合には、前記風景画像中の上空の位置に前記運転支援画像を表示させ、
 前記移動体から前記所定の地点までの距離が所定距離未満である場合には、前記風景画像中の地面近傍の位置に前記運転支援画像を表示させる、
 ことを特徴とする請求項1又は2に記載の情報表示制御装置。
When the distance from the moving body to the predetermined point is equal to or greater than a predetermined distance, the display control unit displays the driving support image at an empty position in the landscape image,
When the distance from the moving body to the predetermined point is less than a predetermined distance, the driving support image is displayed at a position near the ground in the landscape image.
The information display control apparatus according to claim 1, wherein the information display control apparatus is a display apparatus.
 前記移動体の進行予定経路の情報を取得する情報取得部を有し、
 前記表示制御部は、前記所定の地点を示す画像及び前記移動体の前記進行予定経路を示すルート案内画像を前記運転支援画像として表示させることを特徴とする請求項1乃至3のいずれか1に記載の情報表示制御装置。
Having an information acquisition unit for acquiring information on the travel schedule route of the mobile body;
4. The display control unit according to claim 1, wherein the display control unit displays an image indicating the predetermined point and a route guidance image indicating the planned travel route of the moving body as the driving support image. 5. The information display control device described.
 他の装置との間で無線通信を行う通信部を有し、
 前記画像取得部は、前記移動体の周囲を撮影して前記風景画像を取得し、
 前記表示制御部は、前記画像取得部が取得した前記風景画像及び前記通信部が前記他の装置から受信した画像に基づいて、前記運転支援画像を前記風景画像に重畳して表示させることを特徴とする請求項1乃至4のいずれか1に記載の情報表示制御装置。
Having a communication unit that performs wireless communication with other devices,
The image acquisition unit acquires the landscape image by photographing the periphery of the moving body,
The display control unit displays the driving support image superimposed on the landscape image based on the landscape image acquired by the image acquisition unit and the image received by the communication unit from the other device. The information display control device according to any one of claims 1 to 4.
 移動体の前方の風景に重畳して虚像を表示する表示部に、前記虚像を表示させる情報表示制御装置であって、
 前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景に重畳して表示させ、前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景内における高さを変更する前記表示制御部を有することを特徴とする情報表示制御装置。
An information display control device that displays the virtual image on a display unit that displays the virtual image superimposed on the scenery in front of the moving body,
A driving support image related to a predetermined point around the moving body and supporting the driving of the moving body is displayed superimposed on the landscape, and the driving support is based on a distance from the moving body to the predetermined point. An information display control device comprising the display control unit that changes a height of an image display position in the landscape.
 表示部に画像を表示させる情報表示制御装置が実行する情報表示制御方法であって、
 移動体の周囲の風景画像を取得するステップと、
 前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景画像に重畳して表示させるステップと、
 前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景画像内における高さを変更するステップと、
 を含むことを特徴とする情報表示制御方法。
An information display control method executed by an information display control device for displaying an image on a display unit,
Obtaining a landscape image around the moving object;
Displaying a driving assistance image that is related to a predetermined point around the moving body and that supports driving of the moving body, superimposed on the landscape image;
Changing the height of the display position of the driving support image in the landscape image based on the distance from the moving body to the predetermined point;
An information display control method comprising:
 コンピュータに、
 移動体の周囲の風景画像を取得するステップと、
 前記移動体の周囲の所定の地点に関しかつ前記移動体の運転を支援する運転支援画像を前記風景画像に重畳して表示するステップと、
 前記移動体から前記所定の地点までの距離に基づいて、前記運転支援画像の表示位置の前記風景画像内における高さを変更するステップと、
 を実行させることを特徴とする情報表示制御プログラム。
On the computer,
Obtaining a landscape image around the moving object;
Displaying a driving support image that is related to a predetermined point around the moving body and supports driving of the moving body, superimposed on the landscape image;
Changing the height of the display position of the driving support image in the landscape image based on the distance from the moving body to the predetermined point;
An information display control program for executing
PCT/JP2018/004240 2018-02-07 2018-02-07 Information display control device, information display control method, and information display control program Ceased WO2019155557A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/004240 WO2019155557A1 (en) 2018-02-07 2018-02-07 Information display control device, information display control method, and information display control program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/004240 WO2019155557A1 (en) 2018-02-07 2018-02-07 Information display control device, information display control method, and information display control program

Publications (1)

Publication Number Publication Date
WO2019155557A1 true WO2019155557A1 (en) 2019-08-15

Family

ID=67548953

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/004240 Ceased WO2019155557A1 (en) 2018-02-07 2018-02-07 Information display control device, information display control method, and information display control program

Country Status (1)

Country Link
WO (1) WO2019155557A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113538965A (en) * 2020-04-16 2021-10-22 丰田自动车株式会社 Display control device, display control method, and recording medium having program recorded thereon
US11670187B2 (en) * 2020-06-19 2023-06-06 Toyota Jidosha Kabushiki Kaisha Information processing device, information processing system, program, and vehicle

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009264835A (en) * 2008-04-23 2009-11-12 Panasonic Corp Navigation device, navigation method and navigation program
JP2012208111A (en) * 2011-12-05 2012-10-25 Pioneer Electronic Corp Image display device and control method
JP2013079930A (en) * 2012-02-07 2013-05-02 Pioneer Electronic Corp Head-up display, control method, and display device
JP2014037978A (en) * 2012-08-10 2014-02-27 Aisin Aw Co Ltd Intersection guide system, method and program
JP2015105903A (en) * 2013-12-02 2015-06-08 パイオニア株式会社 Navigation device, head-up display, control method, program, and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009264835A (en) * 2008-04-23 2009-11-12 Panasonic Corp Navigation device, navigation method and navigation program
JP2012208111A (en) * 2011-12-05 2012-10-25 Pioneer Electronic Corp Image display device and control method
JP2013079930A (en) * 2012-02-07 2013-05-02 Pioneer Electronic Corp Head-up display, control method, and display device
JP2014037978A (en) * 2012-08-10 2014-02-27 Aisin Aw Co Ltd Intersection guide system, method and program
JP2015105903A (en) * 2013-12-02 2015-06-08 パイオニア株式会社 Navigation device, head-up display, control method, program, and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113538965A (en) * 2020-04-16 2021-10-22 丰田自动车株式会社 Display control device, display control method, and recording medium having program recorded thereon
US11670187B2 (en) * 2020-06-19 2023-06-06 Toyota Jidosha Kabushiki Kaisha Information processing device, information processing system, program, and vehicle

Similar Documents

Publication Publication Date Title
JP2023165757A (en) Information display control device, information display control method, and information display control program
JP5921320B2 (en) Display system, portable device, in-vehicle device, and program
US20190360837A1 (en) Navigation system, computer program product, and in-vehicle apparatus
JP2017207340A (en) Travel plan creation device and center
KR20190109336A (en) A way guidance service supporting device based on the driver gaze, and navigation system using the same
WO2021095481A1 (en) Driving assistance method, roadside device, and in-vehicle device
JP2007292713A (en) Navigation device
CN108225340A (en) Automatic driving assistance system and method thereof
JP2020112542A (en) Display system, display control device, and display control program
JP2016012277A (en) Vehicle communication device and communication system
CN113167592A (en) Information processing apparatus, information processing method, and information processing program
CN110462699A (en) Vehicle display control device and vehicle display unit
KR20150066036A (en) Position Guidance System and Method Using Transparency Navigation
JP2015172548A (en) Display control device, control method, program, and recording medium
JP2021033944A (en) Communication equipment, communication methods and programs
JP5955662B2 (en) Augmented reality system
JP2014211431A (en) Navigation device, and display control method
US11187552B2 (en) Server apparatus and information processing method to process guidance route information acquired from a vehicle
JPWO2017013792A1 (en) Display control device and navigation device
WO2019155557A1 (en) Information display control device, information display control method, and information display control program
JP2019105581A (en) Navigation device
JP4800252B2 (en) In-vehicle device and traffic information presentation method
JP2019120652A (en) Display device for vehicle
JP2008021234A (en) Driving support image display system and on-vehicle device
JP6424100B2 (en) NAVIGATION SYSTEM, NAVIGATION DEVICE, GLASS TYPE DEVICE, AND METHOD FOR LINKING THE DEVICE

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18905469

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18905469

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP