DE102008041295A1 - Mobile navigation device and related method - Google Patents

Abstract

In order to further develop a mobile navigation device (10) and a method for providing at least one additional navigation-related functionality and / or at least one additional driver assistance function in such a mobile navigation device (10) in such a way that additional driver and / or pedestrian functions can be implemented, at least one associated , in particular integrated, image recording unit or camera (30) proposed.

Description

Technical area

The The present invention relates to a mobile navigation device according to the preamble of claim 1 and a related method according to the preamble of claim 6.

State of the art

mobile Navigation devices have been growing in recent years Acceptance, because such devices offer in addition to the conventional Vehicle navigation based on G [lobal] P [ositioning] S [ystem] data, Gyro data and / or map data, also a pedestrian navigation function, based on GPS signals the user to the desired Target directs.

The mobile navigation devices available today are characterized by a graphical or linguistic output function for map data obtained by means of different storage media the navigation device can be loaded.

Of Furthermore, mobile navigation devices with additional, non-navigation-relevant functionalities be, for example, with an MP3 player. As a rule, today is no purely mobile navigation device (except P [ersonal] D [igital] A [ssitant] s or so-called SmartPhones) with an image acquisition unit or Camera (unit) equipped.

on the other hand is in modern vehicles a variety of different assistance functions, for Example concerning adaptive traffic management (ACC = Adaptive Cruise Control) and / or a warning when leaving the Lane Departure Warning (LDW), which includes the driver assist in driving and in safety critical Warn situations. Such systems are able to provide a critical To recognize situation and a warning with the help of the appropriate display systems to send to the driver, be it visually, acoustically and / or haptically.

Of Furthermore, it should be noted in the prior art that for video-based monitoring of the environment of a motor vehicle as well as for the realization of driver assistance functions, which require an additional automatic image analysis (lane assistance, Traffic sign recognition and the like), in addition to fixed in the motor vehicle installed cameras already remote, subsequently camera modules to be mounted have been proposed.

As an example, this is the driver assistance system FAS intended for passenger cars 100 to name the company ALAN Electronics GmbH. This video analysis system, referred to as intelligent by the manufacturer, which evaluates the images of the road surface captured by digital cameras in fractions of a second, which is served by an AplicationS [pecific] I [ntegrated] C [ircuit] video processor, has a camera module and a Control unit on. The camera module is mounted in the center of the windscreen (below the rearview mirror) and the control unit can be placed on the dashboard or in a clamp mount.

For Such camera modules have been used in the case of purely indicative functions in particular, the wireless image transmission to a for the driver visible display and the power supply from a battery (mulatoren) unit proposed. As a display, mobile computers have been proposed among others.

Furthermore, in the prior art, for example in the document WO 2004/074046 A1 , the use of mobile computers, including cell phones, mobile phones and personal computers, with an integrated camera for video-based driver assistance functions. It has been proposed here that the image processing module and the display unit are formed by a microcomputer, in particular by a mobile telephone or by a palmtop or by a personal digital assistant (PDA).

in this connection represents the integration of the image processing module in the vehicle interior sure that this image processing module does not have strong temperature fluctuations or extreme temperatures is exposed. By doing that, the image processing module and the display of the image processing device by the processor module and the display of the microcomputer can be formed the requirements for electromechanical stability and significantly reduced the longevity of this known system become.

• – auf die Druckschrift WO 2006/132522 A1 , in der eine kombinierte Anzeige von Livebild und Navigationshinweisen, zum Beispiel von Richtungspfeilen, für ein mobiles Navigationssystem vorgeschlagen wird, sowie
• – auf die Druckschrift WO 2007/101755 A1 , in der ein Verfahren und eine Anordnung zur Anzeige mindestens eines Navigationshinweises eines Navigationssystems in einem Fahrzeug vorgeschlagen wird, wobei ein Ausschnitt der Fahrzeugumgebung von einer Kamera aufgenommen und als Umgebungsbildfolge mittels einer Anzeigeeinheit angezeigt wird, wobei der Navigationshinweis ebenfalls mittels der Anzeigeeinheit angezeigt wird, und wobei bei Bewegung des Fahrzeugs die Position des mindestens einen Navigationshinweises innerhalb der Umgebungsbildfolge in Abhängigkeit von der relativ zum Fahrzeug erfolgenden Bewegung der Umgebung verändert wird.

Furthermore, attention should be drawn to the state of the art

• - to the publication WO 2006/132522 A1 in which a combined display of live image and navigation hints, for example of directional arrows, for a mobile navigation system is proposed, as well
• - to the publication WO 2007/101755 A1 in which a method and an arrangement for displaying at least one navigation instruction of a navigation system in a vehicle is proposed, wherein a section of the vehicle environment is taken by a camera and displayed as an environmental image sequence by means of a display unit, wherein the navigation instruction is also displayed by means of the display unit and wherein upon movement of the vehicle, the position of the at least one navigation indication within the environmental image sequence is changed in dependence on the movement of the environment relative to the vehicle.

Illustration of the present invention: Task, solution, benefits

outgoing from the disadvantages and shortcomings set out above and in appreciation of the outlined prior art The present invention is based on the object of a mobile Navigation device of the type mentioned in the technical field and to develop a method of the type mentioned in the technical field so that additional driver and / or pedestrian functions can be realized.

The The object of the present invention is a mobile navigation device with the features specified in claim 1 and by a method solved with the features specified in claim 6. advantageous Embodiments and expedient developments The present invention is defined in the respective subclaims characterized.

The The present invention is based on equipment or equipment a mobile navigation device with at least one image acquisition unit or with at least one camera (unit), that is on the implementation of at least one image acquisition unit or at least a camera in a mobile navigation device.

The Equipment or equipment of a mobile navigation device with at least one image acquisition unit or at least one Camera allows additional functionality. The image capture unit or camera allows you to capture the Pedestrian routes that are stored directly can and / or as route guidance to acquaintances can be passed on, and saves the cumbersome Take along additional recording devices, for Example of digital cameras.

If the image recording unit or camera for the aforementioned Functions is not or not only used, it may (also) be used for the realization of driver assistance functions.

• – die in einem mobilen Navigationsgerät ohnehin verbaute oder
• – mindestens eine mit einem mobilen Navigationsgerät verbundene externe

Kamera zur Realisierung von konventionellerweise auf diesen Geräten vorhandenen anzeigenden und/oder warnenden Fahrerassistenzfunktionen.Here, the present invention uses in its various forms

• - Which built in a mobile navigation device anyway or
• - At least one connected to a mobile navigation device external

Camera for the realization of conventionally present on these devices displaying and / or warning driver assistance functions.

therefore become by means of the present invention in a mobile navigation device any existing components, such as processor or computer, Display or display unit and optionally image acquisition unit or camera, to take advantage of in addition to today's usual Other customer-friendly, in particular driver assistance, To realize functions. This way, even by pure Software components, the customer benefits of mobile navigation devices compared to conventional systems at low cost Be increased.

The The present invention finally relates to the use at least one mobile navigation device according to the set out above and / or a method according to the set forth above for video-based driver assistance functions and / or for video-based pedestrian assistance functions.

Brief description of the drawings

As already discussed above, there are various possibilities for embodying and developing the teaching of the present invention in an advantageous manner. For this purpose, reference is made on the one hand to the claims subordinate to claim 1 and claim 6, on the other hand, further embodiments, features and advantages of the present invention will be described below with reference to 1 illustrated embodiment explained in more detail.

It shows:

1 a schematic representation of an embodiment of a mobile navigation device according to the present invention, which operates according to the method according to the present invention.

Best way to execute of the present invention

At the in 1 exemplified mobile navigation device 10 is via at least one image processing module 20 at least one camera module 30 connected, with the camera module 30 in the mobile navigation device 10 can be implemented or integrated or as shown 1 illustrates, wired or wireless with the mobile navigation device 10 can be connected.

That of at least one such camera 30 captured image is sent to the (optional) image processing module 20 transferred, the Image processing module 20 in the mobile navigation device 10 can be integrated or, as shown 1 illustrated, may be performed separately or in the camera module 30 can be integrated, be it in a realization as hardware and / or in a realization as software, for example in the form of an image / video processing software as part of at least one software kernel or software kernel.

The to the image processing module 20 transferred image is processed there and after one or more such processing steps either completely or in excerpts, be it unchanged or modified, by means of the mobile navigation device 10 displayed, be it on display 12 of the mobile navigation device 10 yourself or on one to the mobile navigation device 10 connected external display 12 ,

• – mindestens eines Warnhinweises für den Fahrzeugführer und/oder mindestens einen etwaig anwesenden Beifahrer und/oder
• – mindestens einer Projektion mindestens einer Führungslinie, zum Beispiel in Videosequenzen.

This display documents that the information gained in image processing can be used for driver assistance, for example in form

• - at least one warning for the driver and / or at least one passenger who may be present and / or
• - At least one projection of at least one guide line, for example in video sequences.

Alternatively, the image is not displayed, but only one of image processing depending on the situation generated warning and / or message from the mobile navigation device 10 further processed and / or stored and / or output.

Assuming that mobile navigation devices in their conventional design are portable devices without image acquisition functionality and / or without telephone functionality, the present invention thus offers the advantage that with the camera 30 , additional driver assistance functionalities can be realized.

If the camera 30 is not used by other applications, for example if the mobile navigation device 10 connected to the vehicle infrastructure, the camera 30 be used for monitoring the traffic situation. The recorded video sequences or digital photos are taken with the image editing software 20 edited, for example, to measure the distance to vehicles in front or to recognize leaving the selected lane.

Based on this information used in image processing 20 can be obtained, the driver can be warned by different warning mechanisms against a dangerous situation in a timely manner, which contributes to accident prevention.

Furthermore, those of the camera 30 recorded video / video sequences are used as a basis for further navigation applications (for example, so-called Videonavi) in which directional arrows of the route guidance can be projected directly into the image sequence.

The present invention thus offers the possibility of existing resources, for example camera 30 and computing power of the mobile navigation device 10 to optimally use and realize additional driver assistance functionalities.

With regard to such additional driver assistance functionalities, the realization of different driver assistance functions, listed below and briefly described, comes about on a mobile navigation device 10 in question, being the mobile navigation device 10 either has an internal camera or wired or by radio transmission, so wirelessly to at least one external camera 30 is tied up (cf. 1 ).

• – den Innenraum (vgl. nachstehend Aufmerksamkeitsüberwachung, Kinderüberwachung/Laderaumüberwachung, videounterstützte Kommunikation) und/oder
• – das Umfeld (vgl. nachstehend Rückfahrkamera, Seitenkameras, Blindspot-Überwachung oder Totpunktüberwachung, Fahrspurverlassenswarnung, Verkehrszeichenerkennung, Videonavigation, aufbereitetes Nachtbild, P[oint]O[f]I[nterest] aus Fahrzeugführerperspektive/georeferenzierte Videos)

des Fahrzeugs.The camera 30 monitors here

• - the interior (see below: Attentive surveillance, child monitoring / cargo space monitoring, video-assisted communication) and / or
• - the environment (see rear view camera, side cameras, blind spot monitoring or dead center monitoring, lane departure warning, traffic sign recognition, video navigation, processed night image, P [oint] O [f] I [nterest] from driver's perspective / georeferenced videos)

of the vehicle.

When monitoring attention in the interior of a vehicle, the images of the camera directed inward toward the vehicle driver become 30 analyzed with methods of digital image processing such that due to the eyelid activity, the line of sight and / or posture on the attention and / or the fatigue of the driver can be deduced. If the driver shows signs of fatigue or if the driver is inattentive in critical situations, a warning is issued from the mobile navigation device 10 ,

In the case of child monitoring / loading space monitoring in the interior of a vehicle, the images of the rear area of the rear seat and / or the loading space of a passenger or heavy goods vehicle are recorded 30 in the display area or on the display 12 of the mobile navigation device 10 displayed.

In video-supported communication in the interior of a vehicle to simplify the communication between the driver or the passenger and the passengers in the rear of a video telephony similar system is used, the eye contact between the communi nikationspartnern allows without the driver or the passenger must turn backwards.

This will be the faces of the passengers with the camera 30 detected. The image is displayed on the screen 12 of the mobile device 10 , Optionally, a rear channel from the driver or the passenger to the passenger / passengers can be realized if the rear seats are equipped with display units or with displays.

When reversing in the environment of a vehicle, the image of the rear view camera 30 on the display 12 of the mobile navigation device 10 displayed. In the displayed image or next to the displayed image, guides or other symbols or numbers may optionally be displayed to assist the driver in parking the vehicle and / or maneuvering the vehicle. This auxiliary information can be obtained using methods of automatic and / or digital image processing 20 from the pictures of the camera 30 be won.

In the side camera function around a vehicle, the images of one or more cameras 30 , which observe the lateral or lateral environment of the vehicle and / or the vehicle sides, on the display 12 of the mobile navigation device 10 displayed. In the displayed image or next to the displayed image, guides or other symbols or numbers may optionally be displayed to assist the driver in driving through narrow gates or performing similar maneuvers. This auxiliary information can be obtained using methods of automatic and / or digital image processing 20 from the pictures of the camera (s) 30 be won.

Blind spot monitoring or dead center monitoring in the vicinity of a vehicle produces images of one or more cameras 30 , which monitor the lateral rearward or lateral rearward environment of the vehicle, on the display 12 of the mobile navigation device 10 displayed. With methods of automatic and / or digital image processing 20 Approaching passenger cars are recognized in this area. If there is a risk of collision, for example when overtaking a lane change, a warning is issued.

In lane departure warning in the vicinity of a vehicle, lane markings are left of the vehicle and / or right of the vehicle by one or more appropriately positioned cameras 30 observed. Inattentive driving over the lines is a warning on the mobile navigation device 10 ,

In traffic sign recognition in the vicinity of a vehicle, the images of a roughly aligned in the direction of travel camera 30 with methods of automatic and / or digital image processing 20 evaluated with the aim of detecting traffic signs.

A Possible character classes to be recognized here are speed limits and their cancellation. If such characters are recognized automatically, so this information is stored against a Map much more current and can be used to the driver, for example, when exceeded the currently allowed maximum speed to warn.

A Another possible character class are overtaking bans and their cancellation. Again, the driver referred to currently valid restrictions become. A display of the recognized character also has a memory function, that means the driver can check if he during a inattention phase at a corresponding Sign has passed by.

A improved level of expansion of the aforementioned variances exists in the additional Detection of restrictive additional characters, such as the restriction "Bei Wet ". Here can be a meaningful expression already in pure detection of presence of such additional signs consist. The driver then receives only the additional hint that a character is only valid to a limited extent is. Information about the type of restriction can be given if the sign not only detects, but is recognized. Reliable recognition of additional characters is because of their great diversity and given the comparatively small dimensions but very demanding.

Another possible character class are the triangular danger signs, such as deer, rockfall and the like. If these characters are recognized, then a corresponding note about the mobile navigation device 10 be issued. Furthermore, it is also possible here to display the recognized and / or detected characters only in order to realize a reminder function.

A character type that can be executed in the form of a special function is the sign "entrance forbidden" (= red circle with white crossbeam) at driveways. If this sign is recognized on the right side of the vehicle, then the Driver of the mobile navigation device 10 warned against an approach against the direction of travel (so-called "ghost driver").

Other possible character classes are signboards and city signs. In the simplest case, these can only be detected and as a section of the input image on the mobile navigation device 10 be displayed in the sense of a reminder function. In a further expansion stage, local entrance signs and local exit signs can be recognized as such and the maximum permissible maximum speed can be modified on the basis of this information.

The basic idea of video navigation in the environment of a vehicle is the simultaneous display of a live image of the camera oriented in the direction of travel 30 with navigation instructions, in particular with directional arrows on the display 12 of the mobile navigation device 10 , An important advantage of this display form is the ability to view the relevant environment of the vehicle while reading the mobile navigation device 10 to keep an eye on.

Next a side-by-side display of live image and navigation hints can use the navigation hints in more advanced systems also partially transparent or overlapping in the live image become. This can be especially considering the perspective of the image so that, for example, the impression a directional arrow would be right on the road in front of the vehicle.

• – durch Methoden der automatischen und/oder digitalen Bildverarbeitung 20 und/oder
• – durch Zusatzsensorik

die Nachführung der eingeblendeten Pfeile beim Gieren oder Nicken des Fahrzeugs sowie die Berücksichtigung des Verlaufs der Fahrspur vor dem Fahrzeug.In a first stage of such video navigation, the directional arrows are statically adapted to a medium perspective. Allow later expansion stages

• - by methods of automatic and / or digital image processing 20 and or
• - by additional sensors

the tracking of the arrows displayed when yawing or pitching the vehicle as well as the consideration of the course of the lane in front of the vehicle.

To display a live image on the display 12 of the mobile navigation device 10 , about for a video navigation, in addition to the unaltered image of the camera 30 also an image processed by image processing can be used. A treatment kenn can be used in particular at night to direct the attention of the driver to certain image areas and / or to improve the visibility of objects before driving convincing. It is also possible here to switch from daytime image to nighttime image, which is analogous to switching between daytime display and nighttime display of the map.

In conjunction with the mobile navigation system 10 can be a directional camera 30 can also be used to make individual recordings of a place of interest (so-called POI = point of interest) from the perspective of the driver and save these recordings with the position information. If a location stored in this way is to be approached again later, this can be done by selecting the corresponding picture from a list. The driver sees the image of the place he wants to drive from his perspective.

For Complex route sections, for example for roundabouts with multiple exits, can also record a video documenting the correctly recorded from the driver's point of view and possibly other (subsequent) drivers to provide.

For Motorcyclists can in a similar way the possibility of Video recording of a particularly appealing route section are created. The recorded video can then be shared with the associated geo-coordinates, for example on one Web server, provided as information for like-minded people become.

combinations the aforementioned functionalities, for example a warning only inattention of the driver, are also possible.

QUOTES INCLUDE IN THE DESCRIPTION

This list The documents listed by the applicant have been automated generated and is solely for better information recorded by the reader. The list is not part of the German Patent or utility model application. The DPMA takes over no liability for any errors or omissions.

Cited patent literature

• WO 2004/074046 A1 [0009]
• WO 2006/132522 A1 [0011]
• WO 2007/101755 A1 [0011]

Claims (15)

Mobile navigation device ( 10 ), characterized by at least one associated, in particular integrated, image recording unit or camera ( 30 ) for implementing at least one additional navigation-related functionality and / or at least one additional driver assistance function. Mobile navigation device according to claim 1, characterized in that the image recording unit or camera ( 30 ) wired or wirelessly with the mobile navigation device ( 10 ) connected is. Mobile navigation device according to claim 1 or 2, characterized in that the image recording unit or camera ( 30 ) Is configured as a rear camera for observing the rear area of the vehicle and / or as a side camera for observing at least one lateral or lateral area of the vehicle, and that additional information is extracted from the images of the rear camera or the side camera by means of image processing. 20 ) are obtainable. Mobile navigation device according to at least one of claims 1 to 3, characterized by at least one of the image recording unit or camera ( 30 ) downstream image processing ( 20 ), in particular image processing module or image processing software. Mobile navigation device according to claim 4, characterized in that the image processing ( 20 ) - in the mobile navigation device ( 10 ) or is implemented as a separate unit or as a separate module, or in the image acquisition unit or camera ( 30 ) is integrated. Method for providing at least one additional navigation-related functionality and / or at least one additional driver assistance function in a mobile navigation device ( 10 ), characterized by the evaluation of the at least one image of at least one of the mobile navigation device ( 10 ), in particular in the mobile navigation device ( 10 ) integrated, image capture unit or camera ( 30 ). A method according to claim 6, characterized in that in the attention monitoring in the interior of a vehicle, the image of the directed to the driver imaging unit or camera ( 30 ) by means of image processing ( 20 ), in particular by means of at least one image processing module or by means of image processing software is analyzed. A method according to claim 6 or 7, characterized in that in the monitoring, in particular in the child monitoring and / or loading space monitoring, in the interior of a vehicle, the image of the rear area, in particular rear seat, and / or the loading space receiving image recording unit or camera ( 30 ) in the display area or on the display ( 12 ) of the mobile navigation device ( 10 ) is shown. Method according to at least one of claims 6 to 8, characterized in that in the video-assisted communication in the interior of a vehicle, the faces of the vehicle passengers with the image recording unit or camera ( 30 ) and in the display area or on the display ( 12 ) of the mobile navigation device ( 10 ) are displayed. Method according to at least one of claims 6 to 9, characterized in that in the blind spot monitoring or dead center monitoring in the environment of a vehicle, the laterally rearward or laterally rearward environment of the vehicle by means of the image recording unit or camera ( 30 ) is monitored, in particular by means of image processing ( 20 ) in the lateral rearward or laterally rearward environment approaching vehicles are detected. Method according to at least one of claims 6 to 10, characterized in that - in the lane departure warning in the vicinity of a vehicle lane markings left of the vehicle and / or right of the vehicle of the camera ( 30 ) and that - in the inattentive driving over at least one line at least one warning via the mobile navigation device ( 10 ) is output. Method according to at least one of claims 6 to 11, characterized in that in the traffic sign recognition in the environment of a vehicle, the image of the at least roughly aligned in the direction of travel camera ( 30 ) by means of image processing ( 20 ) is evaluated with respect to recognizing at least one traffic sign. Method according to at least one of claims 6 to 12, characterized in that in video navigation in the environment of a vehicle at least one oriented in the direction of travel live image of the camera ( 30 ) simultaneously with at least one navigation instruction, in particular with at least one directional arrow, in the display area or on the display ( 12 ) of the mobile navigation device ( 10 ) is shown. Method according to at least one of claims 6 to 13, characterized in that the additional navigation-related functionality and / or the additional driver assistance function only by means of the camera ( 30 ) Detected inattention of the driver is activated. Use of a mobile navigation device ( 10 ) according to at least one of claims 1 to 5 and / or a method according to at least one of claims 6 to 14 for video-based driver assistance functions and / or for video-based pedestrian assistance functions.