[go: up one dir, main page]

CN104280034A - Vehicle-mounted navigation method and system based on panoramic videos - Google Patents

Vehicle-mounted navigation method and system based on panoramic videos Download PDF

Info

Publication number
CN104280034A
CN104280034A CN201310272535.XA CN201310272535A CN104280034A CN 104280034 A CN104280034 A CN 104280034A CN 201310272535 A CN201310272535 A CN 201310272535A CN 104280034 A CN104280034 A CN 104280034A
Authority
CN
China
Prior art keywords
picture
video
navigation
vehicle body
panoramic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310272535.XA
Other languages
Chinese (zh)
Inventor
杨金坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201310272535.XA priority Critical patent/CN104280034A/en
Priority to PCT/CN2014/077401 priority patent/WO2014166449A1/en
Publication of CN104280034A publication Critical patent/CN104280034A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3647Guidance involving output of stored or live camera images or video streams
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/207Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using multi-purpose displays, e.g. camera image and navigation or video on same display
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/302Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Navigation (AREA)

Abstract

The invention discloses a vehicle-mounted navigation method based on panoramic videos. The method includes the steps: acquiring multi-channel video images around a vehicle body and a navigation image of the vehicle body; and splicing and fusing the multi-channel video images into a one-channel panoramic video image, and displaying the panoramic video image and a simulation image of the vehicle body at a position of the vehicle body on the navigation image. At the same time, the invention also discloses a vehicle-mounted navigation system based on the panoramic videos. With adopting of the method and the system, vehicle-mounted navigation is preformed for a driver in a real panoramic image, and the user experience is improved.

Description

Vehicle navigation method and system based on panoramic video
Technical Field
The invention relates to a video processing technology and a vehicle navigation technology, in particular to a vehicle navigation method and a vehicle navigation system based on panoramic video.
Background
The Global Positioning System (GPS) is widely used in mobile devices, such as smart terminals and automobiles. When the GPS is loaded in a car, the navigation function provided by the GPS can provide accurate position information and navigation information to the driver.
Meanwhile, in the aspect of vehicle-mounted video monitoring, the integrated video compression chip and optical imaging enable real-time driving video recording, for example, a video monitoring device on a bus records monitored videos in real time.
However, the current car navigation system is not combined with the car video system or is simply combined with the car video system. For a driver, the real panoramic navigation environment can enable the user to concentrate on driving, and unnecessary traffic accidents caused by distraction are reduced, so that the problem that the real panoramic picture navigation is performed by fusing a video system into a navigation system is a problem which needs to be solved urgently at present.
Disclosure of Invention
In view of the above, the present invention mainly aims to provide a vehicle navigation method and system based on a panoramic video, which enable a driver to perform vehicle navigation in a real panoramic image, thereby improving user experience.
In order to achieve the purpose, the technical scheme of the invention is realized as follows:
a vehicle navigation method based on panoramic video comprises the following steps:
acquiring a plurality of paths of video pictures around a vehicle body and a navigation picture of the vehicle body;
and splicing and fusing the multiple paths of video pictures into a path of panoramic video picture, and displaying the panoramic video picture and the analog image of the vehicle body at the position of the vehicle body on the navigation picture.
Wherein, the multichannel video picture around acquireing the automobile body includes: acquiring at least four video pictures around the vehicle body through at least four camera devices arranged around the vehicle body; the at least four camera devices are respectively positioned at the front part, the rear part, the left part and the right part of the vehicle body.
Wherein, the navigation picture of the automobile body is as follows: a two-dimensional navigation screen, a three-dimensional navigation screen, or a satellite navigation screen.
Wherein, the splicing and fusing the multi-channel video pictures into one-channel panoramic video picture comprises the following steps:
determining an overlapping area of the multiple paths of video pictures, and acquiring a transformation relation of the multiple paths of video pictures according to the overlapping area;
and registering the multi-channel video pictures by using the transformation relation, splicing and fusing the registered multi-channel video pictures, and generating a path of panoramic video picture.
After acquiring the plurality of paths of video pictures around the vehicle body, the method further comprises the following steps:
storing the multi-channel video pictures; and/or the presence of a gas in the gas,
after the multi-channel video pictures are spliced and fused into one panoramic video picture, the method also comprises the following steps: and storing the panoramic video picture.
Wherein the displaying the panoramic video picture and the vehicle body on the navigation picture comprises:
scaling the navigation picture according to the panoramic video picture, and increasing the transparency of the navigation picture;
and displaying the panoramic video picture and the simulation image of the car body at the position of the car body on the navigation picture after the picture is scaled and the transparency is increased.
A panoramic video based in-vehicle navigation system, the system comprising: the system comprises a video device, a navigation device, a splicing and fusing device and a display device; wherein,
the video device is used for acquiring a plurality of paths of video pictures around the vehicle body;
the navigation device is used for acquiring a navigation picture of the vehicle body;
the splicing and fusing device is used for splicing and fusing the multiple paths of video pictures into one path of panoramic video picture;
the display device is used for displaying the panoramic video picture and the simulation image of the vehicle body at the position of the vehicle body on the navigation picture.
Wherein the video apparatus comprises at least four video units; the at least four video units are respectively positioned at the front part, the rear part, the left part and the right part of the vehicle body;
the video unit is used for acquiring a video picture around the vehicle body.
Wherein, the navigation picture of the automobile body is as follows: a two-dimensional navigation screen, a three-dimensional navigation screen, or a satellite navigation screen.
Wherein, concatenation fusion device includes: the device comprises a determining unit, an obtaining unit, a registering unit and a splicing fusion unit; wherein,
the determining unit is used for determining the overlapping area of the multiple paths of video pictures;
the acquisition unit is used for acquiring the transformation relation of the multiple paths of video pictures according to the overlapping area;
the registration unit is used for registering the multi-channel video pictures by using the transformation relation;
and the splicing and fusing unit is used for splicing and fusing the registered multi-channel video pictures and generating a path of panoramic video picture.
The system further comprises: the storage device is used for storing the multi-channel video pictures; and/or storing the panoramic video picture.
Wherein the display device includes: the display device comprises a scaling unit, a transparent unit and a display unit; wherein,
the scaling unit is used for scaling the navigation picture according to the panoramic video picture;
the transparent unit is used for increasing the transparency of the navigation picture;
the display unit is used for displaying the panoramic video picture and the simulation image of the car body at the position of the car body on the navigation picture after the picture is scaled and the transparency is increased.
The vehicle-mounted navigation method and system based on the panoramic video, provided by the invention, obtain a plurality of paths of video images around a vehicle body and a navigation image of the vehicle body; splicing and fusing the multiple paths of video pictures into a path of panoramic video picture, and displaying the panoramic video picture and the analog image of the vehicle body at the position of the vehicle body on the navigation picture; therefore, the driver can carry out vehicle navigation under a real panoramic picture, and the user experience is improved. Preferably, after the multiple paths of video pictures around the vehicle body are obtained, the multiple paths of video pictures are stored; and/or, storing the panoramic video picture; therefore, when a traffic accident occurs, real and reliable video data can be provided.
Drawings
FIG. 1 is a schematic flow chart of an implementation of a vehicle navigation method based on panoramic video according to an embodiment of the present invention;
FIG. 2 is a schematic structural component diagram of a vehicle navigation system based on panoramic video according to an embodiment of the present invention;
FIG. 3 is a block diagram of a video apparatus according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a splicing fusion device according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a display device according to an embodiment of the present invention;
FIG. 6 is a schematic flow chart of a panoramic video-based vehicle navigation method according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a vehicle equipped with a panoramic video car navigation system according to an embodiment of the present invention.
Detailed Description
So that the manner in which the features and aspects of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings.
The embodiment of the invention provides a vehicle navigation method based on a panoramic video, which comprises the following steps of:
step 101: and acquiring a plurality of paths of video pictures around the vehicle body and a navigation picture of the vehicle body.
Preferably, the acquiring multiple video frames around the vehicle body includes: acquiring at least four video pictures around the vehicle body through at least four camera devices arranged around the vehicle body; the at least four camera devices are respectively positioned at the front part, the rear part, the left part and the right part of the vehicle body.
Here, the reason why at least four video frames around the vehicle body are acquired by at least four image pickup devices provided around the vehicle body is that it is necessary to acquire video frames in four directions of the front, rear, left, and right of the vehicle body, and thus all video frames around the vehicle body can be acquired, and the entire video frames can be merged and fused into a sub-panoramic video frame. In a specific implementation, the number and positions of the cameras can be arranged according to the shooting angles of the cameras, the shooting angles of all the arranged cameras need to cover the 360-degree range of the vehicle body, for example, when the shooting angle of the camera is 50 degrees, 8 cameras can be arranged, and the positions of the 8 cameras need to cover the 360-degree range of the vehicle body with all the angles of the 8 cameras.
Here, the video pictures are acquired in the form of a video data stream, and thus, a smooth video picture can be acquired by quickly receiving the video data stream transmitted by the image pickup device in real time.
Preferably, the navigation screen of the vehicle body is: a two-dimensional navigation picture, or a three-dimensional navigation picture, or a satellite navigation picture; here, the two-dimensional navigation picture, the three-dimensional navigation picture, or the satellite navigation picture is the prior art, and will not be described herein again.
Here, the navigation screen is acquired in the form of a navigation data stream, and thus, a smooth navigation screen can be acquired by rapidly receiving the navigation data stream transmitted from the GPS device in real time.
Step 102: and splicing and fusing the multiple paths of video pictures into a path of panoramic video picture, and displaying the panoramic video picture and the analog image of the vehicle body at the position of the vehicle body on the navigation picture.
Preferably, the splicing and merging of multiple paths of video pictures into one path of panoramic video picture includes:
determining an overlapping area of the multiple paths of video pictures, and acquiring a transformation relation of the multiple paths of video pictures according to the overlapping area;
and registering the multi-channel video pictures by using the transformation relation, splicing and fusing the registered multi-channel video pictures, and generating a path of panoramic video picture.
Because the shooting visual angle of the camera device is limited, to obtain a video picture with a 360-degree visual angle, the video pictures with different angles need to be smoothly and seamlessly spliced and fused. Therefore, video pictures at different angles need to have overlapping areas, the video pictures with the overlapping areas among the video pictures are registered in real time and spliced and fused into a complete panoramic video picture with 360-degree visual angle.
Here, the simulated image of the vehicle body is displayed at the center position of the panoramic video screen.
Preferably, after acquiring the plurality of video frames around the vehicle body, the method further comprises: storing the multi-channel video pictures; and/or the presence of a gas in the gas,
after the multi-channel video pictures are spliced and fused into one panoramic video picture, the method also comprises the following steps: and storing the panoramic video picture.
Therefore, the stored multi-channel video pictures and/or one-channel panoramic video picture can be browsed, and when a traffic accident happens, more accurate cause of the accident can be obtained by analyzing the stored multi-channel video pictures and/or one-channel panoramic video picture.
Preferably, the displaying the panoramic video screen and the vehicle body on the navigation screen includes:
scaling the navigation picture according to the panoramic video picture, and increasing the transparency of the navigation picture;
and displaying the panoramic video picture and the simulation image of the car body at the position of the car body on the navigation picture after the picture is scaled and the transparency is increased.
Here, since the panoramic video screen needs to be additionally displayed at the position of the vehicle body on the navigation screen, the navigation screen of the embodiment of the present invention needs to increase transparency to display the panoramic video screen, compared with the prior art. Moreover, the scale of the navigation picture needs to be coordinated with the scale of the panoramic video picture, so that the navigation picture is displayed and the panoramic video picture with the corresponding scale is displayed at the same time.
Preferably, in the vehicle-mounted navigation method based on the panoramic video provided by the embodiment of the present invention, all the video images, the navigation images, and the panoramic video images are real-time, and the navigation images and the panoramic video images are updated in real time according to the location of the vehicle.
In view of the vehicle navigation method based on the panoramic video, an embodiment of the present invention further provides a vehicle navigation system based on the panoramic video, and as shown in fig. 2, the system includes: a video device 21, a navigation device 22, a stitching fusion device 23 and a display device 24; wherein,
the video device 21 is used for acquiring a plurality of paths of video pictures around the vehicle body;
the navigation device 22 is used for acquiring a navigation picture of the vehicle body;
the splicing and fusing device 23 is configured to splice and fuse the multiple paths of video frames into one path of panoramic video frame;
the display device 24 is configured to display the panoramic video picture and the simulated image of the vehicle body at the position of the vehicle body on the navigation picture.
It should be understood by those skilled in the art that the functions of each device in the panoramic video based vehicle navigation system shown in fig. 2 can be understood by referring to the related description of the panoramic video based vehicle navigation method. The functions of each device in the panoramic video based car navigation system shown in fig. 2 may be implemented by a program running on a processor, or may be implemented by a specific logic circuit.
Preferably, as shown in fig. 3, the video apparatus 21 includes at least four video units 211; wherein the at least four video units 211 are respectively located at the front, rear, left, and right of the vehicle body;
the video unit 211 is configured to obtain a video frame around the vehicle body.
Preferably, the navigation screen of the vehicle body is: a two-dimensional navigation screen, a three-dimensional navigation screen, or a satellite navigation screen.
Preferably, as shown in fig. 4, the splicing fusion device 23 includes: the device comprises a determining unit 231, an obtaining unit 232, a registering unit 233 and a splicing and fusing unit 234; wherein,
the determining unit 231 is configured to determine an overlapping area of the multiple video pictures;
the obtaining unit 232 is configured to obtain a transformation relationship of the multiple paths of video pictures according to the overlapping area;
the registration unit 233 is configured to register the multiple video frames by using the transformation relationship;
the splicing and fusing unit 234 is configured to splice and fuse the multiple registered video frames and generate a panoramic video frame.
Preferably, the system further comprises: a storage device 25 for storing the multiple video pictures; and/or storing the panoramic video picture.
Preferably, as shown in fig. 5, the display device 24 includes: a scaling unit 241, a transparent unit 242, and a display unit 243; wherein,
the scaling unit 241 is configured to perform picture scaling on the navigation picture according to the panoramic video picture;
the transparent unit 242 is used for increasing the transparency of the navigation picture;
the display unit 243 is configured to display the panoramic video image and the analog image of the vehicle body at the position of the vehicle body on the navigation image after the image is scaled and the transparency is increased.
It should be understood by those skilled in the art that the implementation functions of the units of each device in the panoramic video based vehicle navigation system shown in fig. 3 to 5 can be understood by referring to the related description of the panoramic video based vehicle navigation method. The implementation functions of the units of each apparatus in the panoramic video based car navigation system shown in fig. 2 may be implemented by a program running on a processor, or may be implemented by a specific logic circuit.
In combination with the vehicle navigation method based on the panoramic video and the vehicle navigation system based on the panoramic video, a specific embodiment of the present invention further provides a vehicle navigation method based on the panoramic video, as shown in fig. 6, the method includes the following steps:
step 601: the video device acquires a plurality of paths of video pictures around the vehicle body.
Specifically, at least four video units acquire at least four video pictures around the vehicle body.
Step 602: the navigation device acquires a navigation picture of a vehicle body.
Here, step 601 and step 602 are performed simultaneously and in real time.
Step 603: and the splicing and fusion device splices and fuses the multiple paths of video pictures into one path of panoramic video picture.
Specifically, the determining unit determines an overlapping area of the multiple paths of video pictures;
the acquisition unit acquires the transformation relation of the multiple paths of video pictures according to the overlapping area;
the registration unit registers the multi-channel video pictures by using the transformation relation;
and the splicing and fusing unit splices and fuses the registered multi-channel video pictures and generates a path of panoramic video picture.
Step 604: the display device displays the panoramic video picture and the simulation image of the vehicle body at the position of the vehicle body on the navigation picture.
Specifically, the scaling unit scales the navigation picture according to the panoramic video picture;
the transparency of the navigation picture is increased by the transparent unit;
and the display unit displays the panoramic video picture and the simulation image of the car body at the position of the car body on the navigation picture after the picture is scaled and the transparency is increased.
Fig. 7 is a schematic structural diagram of a vehicle equipped with a vehicle-mounted navigation system of panoramic video according to an embodiment of the present invention, and as shown in fig. 7, a video device is installed around a vehicle body 71, and there are four video units 72, which respectively obtain four video frames with different shooting angles; the navigation device 73, the splicing and fusing device 74 and the display device 75 are positioned at the front part of the vehicle body, and the navigation device 73 and the splicing and fusing device 74 can be arranged at other positions of the vehicle body as required; the four video units 72, the navigation device 73, the stitching fusion device 74 and the display device 75 constitute the vehicle-mounted navigation system with panoramic video in the embodiment of the present invention, and the vehicle-mounted navigation system with panoramic video can display the real panoramic video picture in the navigation picture.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.

Claims (12)

1. A vehicle navigation method based on panoramic video is characterized by comprising the following steps:
acquiring a plurality of paths of video pictures around a vehicle body and a navigation picture of the vehicle body;
and splicing and fusing the multiple paths of video pictures into a path of panoramic video picture, and displaying the panoramic video picture and the analog image of the vehicle body at the position of the vehicle body on the navigation picture.
2. The method of claim 1, wherein said obtaining multiple video frames of the vehicle body surroundings comprises:
acquiring at least four video pictures around the vehicle body through at least four camera devices arranged around the vehicle body; the at least four camera devices are respectively positioned at the front part, the rear part, the left part and the right part of the vehicle body.
3. The method of claim 2, wherein the navigation screen of the vehicle body is: a two-dimensional navigation screen, a three-dimensional navigation screen, or a satellite navigation screen.
4. The method according to claim 3, wherein said stitching and merging multiple video pictures into one panoramic video picture comprises:
determining an overlapping area of the multiple paths of video pictures, and acquiring a transformation relation of the multiple paths of video pictures according to the overlapping area;
and registering the multi-channel video pictures by using the transformation relation, splicing and fusing the registered multi-channel video pictures, and generating a path of panoramic video picture.
5. The method of claim 4, wherein after obtaining the plurality of video frames around the vehicle body, the method further comprises:
storing the multi-channel video pictures; and/or the presence of a gas in the gas,
after the multi-channel video pictures are spliced and fused into one panoramic video picture, the method also comprises the following steps: and storing the panoramic video picture.
6. The method according to any one of claims 1 to 5, wherein the displaying the panoramic video picture and the vehicle body on the navigation picture comprises:
scaling the navigation picture according to the panoramic video picture, and increasing the transparency of the navigation picture;
and displaying the panoramic video picture and the simulation image of the car body at the position of the car body on the navigation picture after the picture is scaled and the transparency is increased.
7. A vehicle navigation system based on panoramic video is characterized in that the system comprises: the system comprises a video device, a navigation device, a splicing and fusing device and a display device; wherein,
the video device is used for acquiring a plurality of paths of video pictures around the vehicle body;
the navigation device is used for acquiring a navigation picture of the vehicle body;
the splicing and fusing device is used for splicing and fusing the multiple paths of video pictures into one path of panoramic video picture;
the display device is used for displaying the panoramic video picture and the simulation image of the vehicle body at the position of the vehicle body on the navigation picture.
8. The system of claim 7, wherein the video device comprises at least four video units; the at least four video units are respectively positioned at the front part, the rear part, the left part and the right part of the vehicle body;
the video unit is used for acquiring a video picture around the vehicle body.
9. The system of claim 8, wherein the navigation screen of the body is: a two-dimensional navigation screen, a three-dimensional navigation screen, or a satellite navigation screen.
10. The system of claim 9, wherein the splice fusion device comprises: the device comprises a determining unit, an obtaining unit, a registering unit and a splicing fusion unit; wherein,
the determining unit is used for determining the overlapping area of the multiple paths of video pictures;
the acquisition unit is used for acquiring the transformation relation of the multiple paths of video pictures according to the overlapping area;
the registration unit is used for registering the multi-channel video pictures by using the transformation relation;
and the splicing and fusing unit is used for splicing and fusing the registered multi-channel video pictures and generating a path of panoramic video picture.
11. The system of claim 10, further comprising: the storage device is used for storing the multi-channel video pictures; and/or storing the panoramic video picture.
12. The system according to any one of claims 7 to 11, wherein the display device comprises: the display device comprises a scaling unit, a transparent unit and a display unit; wherein,
the scaling unit is used for scaling the navigation picture according to the panoramic video picture;
the transparent unit is used for increasing the transparency of the navigation picture;
the display unit is used for displaying the panoramic video picture and the simulation image of the car body at the position of the car body on the navigation picture after the picture is scaled and the transparency is increased.
CN201310272535.XA 2013-07-01 2013-07-01 Vehicle-mounted navigation method and system based on panoramic videos Pending CN104280034A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310272535.XA CN104280034A (en) 2013-07-01 2013-07-01 Vehicle-mounted navigation method and system based on panoramic videos
PCT/CN2014/077401 WO2014166449A1 (en) 2013-07-01 2014-05-13 Panoramic video-based vehicle onboard navigation method and system, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310272535.XA CN104280034A (en) 2013-07-01 2013-07-01 Vehicle-mounted navigation method and system based on panoramic videos

Publications (1)

Publication Number Publication Date
CN104280034A true CN104280034A (en) 2015-01-14

Family

ID=51688961

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310272535.XA Pending CN104280034A (en) 2013-07-01 2013-07-01 Vehicle-mounted navigation method and system based on panoramic videos

Country Status (2)

Country Link
CN (1) CN104280034A (en)
WO (1) WO2014166449A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106427779A (en) * 2016-06-29 2017-02-22 青海青峰激光集成技术与应用研究院 Vehicle-used display equipment
CN106598428A (en) * 2016-11-29 2017-04-26 宇龙计算机通信科技(深圳)有限公司 Method and system for playing panoramic video, and terminal equipment
CN107277350A (en) * 2017-06-23 2017-10-20 广州世盟电子科技有限公司 Panoramic decoding integrated smart phone and panoramic decoding method
WO2023273683A1 (en) * 2021-06-29 2023-01-05 广州小鹏汽车科技有限公司 Display method, vehicle-mounted terminal, vehicle and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107966158B (en) * 2016-10-20 2021-11-23 奥迪股份公司 Navigation system and method for indoor parking lot
CN111757057B (en) * 2020-06-17 2022-06-17 广州市泰睿科技有限公司 Panoramic all-around display method, device, equipment and storage medium
CN113301271B (en) * 2021-05-25 2022-09-06 英博超算(南京)科技有限公司 Domain controller display method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101437155A (en) * 2007-11-12 2009-05-20 詹雨明 Omnidirection circumstance video monitoring system
CN102729902A (en) * 2012-07-19 2012-10-17 西北工业大学 Embedded panoramic display device and method served for automobile safe driving
CN202836578U (en) * 2012-09-26 2013-03-27 天津游奕科技有限公司 Panoramic video map navigation system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101339038B (en) * 2007-07-02 2011-08-17 佛山市顺德区顺达电脑厂有限公司 Real scene navigation apparatus
CN101788304A (en) * 2009-01-22 2010-07-28 广东电子工业研究院有限公司 Vehicle navigation and audio-video multimedia system with multi-channel video recording
CN101588482A (en) * 2009-06-02 2009-11-25 石黎 Vehicular virtual panoramic electronic system
TW201136781A (en) * 2010-04-26 2011-11-01 Fortune Prec Technology Co Ltd Auxiliary apparatus with panoramic viewing and recording for car driving
DE102010034140A1 (en) * 2010-08-12 2012-02-16 Valeo Schalter Und Sensoren Gmbh Method for displaying images on a display device and driver assistance system
US20130162665A1 (en) * 2011-12-21 2013-06-27 James D. Lynch Image view in mapping
CN102889892B (en) * 2012-09-13 2015-11-25 东莞宇龙通信科技有限公司 Live-action navigation method and navigation terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101437155A (en) * 2007-11-12 2009-05-20 詹雨明 Omnidirection circumstance video monitoring system
CN102729902A (en) * 2012-07-19 2012-10-17 西北工业大学 Embedded panoramic display device and method served for automobile safe driving
CN202836578U (en) * 2012-09-26 2013-03-27 天津游奕科技有限公司 Panoramic video map navigation system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106427779A (en) * 2016-06-29 2017-02-22 青海青峰激光集成技术与应用研究院 Vehicle-used display equipment
CN106598428A (en) * 2016-11-29 2017-04-26 宇龙计算机通信科技(深圳)有限公司 Method and system for playing panoramic video, and terminal equipment
CN107277350A (en) * 2017-06-23 2017-10-20 广州世盟电子科技有限公司 Panoramic decoding integrated smart phone and panoramic decoding method
WO2023273683A1 (en) * 2021-06-29 2023-01-05 广州小鹏汽车科技有限公司 Display method, vehicle-mounted terminal, vehicle and storage medium

Also Published As

Publication number Publication date
WO2014166449A1 (en) 2014-10-16

Similar Documents

Publication Publication Date Title
CN104280034A (en) Vehicle-mounted navigation method and system based on panoramic videos
US8773534B2 (en) Image processing apparatus, medium recording image processing program, and image processing method
US8395490B2 (en) Blind spot display apparatus
US20140114534A1 (en) Dynamic rearview mirror display features
JP2019509534A (en) System and method for estimating future paths
CN101855520B (en) Method and device for outputting optical driving advice in a motor vehicle
JP5488303B2 (en) Vehicle display device
CN110998409A (en) Augmented reality glasses, method for determining pose of augmented reality glasses, motor vehicle adapted to use the augmented reality glasses or method
KR20180022374A (en) Lane markings hud for driver and assistant and same method thereof
US10996469B2 (en) Method and apparatus for providing driving information of vehicle, and recording medium
JP6820561B2 (en) Image processing device, display device, navigation system, image processing method and program
CN110672110A (en) Navigation method, device and equipment of vehicle and computer readable storage medium
CN109525790B (en) Video file generation method and system, playback method and device
CN114821544B (en) Perception information generation method and device, vehicle, electronic equipment and storage medium
JP2025137538A (en) Information recording device, information recording method, and information recording program
CN106595695A (en) Vehicle-mounted system and car
JP2011254436A (en) Mobile object detection device and mobile object detection method
JP2007102691A (en) View-field support apparatus for vehicle
WO2017024458A1 (en) System, method and apparatus for vehicle and computer readable medium
JP2020010123A (en) On-vehicle photographing apparatus, photographing system and photographing method
CN102243078B (en) Namely a kind of institute depending on releasing type guider and implementation method
CN109883414A (en) A kind of automobile navigation method, device, electronic equipment and storage medium
KR101744718B1 (en) Display system and control method therof
US20240167837A1 (en) Display processing apparatus, movable apparatus, and display processing method
CN105704438B (en) Method and device for previewing road section in front of vehicle based on video and method and device for recording road section of vehicle based on video

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150114