[go: up one dir, main page]

TWI834301B - Vehicle surrounding image display method - Google Patents

Vehicle surrounding image display method Download PDF

Info

Publication number
TWI834301B
TWI834301B TW111135700A TW111135700A TWI834301B TW I834301 B TWI834301 B TW I834301B TW 111135700 A TW111135700 A TW 111135700A TW 111135700 A TW111135700 A TW 111135700A TW I834301 B TWI834301 B TW I834301B
Authority
TW
Taiwan
Prior art keywords
vehicle
image
area
images
continuous
Prior art date
Application number
TW111135700A
Other languages
Chinese (zh)
Other versions
TW202414333A (en
Inventor
顏文泰
Original Assignee
歐特明電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歐特明電子股份有限公司 filed Critical 歐特明電子股份有限公司
Priority to TW111135700A priority Critical patent/TWI834301B/en
Application granted granted Critical
Publication of TWI834301B publication Critical patent/TWI834301B/en
Publication of TW202414333A publication Critical patent/TW202414333A/en

Links

Landscapes

  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)

Abstract

The present invention discloses a method for displaying a vehicle surrounding image which includes the steps of: capturing images of the surrounding environment when the vehicle is moving by cameras installed on the vehicle to generate continuous image frames, and a first image corresponding to the outside area of the vehicle is generated by the real-time images of the continuous image frames. Delayed images of the continuous image frames is obtained by calculating driving data, and then a second image corresponding to the chassis area of the vehicle is generated by gain operation of the delayed images of the continuous image frames, and a surrounding image of the vehicle is generated and displayed in real time by splicing the first image and the second image.

Description

車輛環景影像顯示方法Vehicle surround image display method

本發明涉及行車影像技術領域,具體涉及一種車輛環景影像顯示方法。 The invention relates to the technical field of driving images, and in particular to a vehicle surround image display method.

一般車輛亦或可裝設額外的攝影機於車輛各個位置。舉例來說,攝影機可安裝在車輛的前、側及後面,採集周圍環境的各個區域的影像。對於車輛行駛中的不同環境或停車場場域需要更多的影像視野來提供給駕駛,然而,受限於攝影機的安裝位置會受到車輛本身的遮蔽,但增加額外的攝影機來採集整體車輛周圍環境,往往會產生較高的成本。此外,受到環境光線的影響,車輛本身會產生投影於地面的陰影或是因車燈開啟照射地面產生光斑,若這些影像被用來產生車輛環景影像,往往會產生不良的影像品質,特別是用來產生攝影機視野被遮蔽的影像,又若以人工智慧判斷車輛陰影或是車燈造成的光斑並加以改善,則會需要大量的影像訓練資料,可能造成影像的誤判或因此抹除環境中重要的影像訊息。 Ordinary vehicles may also be equipped with additional cameras at various locations on the vehicle. For example, cameras can be mounted on the front, sides and back of the vehicle to capture images of various areas of the surrounding environment. For different environments where the vehicle is driving or in the parking lot, more image fields are needed to provide the driver. However, due to the limitation of the installation position of the camera, it will be blocked by the vehicle itself, but adding additional cameras to capture the overall vehicle surrounding environment, Often higher costs will be incurred. In addition, due to the influence of ambient light, the vehicle itself will produce shadows projected on the ground or light spots on the ground caused by turning on the headlights. If these images are used to generate vehicle surround images, poor image quality will often be produced, especially It is used to generate images in which the camera's field of view is blocked. If artificial intelligence is used to determine vehicle shadows or light spots caused by headlights and improve them, a large amount of image training data will be needed, which may cause misjudgment of the image or erase important information in the environment. image information.

為解決上述技術問題而提供了一種車輛環景影像顯示方法。 In order to solve the above technical problems, a vehicle surround image display method is provided.

本發明的目的可以透過以下的技術方案來實現:一種車輛環景影像顯示方法,包含:通過裝設於一車輛上的複數個攝影機擷取所述車輛移動時的周圍環境影像以產生連續影像幀,通過所述連續影像幀的即時影像組成對應於所述車輛外側區域的第一影像,接收所述車輛的行車資料,計算所述行車資料來得到所述連續影像幀的延遲影像,通過對所述連續影像幀的延遲影像進行增益運算組成對應於所述車輛的底盤區域的第二影像,通過拼接所述第一影像及所述第二影像即時產生一車輛環景影像,顯示所述車輛環景影像。 The object of the present invention can be achieved through the following technical solutions: a vehicle surround image display method, including: capturing images of the surrounding environment when the vehicle is moving through a plurality of cameras installed on a vehicle to generate continuous image frames , the real-time image of the continuous image frame is composed of the first image corresponding to the outer area of the vehicle, the driving data of the vehicle is received, and the driving data is calculated to obtain the delayed image of the continuous image frame, and the delayed image of the continuous image frame is obtained by The delayed images of the continuous image frames are subjected to a gain operation to form a second image corresponding to the chassis area of the vehicle. By splicing the first image and the second image, a vehicle surround image is generated in real time to display the vehicle surround. scene image.

根據本案構想,車輛外側區域還包括一影像比對區域,通過比對在所述影像比對區域中的所述連續影像幀的即時影像與所述連續影像幀的延遲影像來調整所述第一影像或第二影像。 According to the concept of this project, the vehicle outer area also includes an image comparison area, and the first image is adjusted by comparing the real-time images of the continuous image frames and the delayed images of the continuous image frames in the image comparison area. image or second image.

根據本案構想,還包括將所述連續影像幀從第一視角執行座標轉換為第二視角。 According to the concept of this project, it also includes performing coordinate conversion of the continuous image frames from the first perspective to the second perspective.

根據本案構想,所述車輛的行車資料至少包含所述車輛的轉向角、車速及檔位。 According to the concept of this case, the driving data of the vehicle at least includes the steering angle, speed and gear position of the vehicle.

根據本案構想,所述影像比對區域相鄰所述車輛的底盤區域。 According to the concept of this project, the image comparison area is adjacent to the chassis area of the vehicle.

根據本案構想,所述增益運算包含調整所述連續影像幀的延遲影像在每一幀的影像透明度變化。 According to the concept of this project, the gain operation includes adjusting the image transparency change of the delayed image of the continuous image frames in each frame.

本發明具有以下優點: The invention has the following advantages:

1、通過對安裝車輛外側的攝影機擷取的連續影像幀的延遲影像進行增益運算可產生成對應於車輛的底盤區域的影像,除了無需增加安裝在車輛底盤下方的攝影機,使車輛在行駛中,如攝影機視野無遮蔽般行駛,同時可以減少車輛陰影或車燈造成的光斑對於組成車輛環景影像的影響。 1. By performing gain operation on delayed images of continuous image frames captured by cameras installed on the outside of the vehicle, images corresponding to the chassis area of the vehicle can be generated. In addition to the fact that there is no need to add a camera installed below the chassis of the vehicle, the vehicle can be moved while the vehicle is in motion. Driving as if the camera's field of view is unobstructed, it can also reduce the impact of vehicle shadows or light spots caused by vehicle lights on the vehicle's surrounding image.

2、透過影像在拼接時特定區域的比對,可降低車輛外部區域影像與對應車輛底盤的影像間因車輛移動的時間先後造成的影像拼接差異,並可以藉此調整車輛外部區域的影像,降低此區域因車輛造成的陰影及車燈造成的光斑。 2. By comparing specific areas of the image during splicing, the difference in image splicing caused by the time of vehicle movement between the image of the vehicle's external area and the corresponding vehicle chassis can be reduced, and the image of the vehicle's external area can be adjusted to reduce This area is subject to shadows caused by vehicles and light spots caused by headlights.

100:車輛環景影像顯示系統 100: Vehicle surround image display system

101:影像訊息接收模組 101:Image message receiving module

102:攝影機 102:Camera

103:處理單元 103: Processing unit

104:車輛訊息總成介面 104: Vehicle information assembly interface

105:儲存模組 105:Storage module

300:車輛環景影像 300: Vehicle surround image

301:車輛外側區域 301: Vehicle outside area

302:車輛的底盤區域 302: Chassis area of vehicle

303:影像比對區域 303:Image comparison area

401:攝影機的前視角的平面 401: The plane of the camera’s front view

402:目標平面 402: Target plane

403:影像點在攝影機的前視角的平面與目標平面的延伸向量 403: The extension vector of the image point between the plane of the camera's front angle of view and the target plane

圖1是本發明的一種車輛環景影像顯示系統的結構示意圖;圖2是本發明的一種車輛環景影像顯示的方法流程圖;圖3是本發明的一種車輛環景影像顯示區域的實施示意圖;圖4是本發明在連續影像幀執行座標轉換視角的實施示意圖;圖5是在計算行車資料來得到連續影像幀的延遲影像的實施示意圖;圖6是本發明通過對連續影像幀的延遲影像進行增益運算的實施示意圖;圖7是本發明在車輛外側區域包括一影像比對區域的實施示意圖。 Figure 1 is a schematic structural diagram of a vehicle surround image display system of the present invention; Figure 2 is a flow chart of a vehicle surround image display method of the present invention; Figure 3 is a schematic diagram of the implementation of a vehicle surround image display area of the present invention ; Figure 4 is a schematic diagram of the implementation of the present invention for executing coordinate conversion perspective in continuous image frames; Figure 5 is a schematic diagram of the implementation of calculating driving data to obtain delayed images of continuous image frames; Figure 6 is a schematic diagram of the present invention through delayed images of continuous image frames A schematic diagram of the implementation of gain calculation; FIG. 7 is a schematic diagram of the present invention including an image comparison area in the vehicle outer area.

為使本發明實施方式的目的、技術方案和優點更加清楚,下面將結合本發明實施方式中的附圖,對本發明實施方式中的技術方案進行清楚、完整地描述,顯然,所描述的實施方式是本發明一部分實施方式,而不是全部的實施方式。基於本發明中的實施方式,本領域普通技術人員在沒有作出創造性勞動前提下所獲得的所有其他實施方式,都屬於本發明保護的範圍。因此,以下對在附圖中提供的本發明的實施方式的詳細描述並非旨在限制要求保護的本發明的範圍,而是僅僅表示本發明的選定實施方式。基於本發明中的實施方式,本 領域普通技術人員在沒有作出創造性勞動前提下所獲得的所有其他實施方式,都屬於本發明保護的範圍。 In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention. Accordingly, the following detailed description of embodiments of the invention provided in the appended drawings is not intended to limit the scope of the claimed invention, but rather to represent selected embodiments of the invention. Based on the implementation of the present invention, this All other implementations obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

在本發明的描述中,需要理解的是,術語“上”、“下”等指示的方位或位置關係為基於附圖所示的方位或位置關係,僅是為了便於描述本發明和簡化描述,而不是指示或暗示所指的設備或元件必須具有特定的方位、以特定的方位構造和操作,因此不能理解為對本發明的限制。 In the description of the present invention, it should be understood that the orientation or positional relationship indicated by the terms "upper", "lower", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description. It is not intended to indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore is not to be construed as a limitation of the invention.

在本發明的描述中,“多個”的含義是兩個或兩個以上,除非另有明確具體的限定。 In the description of the present invention, "plurality" means two or more than two, unless otherwise explicitly and specifically limited.

在本發明中,除非另有明確的規定和限定,術語“安裝”、“相連”、“連接”、“固定”等術語應做廣義理解,例如,可以是固定連接,也可以是可拆卸連接,或成一體;可以是機械連接,也可以是電連接;可以是直接相連,也可以通過中間媒介間接相連,可以是兩個元件內部的連通或兩個元件的相互作用關係。對於本領域的普通技術人員而言,可以根據具體情況理解上述術語在本發明中的具體含義。 In the present invention, unless otherwise clearly stated and limited, the terms "installation", "connection", "connection", "fixing" and other terms should be understood in a broad sense. For example, it can be a fixed connection or a detachable connection. , or integrated; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be an internal connection between two elements or an interaction between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

下面結合附圖與具體實施方式對本發明作進一步詳細描述:請參考圖1,本發明公開了一種車輛環景影像顯示系統100安裝在一車輛上,包括影像訊息接收模組101、攝影機102、處理單元103、車輛訊息總成介面104以及儲存模組105。 The present invention will be described in further detail below in conjunction with the accompanying drawings and specific implementation modes: Please refer to Figure 1. The present invention discloses a vehicle surround image display system 100 installed on a vehicle, including an image message receiving module 101, a camera 102, a processing Unit 103, vehicle information assembly interface 104 and storage module 105.

影像訊息接收模組101用來獲取來自安裝在車輛多顆的攝影機102所擷取的連續影像幀,特別是用來獲取車輛移動時的周圍環境影像幀以產生連續影像幀。影像訊息接收模組101通常具有影像處理單元(ISP,Image Signal Processor),可處理如鏡頭矯正、像素矯正、顏色插值、Bayer雜訊去除、白平 衡矯正、色彩矯正、gamma矯正、色彩空間轉換等功能。影像訊息接收模組101一般可具有LVDS(Low Voltage Differential Signaling,低電壓差分信號)或MIPI CSI傳輸介面(未標示),為了能獲取較好的影像品質,影像訊息可以為LVDS格式訊息。 The image message receiving module 101 is used to obtain continuous image frames captured from multiple cameras 102 installed on the vehicle, and is particularly used to obtain image frames of the surrounding environment when the vehicle is moving to generate continuous image frames. The image message receiving module 101 usually has an image processing unit (ISP, Image Signal Processor), which can process lens correction, pixel correction, color interpolation, Bayer noise removal, whitening, etc. Balance correction, color correction, gamma correction, color space conversion and other functions. The image message receiving module 101 generally has LVDS (Low Voltage Differential Signaling, low voltage differential signaling) or MIPI CSI transmission interface (not marked). In order to obtain better image quality, the image message can be in LVDS format.

複數個攝影機102被安裝在車輛上,如可被安裝在車輛的前側(例如,前表面)的前攝影機,被安裝在車輛的相對後側的後攝影機,以及車輛左右外側的左、右攝影機,由於這些攝影機102通常具備影像感測器並透過廣角鏡頭或魚眼鏡頭從環境接收影像。影像感測器包含各自擷取光以產生影像資料的像素的水準及垂直列。來自像素的影像資料可結合以形成以產生連續影像幀。在本發明中,複數個攝影機102設置在車輛的不同側,可拍攝車輛外側的周圍影像並具有不同的視野,整體而言,這些不同視野的影像可構成車輛外側周圍環境完整的影像視野,並經由影像訊息接收模組101傳送至處理單元103。 A plurality of cameras 102 are mounted on the vehicle, such as a front camera that may be mounted on the front side (e.g., front surface) of the vehicle, a rear camera mounted on the opposite rear side of the vehicle, and left and right cameras on the left and right sides of the vehicle, Because these cameras 102 usually have image sensors and receive images from the environment through wide-angle lenses or fisheye lenses. An image sensor contains horizontal and vertical rows of pixels that each capture light to produce image data. Image data from pixels can be combined to produce successive image frames. In the present invention, a plurality of cameras 102 are arranged on different sides of the vehicle and can capture images of the surroundings outside the vehicle and have different fields of view. Overall, these images of different fields of view can constitute a complete image field of view of the surrounding environment outside the vehicle, and It is sent to the processing unit 103 via the image message receiving module 101.

本發明的處理單元103為本發明的主要的運算單元,如一或多個通用處理器、如數位訊號處理器(DSPs)的專用處理器或其他數文書處理電路。處理單元103與影像訊息接收模組101連接,可接收且處理從複數個攝影機102接收的連續影像幀,並運算自影像訊息接收模組101轉換後的連續影像幀。同時,處理單元103可透過通訊路徑(例如,一或多個電纜,以利控制器區域網路匯流排的通訊匯流排實施於其上)與車輛控制系統通訊連接,更進一步是透過車輛訊息總成介面104連接車輛CAN匯流排,從車輛控制系統接收車輛資料,如車輛速度、轉向角等及其他有關車輛的行車資料。儲存模組105可用來儲存影像。舉例來說,處理單元103可維持一或多個影像緩衝記憶體,並儲存從複數個攝影機102接收的連續影像幀於儲存模組105中。此外,儲存模組105可儲存來自車輛的各式感測 訊息或其他有關車輛的行車資料。儲存模組105可以是內建的積體電路的記憶體,也可以是外接式的存儲裝置,如SSD或SD卡。 The processing unit 103 of the present invention is the main computing unit of the present invention, such as one or more general-purpose processors, special-purpose processors such as digital signal processors (DSPs), or other digital word processing circuits. The processing unit 103 is connected to the image information receiving module 101, can receive and process continuous image frames received from a plurality of cameras 102, and calculate the continuous image frames converted from the image information receiving module 101. At the same time, the processing unit 103 can be communicated with the vehicle control system through a communication path (for example, one or more cables on which a communication bus of the controller area network bus is implemented), and further, through the vehicle information hub. The interface 104 is connected to the vehicle CAN bus and receives vehicle data from the vehicle control system, such as vehicle speed, steering angle, etc. and other driving data related to the vehicle. The storage module 105 can be used to store images. For example, the processing unit 103 can maintain one or more image buffer memories and store consecutive image frames received from a plurality of cameras 102 in the storage module 105 . In addition, the storage module 105 can store various sensing data from the vehicle. messages or other driving information about the vehicle. The storage module 105 may be a built-in integrated circuit memory, or may be an external storage device, such as an SSD or an SD card.

請一併參考圖1至圖7根據本發明的一種車輛環景影像顯示系統100安裝於一車輛上運作的實施方式。根據該系統100可以產生車輛環景影像300,其中車輛環景影像300又可分為車輛外側區域301的影像(本發明的第一影像)及車輛的底盤區域302的影像(本發明的第二影像),而本發明的系統100產生這兩區域影像的方法具有以下步驟: Please refer to FIGS. 1 to 7 for an embodiment of a vehicle surround image display system 100 installed on a vehicle and operating according to the present invention. According to the system 100, a vehicle surrounding image 300 can be generated, wherein the vehicle surrounding image 300 can be divided into an image of the vehicle outer area 301 (the first image of the present invention) and an image of the vehicle chassis area 302 (the second image of the present invention). image), and the method for the system 100 of the present invention to generate images of these two areas has the following steps:

步驟S01,擷取車輛移動時的周圍環境影像以產生連續影像幀並組成對應於所述車輛外側區域的第一影像。 Step S01: Capture the surrounding environment images when the vehicle is moving to generate continuous image frames and form a first image corresponding to the area outside the vehicle.

安裝在車輛各個位置的複數個攝影機102,舉例來說,可安裝在車輛的前、後及/或側面,各自由不同的安裝視角擷取車輛移動時周圍環境影像以產生連續影像幀。由於這些不同安裝視角的攝影機102安裝在車輛外側,因此各攝影機所擷取分別的連續影像幀,在本發明中主要可構成車輛外側區域301的影像,即對應車輛外側區域301的第一影像,如圖3所示。更進一步來說,個別的攝影機102所擷取的影像通常是攝影機光軸方向所拍攝的前視角影像。對應於不同攝影機的前視角影像,本發明的處理單元103在組合所有對應於車輛外側區域301的第一影像之前,須將各攝影機102擷取車輛移動時的周圍環境影像幀的第一視角(即個別攝影機的前視角)執行座標轉換為第二視角(即共同視角),其中第二視角通常為反映車輛由上往下的視角,或稱為鳥瞰視角,如此可讓車輛駕駛方便由這些不同攝影機的視角經座標轉換後的共同視角來觀察車輛外側周圍的影像,當然這些來自不同視角的攝影機102所擷取的連續影像幀是經同步時間處理且為即時拍攝的影像。值得一提的是,為了能反映車輛行駛過程中的即時影像 與真實車輛周圍環境,在對應車輛外側區域301的第一影像中,因車輛本身投射地面的陰影或是車燈產生的光斑等現象,是不經由影像運算或是人工智慧處理被抹去。 A plurality of cameras 102 installed at various positions of the vehicle, for example, can be installed at the front, rear and/or side of the vehicle, each capturing images of the surrounding environment when the vehicle is moving from different installation angles to generate continuous image frames. Since these cameras 102 with different installation angles are installed on the outside of the vehicle, the continuous image frames captured by each camera can mainly constitute the image of the vehicle outside area 301 in the present invention, that is, the first image corresponding to the vehicle outside area 301. As shown in Figure 3. Furthermore, the images captured by individual cameras 102 are usually front-view images captured in the direction of the camera's optical axis. Corresponding to the front view images of different cameras, before combining all the first images corresponding to the vehicle outer area 301, the processing unit 103 of the present invention must capture the first view of the surrounding environment image frame when the vehicle is moving ( (i.e., the front angle of view of an individual camera) performs coordinate conversion into a second angle of view (i.e., a common angle of view). The second angle of view usually reflects the top-down angle of the vehicle, or is called a bird's-eye view. This allows the vehicle to be driven conveniently from these different angles. The cameras' perspectives are used to observe the images around the outside of the vehicle from a common perspective after coordinate conversion. Of course, the continuous image frames captured by the cameras 102 from different perspectives are processed in synchronized time and are captured in real time. It is worth mentioning that in order to reflect the real-time image of the vehicle during driving Compared with the real vehicle surrounding environment, in the first image corresponding to the vehicle outer area 301, phenomena such as shadows cast by the vehicle itself on the ground or light spots produced by the headlights are erased without image computing or artificial intelligence processing.

其中,處理單元103將各攝影機102擷取車輛移動時的周圍環境影像幀的第一視角(即個別攝影機的前視角)執行座標轉換為第二視角(即共同視角)的具體做法,請一併參考圖4。如圖4中所示,以其中一個攝影機102為例,通過攝影機所擷取的影像,可包含在坐標系中,如在攝影機的前視角的平面401中沿著向量403的點X1的影像資料(例如,像素)。向量403延伸在平面401中的點X1與在鳥瞰視角對應的目標平面402中的對應點Xπ之間,其中目標平面402在本發明中即為地平面。由於向量403被繪製於攝影機的前視角平面401上的點與目標平面402之間,所以向量403可表示攝影機被安裝在車輛上且朝向地面的角度。 Among them, the processing unit 103 performs coordinate conversion from the first perspective (ie, the front perspective of an individual camera) of the surrounding environment image frame captured by each camera 102 when the vehicle is moving to the second perspective (ie, the common perspective). Please refer to the specific method. Refer to Figure 4. As shown in Figure 4, taking one of the cameras 102 as an example, the image captured by the camera can be included in the coordinate system, such as the image data of point X1 along the vector 403 in the plane 401 of the front view of the camera. (e.g. pixels). The vector 403 extends between the point X1 in the plane 401 and the corresponding point Xπ in the target plane 402 corresponding to the bird's-eye view, where the target plane 402 is the ground plane in the present invention. Because vector 403 is drawn between a point on the camera's front view plane 401 and the target plane 402 , vector 403 may represent the angle at which the camera is mounted on the vehicle and faces the ground.

在攝影機的前視角的平面401通過攝影機所擷取的連續影像幀,可根據矩陣公式Xπ=H * X1而轉換(例如,投影)至目標平面402上。矩陣「H」可通過對於攝影機的校正程式來計算及決定。舉例來說,攝影機可安裝在車輛上的所需位置,且校正影像可用以產生已知環境的影像。在這種情況下,可以獲得若干對在平面401及目標平面402中的對應點(例如,點X1及點Xπ可構成一對),而「H」可基於已知的點來計算。 Continuous image frames captured by the camera on the front view plane 401 of the camera can be transformed (eg, projected) onto the target plane 402 according to the matrix formula Xπ=H*X1. The matrix "H" can be calculated and determined through the calibration program for the camera. For example, cameras can be mounted on the vehicle at desired locations, and corrected images can be used to produce images of a known environment. In this case, several pairs of corresponding points in the plane 401 and the target plane 402 can be obtained (for example, the point X1 and the point Xπ can form a pair), and "H" can be calculated based on the known points.

作為實例,點X1可通過平面401的坐標系統而被定義為X1=(x i ,y i ,ω i ),而點Xπ可通過目標平面402的坐標系統而被定義為

Figure 111135700-A0305-02-0009-5
。在這種情況下,矩陣「H」可被定義為如在方程式1中所示,點X1與點Xπ之間的關係可被定義為如在方程式2中所示。 As an example , point X1 may be defined by the coordinate system of plane 401 as
Figure 111135700-A0305-02-0009-5
. In this case, the matrix "H" can be defined as shown in Equation 1, and the relationship between the point X1 and the point Xπ can be defined as shown in Equation 2.

Figure 111135700-A0305-02-0010-1
Figure 111135700-A0305-02-0010-1

Figure 111135700-A0305-02-0010-2
Figure 111135700-A0305-02-0010-2

安裝在車輛的各攝影機102,可通過處理單元103計算各攝影機102的前視角的平面401執行座標轉換為目標平面402的各個矩陣「H」,而校正轉換至目標平面402上。也就是說,在複數個攝影機102被安裝在車輛的前、後及側面的情況中,處理單元103可根據各攝影機預先決定的各個轉換矩陣而加以校正,再通過該等轉換矩陣將該複數個攝影機102擷取的連續影像幀從第一視角(即個別攝影機的前視角)執行座標轉換為第二視角(即共同視角),經過影像拼接得到共同的平面影像,如本發明圖3中對應車輛的鳥瞰視角的影像300。最後處理單元103將這些經座標轉換後的連續影像幀的即時影像組成對應於車輛外側區域301的第一影像,同時將這些經座標轉換後的連續影像幀儲存於儲存模組105中,以作為本發明後續步驟所使用。 For each camera 102 installed on the vehicle, the processing unit 103 can calculate the plane 401 of the front angle of each camera 102 to perform coordinate transformation into each matrix "H" of the target plane 402, and then correct the transformation to the target plane 402. That is to say, in the case where a plurality of cameras 102 are installed on the front, rear and side of the vehicle, the processing unit 103 can perform corrections according to the respective conversion matrices predetermined for each camera, and then convert the plurality of cameras 102 through the conversion matrices. The continuous image frames captured by the camera 102 perform coordinate conversion from the first perspective (ie, the front perspective of the individual cameras) to the second perspective (ie, the common perspective), and obtain a common plane image through image splicing, as shown in Figure 3 of the present invention corresponding to the vehicle. Bird's eye view image 300. The final processing unit 103 composes the real-time images of these coordinate-converted continuous image frames into the first image corresponding to the vehicle outer area 301, and at the same time stores these coordinate-converted continuous image frames in the storage module 105 as used in subsequent steps of the present invention.

顯然地,由於本發明中複數個攝影機102安裝於車輛外側,即使其搭載廣角鏡頭或是魚眼鏡頭,但仍受到車輛本身的遮擋,視野因而產生遮蔽,如圖3中車輛所在的區域,或進一步說,在圖3中的鳥瞰影像,複數個攝影機102受到車輛本身所遮蔽的區域投影至地平面的區域,即為對應車輛的底盤區域302。因此,在後續步驟S02至S04為本發明藉由在S01步驟中所儲存經座標轉 換後的連續影像幀,產生被車輛本身所遮蔽的區域(車輛的底盤區域302)影像(本發明的第二影像)的方法。 Obviously, since the plurality of cameras 102 in the present invention are installed on the outside of the vehicle, even if they are equipped with wide-angle lenses or fisheye lenses, they are still blocked by the vehicle itself, and the field of view is thus blocked, such as the area where the vehicle is located in Figure 3, or further. In the bird's-eye view image in FIG. 3 , the area where the multiple cameras 102 are blocked by the vehicle itself is projected onto the ground plane, which is the chassis area 302 corresponding to the vehicle. Therefore, in subsequent steps S02 to S04, the present invention uses the coordinate transformation stored in step S01 to A method of generating an image (the second image of the present invention) of the area (chassis area 302 of the vehicle) that is obscured by the vehicle itself from the converted continuous image frames.

步驟S02,接收車輛的行車資料。 Step S02: Receive vehicle driving data.

在此步驟中,車輛的行車資料可通過控制及/或監測系統(例如,經通訊路徑如控制器區域網路匯流排,controller area network bus,CAN bus)來提供,最後經由車輛訊息總成介面104傳送至處理單元103。行車資料,舉例如車輛的轉向角、速度、檔位等,即足以識別車輛的移動狀態的資料,這些資料將被處理單元計算並判定在步驟S01先前擷取並儲存的連續影像幀的哪個部分,可以用來產生車輛本身所遮蔽的區域(車輛的底盤區域302)的影像。 In this step, the vehicle's driving data can be provided through the control and/or monitoring system (for example, through a communication path such as a controller area network bus, CAN bus), and finally through the vehicle information assembly interface 104 is sent to the processing unit 103. Driving data, such as the vehicle's steering angle, speed, gear, etc., are data sufficient to identify the vehicle's moving state. These data will be calculated by the processing unit and determined which part of the continuous image frame was previously captured and stored in step S01 , can be used to generate an image of the area obscured by the vehicle itself (the chassis area 302 of the vehicle).

步驟S03,計算行車資料來得到連續影像幀的延遲影像。 Step S03: Calculate driving data to obtain delayed images of consecutive image frames.

圖5描述計算行車資料來得到連續影像幀的延遲影像的實施示意圖。其中,Φ為轉向角(例如,平均前輪角度)、V為車速及L為車輛軸距長度(亦即,在車輛前及後輪之間的長度)。在此步驟中,主要是計算車輛的移動,藉由車輛的行車資料可以獲得未來時間點的車輛位置,並由先前擷取並儲存的連續影像幀根據計算後的車輛位置來得到連續影像幀的延遲影像,以用來產生對應於車輛的底盤區域302的影像。 Figure 5 depicts a schematic diagram of an implementation of calculating driving data to obtain delayed images of consecutive image frames. Where, Φ is the steering angle (eg, the average front wheel angle), V is the vehicle speed, and L is the vehicle wheelbase length (ie, the length between the front and rear wheels of the vehicle). In this step, the movement of the vehicle is mainly calculated. The vehicle position at a future time point can be obtained through the vehicle's driving data, and the continuous image frames are obtained based on the calculated vehicle position from the previously captured and stored continuous image frames. Delayed images are used to generate images corresponding to the chassis area 302 of the vehicle.

車輛的角速度可基於目前的車輛速度V、軸距長度L及轉向角Φ(例如,如在方程式3中所示)來計算。 The vehicle's angular velocity may be calculated based on the current vehicle speed V, wheelbase length L, and steering angle Φ (eg, as shown in Equation 3).

Figure 111135700-A0305-02-0011-3
Figure 111135700-A0305-02-0011-3

對於各位置,對應的未來位置可基於預測移動量△yi來計算。預測移動量△yi可基於距車輛的旋轉半徑的中心Oi的位置的X軸距離rxi及Y軸距離Lxi以及車輛角速度來計算(例如,根據方程式4)。 For each position, the corresponding future position can be calculated based on the predicted movement amount Δyi. The predicted movement amount Δyi may be calculated based on the X-axis distance r xi and Y-axis distance L xi from the position of the center O i of the rotation radius of the vehicle and the vehicle angular velocity (for example, according to Equation 4).

Figure 111135700-A0305-02-0012-4
Figure 111135700-A0305-02-0012-4

對於車輛本身所遮蔽的區域(車輛的底盤區域302)的影像內的各位置,預測移動量△yi可用以決定預測的未來位置是否落在車輛周圍環境的目前可見區域(例如,車輛外側區域301)內。如果預測的車輛移動位置是位於目前可見區域內,則在車輛移動至預測位置時,根據本發明,處理單元103可計算在步驟S01已由複數個攝影機102擷取並儲存車輛移動時的周圍環境的連續影像幀中,對應於預測移動量△yi的區塊,而對應區塊的連續影像幀便可以用來產生車輛本身所遮蔽的區域(即車輛的底盤區域302)的影像。因此,對於車輛移動至未來時間點時,相較於車輛外側區域301的影像(第一影像)是由攝影機102擷取的連續影像幀的即時影像所組成,這些被用作產生車輛本身所遮蔽的區域(即車輛的底盤區域302)對應區塊的影像,則可視為前述連續影像幀的延遲影像,亦即在預測車輛移動對應的已儲存的連續影像幀。 For each position within the image of the area occluded by the vehicle itself (the chassis area 302 of the vehicle), the predicted movement amount Δyi can be used to determine whether the predicted future position falls within the currently visible area of the vehicle's surroundings (e.g., the vehicle outer area 301 ) within. If the predicted moving position of the vehicle is within the currently visible area, when the vehicle moves to the predicted position, according to the present invention, the processing unit 103 can calculate the surrounding environment when the vehicle is moving that has been captured and stored by the plurality of cameras 102 in step S01 In the continuous image frames, the block corresponding to the predicted movement amount Δyi, and the continuous image frames corresponding to the block can be used to generate images of the area obscured by the vehicle itself (ie, the chassis area 302 of the vehicle). Therefore, when the vehicle moves to a future time point, the image (the first image) of the area outside the vehicle 301 is composed of real-time images of consecutive image frames captured by the camera 102, which are used to generate the occlusion of the vehicle itself. The image of the corresponding block of the area (ie, the chassis area 302 of the vehicle) can be regarded as a delayed image of the aforementioned continuous image frames, that is, the stored continuous image frames corresponding to the predicted vehicle movement.

同樣地,由於這些對應車輛移動所預先儲存的連續影像幀可能仍然具有車輛本身投射地面的陰影或是車燈產生的光斑,如因此做為產生車輛的底盤區域302的影像時,會造成該區域302的影像品質不良,如原有連續影像幀的陰影產生的不連續、光斑的過曝,進一步對駕駛造成不良的視覺干擾,或是誤判該區域302在地面上有障礙物等不良影響。因此,在下一步驟中,將針對這些預先儲存的連續影像幀進行處理。 Similarly, since these pre-stored continuous image frames corresponding to the movement of the vehicle may still have shadows cast by the vehicle itself on the ground or spots produced by the headlights, for example, when used to generate images of the chassis area 302 of the vehicle, this area will be The image quality of 302 is poor, such as the discontinuity caused by the shadow of the original continuous image frame and the overexposure of light spots, which further causes undesirable visual interference to driving, or misjudges that there are obstacles on the ground in the area 302 and other adverse effects. Therefore, in the next step, these pre-stored continuous image frames will be processed.

步驟S04,對連續影像幀的延遲影像進行增益運算組成對應於所述車輛的底盤區域的第二影像。 Step S04: Perform gain operation on the delayed images of consecutive image frames to form a second image corresponding to the chassis area of the vehicle.

基於前一步驟S03,為了將用來產生車輛的底盤區域302的預先儲存的連續影像幀(即連續影像幀的延遲影像)進行處理,以減少車輛陰影或是車燈對於影像品質的影響。因此,本發明的處理單元103可針對這些預先儲存的連續影像幀進行增益運算組成對應於車輛的底盤區域302的影像(第二影像)。為了清楚說明增益運算的作法,請一併參考圖6,預先儲存的連續影像幀的延遲圖像對應在車輛的外側區域301,此時,在區域301可能會存在有車輛本身造成的陰影或是車燈造成的光斑,本發明的處理單元103則對連續影像幀的延遲影像進行增益運算,以車輛側邊方向的影像增益運算為例(A-A’方向),增益運算的方式,舉例可以如圖6(a)中,預先排除車身向外延伸距離s所形成的範圍內的影像,亦即增益w為0,也就是說,連續影像幀的延遲影像在離車身s距離內的範圍內的部分,也就是車輛本身造成的陰影或是車燈造成的光斑最容易發生的區域範圍,在車輛移動後不作為產生車輛的底盤區域302的影像。而增益w不為0時,可視為將連續影像幀的延遲影像作權重值的調整,例如調整連續影像幀的延遲影像在每一幀的影像透明度變化,直到增益w為1(此時透明度為0)。一般而言,s可以為由車身外側起算40公分至60公分的距離,或是進一步可以根據車輛行駛的狀態,如白天或夜間時段、環境光線的亮度、室外或室內、GPS定位訊號等,由處理單元103內建的預設值進行調整。如同圖6(a)做法,為了淡化車輛陰影或車燈造成光斑的影像,除了預先排除連續影像幀的延遲影像在離車身s距離內的範圍內的部分,在圖6(b)的增益w是往遠離車身方向以線性方式遞增;圖6(c)的增益w則是以二次曲線方程往遠離車身方向遞增,同樣地,這些增益的運算 可內建於處理單元103成為預設值。詳細來說,如在車輛移動到下一位置時,期間所被使用到的連續影像幀的延遲影像的每一幀都可透過前述的增益計算來降低車輛陰影或是車燈對於影像品質的影響,最後,通過處理單元103將這些經過增益運算後的連續影像幀的延遲影像組成對應於車輛的底盤區域的影像(即本發明的第二影像),且儲存於儲存單元105。以上本發明的增益運算僅以本實施方式舉例說明,但不限於前述增益運算的方法。對於預先儲存的連續影像幀的延遲影像可根據對應於車輛的外側區域301作整體的增益運算,換言之,不僅是車輛側邊方向的區域作增益運算,還包括整個對應於車輛的外側區域301的影像。 Based on the previous step S03, in order to process the pre-stored continuous image frames (ie, the delayed images of the continuous image frames) used to generate the chassis area 302 of the vehicle to reduce the impact of vehicle shadows or car lights on image quality. Therefore, the processing unit 103 of the present invention can perform gain operations on these pre-stored consecutive image frames to form an image (second image) corresponding to the chassis area 302 of the vehicle. In order to clearly illustrate the gain operation method, please refer to Figure 6. The pre-stored delayed image of the continuous image frame corresponds to the outer area 301 of the vehicle. At this time, there may be shadows or shadows caused by the vehicle itself in the area 301. For the light spots caused by the car lights, the processing unit 103 of the present invention performs a gain operation on the delayed images of the consecutive image frames. Taking the image gain operation in the side direction of the vehicle as an example (A-A' direction), the gain operation method can be, for example, As shown in Figure 6(a), the images within the range formed by the outward extension of the vehicle body by distance s are excluded in advance, that is, the gain w is 0. That is to say, the delayed images of consecutive image frames are within the range of distance s from the vehicle body. The part, that is, the area where shadows caused by the vehicle itself or spots caused by the headlights are most likely to occur will not be used to generate images of the chassis area 302 of the vehicle after the vehicle moves. When the gain w is not 0, it can be regarded as adjusting the weight value of the delayed image of consecutive image frames. For example, adjusting the image transparency of the delayed image of consecutive image frames in each frame until the gain w is 1 (at this time the transparency is 0). Generally speaking, s can be the distance from 40 cm to 60 cm from the outside of the vehicle body, or it can further be based on the driving status of the vehicle, such as day or night time, ambient light brightness, outdoor or indoor, GPS positioning signal, etc. The preset value built in the processing unit 103 is adjusted. As shown in Figure 6(a), in order to dilute the image caused by vehicle shadows or light spots caused by headlights, in addition to excluding in advance the part of the delayed image of the continuous image frame that is within the distance s from the vehicle body, the gain w in Figure 6(b) It increases in a linear manner in the direction away from the car body; the gain w in Figure 6(c) increases in a direction away from the car body based on the quadratic curve equation. Similarly, the calculation of these gains It can be built into the processing unit 103 to become a default value. Specifically, for example, when the vehicle moves to the next position, each frame of the delayed image of the consecutive image frames used during the period can use the aforementioned gain calculation to reduce the impact of vehicle shadows or car lights on image quality. , finally, the processing unit 103 combines the delayed images of the continuous image frames after the gain operation into an image corresponding to the chassis area of the vehicle (ie, the second image of the present invention), and stores it in the storage unit 105 . The above gain calculation of the present invention is only exemplified by this embodiment, but is not limited to the foregoing gain calculation method. For the delayed images of pre-stored consecutive image frames, the overall gain operation can be performed based on the outer area 301 corresponding to the vehicle. In other words, not only the area in the side direction of the vehicle is subjected to gain operation, but also the entire area corresponding to the outer area 301 of the vehicle. image.

步驟S05,通過拼接第一影像及第二影像即時產生一車輛環景影像。 Step S05: A vehicle panoramic image is generated in real time by splicing the first image and the second image.

針對車輛移動時經由連續影像幀的即時影像組成對應於車輛外側區域301的第一影像,以及通過對連續影像幀的延遲影像進行增益運算組成對應於所述車輛的底盤區域302的第二影像,在此步驟中,處理單元103便將第一影像及第二影像進行拼接以形成本發明的車輛環景影像300。由於本發明可通過結合在步驟S01期間的先前所儲存的連續影像幀,並根據行車資料預測車輛位置,加以計算後用來產生對應車輛的底盤區域302的影像,因此在任何時間,除了在車輛移動時可即時顯示車輛外側區域301的影像外,儘管車輛擋住攝影機視野的部分周圍環境(即車輛的底盤區域302),透過本發明步驟S01~步驟S05可實現彷佛車輛行駛過程中,攝影機視野無任何遮蔽般。本發明進一步考慮影像拼接的品質而言,對應於車輛外側區域301的第一影像是車輛行駛的當下連續影像幀的即時影像,而對應於所述車輛的底盤區域302的第二影像是連續影像幀的延遲影像,也就是車輛在稍早的位置預先儲存的連續影像幀,由於兩者影像有 著時間順序上的差異,因此在將影像進行拼接時,可能會造成影像的不連續,特別是發生在車輛移動時所伴隨的車輛陰影或是當車輛的車燈造成的光斑明顯時,即第一影像具有車輛陰影或是車燈造成的光斑,而第二影像在本發明中則是淡化車輛陰影或是車燈造成的光斑。因此在本發明中,處理單元103還可以進一步比對第一影像及第二影像間的影像差異,並進行影像的調整,如亮度、對比或是伽瑪值(gamma)等相關影像參數。具體作法如圖7,處理單元103可以計算第一影像及第二影像在拼接處附近區域的影像值,如車輛外側區域301還包括一影像比對區域303,該影像比對區域303相鄰車輛的底盤區域302,以本發明的實施方式可以由車身側向外延伸30公分以內所形成的區域範圍。通過比對在影像比對區域303中的連續影像幀的即時影像與連續影像幀的延遲影像來調整車輛外側區域301的第一影像或車輛的底盤區域302的第二影像,使第一影像及第二影像在拼接時不產生太大的影像差異,甚至可因本步驟的比對,調整第一影像存在車輛陰影或是車燈造成的光斑時的影像,藉以提升車輛環景影像的品質。 When the vehicle is moving, the real-time image of the continuous image frames is used to form a first image corresponding to the vehicle outer area 301, and a second image corresponding to the chassis area 302 of the vehicle is formed by performing a gain operation on the delayed image of the continuous image frames, In this step, the processing unit 103 splices the first image and the second image to form the vehicle surrounding image 300 of the present invention. Since the present invention can combine the previously stored continuous image frames during step S01 and predict the vehicle position based on the driving data, and then calculate and use it to generate the image corresponding to the chassis area 302 of the vehicle, therefore at any time, except when the vehicle In addition to the fact that the image of the vehicle outer area 301 can be displayed in real time when moving, even though the vehicle blocks part of the surrounding environment (i.e., the chassis area 302 of the vehicle) of the camera's field of view, through steps S01 to S05 of the present invention, it can be realized that the camera's field of view is as if the vehicle is driving. Like any cover. The present invention further considers the quality of image stitching. The first image corresponding to the vehicle outer area 301 is a real-time image of the current continuous image frame of the vehicle driving, and the second image corresponding to the vehicle's chassis area 302 is a continuous image. The delayed image of the frame is the continuous image frame pre-stored by the vehicle at an earlier position. Since the two images are different There is a difference in time order, so when splicing the images, it may cause discontinuity in the images, especially when the shadow of the vehicle is accompanied by the movement of the vehicle or when the light spot caused by the headlights of the vehicle is obvious, that is, the first One image has vehicle shadows or light spots caused by car lights, while the second image in the present invention dilutes vehicle shadows or light spots caused by car lights. Therefore, in the present invention, the processing unit 103 can further compare the image difference between the first image and the second image, and adjust the image, such as brightness, contrast, gamma and other related image parameters. The specific method is shown in Figure 7. The processing unit 103 can calculate the image value of the first image and the second image in the area near the splicing point. For example, the vehicle outer area 301 also includes an image comparison area 303, and the image comparison area 303 is adjacent to the vehicle. The chassis area 302 can be an area formed by extending outward from the side of the vehicle body within 30 centimeters according to the embodiment of the present invention. The first image of the vehicle outer area 301 or the second image of the vehicle chassis area 302 is adjusted by comparing the real-time image of the continuous image frames and the delayed image of the continuous image frames in the image comparison area 303, so that the first image and The second image does not produce much image difference during stitching. The comparison in this step can even adjust the first image when there are vehicle shadows or light spots caused by car lights, thereby improving the quality of the vehicle surrounding image.

步驟S06,顯示車輛環景影像。 Step S06: Display the vehicle surrounding image.

經由前述步驟S01至步驟S05,當處理單元103已完成影像的拼接後,可透過連接一顯示模組(未示出)以作為車輛環景影像300的輸出顯示,實作上,顯示模組可以是LCD、OLED、PLED或Micro LED監視器。優選地,顯示模組亦可以具有可以互動的觸控功能。影像顯示的方式,除了可顯示拼接後的車輛環景影像300,也可以顯示車輛的框架,可以為半透明顯示或完全不顯示車輛的框架,可依照駕駛員喜好,透過顯示模組選擇即可。 Through the aforementioned steps S01 to S05, after the processing unit 103 has completed the splicing of the images, it can be connected to a display module (not shown) as the output display of the vehicle surrounding image 300. In practice, the display module can Be it an LCD, OLED, PLED or Micro LED monitor. Preferably, the display module may also have an interactive touch function. The image display method can not only display the spliced vehicle panoramic image 300, but also display the frame of the vehicle. It can be semi-transparent or not display the frame of the vehicle at all. It can be selected through the display module according to the driver's preference. .

以上所述,僅是本發明的較佳實施例,並非對本發明作任何形式上的限制,雖然本發明已以較佳實施例揭露如上,然而並非用以限定本發明,任何熟悉本專業的技術人員,在不脫離本發明技術方案範圍內,當可利用上述揭示的方法及技術內容作出些許的更動或修飾為等同變化的等效實施例,但凡是未脫離本發明技術方案的內容,依據本發明的技術實質對以上實施例所作的任何簡單修改、等同變化與修飾,均仍屬於本發明技術方案的範圍內。 The above are only preferred embodiments of the present invention, and do not limit the present invention in any form. Although the present invention has been disclosed above in preferred embodiments, it is not intended to limit the present invention. Anyone familiar with the art of this field will Personnel, without departing from the scope of the technical solution of the present invention, can use the methods and technical contents disclosed above to make slight changes or modifications to equivalent embodiments with equivalent changes. Technical Essence of the Invention Any simple modifications, equivalent changes and modifications made to the above embodiments still fall within the scope of the technical solution of the invention.

S01~S06:步驟 S01~S06: Steps

Claims (5)

一種車輛環景影像顯示方法,包含以下步驟:通過裝設於一車輛上的複數個攝影機擷取所述車輛移動時的周圍環境影像,並藉由一影像訊息接收模組以產生連續影像幀並傳送至一處理單元;藉由所述處理單元通過所述連續影像幀的即時影像組成對應於所述車輛外側區域的第一影像;藉由一車輛訊息總成介面接收所述車輛的行車資料並傳送至所述處理單元;藉由所述處理單元來計算所述行車資料來得到所述連續影像幀的延遲影像,並通過對所述連續影像幀的延遲影像進行增益運算組成對應於所述車輛的底盤區域的第二影像,再通過拼接所述第一影像及所述第二影像即時產生一車輛環景影像,其中所述增益運算包含調整所述連續影像幀的延遲影像在每一幀的影像透明度變化;以及藉由一顯示模組顯示所述車輛環景影像。 A vehicle surround image display method includes the following steps: capturing images of the surrounding environment when the vehicle is moving through a plurality of cameras installed on a vehicle, and using an image message receiving module to generate continuous image frames and Transmitted to a processing unit; the processing unit uses the real-time images of the continuous image frames to form a first image corresponding to the outside area of the vehicle; receives the driving data of the vehicle through a vehicle information assembly interface and Sent to the processing unit; the processing unit calculates the driving data to obtain delayed images of the continuous image frames, and performs gain operations on the delayed images of the continuous image frames to form a corresponding image corresponding to the vehicle The second image of the chassis area is then spliced to generate a vehicle surround image in real time by splicing the first image and the second image, wherein the gain operation includes adjusting the delayed image of the consecutive image frames in each frame. The image transparency changes; and the vehicle surrounding image is displayed through a display module. 如申請專利範圍第1項所述的車輛環景影像顯示方法,其特徵在於,所述車輛外側區域還包括一影像比對區域,所述處理單元通過比對在所述影像比對區域中的所述連續影像幀的即時影像與所述連續影像幀的延遲影像來調整所述第一影像或第二影像。 The vehicle panoramic image display method described in item 1 of the patent application is characterized in that the vehicle outer area also includes an image comparison area, and the processing unit compares the images in the image comparison area. The real-time image of the continuous image frames and the delayed image of the continuous image frames are used to adjust the first image or the second image. 如申請專利範圍第1項所述的車輛環景影像顯示方法,其特徵在於,所述處理單元將所述連續影像幀從第一視角執行座標轉換為第二視角。 The vehicle panoramic image display method described in claim 1 of the patent application is characterized in that the processing unit performs coordinate conversion of the continuous image frames from the first perspective to the second perspective. 如申請專利範圍第1項所述的車輛環景影像顯示方法,其特徵在於,所述車輛的行車資料至少包含所述車輛的轉向角、車速、檔位。 The vehicle surround image display method described in item 1 of the patent application is characterized in that the driving data of the vehicle at least includes the steering angle, vehicle speed and gear position of the vehicle. 如申請專利範圍第2項所述的車輛環景影像顯示方法,其特徵在於,所述影像比對區域相鄰所述車輛的底盤區域。 The vehicle panoramic image display method described in item 2 of the patent application is characterized in that the image comparison area is adjacent to the chassis area of the vehicle.
TW111135700A 2022-09-21 2022-09-21 Vehicle surrounding image display method TWI834301B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW111135700A TWI834301B (en) 2022-09-21 2022-09-21 Vehicle surrounding image display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW111135700A TWI834301B (en) 2022-09-21 2022-09-21 Vehicle surrounding image display method

Publications (2)

Publication Number Publication Date
TWI834301B true TWI834301B (en) 2024-03-01
TW202414333A TW202414333A (en) 2024-04-01

Family

ID=91269434

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111135700A TWI834301B (en) 2022-09-21 2022-09-21 Vehicle surrounding image display method

Country Status (1)

Country Link
TW (1) TWI834301B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111937378A (en) * 2018-04-03 2020-11-13 爱信精机株式会社 Image processing apparatus
CN114162048A (en) * 2021-12-08 2022-03-11 上海寅家电子科技股份有限公司 System and method for ensuring safe driving of vehicle

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111937378A (en) * 2018-04-03 2020-11-13 爱信精机株式会社 Image processing apparatus
CN114162048A (en) * 2021-12-08 2022-03-11 上海寅家电子科技股份有限公司 System and method for ensuring safe driving of vehicle

Also Published As

Publication number Publication date
TW202414333A (en) 2024-04-01

Similar Documents

Publication Publication Date Title
CN112224132B (en) Vehicle panoramic all-around obstacle early warning method
TWI600559B (en) System and method for image processing
EP3565739B1 (en) Rear-stitched view panorama for rear-view visualization
JP5222597B2 (en) Image processing apparatus and method, driving support system, and vehicle
KR100522218B1 (en) Monitor camera, method of adjusting camera, and vehicle monitor system
TWI578271B (en) Dynamic image processing method and dynamic image processing system
US8134608B2 (en) Imaging apparatus
JP2008085446A (en) Image generating apparatus and image generating method
CN111800589A (en) Image processing method, device and system, and robot
US12417642B2 (en) System to integrate high distortion wide-angle camera recognition with low distortion normal-angle camera recognition
US12387455B2 (en) Image processing system, mobile object, image processing method, and storage medium, with output of image recognition result integrtated on basis of first result regarding image recognition on at least partial region and second result regarding image recognition on wider region
US20160037154A1 (en) Image processing system and method
CN111402132B (en) Reversing auxiliary method and system, image processor and corresponding auxiliary driving system
JP3453960B2 (en) Vehicle periphery monitoring device
US12080075B2 (en) Method for generating an image of vehicle surroundings, and apparatus for generating an image of vehicle surroundings
KR20240118670A (en) Image processing system, movable apparatus, image processing method, and storage medium
TWI834301B (en) Vehicle surrounding image display method
TWI672526B (en) Near-eye display system and display method thereof
CN117774834A (en) Vehicle surrounding view image display method
CN114493989A (en) Vehicle bottom perspective display method, device and computer storage medium
CN117799536A (en) A pure visual transparent chassis implementation method and system based on four-way vehicle cameras
JP2008117369A (en) Semiconductor integrated circuit device and rendering processing display system
CN218839318U (en) 360-degree panoramic multi-interface visual system of loader
US20250130069A1 (en) Moving image map processing method, device, system and vehicle thereof
JP5196472B2 (en) Image display processing program and image display processing system