TW201810124A - Automobile model and year identification system and method for easily and quickly obtaining automobile model information and year information through image recognition - Google Patents
Automobile model and year identification system and method for easily and quickly obtaining automobile model information and year information through image recognition Download PDFInfo
- Publication number
- TW201810124A TW201810124A TW105124505A TW105124505A TW201810124A TW 201810124 A TW201810124 A TW 201810124A TW 105124505 A TW105124505 A TW 105124505A TW 105124505 A TW105124505 A TW 105124505A TW 201810124 A TW201810124 A TW 201810124A
- Authority
- TW
- Taiwan
- Prior art keywords
- vehicle
- image
- model
- year
- data
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 21
- 230000010365 information processing Effects 0.000 claims abstract description 28
- 230000005540 biological transmission Effects 0.000 claims description 23
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 15
- 238000006073 displacement reaction Methods 0.000 claims description 14
- 238000013135 deep learning Methods 0.000 claims description 11
- 238000007781 pre-processing Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 8
- 238000011156 evaluation Methods 0.000 claims description 6
- 238000012549 training Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 10
- 238000007637 random forest analysis Methods 0.000 description 6
- 238000003066 decision tree Methods 0.000 description 5
- 230000008054 signal transmission Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000007621 cluster analysis Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000009429 distress Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Landscapes
- Image Analysis (AREA)
Abstract
Description
本發明係有關一種車款年式辨識系統及方法,尤指一種可以方便快速地取得車款及年式資訊的車款影像辨識技術。 The present invention relates to a vehicle model identification system and method, and more particularly to a vehicle model image identification technology that can conveniently and quickly obtain vehicle model and year information.
依據相關報導,台灣地區自西元1995年起,中古車的過戶數量首次超越新車的領牌數。直到西元2010年為止,新車交易量僅為30萬輛,反觀中古車卻高達40萬輛的水準。中古車市場雖然會受到新車市場低迷所影響,但是依據交通部監理單位的統計得知,台灣目前中古車的產值一年可以達到約新台幣1000億元左右,可見,台灣地區中古車市場的交易確實是非常的熱絡,因此,各大車商業者看準國內中古車市場的商機及龐大的市場規模,於是紛紛投入中古車市場的經營行列。 According to related reports, since 1995, the number of transfers of used cars in Taiwan has exceeded the number of licenses for new cars for the first time. Until 2010, only 300,000 new cars were traded, compared with 400,000 used cars. Although the used car market will be affected by the downturn in the new car market, according to statistics from the supervision unit of the Ministry of Transport, the current output value of used cars in Taiwan can reach about NT $ 100 billion a year. It can be seen that the transactions in the used car market in Taiwan It is indeed very enthusiastic. Therefore, the major car makers are aware of the business opportunities and huge market scale of the domestic used car market, so they have entered the operating ranks of the used car market.
再者,車商在收購中古車時,除了需仔細觀察車輛的內外部狀況之外,還需對車輛的品牌、車款以及年式範圍進行辨識,於此,方能依據上述之辨識結果來核對中古車行情表,進而做出合理與正確的車輛估價。然而,或許資深的車商業務人員可以對市面廣為流通的車輛進行上述之辨識估價,若是車輛為熱門品牌的冷門車款;或是冷門品牌的車款時,縱使是資深的車商業務人員還是無法做出合理與正確的車輛估價,因而造成車輛估價辨識上的不便與極大的困擾。 In addition, when buying a used car, in addition to carefully observing the internal and external conditions of the vehicle, the car manufacturer also needs to identify the brand, model, and year range of the vehicle, so that it can be based on the above identification results. Check the used car price list, and then make a reasonable and correct vehicle valuation. However, perhaps senior car dealer business personnel can carry out the above identification and evaluation on the widely circulated vehicles in the market. If the vehicle is a popular model of the unpopular car; or when the unpopular brand is a model, even the senior car dealer business staff Still unable to make a reasonable and correct vehicle valuation, thus causing inconvenience and great distress to vehicle valuation identification.
除此之外,警察人員在搜尋可疑車輛時,其隨身攜帶之辨識 裝置僅能辨識出車輛的車牌而已,至於辨識困難度較高的車款及年式之辨識則無法實現,故而警察人員在動線複雜的大型都會中尋找可疑車輛更是一件困難的事情,因此,如何開發出一種可以辨識車款及年式的影像辨識技術,實已成相關技術領域業者所急欲解決與挑戰的技術課題。 In addition, when police officers search for suspicious vehicles, their identification The device can only recognize the license plate of the vehicle. As for the more difficult models and years, the identification cannot be realized. Therefore, it is even more difficult for police officers to find suspicious vehicles in large and complex metropolises. Therefore, how to develop an image recognition technology that can identify car models and years has become a technical issue that is urgently sought to be solved and challenged by those in the relevant technical field.
為解決上述缺失,相關技術領域業者已然提出一種如中華民國發明公開第201040893號新型專利案所揭露的「車款辨識方法及裝置」,該專利係以車輛車窗之形狀作為辨識之特徵,且使用單應轉換將不同視角之車輛影像轉換至正規化座標系統以擷取出正規化車窗影像,該專利雖然可以透過影像辨識的方式辨識出目標車款,然而,該專利並無深度學習演算的機能建置,故無法以累積車款年式特徵資料的方式來強化資料庫的分類功能,以致無法提升車款年式的辨識成功率。 In order to solve the above-mentioned shortcomings, the related technical field has already proposed a "model identification method and device" as disclosed in the new patent case of the Republic of China Invention Publication No. 201040893. The patent uses the shape of a vehicle window as a feature of identification, Homogeneous transformation is used to convert vehicle images from different perspectives to the normalized coordinate system to capture normalized window images. Although the patent can identify the target vehicle through image recognition, the patent does not have deep learning algorithms. The function is built, so the classification function of the database cannot be enhanced by accumulating the annual model characteristic data of the car model, so that the success rate of the annual model identification cannot be improved.
有鑑於此,尚未有一種具備深度學習演算的車款年式識別及具備強化資料庫分類功能的專利或是論文被提出,而且基於相關產業的迫切需求之下,本發明人等乃經不斷的努力研發之下,終於研發出一套有別於上述習知技術與專利的本發明。 In view of this, there has not been a patent or a paper that has a vehicle model identification with deep learning calculations and an enhanced database classification function. Based on the urgent needs of related industries, the inventors have continuously After hard research and development, a set of inventions different from the above-mentioned conventional technologies and patents has finally been developed.
本發明第一目的,在於提供一種車款年式辨識系統及方法,主要是藉由車款年式辨識的機能設置而方便地辨識出車輛之車款年式資訊,以作為交易估價或是其他用途的辨識依據。達成本發明第一目的採用之技術手段,包括影像擷取裝置、車款影像資料庫、廠牌獲取模組及資訊處理裝置。車款影像資料庫建立包含至少二視角的車款影像樣本,並於車款影像樣本設定有特徵資料,再於每一特徵資料設定有一個車款資料及 一個年式資料。影像擷取裝置用以擷取至少二視角的車輛影像。資訊處理裝置以影像辨識分析出經過影像前處理後之至少二視角車輛影像的二特徵值,再依據品牌訊息而於對應之廠牌車系資料庫比對出辨形相似度約百分之七十以上的二特徵資料,並由二特徵資料得到對應的車款資料及對應的年式資料,俾能透過影像辨識而方便快速地取得車輛之車款資訊及年式資訊。 The first object of the present invention is to provide a vehicle year identification system and method. The vehicle year identification information is mainly used to conveniently identify the vehicle year information of the vehicle for transaction valuation or other purposes. Identification basis of use. The technical means adopted to achieve the first purpose of the invention include an image capture device, a car image database, a brand acquisition module and an information processing device. The car model image database establishes a car model image sample with at least two perspectives, and sets feature data in the car model image sample, and then sets a car model data and An annual information. The image capturing device is used for capturing vehicle images with at least two perspectives. The information processing device analyzes the two feature values of the at least two-viewpoint vehicle images after image pre-processing through image recognition, and then compares the discriminative similarity of about 7% with the corresponding brand car database based on the brand information. More than ten two-characteristic data, and corresponding two-characteristic data to obtain the corresponding car model data and corresponding year-type data, can not easily and quickly obtain vehicle model information and year-type information through image recognition.
本發明第二目的,在於提供一種具備自動估價功能的車款年式辨識系統及方法,主要是於取得車款及年式資料後,自動計算出該車輛的合理估價值,以縮短因翻閱中古車行情表所需花費的找尋時間。達成本發明第二目的採用之技術手段,包括影像擷取裝置、車款影像資料庫、廠牌獲取模組及資訊處理裝置。車款影像資料庫建立包含至少二視角的車款影像樣本,並於車款影像樣本設定有特徵資料,再於每一特徵資料設定有一個車款資料及一個年式資料。影像擷取裝置用以擷取至少二視角的車輛影像。資訊處理裝置以影像辨識分析出經過影像前處理後之至少二視角車輛影像的二特徵值,再依據品牌訊息而於對應之廠牌車系資料庫比對出辨形相似度約百分之七十以上的二特徵資料,並由二特徵資料得到對應的車款資料及對應的年式資料,俾能透過影像辨識而方便快速地取得車輛之車款資訊及年式資訊。其更包含位於該車款年式辨識步驟之後的估價步驟,係於該車款影像資料庫中之每一該車款資料及對應之該年式資料設定有至少一種價格資料,當完成該車款年式辨識步驟時,該資訊處理裝置則將符合之該價格資料輸出為價格資訊。 A second object of the present invention is to provide a vehicle model identification system and method with an automatic valuation function, which is mainly to automatically calculate a reasonable valuation value of the vehicle after obtaining the vehicle model and the annual model information, so as to shorten the time spent reading the ancient Search time required by the car market. The technical means used to achieve the second purpose of the invention include an image capture device, a car image database, a brand acquisition module, and an information processing device. The car model image database establishes car model image samples including at least two perspectives, and sets feature data in the car model image samples, and then sets one model data and one year-type data in each feature data set. The image capturing device is used for capturing vehicle images with at least two perspectives. The information processing device analyzes the two feature values of the at least two-viewpoint vehicle images after image pre-processing through image recognition, and then compares the discriminative similarity of about 7% with the corresponding brand car database based on the brand information. More than ten two-characteristic data, and corresponding two-characteristic data to obtain the corresponding car model data and corresponding year-type data, can not easily and quickly obtain vehicle model information and year-type information through image recognition. It further includes an evaluation step that is located after the car model year identification step. Each car model data and corresponding year model data in the car model image database are set with at least one price data. When the car is completed, During the year-type identification step, the information processing device outputs the corresponding price data as price information.
本發明第三目的,在於提供一種以預定視角與位置來擷取車 輛影像,以獲得不同視角位置之車輛影像來提升車款年式辨識成功機率的車款年式辨識系統及方法。達成本發明第三目的採用之技術手段,包括影像擷取裝置、車款影像資料庫、廠牌獲取模組及資訊處理裝置。車款影像資料庫建立包含至少二視角的車款影像樣本,並於車款影像樣本設定有特徵資料,再於每一特徵資料設定有一個車款資料及一個年式資料。影像擷取裝置用以擷取至少二視角的車輛影像。資訊處理裝置以影像辨識分析出經過影像前處理後之至少二視角車輛影像的二特徵值,再依據品牌訊息而於對應之廠牌車系資料庫比對出辨形相似度約百分之七十以上的二特徵資料,並由二特徵資料得到對應的車款資料及對應的年式資料,俾能透過影像辨識而方便快速地取得車輛之車款資訊及年式資訊。其更包含一拍攝位移控制單元,該拍攝位移控制單元包含一移動機構、一傳動機構及二滑軌,該移動機構不同位置可供設置至少二該影像擷取裝置,該移動機構可受該傳動機構驅動而沿著該二滑軌自一第一位置與一第二位置之間做往復的位移,當該車輛停置於該二滑軌之間位置且該移動機構位於該第一位置時,其一該影像擷取裝置則擷取該車輛之其一視角的車輛影像;當該移動機構位移至該第二位置時,其二該影像擷取裝置則擷取該車輛之其二視角的車輛影像。 A third object of the present invention is to provide a vehicle for capturing a vehicle with a predetermined viewing angle and position. Vehicle image recognition system and method for obtaining vehicle image of different perspective positions to improve the success rate of vehicle model identification. The technical means adopted to achieve the third purpose of the invention include an image capture device, a car image database, a brand acquisition module and an information processing device. The car model image database establishes car model image samples including at least two perspectives, and sets feature data in the car model image samples, and then sets one model data and one year-type data in each feature data set. The image capturing device is used for capturing vehicle images with at least two perspectives. The information processing device analyzes the two feature values of the at least two-viewpoint vehicle images after image pre-processing through image recognition, and then compares the discriminative similarity of about 7% with the corresponding brand car database based on the brand information. More than ten two-characteristic data, and corresponding two-characteristic data to obtain the corresponding car model data and corresponding year-type data, can not easily and quickly obtain vehicle model information and year-type information through image recognition. It further includes a photographing displacement control unit, which includes a moving mechanism, a transmission mechanism, and two slide rails. At least two image capturing devices can be set at different positions of the moving mechanism, and the moving mechanism can be subject to the transmission. The mechanism is driven to make a reciprocating displacement from a first position to a second position along the two slide rails. When the vehicle is parked at the position between the two slide rails and the moving mechanism is located at the first position, One of the image capturing devices captures a vehicle image from one perspective of the vehicle; when the moving mechanism is moved to the second position, the other of the image capturing device captures a vehicle from another perspective of the vehicle image.
1‧‧‧車輛 1‧‧‧ vehicle
10,10a,10b,10c‧‧‧影像擷取裝置 10, 10a, 10b, 10c‧‧‧‧Image capture device
20‧‧‧車款影像資料庫 20‧‧‧Car Model Image Database
21‧‧‧廠牌車系資料庫 21‧‧‧brand car series database
30‧‧‧廠牌獲取模組 30‧‧‧Label Acquisition Module
40‧‧‧資訊處理裝置 40‧‧‧ Information Processing Device
40a‧‧‧網路伺服器 40a‧‧‧web server
40b‧‧‧電腦裝置 40b‧‧‧Computer device
50‧‧‧拍攝位移控制單元 50‧‧‧shooting displacement control unit
51‧‧‧移動機構 51‧‧‧ mobile agency
510‧‧‧載架 510‧‧‧ carrier
511‧‧‧滑輪組 511‧‧‧ pulley block
52‧‧‧傳動機構 52‧‧‧ Transmission mechanism
520‧‧‧馬達 520‧‧‧Motor
521‧‧‧傳動齒輪組 521‧‧‧drive gear set
53‧‧‧滑軌 53‧‧‧Slide
54‧‧‧框格 54‧‧‧ sash
55‧‧‧控制模組 55‧‧‧control module
56‧‧‧位置感測模組 56‧‧‧Position sensing module
60‧‧‧訊號傳輸模組 60‧‧‧Signal transmission module
圖1係本發明具體架構的功能方塊實施示意圖。 FIG. 1 is a schematic diagram of functional block implementation of a specific architecture of the present invention.
圖2係本發明深度學習實施架構的功能方塊示意圖。 FIG. 2 is a functional block diagram of the deep learning implementation architecture of the present invention.
圖3係本發明車輛影像擷取後上傳至雲端進行影像辨識的實施示意圖。 FIG. 3 is a schematic diagram of the image recognition of the vehicle of the present invention after being captured and uploaded to the cloud.
圖4係本發明車輛影像擷取後上傳至電腦進行影像辨識的實施示意圖。 FIG. 4 is a schematic diagram of implementation of image recognition of a vehicle of the present invention after being captured and uploaded to a computer.
圖5係本發明移動機構位於第一位置的實施示意圖。 FIG. 5 is a schematic diagram of the moving mechanism of the present invention in a first position.
圖6係本發明移動機構位於中段位置的實施示意圖。 FIG. 6 is a schematic diagram showing the implementation of the moving mechanism of the present invention at a middle position.
圖7係本發明移動機構位於第二位置的實施示意圖。 FIG. 7 is a schematic diagram of the moving mechanism of the present invention in a second position.
圖8係本發明拍攝位移控制單元於前視角度的部分剖視示意圖。 FIG. 8 is a schematic partial cross-sectional view of a photographing displacement control unit of the present invention at a front-view angle.
圖9係本發明傳動機構於俯視角度的剖視示意圖。 FIG. 9 is a schematic cross-sectional view of the transmission mechanism of the present invention at a plan angle.
圖10係本發明框選框選影像為車輛大燈組及水箱罩之特徵的示意圖。 FIG. 10 is a schematic diagram of the frame selection image selected by the present invention as a feature of a vehicle headlight group and a water tank cover.
圖11係本發明框選框選影像為車側車窗組之特徵的示意圖。 FIG. 11 is a schematic diagram of a frame selection image selected by the present invention as a feature of a vehicle side window group.
圖12係本發明框選框選影像為車輛後燈組之特徵的示意圖。 FIG. 12 is a schematic diagram of a frame selection image selected by the present invention as a feature of a vehicle rear lamp group.
為讓 貴審查委員能進一步瞭解本發明整體的技術特徵與達成本發明目的之技術手段,玆以具體實施例並配合圖式加以詳細說明: In order to allow your reviewers to further understand the overall technical features of the present invention and the technical means for achieving the purpose of the present invention, specific embodiments and drawings are described in detail below:
請配合參看圖1~3所示,為達成本發明第一目的之第一實施例,係包括至少二影像擷取裝置10、一車款影像資料庫20、一廠牌獲取模組30及一資訊處理裝置40等技術特徵。首先係於車款影像資料庫20建立有包含複數個廠牌車系資料庫21(例如豐田車系資料庫、日產車系資料庫、三菱車系資料庫、福特車系資料庫及馬自達車系資料庫等;但不以上述廠牌為限),每一廠牌車系資料庫21建立複數個包含有至少二個視角的車款影像樣本,並於每一視角之車款影像樣本設定有一特徵資料,再於每一特徵資料設定有一車款資料及一年式資料。以至少二影像擷取裝置10擷取車輛至少二個視角的車輛影像。並於資訊處理裝置40內建有一影像辨識軟體,於執行影像辨識軟體時,則依序包含下列之影像處理步驟: Please refer to Figs. 1 to 3, the first embodiment for achieving the first purpose of the present invention includes at least two image capturing devices 10, a car image database 20, a brand acquisition module 30 and a Technical characteristics such as the information processing device 40. First of all, it is based on the car image database 20, which contains a number of brand car models database 21 (such as Toyota car database, Nissan car database, Mitsubishi car database, Ford car database and Mazda car series). Database, etc .; but not limited to the above brands), each brand car department database 21 establishes a plurality of vehicle image samples containing at least two perspectives, and sets a model image sample of each model Feature data, and then set a car model data and one-year data in each feature data. The at least two image capturing devices 10 capture vehicle images of at least two perspectives of the vehicle. An image recognition software is built into the information processing device 40. When the image recognition software is executed, it includes the following image processing steps in sequence:
(a)影像前處理步驟:係預先分別於每一視角之車輛影像中框選出至少 一個小於車輛影像面積的框選影像(可預先定義框選影像特定區域之複數個像素的座標值;或是以手動框選的方式來實現),然後去除框選影像以外的影像,再將框選影像進行影像前處理;例如依序對框選影像進行灰階轉換處理、高斯平滑處理及二值化處理。此外,必須說明的是,為加快影像處理速度,如圖10所示之框選影像為涵蓋車輛前方的二個大燈組及水箱罩的矩形框選影像;或是如圖11所示之框選影像為是涵蓋車輛側方的車窗組的矩形框選影像;或是如圖12所示之框選影像則是涵蓋車輛後方的二個尾燈組的矩形框選影像。 (a) Image pre-processing steps: At least one frame is selected in advance from the vehicle image at each perspective. A frame selection image smaller than the area of the vehicle image (coordinate values of a plurality of pixels of a specific area of the frame selection image can be defined in advance; or by manual frame selection), and then remove the image other than the frame selection image, and then frame the frame Select the image for image preprocessing; for example, perform grayscale conversion processing, Gaussian smoothing, and binarization processing on the frame-selected image in sequence. In addition, it must be noted that, in order to speed up the image processing speed, the frame selection image shown in FIG. 10 is a rectangular frame selection image covering the two headlight groups and the water tank cover in front of the vehicle; or the frame shown in FIG. 11 The selection image is a rectangular frame selection image covering the window groups on the side of the vehicle; or the frame selection image shown in FIG. 12 is a rectangular frame selection image covering the two rear light groups on the rear of the vehicle.
(b)深度學習步驟:如圖2所示,係執行一具備深度學習訓練功能的深度學習演算法,以累積特徵資料來強化車款影像資料庫20的分類功能;具體來說,深度學習演算法可以是人工類神經網路演算法、專家系統演算法以及隨機森林演算法等諸多的人工智慧演算法。 (b) Deep learning steps: As shown in Figure 2, a deep learning algorithm with deep learning training functions is executed to enhance the classification function of the car image database 20 by accumulating feature data; specifically, the deep learning algorithm The method can be many artificial intelligence algorithms such as artificial neural network algorithms, expert system algorithms, and random forest algorithms.
(c)車款年式辨識步驟:係以影像辨識分析出經過影像前處理後之至少二個視角之車輛影像的二特徵值,再依據品牌訊息而於對應之廠牌車系資料庫比對出與二特徵值之辨形相似度約百分之七十以上的二特徵資料,並由二特徵資料得到對應的車款資料及對應的年式資料,再由資訊處理裝置再處理轉換為車款資訊及年式資訊。當上述二特徵資料所得到的車款資料都為相同時,則表示所預先設定之辨形相似度的設定值為正確,故不需調整辨形相似度的設定值;反之,當上述二特徵資料所得到的車款資料為不相同時,則表示所預先設定之辨形相似度的設定值過低,故可藉由上調辨形相似度的設定值(如將辨形相似度上調至百分之八十以上),直到上述二特徵資料所得到的車款資料相同為止。 (c) Car model identification step: The two feature values of the vehicle image of at least two perspectives after image pre-processing are analyzed by image recognition, and then compared with the corresponding brand car series database based on the brand information The two-characteristic data with a discriminative similarity to the two-characteristic values of about 70% or more are obtained, and the corresponding model data and corresponding year-type data are obtained from the two-characteristic data, and then processed by the information processing device and converted into a car Information and year information. When the vehicle model data obtained by the above two characteristic data are all the same, it means that the preset similarity setting value is correct, so there is no need to adjust the setting similarity setting value; otherwise, when the above two characteristics are When the vehicle model data obtained from the data are different, it means that the preset similarity setting value is too low, so you can increase the setting value of the similarity value (such as increasing the similarity value to 100). 80% or more), until the vehicle model data obtained by the above two characteristics data is the same.
基於上述實施例的一種應用實施例中,資訊處理裝置40可以是網路伺服器、電腦、智慧型手機;或是平板電腦。如圖3所示係表示資訊處理裝置40為網路伺服器40a,在取得車輛影像後,可透過有線或無 線之訊號傳輸模組60(例如有線或無線通訊網路與網路傳輸介面的組合)之資訊連結而上傳至網路伺服器,並由伺服器來進行上述的影像處理步驟;另外,圖4所示之資訊處理裝置40為電腦,在取得上述車輛影像後,再透過有線或無線之訊號傳輸模組60(例如RS232、USB等傳輸介面)傳輸至電腦40b中,再由電腦40b來進行上述的影像處理步驟。 In an application embodiment based on the above embodiments, the information processing device 40 may be a network server, a computer, a smart phone, or a tablet computer. As shown in FIG. 3, it indicates that the information processing device 40 is a network server 40a. The information of the line signal transmission module 60 (such as a combination of a wired or wireless communication network and a network transmission interface) is uploaded to a network server, and the server performs the above-mentioned image processing steps. In addition, FIG. 4 The information processing device 40 shown is a computer. After obtaining the vehicle image, it is transmitted to the computer 40b through a wired or wireless signal transmission module 60 (such as RS232, USB and other transmission interfaces), and the computer 40b performs the above-mentioned Image processing steps.
本實施例為達成本發明第二目的之第二實施例,本實施例大致上與上述第一實施例的技術架構雷同,二者之技術差異在於,本實施例更包括一在車款年式辨識步驟執行之後的估價步驟,於執行估價步驟時,係於車款影像資料庫20中之每一車款資料及對應之年式資料設定有至少一種價格資料,當完成車款年式辨識步驟時,資訊處理裝置40則將符合之價格資料輸出為價格資訊。 This embodiment is a second embodiment for achieving the second purpose of the present invention. This embodiment is substantially the same as the technical structure of the first embodiment described above. The technical difference between the two is that this embodiment further includes The evaluation step after the identification step is performed. At the time of performing the evaluation step, at least one price data is set for each car model data and corresponding year-type data in the car model image database 20. When the car model year-end identification step is completed At this time, the information processing device 40 outputs the matched price data as price information.
請配合參看圖1~4所示,為達成本發明第三目的之第三實施例,本實施例大致上與上述第一實施例的技術架構雷同,二者之技術差異在於,本實施例係更包括一拍攝位移控制單元50,此拍攝位移控制單元50包含一移動機構51、一傳動機構52及二滑軌53。移動機構51不同位置可供設置至少二組影像擷取裝置10。移動機構51可受傳動機構52驅動而沿著二滑軌53自一第一位置與一第二位置之間做往復的位移;當車輛1停置於二滑軌53之間位置且移動機構51位於第一位置時(如圖5所示),其一影像擷取裝置10a則擷取車輛1之其一視角,如圖5所示係由上往下傾斜的前視角度)的車輛影像,此車輛影像如圖10所示;當移動機構51位移至第二位置時,如圖7所示,其二影像擷取裝置10b則擷取車輛1之其二視角(如圖7所示由上往下傾斜的後視角度)的車輛影像,此車輛影像如圖12所示。 Please refer to FIG. 1 to FIG. 4 for a third embodiment for achieving the third purpose of the present invention. This embodiment is substantially the same as the first embodiment in the technical architecture. The technical difference between the two is that this embodiment is It further includes a photographing displacement control unit 50. The photographing displacement control unit 50 includes a moving mechanism 51, a transmission mechanism 52, and two slide rails 53. The moving mechanism 51 can be provided with at least two sets of image capturing devices 10 at different positions. The moving mechanism 51 can be driven by the transmission mechanism 52 to make a reciprocating displacement between a first position and a second position along the two slide rails 53; when the vehicle 1 is parked at a position between the two slide rails 53 and the moving mechanism 51 When it is located at the first position (as shown in FIG. 5), an image capturing device 10a captures a vehicle perspective of the vehicle 1, as shown in FIG. 5 (a forward-looking angle inclined from top to bottom), This vehicle image is shown in FIG. 10; when the moving mechanism 51 is displaced to the second position, as shown in FIG. 7, the second image capturing device 10b captures the other two perspectives of the vehicle 1 (as shown in FIG. 7 from above). A downwardly tilted rear-view angle) vehicle image. This vehicle image is shown in FIG. 12.
具體來說,請配合參看圖5~9所示之移動機構51係包含 一略呈ㄇ型的載架510,及二分別樞設於載架510之二末端的滑輪組511,二滑輪組511可供沿著二滑軌轉動53移動;圖8、9所示之傳動機構52係包含二組馬達520及二組傳動齒輪組521,用以分別帶動二滑輪組511以前進、後退及停止等方式沿著二滑軌53移動;除此之外,圖5~7所示之二滑軌53之間劃設有一供車輛1停放拍照的框格54;另,如圖1所示之拍攝位移控制單元50更包含一控制模組55,及一位置感測模組56;此位置感測模組56用以感測車輛1是否停置於框格54內,感測結果為是則輸出一感測訊號至控制模組55,經控制模組解讀後啟動其一影像擷取裝置10a,以擷取車輛之其一視角的車輛影像,經過一預設時間(約1~30秒)後,控制模組55則觸發傳動機構52,令傳動機構52驅動載架510自第一位置移至第二位置,並啟動其二影像擷取裝置10b,以擷取車輛1之其二視角的車輛影像,再經過一預設時間(約1~30秒)後,控制模組再次觸發傳動機構52,以驅動載架510自第二位置回到原本的第一位置。具體來說,圖3~5所示之其一影像擷取裝置10a位於載架510頂部的前側面,且其一影像擷取裝置10a之鏡頭的軸線與平面(即X、Y軸)具有30~70度的夾角;其二影像擷取裝置10b位於載架510頂部的後側面,且其二影像擷取裝置10b之鏡頭的軸線與平面(即X、Y軸)具有30~70度的夾角。此外,影像擷取裝置10更包含一位於載架之一側部的其三影像擷取裝置10c,載架510自第一位置往第二位置移動的過程中,當載架510進入至第一位置與第二位置之間的中段位置時,控制模組55則令傳動機構52停止運作一預設時間(約10~50秒),並啟動其三影像擷取裝置10c,以擷取車輛之其三視角(即圖6所示之側視角度)的車輛影像(即圖11所示的車輛影像)。 Specifically, please cooperate with the moving mechanism 51 shown in Figs. A carrier frame 510 which is slightly ㄇ -shaped, and two pulley sets 511 pivoted at the two ends of the carrier 510, and the two pulley sets 511 can be rotated along the two slide rails 53; the transmission mechanism 52 shown in Figs. 8 and 9 The system includes two sets of motors 520 and two sets of transmission gear sets 521, which are used to drive the two pulley sets 511 to move forward, backward, and stop along the two slide rails 53; in addition, the two shown in Figures 5-7 A frame 54 is provided between the slide rails 53 for the vehicle 1 to park and take pictures. In addition, the photographing displacement control unit 50 shown in FIG. 1 further includes a control module 55 and a position sensing module 56; this position The sensing module 56 is used to sense whether the vehicle 1 is parked in the frame 54. If the sensing result is yes, a sensing signal is output to the control module 55. After being interpreted by the control module, an image capturing device is activated. 10a, to capture a vehicle image from one perspective of the vehicle. After a preset time (about 1 to 30 seconds), the control module 55 triggers the transmission mechanism 52 to cause the transmission mechanism 52 to drive the carrier 510 from the first position. Move to the second position, and activate the second image capturing device 10b to capture the vehicle image of the vehicle 2 from two perspectives, After a preset time (about 1 to 30 seconds) has passed, the control module triggers the transmission mechanism 52 again to drive the carrier 510 from the second position to the original first position. Specifically, one of the image capturing devices 10a shown in FIGS. 3 to 5 is located on the front side of the top of the carrier 510, and the axis and plane of the lens of the image capturing device 10a (ie, the X and Y axes) have 30 An angle of ~ 70 degrees; the second image capturing device 10b is located on the rear side of the top of the carrier 510, and the lens axis and plane (ie, X and Y axes) of the second image capturing device 10b have an angle of 30 to 70 degrees . In addition, the image capturing device 10 further includes a three image capturing device 10c located on one side of the carrier. During the movement of the carrier 510 from the first position to the second position, when the carrier 510 enters the first At the middle position between the position and the second position, the control module 55 stops the transmission mechanism 52 for a preset time (about 10-50 seconds) and activates its three image capturing device 10c to capture the vehicle's A vehicle image (that is, a vehicle image shown in FIG. 11) of three viewing angles (that is, a side view angle shown in FIG. 6).
除此之外,於上述影像處理步驟中,本發明係採用樣板特徵比對法,依序對各視角車輛影像計算出足以描述車輛特徵的特徵值, 而上述特徵資料係為一種特徵表,每一特徵表寫入一特定品牌且依序排列的車款與年式類別,於影像處理步驟時,本發明係採用隨機森林演算法將各車輛影像之各特徵值逐一與各特徵表進行比對,於此,即可得到相應的車款與年式類別(如豐田品牌:車款為ALTIS:年式為2010~2015年份等)。 In addition, in the above-mentioned image processing steps, the present invention uses a template feature comparison method to sequentially calculate the feature values sufficient to describe the characteristics of the vehicle from the vehicle images at various perspectives. The above feature data is a feature table. Each feature table writes a specific brand and the car models and year types arranged in order. In the image processing step, the present invention uses a random forest algorithm to separate each vehicle image. Each feature value is compared with each feature table one by one. Here, the corresponding car model and year type can be obtained (such as the Toyota brand: the model is ALTI: the year is 2010-2015, etc.).
具體來說,本發明在影像處理步驟中,係使用類似樣板特徵比對法的概念,為找出需要辨認之車款與年式類別,且需透過辨識軟體的撰寫,以計算出足以描述車輛影像之物件特徵的數值,此即為元件特徵值(即上述特徵值);接著,蒐集許多彼此間存在著些微相異的樣板物件(即車款影像樣本),透過隨機森林演算法,進行特徵積累與演算訓練,以計算出它們之間應該歸屬在不同的幾個車款與年式類別,這種方式與聚類(Cluster)分析的原理相同;假設有一車輛1影像之元件集合C,系統必須計算所有元件之特徵值用來比對辨識,計算公式如下:
公式(1)中,w與h分別表示車輛1影像特徵擷取區域之寬度與高度,x與y為隨機產生之座標位置,範圍限制在車輛1框選影像中,p則代表(x,y)座標上之像素值;公式(2)中,所有p屬於像素值集合P,下標i為0到n,表示集合中的第幾個像素值,f為特徵二元碼,下標j為1 到n;這個公式的意思是,若當前像素值不等於下一個像素值,則特徵二元碼為1,否則為0;公式(3)為合併特徵二元碼之公式,隨機座標點依照由上而下順序排列,以輔助虛線區隔,最上層的座標點像素值為p 0,最下層為p 6,因為p 0與p 1不相等,故f 1為1,又因為p 1與p 2相等,故f 2為0,以此類推,最後得到該元件之特徵值為100111,並透過(3)式得到F等於39;由此範例說明了如何計算特徵二元碼,以數值描述該元件之特徵,另一方面,若隨機產生越多的座標點,則特徵二元碼會有越多的位元。 In formula (1), w and h respectively represent the width and height of the feature capture area of the vehicle 1 image, x and y are randomly generated coordinate positions, and the range is limited to the frame 1 selected image of the vehicle. P represents ( x , y ) The pixel value in the coordinates; in formula (2), all p belong to the pixel value set P , the subscript i is 0 to n , which represents the number of pixel values in the set, f is the feature binary code, and the subscript j is 1 to n ; this formula means that if the current pixel value is not equal to the next pixel value, the feature binary code is 1, otherwise it is 0; formula (3) is a formula combining feature binary codes, and the random coordinate points are according to They are arranged in order from top to bottom, separated by auxiliary dotted lines. The pixel value of the coordinate point at the top layer is p 0 , and the bottom layer is p 6. Because p 0 is not equal to p 1 , f 1 is 1, and because p 1 and p 2 is equal, so f 2 is 0, and so on. Finally, the characteristic value of the component is 100111, and F is equal to 39 through formula (3). This example shows how to calculate the feature binary code, which is described by numerical values. The feature of the element, on the other hand, if the more coordinate points are randomly generated, the more bits of the feature binary code will be.
本實施例係以隨機森林演算法作為上述深度學習演算法,車款年式辨識步驟是透過參照特徵表的方式進行投票,得票最多者即視為該元件的所屬的車款年式類別。由隨機產生的三組特徵值萃取位置,代入車款影像樣本所計算出來的特徵表,每個元件對應到不同的特徵表會有不同的索引值,當系統計算出車輛1影像的特徵值後,按照查表的方式,於表1中對應的車款與年式類別進行投票,得到最多票的類別即為該元件的辨識結果。舉例來說,輸入一個元件並計算其特徵,由第一組萃取位置計算後得到特徵值42,第二組為80,第三組為22,則對應的VIOS,2010~2015年式的車款與年式類別得到2票,CAMRY,2005~2010年式的車款與年式類別得到1票,系統則判斷此車輛1之品牌為豐田,車款為VIOS,年式為2010~2015年份。 In this embodiment, the random forest algorithm is used as the above-mentioned deep learning algorithm. The vehicle model year identification step is to vote by referring to the feature table. The person who receives the most votes is regarded as the vehicle model year category to which the component belongs. The positions are extracted from three randomly generated feature values and substituted into the feature table calculated by the car image sample. Each element corresponds to a different feature table with a different index value. After the system calculates the feature value of the vehicle 1 image According to the way of checking the table, the corresponding car models and year-type categories in Table 1 are voted, and the category with the most votes is the identification result of the component. For example, input a component and calculate its characteristics. After calculating the feature location from the first group, the characteristic value is 42, the second group is 80, and the third group is 22. The corresponding VIOS, 2010-2015 model Two votes were obtained for the year-and-year category, and one vote for the CAMRY, 2005-2010 year and year-year category. The system judged that the brand of this vehicle 1 was Toyota, the model was VIOS, and the year was 2010-2015.
本發明採用之影像辨識法係屬於隨機森林演算法(Random Forest,RF)的變形,在描述影像特徵的部分,是在影像中產生多組隨機座標,藉由比較、組合,得到屬於目標影像的特徵二元碼,並由後續演算法達到影像追蹤的目的。本發明的作法為部分採取該法之運用方式,設計了適用於車款與年式類別辨識的分類器;在車款與年式類別辨識的系統處理過程中,可以從實際影像,作為欲偵測目標建立其特徵,由隨機產生置的座標取得該點像素值,透過相互間像素值比較的方式設定位元值,將所有得到的二元碼做為表示該影像的元件特徵值,元件特徵計算完成後,將透過車輛1影像資料庫中之車款影像樣本所建立的多組特徵表,代表為元件的集成分類器(Ensemble Classifier),最後再進行元件辨識。 The image recognition method used in the present invention belongs to the deformation of the Random Forest Algorithm (RF). In describing the characteristics of the image, multiple sets of random coordinates are generated in the image, and the images belonging to the target image are obtained by comparison and combination. Feature binary code, and the follow-up algorithm to achieve the purpose of image tracking. The method of the present invention adopts the application method of this method in part, and designs a classifier suitable for vehicle type and year type identification. In the system processing process of vehicle type and year type identification, the actual image can be used as the detection target. The measurement target establishes its characteristics, obtains the pixel value of the point from the randomly generated coordinates, sets the bit value by comparing the pixel values with each other, and uses all the obtained binary codes as the component feature values and component features of the image. After the calculation is completed, multiple sets of feature tables created from the vehicle image samples in the image database of Vehicle 1 are used to represent the component's integrated classifier (Ensemble Classifier), and finally component identification is performed.
本發明在起初創建森林時,不用隨機採樣的方式建立決策樹,而是將所有元件樣板(即車款影像樣本)輸入,依據不同的特徵值萃取位置,建立出不同的決策樹,形成「特徵表森林」,最後透過訓練的方式將每個弱分類的能力增強,使森林有很好的元件辨識能力。再者,一個決策樹是基於隨機產生的座標點集合,投入所有樣板後建立而成,一棵決策樹模型可被定義如下公式(4)所示:
由於應變辨識的演算法,必須依賴樣板特徵(即車款影像樣本)使其強健,作為特徵表建立所需要的樣板資料(即特徵資料),數量越多越好,可以讓車輛1影像資料庫的分類器更具強健性,至此,每個車款與年式類別大約可以各有100張左右的比對車款影像樣本,共計約700張比對車款影像樣本。再者,本發明所採用之隨機森林演算法的概念,並根據特殊設計的特徵值萃取方式,將表示特徵的數值轉換成一棵棵的決策樹,即特徵表,藉此作為集成車款與年式類別的分類器,透過實作結果得知,每一個特徵表都具有將近7成以上的辨識能力,可以獨立分辨出測試資料將近70%以上的車款年式類別。 Due to the strain identification algorithm, it is necessary to rely on the template features (that is, the vehicle image samples) to make it robust. As the feature table is required to build the template data (that is, the feature data), the larger the number, the better. The classifier is more robust. So far, each car model and year category can each have about 100 comparison car image samples, for a total of about 700 comparison car image samples. Furthermore, the concept of the random forest algorithm used in the present invention, and according to a specially designed feature value extraction method, the values representing the features are converted into a decision tree, that is, a feature table, as an integrated model and year The classifier of the type category knows from the implementation results that each feature table has a recognition ability of more than 70%, and can independently distinguish the annual model of the car model with more than 70% of the test data.
以上所述,僅為本發明之可行實施例,並非用以限定本發明之專利範圍,凡舉依據下列請求項所述之內容、特徵以及其精神而為之其他變化的等效實施,皆應包含於本發明之專利範圍內。本發明所具體界定於請求項之結構特徵,未見於同類物品,且具實用性與進步性,已符合發明專利要件,爰依法具文提出申請,謹請 鈞局依法核予專利,以維護本申請人合法之權益。 The above description is only a feasible embodiment of the present invention, and is not intended to limit the patent scope of the present invention. Any equivalent implementation of other changes based on the content, characteristics and spirit of the following claims should be It is included in the patent scope of the present invention. The structural features specifically defined in the present invention are not found in similar items, and are practical and progressive. They have met the requirements for invention patents. They have filed applications in accordance with the law. I would like to request the Bureau to verify the patents in accordance with the law in order to maintain this document. Applicants' legitimate rights and interests.
1‧‧‧車輛 1‧‧‧ vehicle
10,10a,10b,10c‧‧‧影像擷取裝置 10, 10a, 10b, 10c‧‧‧‧Image capture device
20‧‧‧車款影像資料庫 20‧‧‧Car Model Image Database
21‧‧‧廠牌車系資料庫 21‧‧‧brand car series database
30‧‧‧廠牌獲取模組 30‧‧‧Label Acquisition Module
40‧‧‧資訊處理裝置 40‧‧‧ Information Processing Device
50‧‧‧拍攝位移控制單元 50‧‧‧shooting displacement control unit
52‧‧‧傳動機構 52‧‧‧ Transmission mechanism
55‧‧‧控制模組 55‧‧‧control module
56‧‧‧位置感測模組 56‧‧‧Position sensing module
60‧‧‧訊號傳輸模組 60‧‧‧Signal transmission module
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW105124505A TWI596552B (en) | 2016-08-02 | 2016-08-02 | Car models recognition system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW105124505A TWI596552B (en) | 2016-08-02 | 2016-08-02 | Car models recognition system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI596552B TWI596552B (en) | 2017-08-21 |
| TW201810124A true TW201810124A (en) | 2018-03-16 |
Family
ID=60189173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW105124505A TWI596552B (en) | 2016-08-02 | 2016-08-02 | Car models recognition system and method |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI596552B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI755669B (en) * | 2020-01-02 | 2022-02-21 | 中華電信股份有限公司 | Homogeneous vehicle retrieval system and method |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109711357A (en) * | 2018-12-28 | 2019-05-03 | 北京旷视科技有限公司 | A kind of face identification method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708691B (en) * | 2011-12-26 | 2015-04-22 | 南京信息工程大学 | False license plate identification method based on matching between license plate and automobile type |
| CN105654066A (en) * | 2016-02-02 | 2016-06-08 | 北京格灵深瞳信息技术有限公司 | Vehicle identification method and device |
-
2016
- 2016-08-02 TW TW105124505A patent/TWI596552B/en not_active IP Right Cessation
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI755669B (en) * | 2020-01-02 | 2022-02-21 | 中華電信股份有限公司 | Homogeneous vehicle retrieval system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| TWI596552B (en) | 2017-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Özkanoğlu et al. | InfraGAN: A GAN architecture to transfer visible images to infrared domain | |
| Weinland et al. | Free viewpoint action recognition using motion history volumes | |
| JP7649350B2 (en) | SYSTEM AND METHOD FOR DETECTING AND CLASSIFYING PATTERNS IN IMAGES WITH A VISION SYSTEM - Patent application | |
| US9842266B2 (en) | Method for detecting driver cell phone usage from side-view images | |
| US8774465B2 (en) | System and method for providing automotive purchase, insurance quote, and vehicle financing information using vehicle recognition | |
| CN111126224A (en) | Vehicle detection method and classification recognition model training method | |
| CN107992819B (en) | Method and device for determining vehicle attribute structural features | |
| CN108875600A (en) | A kind of information of vehicles detection and tracking method, apparatus and computer storage medium based on YOLO | |
| CN114038007B (en) | A pedestrian re-identification method combining style transformation and pose generation | |
| Hu et al. | LE–MSFE–DDNet: a defect detection network based on low-light enhancement and multi-scale feature extraction | |
| WO2016150240A1 (en) | Identity authentication method and apparatus | |
| CN114140025B (en) | Auto insurance fraud prediction system, method and device for multimodal data | |
| CN111783654B (en) | Vehicle weight identification method and device and electronic equipment | |
| CN113689475A (en) | Cross-border head trajectory tracking method, equipment and storage medium | |
| CN113469143A (en) | Finger vein image identification method based on neural network learning | |
| Wang et al. | A UAV to UAV tracking benchmark | |
| Ngxande et al. | Detecting inter-sectional accuracy differences in driver drowsiness detection algorithms | |
| Hasan et al. | GroundingCarDD: Text-guided multimodal phrase grounding for car damage detection | |
| JP2015128228A (en) | Image processing apparatus, image processing system, image processing method, image processing program, and moving body control device | |
| Suárez et al. | Cross-spectral image patch similarity using convolutional neural network | |
| TWI596552B (en) | Car models recognition system and method | |
| Ding et al. | Oilpalm-RTMDet: An lightweight oil palm detector base on RTMDet | |
| CN101996315A (en) | System, method and program product for camera-based object analysis | |
| CN115170471A (en) | Part identification method and device based on image identification model | |
| Li et al. | Research on hybrid information recognition algorithm and quality of golf swing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |