[go: up one dir, main page]

TWI894931B - Electronic device and method for excluding misjudgment of driver violation behavior detection - Google Patents

Electronic device and method for excluding misjudgment of driver violation behavior detection

Info

Publication number
TWI894931B
TWI894931B TW113116167A TW113116167A TWI894931B TW I894931 B TWI894931 B TW I894931B TW 113116167 A TW113116167 A TW 113116167A TW 113116167 A TW113116167 A TW 113116167A TW I894931 B TWI894931 B TW I894931B
Authority
TW
Taiwan
Prior art keywords
local
electronic device
probability
historical
current
Prior art date
Application number
TW113116167A
Other languages
Chinese (zh)
Other versions
TW202543863A (en
Inventor
謝翔宇
Original Assignee
神達數位股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 神達數位股份有限公司 filed Critical 神達數位股份有限公司
Priority to TW113116167A priority Critical patent/TWI894931B/en
Application granted granted Critical
Publication of TWI894931B publication Critical patent/TWI894931B/en
Publication of TW202543863A publication Critical patent/TW202543863A/en

Links

Landscapes

  • Traffic Control Systems (AREA)

Abstract

一種具有誤判排除功能的駕駛違規行為偵測方法,由一電子裝置來實施,包含以下步驟:(A)產生並儲存一當前影像;(B)利用一本地物件偵測模型判斷一司機是否發生駕駛違規行為並產生一本地偵測結果,根據多張在一預定時間區間拍攝的目標歷史影像,及該當前影像,產生多個本地歷史聯合機率,及一本地當前聯合機率;(C)根據該等本地歷史聯合機率,及該本地當前聯合機率,產生一本地機率密度函數;(D)根據該本地機率密度函數,及一基準真相機率密度函數,產生一誤差值;(E)判定該誤差值是否小於一預設閾值(F)若小於該預設閾值,確定該該本地偵測結果為可信成立;及(G) 若大於該預設閾值,確定該本地偵測結果為不可信,重複步驟(A)。 A method for excluding misjudgment of driver violation behavior detection is implemented using an electronic device. The method includes the following steps: (A) generating and storing a current image; (B) using a local object detection model to determine whether a driver commits driving violation and generate a local detection result, and generating a plurality of local historical joint probabilities and a local current joint probability according to a plurality of target historical images captured during a predetermined time interval and the current image; (C) generating a local probability density function (PDF) according to the plurality of local historical joint probabilities and the local current joint probability; (D) generating an error value according to the local PDF and a ground truth PDF; (E) determining whether the error value is less than a preset threshold; (F) if yes, determining the local detection result is credible; and (G) if no, determining the local detection result is incredible and repeating step (A). A method for detecting driving violations with a false positive elimination function, implemented by an electronic device, includes the following steps: (A) generating and storing a current image; (B) using a local object detection model to determine whether a driver has committed a driving violation and generating a local detection result. The method generates multiple local historical joint probabilities based on multiple historical images of the target captured within a predetermined time period and the current image. and a local current joint probability; (C) generating a local probability density function based on the local historical joint probabilities and the local current joint probability; (D) generating an error value based on the local probability density function and a reference truth probability density function; (E) determining whether the error value is less than a preset threshold; (F) if the error value is less than the preset threshold, determining that the local detection result is reliable; and (G) if the error value is greater than the preset threshold, determining that the local detection result is unreliable, and repeating step (A). A method for excluding misjudgment of driver violation behavior detection is using an electronic device. The method includes the following steps: (A) generating and storing a current image; (B) using a local object detection model to determine whether implemented a driver commits driving violation and generate a local detection result, and generating a plurality of local historical joint probabilities and a local current joint probability according to a plurality of target historical images captured during a predetermined time interval and the current image; (C) generating a local probability density function (PDF) according to the plurality of local historical joint probabilities and the local current joint probability; (D) generating an error value according to the local PDF and a ground truth PDF; (E) determining whether the error value is less than a preset threshold; (F) if yes, determining the local detection result is credible; and (G) if no, determining the local detection result is incredible and repeating step (A).

Description

一種具有誤判排除功能的駕駛違規行為偵測方法及電子裝置A method and electronic device for detecting driving violations with a misjudgment elimination function

本發明是有關於一種偵測駕駛違規行為的技術,特別是指一種具有誤判排除功能的駕駛違規行為偵測方法及電子裝置。The present invention relates to a technology for detecting driving violations, and more particularly to a method and electronic device for detecting driving violations with a misjudgment elimination function.

運輸公司會透過車用駕駛監控系統(Driver Monitoring System, DMS)偵測司機是否有違規行為,例如打瞌睡、分心,或講電話,以對公司所屬的司機的駕車行為進行品質監控和管理。車用駕駛控系統主要是利用車內攝影機拍攝司機,搭配影像辨識技術分析司機的駕車行為,若是偵測到司機有違規行為,就會將事件上傳到雲端。Transportation companies use driver monitoring systems (DMS) to monitor and manage the driving behavior of their drivers, detecting violations such as drowsiness, distraction, or phone calls. DMS primarily utilizes in-car cameras to film the driver and analyze their behavior using image recognition technology. If any violations are detected, the incident is uploaded to the cloud.

車用駕駛監控系統除了偵測司機是否有違規行為之外,還會搭配例如行車錄影、多鏡頭影像辨識、事件上傳等多工處理功能。受限於硬體平台的資源分配,車用駕駛監控系統大多是使用輕量化的偵測模型或是偵測演算法,進行影像偵測分析處理。In addition to detecting driver violations, vehicle driver monitoring systems also incorporate multi-tasking capabilities such as driving video recording, multi-camera image recognition, and event upload. Limited by hardware platform resource allocation, most vehicle driver monitoring systems utilize lightweight detection models or algorithms for image detection, analysis, and processing.

然而,傳統對於違規行為的判別上常以單張幀(frame)的物件(例如:手機)辨識門檻值作為是否有講電話的判斷,同時使用輕量化的偵測模型或是偵測演算法容易無法兼顧環境中一些非預期的變化而造成該監控系統做出錯誤的影像辨識而產生誤判,導致發出誤警報或是漏警報的問題,另一方面還可能對司機違規行為的紀錄產生影響,同時若是頻繁的誤警報更是會讓司機失去對該監控系統的信賴。However, traditional methods for identifying violations often use a single-frame recognition threshold (e.g., a cell phone) to determine if a call is being made. Furthermore, lightweight detection models or algorithms often fail to account for unexpected environmental changes, leading to image recognition errors and misjudgments, resulting in false alarms or missed alarms. Furthermore, these errors can negatively impact the driver's record of violations. Frequent false alarms can also cause drivers to lose trust in the system.

因此,本發明之目的,即在提供一種具有誤判排除功能的駕駛違規行為偵測方法。Therefore, the purpose of the present invention is to provide a method for detecting driving violations with the function of eliminating misjudgments.

於是,本發明具有誤判排除功能的駕駛違規行為偵測方法,適用於判斷一司機在駕駛一車輛時是否發生一駕駛違規行為,由一設置於該車輛內的一電子裝置來實施,該電子裝置儲存有一當前時間點拍攝該司機的影像及多張在過去時間點的歷史影像、一用以判定影像是否含有多個特徵物件的本地物件偵測模型,及一由一伺服器預先提供的基準真相機率密度函數,該電子裝置連續拍攝該司機以便連續產生並儲存該司機之影像,該駕駛違規偵測方法包含一步驟(A)、一步驟(B)、一步驟(C)、一步驟(D)、一步驟(E)、一步驟(F),及一步驟(G)。Therefore, the present invention has a driving violation detection method with a misjudgment elimination function, which is suitable for judging whether a driver has committed a driving violation while driving a vehicle. The method is implemented by an electronic device installed in the vehicle. The electronic device stores an image of the driver taken at a current time point and multiple historical images taken at past time points, and a method for judging whether the image contains multiple features. A local object detection model of an object and a ground truth probability density function pre-provided by a server are provided. The electronic device continuously photographs the driver to continuously generate and store images of the driver. The driving violation detection method includes step (A), step (B), step (C), step (D), step (E), step (F), and step (G).

在該步驟(A)中,該電子裝置在一當前時間點拍攝該司機,以產生並儲存一當前影像。In step (A), the electronic device captures the driver at a current time point to generate and store a current image.

在該步驟(B)中,該電子裝置利用該本地物件偵測模型,根據多張在該等歷史影像中在一預定時間區間拍攝的目標歷史影像,及該當前影像,產生多個分別對應該等目標歷史影像的本地歷史聯合機率,及一對應該當前影像的本地當前聯合機率。In step (B), the electronic device utilizes the local object detection model to generate a plurality of local historical joint probabilities corresponding to the target historical images and a local current joint probability corresponding to the current image based on a plurality of target historical images captured within a predetermined time period in the historical images and the current image.

在該步驟(C)中,該電子裝置根據該等本地歷史聯合機率,及該本地當前聯合機率,產生一相關於在該當前影像及該等目標歷史影像中發生該駕駛違規行為之機率分布的本地機率密度函數。In the step (C), the electronic device generates a local probability density function related to the probability distribution of the driving violation occurring in the current image and the target historical images based on the local historical joint probabilities and the local current joint probability.

在該步驟(D)中,該電子裝置根據該本地機率密度函數,及該基準真相機率密度函數,產生一誤差值。In the step (D), the electronic device generates an error value according to the local probability density function and the reference truth probability density function.

在該步驟(E)中,該電子裝置判定該誤差值是否小於一預設閾值。In the step (E), the electronic device determines whether the error value is less than a preset threshold.

在該步驟(F)中,當判定出該誤差值小於該預設閾值時,該電子裝置產生一指示該本地偵測結果為可信的檢測結果。In the step (F), when it is determined that the error value is less than the preset threshold, the electronic device generates a detection result indicating that the local detection result is reliable.

本發明之另一目的,即在提供一種避免誤判的駕駛違規行為電子裝置。Another object of the present invention is to provide an electronic device for preventing misjudgment of driving violations.

於是,本發明具有誤判排除的駕駛違規行為偵測電子裝置,適用於判斷一司機在駕駛一車輛時是否發生一駕駛違規行為,設置於該車輛內,該具有誤判排除的駕駛違規行為偵測電子裝置包含一儲存單元、一拍攝單元,及一處理單元。Therefore, the present invention provides an electronic device for detecting driving violations with the ability to exclude false positives. The device is suitable for determining whether a driver has committed a driving violation while driving a vehicle. The device is installed in the vehicle and includes a storage unit, a camera unit, and a processing unit.

該儲存單元,儲存有多張在過去時間點拍攝該司機的歷史影像、一用以判定影像是否含有多個特徵物件的本地物件偵測模型,及一基準真相機率密度函數。The storage unit stores a plurality of historical images of the driver taken at past time points, a local object detection model for determining whether the image contains a plurality of feature objects, and a ground truth probability density function.

該拍攝單元,電連接該拍攝該儲存單元,用以連續拍攝該司機以便連續產生並儲存該司機之影像至該儲存單元。The shooting unit is electrically connected to the shooting and storage unit for continuously shooting the driver so as to continuously generate and store images of the driver in the storage unit.

該處理單元電連接該拍攝單元及該儲存單元。The processing unit is electrically connected to the photographing unit and the storage unit.

其中,該拍攝單元在一當前時間點拍攝該司機,以產生並儲存一當前影像至該儲存單元,該處理單元利用該本地物件偵測模型偵測司機是否產生違規行為,例如使用手機講電話,接著根據多張在該等歷史影像中在一預定時間區間拍攝的目標歷史影像,及該當前影像,產生多個分別對應該等目標歷史影像的本地歷史聯合機率,及一對應該當前影像的本地當前聯合機率,該處理單元根據該等本地歷史聯合機率,及該本地當前聯合機率,產生一相關於在該當前影像及該等目標歷史影像中發生該違規行為之機率分布的本地機率密度函數,該處理單元根據該本地機率密度函數,及該基準真相機率密度函數,產生一誤差值,該電子裝置判定該誤差值是否小於一預設閾值,當判定出該誤差值小於該預設閾值時,該電子裝置產生一指示該本地偵測結果為可信的檢測結果。The shooting unit shoots the driver at a current time point to generate and store a current image in the storage unit. The processing unit uses the local object detection model to detect whether the driver has committed any illegal behavior, such as using a mobile phone to talk on the phone. Then, based on a plurality of target historical images shot within a predetermined time period in the historical images and the current image, a plurality of local historical joint probabilities corresponding to the target historical images and a local current joint probability corresponding to the current image are generated. The processing unit generates a local current joint probability corresponding to the current image. Based on the local historical joint probabilities and the local current joint probability, a local probability density function is generated, which is related to the probability distribution of the illegal behavior occurring in the current image and the target historical images. The processing unit generates an error value based on the local probability density function and the reference truth probability density function. The electronic device determines whether the error value is less than a preset threshold. When it is determined that the error value is less than the preset threshold, the electronic device generates a detection result indicating that the local detection result is reliable.

本發明之功效在於:藉由本地機率密度函數及該基準真相機率密度函數,檢視兩者間的誤差值,並判定該誤差值是否小於該預設閾值,當判定出該誤差值小於該預設閾值時,表示該本地物件偵測模型所判斷的該本地偵測結果可信,當判定出該誤差值不小於該預設閾值時,表示該本地物件偵測模型所判斷的該本地偵測結果不可信,則該電子裝置將重新產生一新的當前影像並且重新偵測計算,可以在有判斷疑慮的情況下重新進行影像辨識與計算,以降低駕駛違規行為偵測時的誤判及誤警報的情況發生。The present invention utilizes a local probability density function and a ground-truth probability density function to examine the error between the two and determine whether the error is less than a preset threshold. If the error is less than the threshold, the local object detection model's local detection results are reliable. If the error is not less than the threshold, the local object detection model's local detection results are unreliable. The electronic device then generates a new current image and performs new detection calculations. Image recognition and calculations can be re-performed in cases of doubt, reducing the likelihood of misjudgments and false alarms during driving violation detection.

在本發明被詳細描述之前,應當注意在以下的説明內容中,類似的元件是以相同的編號來表示。Before the present invention is described in detail, it should be noted that similar elements are denoted by the same reference numerals in the following description.

參閱圖1,本發明適用於實施具有誤判排除功能的駕駛違規行為偵測方法的電子裝置1的一實施例,包含一儲存單元11、一通訊單元12、一拍攝單元13,及一處理單元14,其中該些單元可藉由電連接方式進行相關資料或數據的傳輸。該電子裝置1用於實施一種具有誤判排除功能的駕駛違規行為偵測方法,該誤判排除的功能適用於針對一物件偵測模型所產生之指示一司機在駕駛一車輛時是否發生違規行為的一本地偵測結果,判斷該本地偵測結果是否有誤判發生。Referring to FIG. 1 , the present invention is applicable to an embodiment of an electronic device 1 for implementing a method for detecting driving violations with a misjudgment elimination function. The device includes a storage unit 11, a communication unit 12, a camera unit 13, and a processing unit 14. These units can be electrically connected to transmit relevant information or data. The electronic device 1 is used to implement a method for detecting driving violations with a misjudgment elimination function. The misjudgment elimination function is applied to a local detection result generated by an object detection model, indicating whether a driver has engaged in a misjudgment while driving a vehicle, and determines whether the local detection result contains a misjudgment.

要特別注意的是,在本實施例中,該違規行為例如為以手持電話通話同時駕駛車輛,該電子裝置1例如為車用駕駛監控系統,在其他實施方式中,該違規行為亦可例如為打瞌睡,不以此為限。因此,舉例來說,若駕駛並未於駕駛時手持電話通話,但本地偵測結果指示該駕駛於駕駛時手持電話通話,則上述誤判排除的功能將判斷出本地偵測結果指示為誤判。It is important to note that in this embodiment, the violation is, for example, talking on a handheld phone while driving, and the electronic device 1 is, for example, a vehicle driver monitoring system. In other embodiments, the violation may also be, for example, dozing off, without limitation. Therefore, for example, if the driver was not talking on a handheld phone while driving, but the local detection results indicate that the driver was talking on a handheld phone while driving, the above-mentioned false positive detection function will determine that the local detection results indicate a false positive.

該儲存單元11儲存有多張在過去時間點拍攝該司機的歷史影像、一用以判定影像是否含有多個特徵物件的本地物件偵測模型,及一基準真相機率密度函數。該基準真相機率密度函數可以是在該電子裝置1出廠時的原廠設定,也可以是該電子裝置1於使用過程中,執行校正程序之後與伺服器通訊時,接收自前述伺服器,並不以此為限。The storage unit 11 stores a plurality of historical images of the driver taken at past time points, a local object detection model used to determine whether an image contains multiple characteristic objects, and a ground truth probability density function. The ground truth probability density function can be the factory setting of the electronic device 1 or received from the server during use after the electronic device 1 performs a calibration procedure and communicates with the server, but the present invention is not limited thereto.

該通訊單元12經由一通訊網路100連接一遠端伺服器101。該遠端伺服器101儲存有一用以判定影像是否含有多個特徵物件的遠端物件偵測模型。The communication unit 12 is connected to a remote server 101 via a communication network 100. The remote server 101 stores a remote object detection model for determining whether an image contains multiple feature objects.

值得注意的是,在本實施例中,該本地物件偵測模型及該遠端物件偵測模型皆是以一深度學習的方式建立,且該本地物件偵測模型用以根據呈現出該司機的影像並利用影像辨識的技術,產出指示該司機在駕駛車輛的過程中是否發生違規行為的偵測結果。所述違規行為例如包含但不限於打瞌睡、使用行動電話等。通常來說,由於車內空間大小、司機行車視線的考量,偵測該司機違規行為的該電子裝置1的體積傾向小型化設計,因此該電子裝置1內部空間所搭載的硬體的效能有限,僅能使用數位訊號處理器(Digital Signal Processor, DSP)進行運算,故該本地物件偵測模型可執行的運算層數較少,變數可能只會是整數形式,參數數值的解析度較差。反之,該遠端伺服器101相較於該可偵測駕駛違規行為電子裝置1,較無硬體上的限制,可使用圖形處理器(Graphics Processing Unit)進行運算,故該遠端物件偵測模型可執行的運算層數較多,變數可多為浮點數,參數數值的解析度較高,因此該遠端伺服器101藉由較高階之綜合運算能力,對該遠端物件偵測模型採用更完整且架構更嚴謹之演算法進行影像辨識,以得到相較於該本地物件偵測模型可信度更高的偵測結果。It is worth noting that in this embodiment, both the local object detection model and the remote object detection model are built using a deep learning approach. The local object detection model uses image recognition technology to generate a detection result indicating whether the driver has engaged in any illegal behavior while driving the vehicle. Examples of illegal behavior include, but are not limited to, dozing off or using a mobile phone. Generally speaking, due to considerations of vehicle interior space and the driver's line of sight, the electronic device 1 used to detect the driver's illegal behavior tends to be miniaturized. Consequently, the hardware contained within the electronic device 1 has limited performance, requiring only a digital signal processor (DSP) for computation. Consequently, the local object detection model can only perform a limited number of computational layers, and variables may only be integers, resulting in poor resolution of parameter values. In contrast, the remote server 101 is less hardware-restricted than the electronic device 1 capable of detecting driving violations and can use a graphics processing unit (GPU) for computation. Therefore, the remote object detection model can execute more computational layers, with more variables being floating-point numbers and parameter values having a higher resolution. Therefore, the remote server 101 utilizes higher-level comprehensive computational capabilities to employ a more complete and rigorously structured algorithm for image recognition in the remote object detection model, thereby obtaining detection results with a higher degree of reliability than the local object detection model.

要特別注意的是,在本實施例中,由於該違規行為係以手持電話通話,故該等特徵物件例如為手機、手、臉,及嘴,在其他實施方式,該等特徵物件可僅為手機及手,但不以此為限。It should be noted that in this embodiment, since the illegal behavior is to make a call with a handheld phone, the characteristic objects are, for example, a mobile phone, a hand, a face, and a mouth. In other embodiments, the characteristic objects may only be a mobile phone and a hand, but are not limited to this.

該拍攝單元13電連接該儲存單元11,用以連續拍攝該司機以便連續產生並儲存該司機之影像至該儲存單元11,其中拍攝區域包含司機臉部及駕駛座周圍之影像,但不以此為限。The shooting unit 13 is electrically connected to the storage unit 11 for continuously shooting the driver so as to continuously generate and store images of the driver in the storage unit 11, wherein the shooting area includes images of the driver's face and the area around the driver's seat, but is not limited thereto.

要特別注意的是,在本實施例中,該拍攝單元13每秒拍攝一張影像,但不以此為限。It should be noted that, in this embodiment, the photographing unit 13 photographs one image per second, but the present invention is not limited thereto.

該處理單元14電連接該儲存單元11、該通訊單元12,及該拍攝單元13。The processing unit 14 is electrically connected to the storage unit 11, the communication unit 12, and the photographing unit 13.

參閱圖1、2、3,說明該具有誤判排除功能的駕駛違規行為偵測方法的一實施例。以下詳細說明該實施例所包含的步驟。Referring to Figures 1, 2, and 3, an embodiment of a method for detecting driving violations with a misjudgment elimination function is described. The following details the steps involved in this embodiment.

在步驟201中,該拍攝單元13在一當前時間點拍攝該司機,以產生並儲存一當前影像至該儲存單元11。In step 201, the photographing unit 13 photographs the driver at a current time point to generate and store a current image in the storage unit 11.

在步驟202中,該處理單元14判斷是否需要執行校正程序。當判斷出需要校正時,流程進行步驟203;而當判斷出不需要校正時,則流程進行步驟207。In step 202, the processing unit 14 determines whether a calibration procedure is required. If it is determined that calibration is required, the process proceeds to step 203; if it is determined that calibration is not required, the process proceeds to step 207.

要特別注意的是,在本實施例中,該處理單元14是根據該當前時間點及一預設週期判斷是否需要執行校正。當處理單元14根據該當前時間判定出已經歷一預設週期時,該處理單元14判定需要執行校正程序,但不以此為限。於此實施例中,該預設週期例如但不限於10分,若以09:00開始計算,則09:10、09:20、09:30等每間隔10分鐘便啟動進行校正。在其他實施方式中,該電子裝置1還包含一光線感測器(圖未示),當該光線感測器感測到光線環境變化時,例如車輛進入隧道、駛離隧道,導致環境中形成的強光、陰影覆蓋於駕駛座周圍等,由於外在環境光線變化大的情況下,可能會增加該本地物件偵測模型對影像辨識的結果錯誤的機率,因此可藉由量測駕駛座周圍照度(單位:勒克斯)來確認環境中的光量,並當偵測到照度變化量大於一設定值時,該處理單元14即判定需要執行校正程序。此外,若該處理單元14偵測到該當前影像與該等歷史影像的人臉特徵不同時,為避免因為臉型、眼、口之間的比例或臉部特徵的差異性,而造成在辨識不同司機的駕駛違規行為時發生誤判,故該處理單元14即判定需要執行校正程序,但不以此為限。It is important to note that in this embodiment, the processing unit 14 determines whether calibration is necessary based on the current time and a preset period. When the processing unit 14 determines that the preset period has elapsed based on the current time, the processing unit 14 determines that calibration is necessary, but this is not a limitation. In this embodiment, the preset period is, for example, but not limited to, 10 minutes. If it starts at 09:00, calibration will be initiated at 09:10, 09:20, 09:30, and so on, every 10 minutes. In other embodiments, the electronic device 1 further includes a light sensor (not shown). When the light sensor detects changes in the light environment, such as when a vehicle enters or exits a tunnel, resulting in strong light or shadows cast around the driver's seat, the local object detection model may have an increased probability of erroneous image recognition results due to large changes in the external ambient light. Therefore, the amount of light in the environment can be confirmed by measuring the illumination around the driver's seat (unit: lux). When the detected illumination change is greater than a set value, the processing unit 14 determines that a calibration procedure needs to be executed. In addition, if the processing unit 14 detects that the facial features of the current image are different from those of the historical images, in order to avoid misjudgment when identifying driving violations of different drivers due to differences in the proportions of face shape, eyes, and mouth or facial features, the processing unit 14 determines that a correction procedure needs to be executed, but the present invention is not limited to this.

在步驟203中,該處理單元14經由該通訊單元12傳送多張在該等歷史影像中於一預定時間區間拍攝的目標歷史影像,及該當前影像至該遠端伺服器101。In step 203 , the processing unit 14 transmits a plurality of target historical images captured within a predetermined time period among the historical images and the current image to the remote server 101 via the communication unit 12 .

要特別注意的是,在本實施例中,該預定時間區間為該當前時間的前10秒至該當前時間的前1秒。舉例來說,若該當前時間點為第10秒,則該預定時間區間為第0~9秒,但不以此為限。更進一步地說,若將該拍攝單元13設定為每秒拍攝1張影像,則該拍攝單元13便會在上述預定時間區間內,拍攝9張影像。前述每秒拍攝的影像數以及預定時間區間的長度,皆僅為舉例說明,並不以此為限。It is important to note that in this embodiment, the predetermined time period is from 10 seconds before the current time to 1 second before the current time. For example, if the current time is the 10th second, the predetermined time period is from 0 to 9 seconds, but this is not limited to this. Specifically, if the camera unit 13 is set to capture one image per second, the camera unit 13 will capture 9 images within the predetermined time period. The aforementioned number of images captured per second and the length of the predetermined time period are merely examples and are not intended to be limiting.

在步驟204中,該遠端伺服器101利用該遠端物件偵測模型並根據所接收到的該當前影像,產生一遠端偵測結果,該遠端偵測結果指示該司機是否發生駕駛違規行為,其中,該遠端偵測結果包含駕駛違規行為發生與否及於符合駕駛違規行為時該等特徵物件個別的機率值。該遠端物件偵測模型係採用完整且架構更嚴謹之演算法對該當前影像進行辨識。而該遠端伺服器101將根據所接收到該等目標歷史影像、該當前影像,產生多個分別對應該等目標歷史影像的遠端歷史聯合機率,及一對應該當前影像的遠端當前聯合機率。In step 204, the remote server 101 utilizes the remote object detection model and generates a remote detection result based on the received current image. The remote detection result indicates whether the driver has engaged in a driving violation. The remote detection result includes whether the driving violation has occurred and the probability values of each of the characteristic objects when the driving violation is present. The remote object detection model employs a comprehensive and rigorous algorithm to identify the current image. The remote server 101 generates a plurality of remote historical connection probabilities corresponding to the target historical images and a remote current connection probability corresponding to the current image according to the received target historical images and the current image.

其中,該遠端歷史聯合機率為該伺服器101基於該遠端物件偵測模型對輸入的該等目標歷史影像進行影像識別而產生該遠端偵測結果時,將每一幀裡該等特徵物件個別獨立對應的該些機率值相乘,產生多個分別對應該目標歷史影像每一幀的遠端歷史聯合機率,表示對該目標歷史影像中每一幀發生駕駛違規行為之整體機率。該遠端當前聯合機率產生方式與該等遠端歷史聯合機率相似,僅係接收使用的影像為該當前影像,故在此不加以贅述。The remote historical joint probability is generated by multiplying the probability values corresponding to the characteristic objects in each frame when the server 101 performs image recognition on the input target historical images based on the remote object detection model to generate the remote detection results. This generates multiple remote historical joint probabilities corresponding to each frame of the target historical image, representing the overall probability of a driving violation occurring in each frame of the target historical image. The remote current joint probability is generated in a similar manner to the remote historical joint probabilities, except that the image received and used is the current image, so this is not further described here.

在步驟205中,該遠端伺服器101根據該等遠端歷史聯合機率,及該遠端當前聯合機率產生一相關於在該等目標歷史影像及該當前影像在該預定時間區間範圍中發生該駕駛違規行為之機率分布的遠端機率密度函數,且根據該遠端機率密度函數,並計算出多個相關該遠端機率密度函數的即時參數,經由該通訊網路100傳送該等即時參數至該通訊單元12,該通訊單元12透過電連接方式傳送該等即時參數給該處理單元14。In step 205, the remote server 101 generates a remote probability density function related to the probability distribution of the driving violation occurring in the target historical images and the current image within the predetermined time interval based on the remote historical joint probabilities and the remote current joint probability. Based on the remote probability density function, the remote server 101 calculates a plurality of real-time parameters related to the remote probability density function and transmits the real-time parameters to the communication unit 12 via the communication network 100. The communication unit 12 transmits the real-time parameters to the processing unit 14 via an electrical connection.

值得注意的是,在本實施例中,該等即時參數至少包括一事件代表平均數及一事件代表變異數,也就是當該遠端伺服器101利用該遠端物件偵測模型對該等目標歷史影像的每一幀影像資料進行影像辨識,而輸出基於該等特徵物件於符合駕駛違規行為時個別的機率時,該遠端伺服器101進一步產生多個分別對應該等目標歷史影像中每一幀的遠端歷史聯合機率,以及根據該當前影像,產生對應該遠端當前聯合機率後,以該等遠端歷史聯合機率、該遠端當前聯合機率,計算該遠端機率密度函數,將該遠端機率密度函數,利用一最大概似估計(maximum likelihood estimation, MLE)估測在偵測該駕駛違規行為完整影像資料的該時間區間中最符合該遠端機率密度函數結果的該等即時參數,即該事件代表平均數及該事件代表變異數,但不以此為限。It is worth noting that in this embodiment, the real-time parameters include at least an event representative mean and an event representative variance. That is, when the remote server 101 uses the remote object detection model to perform image recognition on each frame of the target historical images and outputs the individual probabilities of the feature objects when they meet the driving violation behavior, the remote server 101 further generates a plurality of remote historical joint probabilities corresponding to each frame in the target historical images, and generates the remote current joint probability corresponding to the current image. Then, the remote probability density function is calculated using the remote historical joint probabilities and the remote current joint probability, and the remote probability density function is used to calculate the remote probability density function using a maximum likelihood estimation method. The real-time parameters that best fit the remote probability density function result within the time interval of the complete image data of the driving violation detection are estimated using MLE, namely, the event representative mean and the event representative variance, but not limited thereto.

在步驟206中,該處理單元14即可根據該等即時參數,更新該基準真相機率密度函數。In step 206, the processing unit 14 updates the baseline truth probability density function based on the real-time parameters.

在步驟207中,該處理單元14利用該本地物件偵測模型及步驟201中所拍攝的該當前影像,計算出一關於該當前影像中該司機是否發生駕駛違規行為的一本地偵測結果,該本地偵測結果同樣用以指示該司機是否發生駕駛違規行為,並且該本地偵測結果包含該駕駛違規行為發生與否及於符合駕駛違規行為時該等特徵物件個別的機率值。該處理單元14還根據多張在該等歷史影像中於一預定時間區間拍攝的該等目標歷史影像,及該當前影像,產生多個分別對應該等目標歷史影像的本地歷史聯合機率,及一對應該當前影像的本地當前聯合機率。In step 207, the processing unit 14 uses the local object detection model and the current image captured in step 201 to calculate a local detection result regarding whether the driver has committed a driving violation in the current image. The local detection result is also used to indicate whether the driver has committed a driving violation, and the local detection result includes whether the driving violation has occurred and the probability values of each of the characteristic objects when the driving violation is satisfied. The processing unit 14 also generates a plurality of local historical joint probabilities corresponding to the target historical images and a local current joint probability corresponding to the current image based on a plurality of target historical images captured within a predetermined time period in the historical images and the current image.

特別說明的是,於本實施例的步驟204與步驟207中,該遠端伺服器101與該處理單元14皆是以所述相同的預定時間區間拍攝到的影像進行辨識。然而,由於該遠端伺服器101相較於該處理單元14有較佳的效能,因此,在其他實施態樣中,該遠端伺服器101在步驟204中可以是採取較所述預定時間區間還要長的時間區間內拍攝到的影像進行影像辨識,而該處理單元14同樣以所述預定時間區間內拍攝到的目標歷史影像進行辨識,也就是該遠端伺服器101與該處理單元14亦可以採取不同的預定時間區間,該遠端伺服器101透過計算分析更長時間的影像資料來增加整體判斷的精準度,而該處理單元14則採取可因應即時運算需求的資料量為主。舉例來說,該遠端伺服器101可以是根據50秒拍攝到的影像進行辨識,而該處理單元14只根據10秒內拍攝到的影像進行辨識。在本實施例中,該電子裝置1將該當前影像輸入至該本地物件偵測模型,該處理單元14根據該本地物件偵測模型的該本地偵測結果,計算該等特徵物件個別獨立對應出的該些機率值相乘,產生一對應該當前影像的本地當前聯合機率。相似地,該處理單元14將該等目標歷史影像輸入至該本地物件偵測模型,該處理單元14根據該等特徵物件個別獨立對應出的該些機率值計算,以產生多個分別對應該目標歷史影像每一幀的本地歷史聯合機率。It is particularly noted that in step 204 and step 207 of this embodiment, the remote server 101 and the processing unit 14 both perform recognition based on images captured within the same predetermined time period. However, since the remote server 101 has better performance than the processing unit 14, in other implementations, the remote server 101 may perform image recognition in step 204 using images captured within a time period longer than the predetermined time period, while the processing unit 14 may also perform recognition using historical images of the target captured within the predetermined time period. In other words, the remote server 101 and the processing unit 14 may also use different predetermined time periods. The remote server 101 increases the accuracy of the overall judgment by calculating and analyzing image data over a longer period of time, while the processing unit 14 mainly uses the amount of data that can meet real-time computing needs. For example, the remote server 101 may perform recognition based on images captured over a 50-second period, while the processing unit 14 may only perform recognition based on images captured within a 10-second period. In this embodiment, the electronic device 1 inputs the current image into the local object detection model. The processing unit 14 calculates the probability values corresponding to the individual feature objects based on the local detection results of the local object detection model and multiplies them to generate a local current joint probability corresponding to the current image. Similarly, the processing unit 14 inputs the target historical images into the local object detection model. The processing unit 14 calculates the probability values corresponding to the feature objects to generate a plurality of local historical joint probabilities corresponding to each frame of the target historical images.

在步驟208中,該處理單元14根據該等本地歷史聯合機率,及該本地當前聯合機率產生一相關於在該當前影像及該等目標歷史影像在該預定時間區間範圍中中發生該駕駛違規行為之機率分布的本地機率密度函數。In step 208, the processing unit 14 generates a local probability density function related to the probability distribution of the driving violation occurring in the current image and the target historical images within the predetermined time interval according to the local historical joint probabilities and the local current joint probability.

搭配參閱圖4,示例說明由在第10~11秒拍攝該當前影像對應的該本地當前聯合機率值,及在第0~10秒拍攝的該等目標歷史影像對應的該等本地歷史聯合機率值組成之本地聯合機率分布。該本地機率密度函數、該基準真相機率密度函數,及該遠端機率密度函數的機率分布例如為常態分佈(Normal distribution)的機率密度函數(Probability Density Function, PDF)。Referring to Figure 4, an example of a local joint probability distribution is shown, consisting of the local current joint probability value corresponding to the current image captured between seconds 10 and 11, and the local historical joint probability values corresponding to the target historical images captured between seconds 0 and 10. The probability distribution of the local probability density function, the ground truth probability density function, and the remote probability density function is, for example, a normal probability density function (PDF).

在步驟209中,該處理單元14根據該本地機率密度函數及該基準真相機率密度函數,產生一關於該些機率密度函數間的誤差值。In step 209, the processing unit 14 generates an error value between the local probability density function and the reference truth probability density function according to the local probability density function and the reference truth probability density function.

要特別注意的是,在本實施例中,該誤差值為該基準真相機率密度函數及該本地機率密度函數的交叉熵(Cross entropy),也就是透過交叉熵計算的結果來衡量該電子裝置1與該遠端伺服器101兩者偵測關於駕駛違規行為及其機率密度分布之間的誤差程度,若兩者個別所計算的結果接近(重疊性高),則該交叉熵的值就會越低(差異小),表示兩者在計算資料中產生不確定的可能性越少,因此對於對駕駛違規行為的偵測結果的可信度越高,但衡量方式不以此為限。It should be noted that in this embodiment, the error value is the cross entropy of the baseline truth probability density function and the local probability density function. That is, the result of the cross entropy calculation is used to measure the degree of error between the electronic device 1 and the remote server 101 in detecting driving violations and their probability density distribution. If the results calculated by the two are close (high overlap), the cross entropy value will be lower (smaller difference), indicating that the possibility of uncertainty generated in the calculation data by the two is less, and therefore the credibility of the detection result of driving violations is higher, but the measurement method is not limited to this.

在步驟210中,該處理單元14判定該誤差值是否小於一預設閾值。當該處理單元14判定出該誤差值小於該預設閾值時,該處理單元14產生一指示該本地偵測結果為可信的檢測結果,且流程進行步驟211;而當該處理單元14判定出該誤差值不小於該預設閾值時,該處理單元14產生一指示該本地偵測結果為不可信的檢測結果並重複步驟201。In step 210, the processing unit 14 determines whether the error value is less than a preset threshold. If the processing unit 14 determines that the error value is less than the preset threshold, the processing unit 14 generates a detection result indicating that the local detection result is reliable, and the process proceeds to step 211. If the processing unit 14 determines that the error value is not less than the preset threshold, the processing unit 14 generates a detection result indicating that the local detection result is unreliable, and step 201 is repeated.

在步驟211中,該處理單元14根據該本地物件偵測模型產生關於該司機駕駛違規行為的該本地偵測結果,並於前述該誤差值低於該預設閾值時,確定該本地偵測結果可信。其中當該本地偵測結果指示駕駛違規行為發生時,流程進行步驟212;而當該本地偵測結果指示駕駛違規行為未發生時,則流程進行步驟201。In step 211, the processing unit 14 generates a local detection result regarding the driver's driving violation based on the local object detection model. When the error value is lower than the preset threshold, the processing unit 14 determines that the local detection result is reliable. If the local detection result indicates that a driving violation has occurred, the process proceeds to step 212; if the local detection result indicates that a driving violation has not occurred, the process proceeds to step 201.

在步驟212中,該處理單元14產生一警示訊息。In step 212, the processing unit 14 generates a warning message.

值得注意的是,該警示訊息可為一語音訊息,該處理單元14可透過一喇叭(圖未示)發出該警示訊息,提醒該司機停止目前使用手機導致分心的駕駛違規行為,該警示訊息亦可為一文字訊息,該處理單元14可經由該通訊模組傳送該警示訊息至該遠端伺服器101,將該司機的駕駛違規行為發生的時間、地點及持續時間等多項行車資訊數據統一紀錄儲存,作為關於車隊管理功能中司機駕駛行為的歷史數據資料,但不以此為限。It is worth noting that the warning message can be a voice message. The processing unit 14 can issue the warning message through a speaker (not shown) to remind the driver to stop the current distracted driving behavior caused by using the mobile phone. The warning message can also be a text message. The processing unit 14 can transmit the warning message to the remote server 101 via the communication module to uniformly record and store multiple driving information data such as the time, location, and duration of the driver's driving violation as historical data on the driver's driving behavior in the fleet management function, but the present invention is not limited to this.

綜上所述,藉由該電子裝置1之處理單元14根據該本地機率密度函數及該基準真相機率密度函數,產生該誤差值,並判定該誤差值是否小於該預設閾值,當判定出該誤差值小於該預設閾值時,表示該本地物件偵測模型的該本地偵測結果可信,當判定出該誤差值不小於該預設閾值時,表示該本地物件偵測模型的該本地偵測結果不可信,則該處理單元14將重新產生一新的當前影像並且重新偵測計算,本發明利用遠端伺服器101算力的優勢來執行校正程序,從而得出較符合當前影像資料的該等即時參數來更新該電子裝置1中的該基準真相機率密度函數,藉由更新的該基準真相機率密度函數與該本地機率密度函數之間的誤差狀況來排除部分不正確的駕駛違規行為的辨識結果,達到降低誤判或誤警報的情況發生,故確實能達成本發明之目的。In summary, the processing unit 14 of the electronic device 1 generates the error value based on the local probability density function and the reference truth probability density function, and determines whether the error value is less than the preset threshold. When it is determined that the error value is less than the preset threshold, it indicates that the local detection result of the local object detection model is credible. When it is determined that the error value is not less than the preset threshold, it indicates that the local detection result of the local object detection model is not credible, and the processing unit 14 will regenerate a new The present invention utilizes the computing power of the remote server 101 to execute a calibration procedure, thereby obtaining real-time parameters that are more consistent with the current image data to update the baseline truth probability density function in the electronic device 1. By eliminating the error between the updated baseline truth probability density function and the local probability density function, some incorrect driving violation identification results are eliminated, thereby reducing the occurrence of misjudgments or false alarms, and thus can indeed achieve the purpose of the present invention.

惟以上所述者,僅為本發明之實施例而已,當不能以此限定本發明實施之範圍,凡是依本發明申請專利範圍及專利說明書內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。However, the above description is merely an example of the present invention and should not be used to limit the scope of the present invention. All simple equivalent changes and modifications made within the scope of the patent application and the contents of the patent specification of the present invention are still within the scope of the present patent.

1:電子裝置 11:儲存單元 12:通訊單元 13:拍攝單元 14:處理單元 100:通訊網路 101:遠端伺服器 201~212 :步驟 1: Electronic Device 11: Storage Unit 12: Communication Unit 13: Camera Unit 14: Processing Unit 100: Communication Network 101: Remote Server 201-212: Steps

本發明之其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中: 圖1是一方塊圖,說明本發明具有誤判排除的駕駛違規行為偵測電子裝置的一實施例; 圖2是一流程圖,說明本發明具有誤判排除功能的駕駛違規行為偵測方法的一實施例的步驟201~206; 圖3是一流程圖,說明本發明具有誤判排除功能的駕駛違規行為偵測方法的該實施例的步驟207~212;及 圖4是一示意圖,說明一當前影像對應的一本地當前聯合機率值,及多個目標歷史影像對應的多個本地歷史聯合機率值組成之本地聯合機率分布,及一本地機率密度函數。 Other features and functions of the present invention are clearly illustrated in the accompanying drawings, wherein: Figure 1 is a block diagram illustrating an embodiment of an electronic device for detecting driving violations with a misjudgment elimination function according to the present invention; Figure 2 is a flow chart illustrating steps 201-206 of an embodiment of a method for detecting driving violations with a misjudgment elimination function according to the present invention; Figure 3 is a flow chart illustrating steps 207-212 of the method for detecting driving violations with a misjudgment elimination function according to the present invention; and Figure 4 is a schematic diagram illustrating a local joint probability distribution consisting of a local current joint probability value corresponding to a current image, a plurality of local historical joint probability values corresponding to a plurality of target historical images, and a local probability density function.

201~206:步驟 Steps 201-206

Claims (10)

一種具有誤判排除功能的駕駛違規行為偵測方法,適用於檢測一物件偵測模型所偵測之指示一司機在駕駛一車輛時是否發生違規行為的一本地偵測結果,該檢測方法由一設置於該車輛內的電子裝置來實施,該電子裝置儲存有多張在過去時間點拍攝該司機的歷史影像、一用以判定影像是否含有多個特徵物件的本地物件偵測模型,及一基準真相機率密度函數,該電子裝置連續拍攝該司機以便連續產生並儲存該司機之影像,該駕駛違規行為檢測方法包含以下步驟: (A)該電子裝置在一當前時間點拍攝該司機,以產生並儲存一當前影像; (B)該電子裝置利用該本地物件偵測模型,根據多張在該等歷史影像中在一預定時間區間拍攝的目標歷史影像,及該當前影像,產生多個分別對應該等目標歷史影像的本地歷史聯合機率,及一對應該當前影像的本地當前聯合機率; (C)該電子裝置根據該等本地歷史聯合機率,及該本地當前聯合機率,產生一相關於在該當前影像及該等目標歷史影像中發生該違規行為之機率分布的本地機率密度函數; (D)該電子裝置根據該本地機率密度函數,及該基準真相機率密度函數,產生一誤差值; (E)該電子裝置判定該誤差值是否小於一預設閾值;及 (F)當判定出該誤差值小於該預設閾值時,該電子裝置產生一指示該本地偵測結果為可信的檢測結果。 A method for detecting driving violations with a false positive elimination function is disclosed. The method is applied to detect a local detection result, detected by an object detection model, indicating whether a driver has engaged in a violation while driving a vehicle. The detection method is implemented by an electronic device installed in the vehicle. The electronic device stores a plurality of historical images of the driver taken at past time points, a local object detection model for determining whether an image contains a plurality of characteristic objects, and a ground truth probability density function. The electronic device continuously captures the driver to continuously generate and store images of the driver. The method for detecting driving violations comprises the following steps: (A) The electronic device captures the driver at a current time to generate and store a current image; (B) The electronic device utilizes the local object detection model to generate, based on a plurality of historical images of the target captured within a predetermined time period in the historical images and the current image, a plurality of local historical joint probabilities corresponding to the target historical images, and a local current joint probability corresponding to the current image; (C) The electronic device generates, based on the local historical joint probabilities and the local current joint probability, a local probability density function related to the probability distribution of the violation occurring in the current image and the target historical images; (D) The electronic device generates an error value based on the local probability density function and the ground truth probability density function; (E) The electronic device determines whether the error value is less than a preset threshold; and (F) When it is determined that the error value is less than the preset threshold, the electronic device generates a detection result indicating that the local detection result is reliable. 如請求項1所述的具有誤判排除功能的駕駛違規行為偵測方法,該電子裝置經由一通訊網路連接一遠端伺服器,該遠端伺服器儲存有一用以判定影像是否含有多個特徵物件的遠端物件偵測模型,在步驟(A)及步驟(B)之間,還包含以下步驟: (H)該電子裝置判定是否需要校正; (I)當判定出需要校正時,該電子裝置經由該通訊網路傳送該等目標歷史影像,及該當前影像至該遠端伺服器,該遠端伺服器利用該遠端物件偵測模型產生一遠端偵測結果,並根據該等目標歷史影像及該當前影像,產生一相關於在該當前影像及該等目標歷史影像中發生該駕駛違規行為之機率分布的遠端機率密度函數,並計算出多個符合該遠端機率密度函數的即時參數再由該通訊網路回傳; (J)該電子裝置根據該等即時參數,更新該基準真相機率密度函數; (K)當判定出不需要校正時,進行步驟(B)。 The driving violation detection method with misjudgment elimination function described in claim 1 includes an electronic device connected to a remote server via a communication network. The remote server stores a remote object detection model for determining whether an image contains multiple feature objects. Between steps (A) and (B), the method further includes the following steps: (H) the electronic device determines whether calibration is required; (I) When calibration is determined to be necessary, the electronic device transmits the target historical images and the current image to the remote server via the communication network. The remote server generates a remote detection result using the remote object detection model and, based on the target historical images and the current image, generates a remote probability density function (PDF) corresponding to the probability distribution of the driving violation occurring in the current image and the target historical images. The remote server then calculates a plurality of real-time parameters consistent with the remote PDF and transmits these parameters back via the communication network. (J) The electronic device updates the ground truth PDF based on the real-time parameters. (K) When calibration is determined not to be necessary, step (B) is performed. 如請求項2所述的具有誤判排除功能的駕駛違規行為偵測方法,其中,在步驟(H)中,當該電子裝置判定出該當前時間點已經歷一預設週期時,該電子裝置判定出需要校正。As described in claim 2, the driving violation detection method with a misjudgment elimination function, wherein, in step (H), when the electronic device determines that the current time point has experienced a preset cycle, the electronic device determines that correction is required. 如請求項1所述的具有誤判排除功能的駕駛違規行為偵測方法,其中,在步驟(B)中,該電子裝置將該當前影像輸入至該本地物件偵測模型,並根據該本地偵測結果,將該當前影像中該等特徵物件於符合駕駛違規行為時個別的機率值相乘,產生對應該當前影像的該本地當前聯合機率。As described in claim 1, the driving violation detection method with a misjudgment elimination function, wherein in step (B), the electronic device inputs the current image into the local object detection model and, based on the local detection results, multiplies the individual probability values of the characteristic objects in the current image when they meet the driving violation requirements to generate the local current joint probability corresponding to the current image. 如請求項1所述的具有誤判排除功能的駕駛違規行為偵測方法,其中,在步驟(B)中,該電子裝置將該目標歷史影像輸入至該本地物件偵測模型,並根據影像辨識結果,輸出該目標歷史影像中的每一幀裡該等特徵物件於符合駕駛違規行為時個別的機率值,接著再將每一幀裡該等個別獨立對應的機率值相乘,產生多個分別對應該目標歷史影像每一幀的該本地歷史聯合機率。As described in claim 1, the driving violation detection method with a misjudgment elimination function, wherein in step (B), the electronic device inputs the target historical image into the local object detection model and, based on the image recognition results, outputs the individual probability values of the characteristic objects in each frame of the target historical image when they meet the driving violation requirements. Then, the individual independent corresponding probability values in each frame are multiplied to generate a plurality of local historical joint probabilities corresponding to each frame of the target historical image. 一種電子裝置,適用於實施具有誤判排除功能的駕駛違規行為偵測方法,該電子裝置設置於一車輛內並包含: 一儲存單元,儲存有多張在過去時間點拍攝一司機的歷史影像、一用以判定影像是否含有多個特徵物件的本地物件偵測模型,及一基準真相機率密度函數; 一拍攝單元,電連接該拍攝該儲存單元,用以連續拍攝該司機以便連續產生並儲存該司機之影像至該儲存單元;及 一處理單元,電連接該拍攝單元及該儲存單元; 其中,該拍攝單元在一當前時間點拍攝該司機,以產生並儲存一當前影像至該儲存單元, 該處理單元利用該本地物件偵測模型產生一本地偵測結果,並根據多張在該等歷史影像中在一預定時間區間拍攝的目標歷史影像,及該當前影像,產生多個分別對應該等目標歷史影像的本地歷史聯合機率,及一對應該當前影像的本地當前聯合機率,該處理單元根據該等本地歷史聯合機率,及該本地當前聯合機率,產生一相關於在該當前影像及該等目標歷史影像中發生該駕駛違規行為之機率分布的本地機率密度函數,該處理單元根據該本地機率密度函數,及該基準真相機率密度函數,產生一誤差值,該電子裝置判定該誤差值是否小於一預設閾值,當判定出該誤差值小於該預設閾值時,該電子裝置產生一指示該本地偵測結果為可信的檢測結果。 An electronic device suitable for implementing a method for detecting driving violations with a false positive detection function is provided in a vehicle and comprises: A storage unit storing a plurality of historical images of a driver taken at past time points, a local object detection model for determining whether an image contains a plurality of characteristic objects, and a ground truth probability density function; A capturing unit electrically connected to the capturing and storing unit for continuously capturing the driver to continuously generate and store images of the driver in the storage unit; and A processing unit electrically connected to the capturing unit and the storage unit; The capturing unit captures the driver at a current time to generate and store a current image in the storage unit. The processing unit generates a local detection result using the local object detection model and, based on a plurality of historical images of the target captured within a predetermined time interval in the historical images and the current image, generates a plurality of local historical joint probabilities corresponding to the target historical images and a local current joint probability corresponding to the current image. The processing unit generates a corresponding local historical joint probability based on the local historical joint probabilities and the local current joint probability. The processing unit generates an error value based on a local probability density function (PDF) representing the probability distribution of the driving violation occurring in the current image and the target historical images and the ground truth PDF. The electronic device determines whether the error value is less than a preset threshold. When the error value is determined to be less than the preset threshold, the electronic device generates a detection result indicating that the local detection result is reliable. 如請求項6所述的電子裝置,還包含一電連接該處理單元的通訊單元,該通訊單元經由一通訊網路連接一遠端伺服器,該遠端伺服器儲存有一用以判定影像是否含有多個特徵物件的遠端物件偵測模型,其中,該處理單元判定是否需要校正,當判定出需要校正時,該電子裝置經由該通訊網路傳送在該等目標歷史影像,及該當前影像至該遠端伺服器,該遠端伺服器利用該遠端物件偵測模型產生一遠端偵測結果,並根據該等目標歷史影像及該當前影像,產生一相關於在該當前影像及該等目標歷史影像中發生該駕駛違規行為之機率分布的遠端機率密度函數,並計算出多個符合該遠端機率密度函數的即時參數再由該通訊網路回傳,該電子裝置根據該等即時參數,更新該基準真相機率密度函數,當判定出不需要校正時,該處理單元產生該等本地歷史聯合機率,及該當前聯合機率。The electronic device as described in claim 6 further includes a communication unit electrically connected to the processing unit, the communication unit being connected to a remote server via a communication network, the remote server storing a remote object detection model for determining whether an image contains a plurality of feature objects, wherein the processing unit determines whether correction is required. When correction is determined to be required, the electronic device transmits the target historical images and the current image to the remote server via the communication network, and the remote server generates a correction using the remote object detection model. A remote detection result is generated, and based on the target historical images and the current image, a remote probability density function is generated, which is related to the probability distribution of the driving violation occurring in the current image and the target historical images. A plurality of real-time parameters that conform to the remote probability density function are calculated and then transmitted back via the communication network. The electronic device updates the reference truth probability density function based on the real-time parameters. When it is determined that no correction is required, the processing unit generates the local historical joint probabilities and the current joint probability. 如請求項7所述的電子裝置,其中,當該電子裝置判定出該當前時間點到達該一預設的週期時,該電子裝置判定出需要校正。The electronic device as described in claim 7, wherein when the electronic device determines that the current time point has reached the preset period, the electronic device determines that calibration is required. 如請求項6所述的電子裝置,其中,該處理單元將該當前影像輸入至該本地物件偵測模型,該本地物件偵測模型輸出多個分別對應於該等特徵物件於符合駕駛違規行為時個別的機率值,接著該處理單元再將該等個別獨立對應的機率值相乘,產生對應該當前影像的該本地當前聯合機率。An electronic device as described in claim 6, wherein the processing unit inputs the current image into the local object detection model, and the local object detection model outputs a plurality of individual probability values corresponding to the feature objects when they meet the driving violation requirements. The processing unit then multiplies the individual independent corresponding probability values to generate the local current joint probability corresponding to the current image. 如請求項7所述的電子裝置,其中,該處理單元將該目標歷史影像輸入至該本地物件偵測模型,該本地物件偵測模型輸出多個分別對應該目標歷史影像中的每一幀裡該等特徵物件於符合駕駛違規行為時個別的機率值,接著該處理單元再將每一幀裡該等個別獨立對應的機率值相乘,產生多個分別對應該目標歷史影像每一幀的該本地歷史聯合機率。An electronic device as described in claim 7, wherein the processing unit inputs the target historical image into the local object detection model, and the local object detection model outputs a plurality of individual probability values corresponding to each frame of the target historical image for the characteristic objects when they meet the driving violation requirements. The processing unit then multiplies the individual independent corresponding probability values in each frame to generate a plurality of local historical joint probabilities corresponding to each frame of the target historical image.
TW113116167A 2024-04-30 2024-04-30 Electronic device and method for excluding misjudgment of driver violation behavior detection TWI894931B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW113116167A TWI894931B (en) 2024-04-30 2024-04-30 Electronic device and method for excluding misjudgment of driver violation behavior detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW113116167A TWI894931B (en) 2024-04-30 2024-04-30 Electronic device and method for excluding misjudgment of driver violation behavior detection

Publications (2)

Publication Number Publication Date
TWI894931B true TWI894931B (en) 2025-08-21
TW202543863A TW202543863A (en) 2025-11-16

Family

ID=97524119

Family Applications (1)

Application Number Title Priority Date Filing Date
TW113116167A TWI894931B (en) 2024-04-30 2024-04-30 Electronic device and method for excluding misjudgment of driver violation behavior detection

Country Status (1)

Country Link
TW (1) TWI894931B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111332309A (en) * 2018-12-19 2020-06-26 通用汽车环球科技运作有限责任公司 Driver monitoring system and method of operating the same
CN112644506A (en) * 2021-01-05 2021-04-13 江苏大学 Method for detecting driver driving distraction based on model long-time memory neural network LSTM-NN
CN115546863A (en) * 2022-09-14 2022-12-30 际络科技(上海)有限公司 Attention detection method and device
CN116186591A (en) * 2023-03-06 2023-05-30 吉林大学 A Driver State Monitoring Method Based on 3D Deformation Model
CN116588115A (en) * 2022-12-20 2023-08-15 合肥工业大学 Vehicle safety system based on driver state analysis

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111332309A (en) * 2018-12-19 2020-06-26 通用汽车环球科技运作有限责任公司 Driver monitoring system and method of operating the same
CN112644506A (en) * 2021-01-05 2021-04-13 江苏大学 Method for detecting driver driving distraction based on model long-time memory neural network LSTM-NN
CN115546863A (en) * 2022-09-14 2022-12-30 际络科技(上海)有限公司 Attention detection method and device
CN116588115A (en) * 2022-12-20 2023-08-15 合肥工业大学 Vehicle safety system based on driver state analysis
CN116186591A (en) * 2023-03-06 2023-05-30 吉林大学 A Driver State Monitoring Method Based on 3D Deformation Model

Similar Documents

Publication Publication Date Title
CN110889351B (en) Video detection method, device, terminal equipment and readable storage medium
CN108965826B (en) Monitoring method, monitoring device, processing equipment and storage medium
US20150042789A1 (en) Determining the distance of an object to an electronic device
CN113673311A (en) Traffic abnormal event detection method, equipment and computer storage medium
CN110060441A (en) Method and apparatus for terminal anti-theft
CN111464736A (en) Server, server control method, vehicle, vehicle control method, and storage medium storing programs
CN113869137A (en) Event detection method and device, terminal equipment and storage medium
CN108876964A (en) Grasp shoot method and system applied to automobile data recorder
CN111784759A (en) Computer vision-based ship height calculation method, system and storage medium
CN110874953A (en) Area alarm method, device, electronic device and readable storage medium
TWI894931B (en) Electronic device and method for excluding misjudgment of driver violation behavior detection
JP7492595B2 (en) Monitoring system, analysis device, and AI model generation method
CN111814526A (en) Gas station congestion assessment method, server, electronic equipment and storage medium
CN102740107A (en) Damage monitoring system of image surveillance equipment and method
CN111913850A (en) Data anomaly detection method, device, equipment and storage medium
CN114063964B (en) Volume compensation optimization method, device, electronic device and readable storage medium
TW202543863A (en) Electronic device and method for excluding misjudgment of driver violation behavior detection
CN100375530C (en) A method of motion detection
CN121010964A (en) Driving violation detection method and electronic device with false positive elimination function
CN114898270B (en) BMC equipment monitoring method, device, equipment and readable storage medium
CN118781664A (en) Method, device, equipment and computer-readable storage medium for identifying AI face-changing
CN111625755B (en) Data processing method, device, server, terminal and readable storage medium
US20110234912A1 (en) Image activity detection method and apparatus
CN111429701B (en) Alarm method, device, equipment and storage medium
CN110717386A (en) Method and device for tracking affair-related object, electronic equipment and non-transitory storage medium