TWI782751B - Method and system of intelligent auxiliary judgement and processing for traffic violations - Google Patents

Abstract

In a system of intelligent auxiliary judgement and processing for traffic violations, a judgement server uses a pre-trained AI violation judgement model to analyze received driving record data related to a traffic event. When judging the violation of the traffic event, the judgement server transmits to an electronic terminal report, which is generated based on the driving record image, time data of the traffic event and vehicle’s location data, together with the link URL of a report platform, such that the report is thus sent from the electronic terminal to the report platform. When the traffic event cannot be successfully judged, upon judging based on sound data of the traffic event, the driving record data and vehicle’s inertial data that there is property damage or personal damage, the judgement server transmits the driving record data and contact information of a vehicle’s driver to a consulting server, such that the consulting server provides consulting services to the vehicle’s driver.

Description

Intelligent auxiliary judgment and processing method and system for traffic violations

The invention relates to the judgment of traffic violations, in particular to an intelligent auxiliary judgment and processing method and system for traffic violations.

The current driving recorder can automatically or manually record relevant images of the vehicle in motion. Especially in the case of encountering a traffic accident or encountering another vehicle that may cause traffic violations, because ordinary drivers have insufficient knowledge of laws or regulations for various traffic violations, they often cannot The video correctly judges whether there is a traffic violation, and thus misses the opportunity to report the violation. This will not only cause damage to one's own rights and interests without knowing it, but also may imperceptibly appease drivers who deliberately violate the rules.

On the other hand, when a driver encounters a traffic accident, the driver and related parties may have to seek help from legal counsel to clarify the culpability, which will result in relatively expensive legal consultation fees.

Therefore, it has become one of the issues to be solved in the relevant technical field how to devise a way to make the driver spend the least amount of money to correctly judge traffic violations to improve traffic safety and public safety.

Therefore, the object of the present invention is to provide an intelligent auxiliary judgment and processing method and system for traffic violations, which can overcome at least one shortcoming of the prior art.

Therefore, an intelligent auxiliary judging and processing method for traffic violations provided by the present invention is implemented by a judging server, and includes the following steps: (A) receiving a traffic information about at least one of a vehicle and another vehicle An event judgment request for an event, the event judgment request includes the positioning data, time data, driving record data and inertial data of the vehicle corresponding to the traffic event, the driving record data includes the vehicle interior information of the driver and passengers in the vehicle Image information, image information outside the vehicle containing the other vehicle, and sound information of the environment in which the vehicle is located; (B) using a pre-trained AI violation judgment model to analyze the image information outside the vehicle to obtain a corresponding traffic incident (C) when the judgment result indicates the traffic violation that matches the traffic event, according to the The image information outside the vehicle, the time data and the positioning data generate a reporting report corresponding to the traffic violation, and send an event judgment reply including the reporting report and a link URL of a reporting platform to an electronic terminal, so that the electronic terminal transmits the reporting report to the reporting platform through the linked website; and (D) when the judgment result indicates that the traffic incident cannot be successfully judged, according to the sound information, the image information and the inertial data to determine whether the traffic incident has property damage or personal damage higher than a predetermined amount, and when it is judged that the traffic incident has a property loss higher than the predetermined amount or when it is judged that the traffic incident has occurred When a person is damaged, the event consultation information including the driving record data and the driver's contact information of the vehicle is sent to a consultation server, so that the consultation server can provide further consultation on the traffic incident to the driver Serve.

The intelligent auxiliary judging and processing method of traffic violations of the present invention also utilizes an on-vehicle system installed in the vehicle and capable of communicating with the judging server to execute, and also includes the following steps before step (A): (E) when When the vehicle-mounted system detects a specific driving condition associated with a change in at least one of the vehicle's driving speed and driving direction when the traffic event occurs, or when the vehicle-mounted system receives a corresponding to the traffic event When the control is input, the in-vehicle system collects the positioning data, the time data, the driving record data and the inertial data in response to the specific driving situation or the input control to generate the event judgment request, and sends the event judgment request to The judgment server.

In the intelligent auxiliary judging and processing method for traffic violations of the present invention, in step (E), the specific driving condition includes at least one of emergency braking and emergency steering.

Therefore, a kind of intelligent assistant judging and The processing system includes a judging server and a consulting server.

The judging server is configured with a traffic violation database containing a large amount of reference image data related to various traffic violations, and stores an AI violation judgment model established in advance through machine learning training based on the large amount of reference image data.

The consulting server is connected to the judging server, and operates to provide a traffic or legal consulting service on traffic events.

The judging server receives an event judging request related to a traffic event of at least one of a vehicle and another vehicle, the event judging request includes positioning data, time data, driving record data and Inertial data, the driving record data includes in-vehicle image information containing the driver and passengers in the vehicle, external image information containing the other vehicle, and sound information of the environment in which the vehicle is located.

The judging server uses the AI violation judging model to analyze the image information outside the vehicle to obtain a judging result corresponding to the traffic event. event.

When the judging result indicates the traffic violation matching the traffic event, the judging server generates a reporting report corresponding to the traffic violation according to the outside image information, the time data and the positioning data, and sends a An event judgment reply including the reporting report and a linked website of a reporting platform is sent to an electronic terminal, so that the electronic terminal transmits the reporting report to the reporting platform through the linked website.

When the judging result indicates that the traffic event cannot be successfully judged, the judging server judges whether the traffic event has property damage or personal injury higher than a predetermined amount according to the sound information, the in-vehicle image information and the inertial data. loss, and when it is judged that the traffic event has a property loss higher than the predetermined amount or when it is judged that the traffic event has caused personal damage, the event consultation including the driving record data and the contact information of the driver of the vehicle The data is sent to the consulting server, so that the consulting server can further provide consulting services about the traffic incident to the driver.

The intelligent auxiliary judging and processing system for traffic violations of the present invention also includes a vehicle-mounted system. The vehicle-mounted system is adapted to be installed on the vehicle, communicated with the judging server, and operates to provide driving record data, driving trajectory, and driving control information related to inertia after the vehicle is started. When the vehicle-mounted system detects a specific driving condition associated with a change in at least one of the vehicle's driving speed and driving direction when the traffic event occurs, or when the vehicle-mounted system receives a corresponding to the traffic event When the control is input, the in-vehicle system collects the positioning data, the time data, the driving record data and the inertial data in response to the specific driving situation or the input control to generate the event judgment request, and sends the event judgment request to The judgment server.

In the intelligent auxiliary judging and processing system for traffic violations of the present invention, the specific driving condition includes at least one of emergency braking and emergency steering.

In the intelligent auxiliary judging and processing system for traffic violations of the present invention, when the judging result indicates the traffic violation matching the traffic event, the judging The server stores the image information outside the vehicle as reference image data corresponding to the traffic violation in the traffic violation database.

The effect of the present invention is that: the judging server first uses the AI violation judging model to analyze the image information outside the car to make a preliminary judgment on whether the traffic event matches the traffic violation, and when the matching traffic violation is successfully judged, automatically Locally generate the reporting report and provide it to the driver, so that the informant can report violations; and if the preliminary judgment fails, if it is further confirmed that the traffic accident has more than the predetermined amount of property damage or personal damage, through consultation The server provides drivers with advanced consultation on traffic or law, so that traffic violations can be reported in a relatively convenient and correct way, which can help improve overall traffic safety and public safety, and can be spent at a relatively minimal cost In order to obtain traffic or legal consulting information in order to take into account the driver's own rights and interests.

100: Intelligent auxiliary judgment and processing system for traffic violations

1: Vehicle system

11: Driving record module

12:GPS module

13: Inertial sensing module

14: Trip computer system

15: Communication module

2: Determine the server

21: Image database

200: communication network

300: electronic terminal

400: driver

S21~S27: Steps

Other features and effects of the present invention will be clearly presented in the implementation manner with reference to the drawings, wherein: Fig. 1 is a block diagram illustrating an intelligent auxiliary judgment and processing system for a traffic violation according to an embodiment of the present invention ; and FIG. 2 is a flow chart illustrating how a judging server of this embodiment executes an intelligent auxiliary judging and processing procedure corresponding to a traffic violation of a traffic event.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are denoted by the same numerals.

Referring to Fig. 1, it schematically shows a kind of intelligent auxiliary judging and processing system 100 for traffic violations according to the embodiment of the present invention, which is used to provide traffic violation information for any traffic incidents encountered by the driver of the vehicle or the vehicle itself. Intelligent auxiliary judgment and related processing services. The intelligent auxiliary judging and processing system 100 for traffic violations includes, for example, an in-vehicle system 1 suitable for installation in a vehicle (not shown), a judging server 2 , and a consulting server 3 . It is worth mentioning that before the actual use, the user corresponding to the vehicle (for example, the owner or driver of the vehicle) can provide relevant member basic information through the registration process (for example, including the license plate number used as vehicle identification, user name, user's contact information, etc.) to become a member who can use the above services.

In this embodiment, the vehicle-mounted system 1 operates to provide driving record data, driving trajectory, and inertia-related driving control information of the vehicle after it is started. The vehicle system 1 includes, for example, a driving record module 11 , a GPS module 12 , an inertial sensing module 13 , a driving computer system 14 and a communication module 15 . The communication module 15 is operable to connect to a communication network 200 . Preferably, the driving recording module 11 operates to record the internal image information and external image information of the vehicle during the driving of the vehicle, as well as the sound information of the environment in which the vehicle is located, so as to obtain driving recording data. For example, the external image information at least includes the image information in front of the vehicle, more preferably, it can also The image information of the rear of the vehicle and the image information of the blind spots on both sides of the vehicle are included. The GPS module 12 operates to locate the vehicle during the driving to obtain GPS data and can record the positioning data during the driving as the driving track of the vehicle. The inertial sensing module 13 (eg, may include multi-axis acceleration sensors, gyroscopes, etc.) operates to sense the inertial behavior of the vehicle (eg, inertial behavior in terms of acceleration and orientation) during the driving. The trip computer system 14 operates to monitor the driving control (eg, control in speed and direction) of the vehicle during the drive.

The judging server is connected to the communication network 200, configured with a traffic violation database containing a large amount of reference image data collected in advance related to various traffic violations, and stores a pre-established AI violation judgment model. In this embodiment, the AI violation judgment model is established, for example, according to the large amount of reference image data through machine learning training.

The consulting server 3 is connected to the judging server 2 and operates, for example but not limited to, to provide legal consulting services related to traffic incidents by man-machine dialogue.

In this embodiment, when the vehicle-mounted system 1 detects that a traffic event related to at least one of the vehicle and another vehicle occurs, it is associated with a change in at least one of the vehicle's driving speed and driving direction. When a specific driving condition of the vehicle, or when the vehicle-mounted system 1 receives an input control corresponding to the traffic event, the vehicle-mounted system 1 responds to the specific driving condition or the input control and collects the information of the vehicle corresponding to the traffic event Positioning data, time data, driving record data and inertia data to generate An event judgment request, and send the event judgment request to the judgment server 1 through the communication module 15 . Specifically, the specific driving situation may include emergency braking, emergency steering, or emergency braking and steering.

For example, if the traffic event is a collision event between the vehicle and another vehicle, the driver of the vehicle will often steer by pressing the brakes heavily and/or turning the steering wheel urgently when the other vehicle is about to collide The vehicle avoids the other vehicle, so in the vehicle-mounted system 1, the trip computer system 14 detects that the brake pedal of the vehicle is pressed too much and/or the angular velocity of the steering wheel of the vehicle is too large, Or when the GPS module 12 or the inertial sensing module 13 senses that the angular velocity of the vehicle is too high when it is moving, it means that the vehicle-mounted system 1 has detected the specific driving condition of the vehicle. Alternatively, if the driver of the vehicle witnesses a traffic incident related to another vehicle (for example, suspected improper overtaking, sudden braking or running a red light), the driver can manually operate a user of the vehicle-mounted system 1 The input and output interface, for example, touches the screen (not shown) to generate the input control. In other words, the event determination request can be automatically generated by the vehicle-mounted system 1 upon detecting the specific driving condition, or manually triggered by the driver of the vehicle after witnessing the traffic event.

In this embodiment, the event determination request includes, for example, the positioning data, time data, driving record data, and inertial data of the vehicle corresponding to the traffic event. In particular, the driving record data includes in-vehicle image information containing the owners of the vehicle (i.e., the driver and passengers), external image information containing the other vehicle, and The sound information of the environment (for example, including the radio audio inside and outside the vehicle). In particular, when the vehicle-mounted system 1 detects the specific driving condition, the driving record data may include the first time ( For example, the first 5 seconds) to the second time after the detection time point (for example, the last 10 seconds) recorded the image information inside the car, the image information outside the car and the sound information; In the case of witnessing the traffic event, the driving record data may include the third time (for example, before 20 seconds) before the receiving time point when the vehicle-mounted system 1 receives the input control to the fourth time after the receiving time point (for example, , the last 5 seconds) of the in-vehicle image information, the extravagant image information and the audio information recorded during the period.

Hereinafter, referring to Fig. 1 and Fig. 2, it will be described in detail by way of example, after the vehicle-mounted system 1 sends out the event judging request corresponding to the traffic event, how the judging server 2 executes the traffic violation corresponding to the traffic event. Intelligent auxiliary judgment and processing procedures. The intelligent auxiliary judgment and processing program for traffic violations includes the following steps S21-S27. In this embodiment, the driver 400 (see FIG. 1 ) of the vehicle is, for example, a member who has registered with the vehicle for the intelligent assistant judgment service.

After the judging server 2 receives the event judging request from the vehicle-mounted system 1 (step S21), in step S22, the judging server 2 uses the AI violation judging model to analyze the image information outside the car, To determine whether the image information outside the vehicle matches a traffic violation line, and then obtain a judgment corresponding to the traffic event result. If the judging server 2 judges that the image information outside the vehicle matches a traffic violation (for example, one of various traffic violations related to a large amount of reference image data stored in the traffic violation database), In this case, the judging result generated by the judging server 2 will indicate a traffic violation matching the traffic event; then the process will go to step S23. On the contrary, if the judging server 2 cannot successfully judge any traffic violation matching the image information outside the vehicle (for example, because the image information outside the vehicle is unclear or insufficient to determine the matching traffic violation, or although A matching traffic violation can be judged but the degree of confidence in this judgment (being correct) is lower than a predetermined threshold), in this case, the judging result generated by the judging server 2 will indicate that the judgment cannot be successfully judged. traffic event; then the process will proceed to step S25.

In step S23, the judging server 2 generates a report corresponding to the (judged) traffic violation according to the outside image information, the time data and the location data. Specifically, the reporting report has a specific form or format, for example. In addition, in step S23 , the judging server 2 also stores the image information outside the vehicle in the traffic violation database 21 as reference image data corresponding to the (judged) traffic violation behavior.

Next, in step S24 , the judging server 2 sends an event judging reply including the reporting report and a link URL of a reporting platform to an electronic terminal 300 . Specifically, the electronic terminal 300 may be used by the driver 400, for example personal computer or smart phone; therefore, after receiving the event judgment reply, the electronic terminal 300 manually fills in the reporting report with the informant’s identification information and transmits the reporting report to the Reporting platform, in order to complete the reporting procedure of the traffic violation. For example, in the case that the electronic terminal 300 is a smart phone, when the electronic terminal 300 receives the event judgment reply, it can push and broadcast instructions such as "received To remind the driver 400 that he can continue to complete the reporting procedure of the traffic violation through the operation interface provided by the exclusive application program.

After the judging server 2 fails to judge the traffic event, the judging server 2 judges whether the traffic event has property damage higher than a predetermined amount or Human loss. Specifically, in step S25, the judging server 2 will perform the following operations. The judging server 2 utilizes image recognition to analyze the in-vehicle image information to confirm whether the in-vehicle image information has characteristic images such as injuries or bleeding. On the other hand, the judging server 2 estimates whether the vehicle has property damage according to the sound information and the inertial data. For example, if the judging server 2 confirms that the sound information contains the sound feature of a collision, and at the same time confirms that the inertia data indicates (abnormal) acceleration in multi-axis directions (including the direction of travel), in this case, The judging server 2 will judge that there is a collision of the vehicle in the traffic event, that is, a property loss. Then, the judging server 2 can estimate the impact point and impact point of the vehicle according to the magnitude of the acceleration in the multi-axis direction indicated by the inertial data. The size of the impact. More specifically, the judging server 2 can determine the body parts and/or parts of the vehicle hit by the impact according to the estimated impact point, and can use, for example, the correlation data containing acceleration and impact force according to the magnitude of the acceleration. The impact force of the vehicle can be estimated by looking up the table or database, so by determining the impacted parts and/or parts of the vehicle and the impact force, the damage degree of the vehicle and the amount of repairs required can be comprehensively estimated. That is, the amount in the financial loss. Therefore, when the judging server 2 confirms that the characteristic image appears in the in-vehicle image information, or when the judging server 2 confirms that the estimated amount of property loss is higher than the predetermined amount, the process will proceed to step S26 , otherwise, the process will proceed to step S27.

In step S26, the judgment server 2 sends the event consultation data including the driving record data and the contact information of the driver of the vehicle to the consultation server 3, for the consultation server 3, for example, through man-machine dialogue. The driver 400 further provides remote consulting services. For example, the electronic terminal 300 is the smart phone used by the driver and the contact information is the mobile phone number of the smart phone, so the consulting server 3 can be dialed through the mobile phone number and combined with the pre-installed The exclusive application program of the electronic terminal 300 is executed to provide voice consultation service to the driver 400 .

It should be noted that, in other embodiments, when the judging server 2 confirms that the in-vehicle image information has the characteristic image, or when the judging server 2 confirms that the estimated amount of property loss is higher than the predetermined amount, the judging server 2 can first set the An inquiry notification of whether consultation service is required is sent to the electronic terminal 300 , and then the judgment server 2 executes step S26 after receiving a confirmation (consultation service is required) reply from the electronic terminal 300 .

When the judging server 2 confirms that the in-vehicle image information does not contain the feature image (that is, it is judged that there is no human damage in the traffic event), and it is confirmed that the audio data does not contain collision sound (that is, it is judged that the traffic event does not occur property damage due to collision) or when it is confirmed that the amount of property damage in the case of a collision is not higher than the predetermined amount, in step S27, the judging server 2 can judge the event as failure but no one has damaged property. Notify the on-vehicle system 1 or the electronic terminal 300 of related information that the event judgment fails but no one is damaged and the amount of property loss is not higher than the predetermined amount.

To sum up, the judging server 2 first uses the AI violation judging model to analyze the image information outside the car to make a preliminary judgment on whether the traffic event matches a traffic violation, and when the matching traffic violation is successfully judged , automatically generate a report and provide it to the driver, so that the reporter can report violations; and in the case of a preliminary judgment failure, when it is further confirmed that there is a property loss or personal loss higher than the predetermined amount in the traffic incident, Through the consulting server 3, the driver can be provided with advanced consulting services in terms of traffic or law, so that traffic violations can be reported in a relatively convenient and correct way, thereby helping to improve overall traffic safety and public safety, and can Obtain traffic or legal consulting information in a relatively minimal way to take into account the driver's own rights and interests. Therefore, the intelligent auxiliary judgment and processing system 100 of traffic violations of the present invention can really Reach the purpose of the present invention.

But the above-mentioned ones are only embodiments of the present invention, and should not limit the scope of the present invention. All simple equivalent changes and modifications made according to the patent scope of the present invention and the content of the patent specification are still within the scope of the present invention. Within the scope covered by the patent of the present invention.

100: Intelligent auxiliary judgment and processing system for traffic violations

1: Vehicle system

11: Driving record module

12:GPS module

13: Inertial sensing module

14: Trip computer system

15: Communication module

2: Determine the server

21: Image database

200: communication network

300: electronic terminal

400: driver

Claims (7)

An intelligent auxiliary judging and processing method for traffic violations is implemented by a judging server, and includes the following steps: (A) receiving an event judging request related to a traffic event of at least one of a vehicle and another vehicle, The event judgment request includes the positioning data, time data, driving record data and inertial data of the vehicle corresponding to the traffic event. The driving record data includes in-car image information containing the driver and passengers in the vehicle, including the other The image information outside the vehicle and the sound information of the environment where the vehicle is located; (B) using a pre-trained AI violation judgment model to analyze the image information outside the vehicle to obtain a judgment result corresponding to the traffic incident, the judgment result Indicate the traffic violation that matches the traffic event, or fail to successfully judge the traffic event; (C) When the judgment result indicates the traffic violation that matches the traffic event, according to the image information outside the vehicle, the time data Generate a reporting report corresponding to the traffic violation with the positioning data, and send an event judgment reply including the reporting report and a link URL of a reporting platform to an electronic terminal, so that the electronic terminal can use the link URL to The reporting report is sent to the reporting platform; and (D) when the judgment result indicates that the traffic incident cannot be successfully judged, according to the sound information, the in-vehicle image information and the inertial data, determine whether the traffic incident has occurred with high A predetermined amount of property damage or personal loss, and when it is judged that the traffic incident has a property loss higher than the predetermined amount or when it is judged that the traffic incident has caused a personal loss, the line will be included The event consultation information of the vehicle record data and the contact information of the driver of the vehicle is sent to a consultation server, so that the consultation server can further provide consultation services about the traffic incident to the driver. The intelligent auxiliary judging and processing method for traffic violations as described in claim 1 is also executed by using an on-board system installed in the vehicle and capable of communicating with the judging server, and also includes the following steps before step (A) : (E) When the vehicle-mounted system detects a specific driving condition associated with a change in at least one of the vehicle's driving speed and driving direction when the traffic event occurs, or when the vehicle-mounted system receives a corresponding During an input control of the traffic event, the vehicle-mounted system collects the positioning data, the time data, the driving record data and the inertial data in response to the specific driving situation or the input control to generate the event judgment request, and sends the The event judgment request is sent to the judgment server. The intelligent assistance judging and processing method for traffic violations according to Claim 2, wherein, in step (E), the specific driving condition includes at least one of emergency braking and emergency steering. An intelligent auxiliary judging and processing system for traffic violations, comprising: a judging server configured with a traffic violation database containing a large amount of reference image data related to various traffic violations, and storing a device based on the large amount of reference image data in advance An AI violation judgment model established by learning training methods; and a consulting server, connected to the judgment server, and operated to provide traffic or legal consulting services related to traffic incidents; wherein, the judgment server receives information about a vehicle and another vehicle An event determination request for a traffic event of at least one of them, the event determination request includes the positioning data, time data, driving record data and inertial data of the vehicle corresponding to the traffic event, the driving record data includes The in-vehicle image information of the driver and passengers, the external image information of the other vehicle, and the sound information of the vehicle's environment; wherein, the judgment server uses the AI violation judgment model to analyze the external image information to Obtaining a judgment result corresponding to the traffic event, the judgment result indicating a traffic violation matching the traffic event, or failing to judge the traffic event successfully; wherein, when the judgment result indicates the traffic violation matching the traffic event In the event of a violation, the judging server generates a reporting report corresponding to the traffic violation based on the image information outside the vehicle, the time data and the positioning data, and judges an event including the reporting report and a link URL of a reporting platform The reply is sent to an electronic terminal for the electronic terminal to transmit the reporting report to the reporting platform through the linked website; and wherein, when the judgment result indicates that the traffic incident cannot be successfully judged, the judging server Information, the image information in the car and the inertial data, to determine whether the traffic incident has property damage or personal damage higher than a predetermined amount, and when it is judged that the traffic incident has a property loss higher than the predetermined amount or When it is judged that the traffic incident has caused human damage, the event consultation information including the driving record data and the driver's contact information of the vehicle is sent to the consultation server, so that the consultation server can further provide relevant information to the driver. Inquiries about the traffic incident Serve. The intelligent auxiliary judging and processing system for traffic violations as described in claim 4, further comprising: a vehicle-mounted system, adapted to be installed on the vehicle, connected to the judging server through communication, and operated to provide driving record data after the vehicle is started , driving trajectory, and driving control information related to inertia; wherein, when the vehicle-mounted system detects a specific driving condition associated with a change in at least one of the vehicle's driving speed and driving direction when the traffic event occurs , or when the on-board system receives an input control corresponding to the traffic event, the on-board system collects the positioning data, the time data, the driving record data and the inertia in response to the specific driving situation or the input control data to generate the event judgment request, and send the event judgment request to the judgment server. The intelligent auxiliary judging and processing system for traffic violations according to claim 5, wherein the specific driving condition includes at least one of emergency braking and emergency steering. The intelligent auxiliary judging and processing system for traffic violations as described in claim 4, wherein when the judging result indicates the traffic violation matching the traffic event, the judging server regards the image information outside the vehicle as corresponding to the Reference image data of traffic violations are stored in the traffic violation database.

Images