CN114446010A - A vehicle-mounted robot system and its driving management method - Google Patents
A vehicle-mounted robot system and its driving management method Download PDFInfo
- Publication number
- CN114446010A CN114446010A CN202210370860.9A CN202210370860A CN114446010A CN 114446010 A CN114446010 A CN 114446010A CN 202210370860 A CN202210370860 A CN 202210370860A CN 114446010 A CN114446010 A CN 114446010A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- driving
- image
- module
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B31/00—Predictive alarm systems characterised by extrapolation or other computation using updated historic data
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Robotics (AREA)
- Automation & Control Theory (AREA)
- Mathematical Physics (AREA)
- Transportation (AREA)
- Computing Systems (AREA)
- Traffic Control Systems (AREA)
- Alarm Systems (AREA)
Abstract
一种车载机器人系统,包括OBD采集终端、视频采集端、智能机器人及云端系统,其中OBD采集终端及视频采集端均连接智能机器人,且智能机器人连接云端系统;智能机器人包括:驾驶行为识别模块、图像处理模块、本地存储模块、无线通讯模块、语音播放模块及屏幕显示模块;云端系统包括:消息队列、缓存、数据库以及物联网关。该车载机器人系统的驾驶管理方法包括:常规车辆驾驶行为管理、危险驾驶行为管理、行车安全管理、语音播报和灯光提醒、实时饰品监控、违规雏形分析及能源补给提醒。该系统及其驾驶管理方法实现了车辆全面监控、安全驾驶及智能管理功能,可对行驶中的车辆进行有效监控。
An in-vehicle robot system includes an OBD collection terminal, a video collection terminal, an intelligent robot and a cloud system, wherein the OBD collection terminal and the video collection terminal are both connected to an intelligent robot, and the intelligent robot is connected to a cloud system; the intelligent robot comprises: a driving behavior recognition module, Image processing module, local storage module, wireless communication module, voice playback module and screen display module; the cloud system includes: message queue, cache, database and IoT gateway. The driving management method of the vehicle-mounted robot system includes: conventional vehicle driving behavior management, dangerous driving behavior management, driving safety management, voice broadcast and light reminder, real-time ornament monitoring, violation prototype analysis and energy supply reminder. The system and its driving management method realize the functions of comprehensive vehicle monitoring, safe driving and intelligent management, and can effectively monitor the running vehicle.
Description
技术领域technical field
本发明涉及汽车辅助驾驶系统技术领域,具体为一种车载机器人系统及其驾驶管理方法。The invention relates to the technical field of automobile auxiliary driving systems, in particular to a vehicle-mounted robot system and a driving management method thereof.
背景技术Background technique
企业现有的车辆管理和监控系统,都是对车辆的使用过程进行管理,通过车辆GPS轨迹监控车辆的位置,管理方式比较单一。驾驶员在驾驶车辆的过程中根据车辆的行驶状况和周围道路环境的情况,对车辆做出不同的控制行为,对车辆和车辆上人员的安全有着非常重要的直接影响。The company's existing vehicle management and monitoring system manages the use process of the vehicle, monitoring the location of the vehicle through the GPS track of the vehicle, and the management method is relatively simple. In the process of driving a vehicle, the driver makes different control behaviors on the vehicle according to the driving conditions of the vehicle and the surrounding road environment, which has a very important and direct impact on the safety of the vehicle and the people on the vehicle.
目前的通用的监控和管理方式比较单一,要么只能监控驾驶员的驾驶状况,要么只能监控道路行驶状态,要么只能监控车辆的位置信息,要么只有单一的视频监控,无法同云端系统存储的数据进行交互分析,无法综合多种数据进行分析、预警。The current general monitoring and management methods are relatively simple, either only monitoring the driving status of the driver, or only monitoring the driving status of the road, or only monitoring the location information of the vehicle, or only a single video monitoring, which cannot be stored with the cloud system. It is impossible to integrate multiple data for analysis and early warning.
随着企业精细化管理的要求,伴随着行车安全方面的要求,需求越来越多样化,因此研究一种车载机器人系统,实现车辆的全面监控、安全驾驶、智能管理是企业迫切的需求。With the requirements of refined management of enterprises and the requirements of driving safety, the needs are becoming more and more diversified. Therefore, it is an urgent need for enterprises to develop a vehicle-mounted robot system to realize comprehensive monitoring, safe driving and intelligent management of vehicles.
通过公开专利检索,发现以下对比文件:Through a public patent search, the following comparative documents were found:
CN112085347A-公开了一种集装箱货车车队数字化调拨管理系统及方法,车队端、用户端和司机端共同组成一个数字化集装箱卡车运输平台,进行数据对接处理,车队端、用户端和司机端的三端系统各有侧重,且三端系统的目标用户不同,由车用户端派发订单,车队端接受订单,司机端实施订单,交互页面由实时抢单、车队管理和资质认证三部分组成,且实时抢单页面包括地图信息及订单管理信息,需求侧数字化领域由货主、第三方物流和货代、车队三部分组成。该集装箱货车车队数字化调拨管理系统及方法为调度员提供获取业务、分发任务、任务追踪、车辆管理、司机管理、资质认证等功能,显著提升车队的管理效率,降低管理端人力成本。CN112085347A-Disclosed is a system and method for digital allocation management of container truck fleet. Fleet end, user end and driver end together form a digital container truck transportation platform for data docking processing. There is a focus, and the target users of the three-terminal system are different. The car user terminal distributes the order, the fleet terminal accepts the order, and the driver terminal implements the order. The interactive page consists of three parts: real-time order grabbing, fleet management and qualification certification, and the real-time order grabbing page. Including map information and order management information, the demand-side digital field consists of three parts: cargo owners, third-party logistics and freight forwarders, and fleets. The container truck fleet digital allocation management system and method provide dispatchers with functions such as business acquisition, task distribution, task tracking, vehicle management, driver management, and qualification certification, which significantly improves the management efficiency of the fleet and reduces labor costs on the management side.
发明内容SUMMARY OF THE INVENTION
本发明的目的在于克服现有技术的不足之处,提供一种车载机器人系统及其驾驶管理方法,该系统及其驾驶管理方法实现了车辆全面监控、安全驾驶及智能管理功能,可对行驶中的车辆进行有效监控。The purpose of the present invention is to overcome the deficiencies of the prior art, and to provide a vehicle-mounted robot system and a driving management method thereof. Vehicles are effectively monitored.
一种车载机器人系统,包括OBD终端采集、视频采集端、车载机器人及云端系统;车载机器人内置有驾驶行为识别模块、图像处理模块、语音播放模块及屏幕显示模块;驾驶行为识别模块接收并处理OBD终端采集通过车辆CAN总线发送的里程油耗信息、车辆位置信息、车辆状态信息及车辆故障信息;图像处理模块接收并处理视频采集端发送的车辆行驶过程道路上状态,以及行人、车道线、交通标志、交通灯状态以及驾驶员信息;语音播放模块与屏幕显示模块播报及显示驾驶行为识别模块与图像处理模块处理后的信息并发送至云端系统列队并储存。An in-vehicle robot system includes an OBD terminal acquisition terminal, a video acquisition terminal, an in-vehicle robot and a cloud system; the in-vehicle robot has a built-in driving behavior recognition module, an image processing module, a voice playback module and a screen display module; the driving behavior recognition module receives and processes the OBD The terminal collects the mileage and fuel consumption information, vehicle position information, vehicle status information and vehicle fault information sent through the vehicle CAN bus; the image processing module receives and processes the road status of the vehicle during the driving process sent by the video acquisition terminal, as well as pedestrians, lane lines, traffic signs , traffic light status and driver information; the voice playback module and the screen display module broadcast and display the information processed by the driving behavior recognition module and the image processing module, and send them to the cloud system for queuing and storage.
优选地,云端系统包括消息队列、缓存、数据库以及物联网关;车载机器人远程发送的数据信息经物联网关进入云端系统,用于车载机器人的统一接入和数据交互;消息队列传递用户云端系统的消息;缓存用于云端系统的数据缓存;数据库存储云端系统的数据。Preferably, the cloud system includes a message queue, a cache, a database and an IoT gateway; the data information remotely sent by the vehicle-mounted robot enters the cloud system through the IoT gateway for unified access and data interaction of the vehicle-mounted robot; the message queue transmits the user cloud system message; cache is used for data cache of cloud system; database stores data of cloud system.
优选地,车载机器人还内置有本地存储模块及无线通讯模块;本地存储模块存储OBD终端采集及视频采集端采集的数据信息;无线通讯模块远程接入云端系统的物联网关。Preferably, the vehicle-mounted robot also has a built-in local storage module and a wireless communication module; the local storage module stores data information collected by the OBD terminal and the video collection terminal; the wireless communication module is remotely connected to the IoT gateway of the cloud system.
优选地,驾驶行为识别模块处理判断行车安全和驾驶员存在的危险驾驶行为;图像处理模块对高清摄像头传回的图像视频进行处理,获得包括车道信息和交通标识信息在内的行驶路况目标信息;图像处理模块用于对高清摄像头传回的图像或视频进行处理,获得行驶路况目标信息,行驶路况目标信息包括车道信息和交通标识信息;本地存储模块存储车载机器人采集的数据和分析的结果;无线通讯模块远程连接云端系统的物联网关并进行通讯;语音播放模块实时向驾驶室内提供语音提醒和播报;屏幕显示模块显示车载机器人的控制界面以及报警信息。Preferably, the driving behavior recognition module processes and judges the driving safety and the dangerous driving behavior of the driver; the image processing module processes the images and videos returned by the high-definition camera to obtain the driving road condition target information including lane information and traffic sign information; The image processing module is used to process the image or video returned by the high-definition camera to obtain the target information of driving road conditions, which includes lane information and traffic sign information; the local storage module stores the data collected by the vehicle-mounted robot and the results of analysis; wireless The communication module is remotely connected to the IoT gateway of the cloud system and communicates; the voice playback module provides real-time voice reminders and broadcasts to the cab; the screen display module displays the control interface and alarm information of the vehicle-mounted robot.
一种车载机器人系统的驾驶管理方法,驾驶管理方法包括以下管理内容:常规车辆驾驶行为管理、危险驾驶行为管理、行车安全管理、语音播报和灯光提醒、实时视频监控、违规雏形分析及能源补给提醒。A driving management method for a vehicle-mounted robot system, the driving management method includes the following management contents: conventional vehicle driving behavior management, dangerous driving behavior management, driving safety management, voice broadcast and light reminder, real-time video monitoring, violation prototype analysis and energy supply reminder .
优选地,常规车辆驾驶行为管理包括以下步骤:Preferably, the conventional vehicle driving behavior management includes the following steps:
步骤1.1:车辆行驶过程中,OBD终端采集实时采集车辆的速度信息和方向信息,发送给驾驶行为识别模块进行分析计算;Step 1.1: During the driving process of the vehicle, the OBD terminal collects the speed information and direction information of the vehicle in real time, and sends it to the driving behavior recognition module for analysis and calculation;
步骤1.2:驾驶行为识别模块通过单位时间内车辆速度的变化来计算车辆的加速度,当车辆的加速度变化超过预先定义的急加速、急减速的阈值时,确定车辆存在急加速、急减速的驾驶行为;进一步的通过单位时间内车辆方向的变化来计算车辆拐弯速度,当车辆方向变化的速度超过预先定义的急拐弯阈值时,确定车辆存在急拐弯的驾驶行为;Step 1.2: The driving behavior recognition module calculates the acceleration of the vehicle through the change of the vehicle speed per unit time. When the acceleration change of the vehicle exceeds the predefined thresholds of rapid acceleration and rapid deceleration, it is determined that the vehicle has driving behavior of rapid acceleration and rapid deceleration ; Further calculate the vehicle turning speed through the change of the vehicle direction per unit time, and when the speed of the vehicle direction change exceeds the predefined sharp turning threshold, it is determined that the vehicle has a sharp turning driving behavior;
步骤1.3:识别出来的车辆驾驶行为,通过语音播放模块和屏幕显示模块进行语音播报和灯光闪烁提醒;Step 1.3: The recognized driving behavior of the vehicle, through the voice playback module and the screen display module for voice broadcast and light flashing reminder;
步骤1.4:进一步将车辆驾驶行为记录通过无线通讯模块连接物联网关,上传到云端系统进行保存。Step 1.4: The vehicle driving behavior record is further connected to the IoT gateway through the wireless communication module, and uploaded to the cloud system for storage.
优选地,危险驾驶行为管理包括以下步骤:Preferably, the management of dangerous driving behavior includes the following steps:
步骤2.1:在车辆行驶的过程中,视频采集端采集驾驶员信息的高清视频摄像头,预先采集驾驶员的驾车图像信息,并将图像信息传递给图像处理模块进行处理;Step 2.1: During the driving process of the vehicle, the video collection terminal collects the high-definition video camera of the driver's information, collects the driver's driving image information in advance, and transmits the image information to the image processing module for processing;
步骤2.2:图像处理模块对图像进行预处理,进行图像增强,以减少图像中的图像的噪声,改变原来图像的亮度、色彩分布、对比度等参数;图像增强提高了图像的清晰度、图像的质量,使图像中的物体的轮廓更加清晰,细节更加明显;图像处理模块将处理之后的图像传递给驾驶行为识别模块进行驾驶行为识别;Step 2.2: The image processing module preprocesses the image and performs image enhancement to reduce the noise of the image in the image and change the brightness, color distribution, contrast and other parameters of the original image; image enhancement improves the clarity and quality of the image. , to make the outline of the object in the image clearer and the details more obvious; the image processing module transmits the processed image to the driving behavior recognition module for driving behavior recognition;
步骤2.3:驾驶行为识别模块首先识别图像中是否有人体,若没有检测到人体,则继续处理后续图像信息,若检测到至少1个人体,将目标最大的人体作为驾驶员,进一步识别驾驶员的属性行为,通过内置的模型,来判断驾驶员的各种行为,具体包含:通过识别图像中驾驶员手中是否有手机,来识别驾驶员是否在行车的过程中使用手机;通过识别图像中驾驶员手中或者嘴中是否有烟,来识别驾驶员是否在行车的过程中抽烟;通过识别驾驶员双手离方向盘的远近,来判断驾驶员是否双手离开方向盘;通过连续多张图像中眼睛闭合程度和嘴部的张合程度,来识别驾驶员是否疲劳驾驶;通过连续多张图像中的头部方向,来判断驾驶员是否视线未直视前方,存在低头行为;Step 2.3: The driving behavior recognition module first identifies whether there is a human body in the image. If no human body is detected, it continues to process the subsequent image information. If at least one human body is detected, the human body with the largest target is used as the driver to further identify the driver's Attribute behavior, through the built-in model, to determine the various behaviors of the driver, including: by identifying whether the driver has a mobile phone in the image, to identify whether the driver is using a mobile phone in the process of driving; by identifying the driver in the image. Whether there is smoke in the hands or mouth, to identify whether the driver is smoking during driving; by identifying the distance between the driver's hands and the steering wheel, to determine whether the driver's hands are off the steering wheel; through the degree of eye closure and mouth closure in multiple consecutive images The degree of opening and closing of the head is used to identify whether the driver is driving fatigued; the direction of the head in multiple consecutive images is used to determine whether the driver is not looking straight ahead, and there is a bowing behavior;
步骤2.4:识别出来的危险驾驶行为,通过语音播放模块和屏幕显示模块,进行语音播报和灯光闪烁提醒;Step 2.4: For the identified dangerous driving behavior, through the voice playback module and the screen display module, voice broadcast and light flashing reminders;
步骤2.5:进一步将危险驾驶行为记录通过无线通讯模块,连接物联网关,上传到云端系统进行保存。Step 2.5: Further record the dangerous driving behavior through the wireless communication module, connect to the IoT gateway, and upload it to the cloud system for storage.
优选地,行车安全管理包括以下步骤:Preferably, the driving safety management includes the following steps:
步骤3.1:在车辆行驶的过程中,视频采集端中采集车辆行驶过程道路状况的高清视频摄像头,预先采集车辆前方的图像信息,并将图像信息传递给图像处理模块进行处理;Step 3.1: During the driving of the vehicle, a high-definition video camera that collects the road conditions during the driving of the vehicle in the video collection terminal collects the image information in front of the vehicle in advance, and transmits the image information to the image processing module for processing;
步骤3.2:图像处理模块对图像进行预处理,进行图像增强,以减少图像中的图像的噪声;图像处理模块将处理之后的图像传递给驾驶行为识别模块进行驾驶行为识别;Step 3.2: the image processing module preprocesses the image and performs image enhancement to reduce the noise of the image in the image; the image processing module transmits the processed image to the driving behavior recognition module for driving behavior recognition;
步骤3.3:驾驶行为识别模块,识别图像中的物体,通过内置的模型,来判断车辆的行车安全,具体包含:对车辆前方车道图像进行处理获得车道数量、车道边线信息,并且进一步处理获得车道中的当前汽车位置,判断车辆是否在预定的一段时间内压到路面车道边线,来判断汽车是否偏离车道;对车辆前方行车图像进行处理,识别前方车辆、行人等障碍物,在一定时间或距离内,识别车辆是否存在潜在的碰撞危险;Step 3.3: The driving behavior recognition module recognizes the objects in the image, and judges the driving safety of the vehicle through the built-in model, which specifically includes: processing the image of the lane in front of the vehicle to obtain the number of lanes and lane edge information, and further processing to obtain the information of the lane in the lane. The current car position of the vehicle can be determined by judging whether the vehicle is pressed against the sideline of the road lane within a predetermined period of time to determine whether the car deviates from the lane; the driving image in front of the vehicle is processed to identify obstacles such as vehicles and pedestrians ahead, within a certain time or distance. , to identify whether the vehicle has a potential collision hazard;
步骤3.4:识别出来的行车安全提醒,通过语音播放模块和屏幕显示模块,进行语音播报和灯光闪烁提醒;Step 3.4: For the recognized driving safety reminder, the voice broadcast module and the screen display module are used for voice broadcast and light flashing reminder;
步骤3.5:进一步将行车安全提醒记录通过无线通讯模块,连接物联网关,上传到云端系统进行保存。Step 3.5: Further record the driving safety reminder through the wireless communication module, connect to the IoT gateway, and upload it to the cloud system for storage.
本发明的优点和技术效果是:The advantages and technical effects of the present invention are:
本发明的一种车载机器人系统及其驾驶管理方法相比于传统的车辆管理系统,具有如下优点:Compared with the traditional vehicle management system, the vehicle-mounted robot system and the driving management method thereof of the present invention have the following advantages:
1、通过视频采集端采集驾驶员和车辆前方视频或图像,在终端侧实现对视频、图像的分析处理,判断驾驶员的危险驾驶行为、车辆碰撞危险和车道偏离。1. The video or image in front of the driver and the vehicle is collected through the video collection terminal, and the video and image are analyzed and processed on the terminal side to judge the driver's dangerous driving behavior, vehicle collision risk and lane departure.
2、通过OBD终端采集车辆运行数据,实时分析车辆的驾驶行为。2. Collect vehicle operation data through the OBD terminal, and analyze the driving behavior of the vehicle in real time.
3、采集的数据存储到云端,结合云端车辆管理和运行的数据,基于大数据综合分析多样化的数据,全方位的对车辆进行管理、监控、预警。3. The collected data is stored in the cloud, combined with the data of vehicle management and operation in the cloud, and comprehensively analyzes diversified data based on big data to manage, monitor and warn the vehicle in an all-round way.
附图说明Description of drawings
图1是本发明车载机器人的系统框架图。FIG. 1 is a system frame diagram of the vehicle-mounted robot of the present invention.
具体实施方式Detailed ways
为能进一步了解本发明的内容、特点及功效,兹例举以下实施例,并配合附图详细说明如下,需要说明的是,本实施例是描述性的,不是限定性的,不能由此限定本发明的保护范围。In order to further understand the content, features and effects of the present invention, the following embodiments are exemplified and described in detail with the accompanying drawings. protection scope of the present invention.
如图1所示,本发明是一种车载机器人系统,而且,系统包含:OBD终端采集1、视频采集端2、智能机器人、云端系统,其中OBD终端采集1、视频采集端2与智能机器人相连接,智能机器人与云端系统相连接。As shown in FIG. 1 , the present invention is a vehicle-mounted robot system, and the system includes:
其中智能机器人包含:驾驶行为识别模块3、图像处理模块4、本地存储模块5、无线通讯模块6、语音播放模块7、屏幕显示模块8。云端系统包含:物联网关9、消息队列10、缓存11、数据库12。The intelligent robot includes: a driving behavior recognition module 3 , an image processing module 4 , a
而且,OBD终端采集1通过车辆CAN总线进行车辆数据采集,包括四类数据:Moreover,
里程油耗信息:仪表盘里程、发动机转速、动态油耗、静态油耗、平均油耗。Mileage and fuel consumption information: dashboard mileage, engine speed, dynamic fuel consumption, static fuel consumption, and average fuel consumption.
车辆位置信息:位置、车速、方向。Vehicle location information: location, speed, direction.
车辆状态信息:电瓶电压、温度、油量、胎压等。Vehicle status information: battery voltage, temperature, fuel volume, tire pressure, etc.
车辆故障信息。Vehicle fault information.
而且,视频采集端2通过两路高清视频摄像头采集视频,一路采集车辆行驶过程道路上状态,包括过往车辆、行人、车道线、交通标志、交通灯等;一路采集驾驶员信息,实现对行驶的道路环境、驾驶员的状态进行采集。Moreover, the
而且,驾驶行为识别模块3用于来处理判断行车安全和驾驶员是否存在危险的驾驶行为。Moreover, the driving behavior recognition module 3 is used to process and judge the driving behavior of driving safety and whether the driver has dangerous driving behavior.
而且,图像处理模块4块用于对高清摄像头传回的图像或视频进行处理,获得行驶路况目标信息,而且,行驶路况目标信息包括车道信息和交通标识信息。Moreover, the image processing module 4 is used to process the image or video returned by the high-definition camera to obtain the target information of driving road conditions, and the target information of driving road conditions includes lane information and traffic sign information.
而且,本地存储模块5用于智能机器人存储采集的数据和分析的结果。Moreover, the
而且,无线通讯模块6用于智能机器人与云端新统计进行通讯。Moreover, the
而且,语音播放模块7用于实时语音提醒和播报。Moreover, the voice playing module 7 is used for real-time voice prompting and broadcasting.
而且,屏幕显示模块8用于智能机器人的界面显示和报警和提醒。Moreover, the
而且,物联网关9用于实现车载机器人的统一接入和数据交互。Moreover, the
而且,消息队列10用户云端系统消息的传递,实现系统的解耦、异步、削峰。Moreover, the
而且,缓存11用于云端系统的数据缓存,提高系统运行效率。Moreover, the
而且,数据库12用于云端系统数据的存储。Also, the
而且,判断车辆驾驶行为,具体包括以下步骤:Moreover, judging the driving behavior of the vehicle specifically includes the following steps:
步骤1.1:车辆行驶过程中,OBD终端采集1,实时采集车辆的速度信息和方向信息,发送给驾驶行为识别模块3进行分析计算。Step 1.1: During the driving process of the vehicle, the OBD terminal collects 1, collects the speed information and direction information of the vehicle in real time, and sends it to the driving behavior recognition module 3 for analysis and calculation.
步骤1.2:驾驶行为识别模块3通过单位时间内车辆速度的变化来计算车辆的加速度,当车辆的加速度变化超过预先定义的急加速、急减速的阈值时,确定车辆存在急加速、急减速的驾驶行为。进一步的通过单位时间内车辆方向的变化来计算车辆拐弯速度,当车辆方向变化的速度超过预先定义的急拐弯阈值时,确定车辆存在急拐弯的驾驶行为。Step 1.2: The driving behavior recognition module 3 calculates the acceleration of the vehicle through the change of the vehicle speed per unit time. When the acceleration change of the vehicle exceeds the predefined thresholds of rapid acceleration and rapid deceleration, it is determined that the vehicle is driving with rapid acceleration and rapid deceleration. Behavior. Further, the vehicle turning speed is calculated by the change of the vehicle direction in a unit time, and when the speed of the vehicle direction change exceeds a predefined sharp turning threshold, it is determined that the vehicle has a sharp turning driving behavior.
步骤1.3:识别出来的车辆驾驶行为,通过语音播放模块7和屏幕显示模块8,进行语音播报和灯光闪烁提醒。Step 1.3: The recognized driving behavior of the vehicle, through the voice playback module 7 and the
步骤1.4:进一步将车辆驾驶行为记录通过无线通讯模块6,连接物联网关9,上传到云端系统进行保存。Step 1.4: Further record the driving behavior of the vehicle through the
而且,判断驾驶员是否存在危险的驾驶行为,具体包含以步骤:Moreover, judging whether the driver has dangerous driving behaviors specifically includes the following steps:
步骤2.1:在车辆行驶的过程中,视频采集端2中采集驾驶员信息的高清视频摄像头,预先采集驾驶员的驾车图像信息,并将图像信息传递给图像处理模块4进行处理。Step 2.1: During the driving of the vehicle, the high-definition video camera that collects driver information in the
步骤2.2:图像处理模块4对图像进行预处理,进行图像增强,以减少图像中的图像的噪声,改变原来图像的亮度、色彩分布、对比度等参数。图像增强提高了图像的清晰度、图像的质量,使图像中的物体的轮廓更加清晰,细节更加明显。图像处理模块4将处理之后的图像传递给驾驶行为识别模块3进行驾驶行为识别。Step 2.2: The image processing module 4 preprocesses the image and performs image enhancement to reduce the noise of the image in the image, and to change the brightness, color distribution, contrast and other parameters of the original image. Image enhancement improves the clarity and quality of the image, and makes the outline of the object in the image clearer and the details more obvious. The image processing module 4 transmits the processed image to the driving behavior recognition module 3 for driving behavior recognition.
步骤2.3:驾驶行为识别模块3,首先识别图像中是否有人体,若没有检测到人体,则继续处理后续图像信息,若检测到至少1个人体,将目标最大的人体作为驾驶员,进一步识别驾驶员的属性行为,通过内置的模型,来判断驾驶员的各种行为,具体包含:通过识别图像中驾驶员手中是否有手机,来识别驾驶员是否在行车的过程中使用手机;通过识别图像中驾驶员手中或者嘴中是否有烟,来识别驾驶员是否在行车的过程中抽烟;通过识别驾驶员双手离方向盘的远近,来判断驾驶员是否双手离开方向盘;通过连续多张图像中眼睛闭合程度和嘴部的张合程度,来识别驾驶员是否疲劳驾驶;通过连续多张图像中的头部方向,来判断驾驶员是否视线未直视前方,存在低头行为。Step 2.3: Driving behavior recognition module 3, first identify whether there is a human body in the image, if no human body is detected, continue to process the subsequent image information, if at least one human body is detected, the human body with the largest target is used as the driver to further identify the driver The attribute behavior of the driver is used to judge the various behaviors of the driver through the built-in model, which includes: identifying whether the driver is using a mobile phone during driving by identifying whether the driver has a mobile phone in the image; Whether there is smoke in the driver's hands or mouth to identify whether the driver is smoking while driving; by identifying the distance between the driver's hands and the steering wheel, to determine whether the driver's hands are off the steering wheel; through the degree of eye closure in consecutive images The degree of opening and closing of the mouth and the mouth are used to identify whether the driver is driving fatigued; the direction of the head in multiple consecutive images is used to determine whether the driver is not looking straight ahead, and there is a bowing behavior.
步骤2.4:识别出来的危险驾驶行为,通过语音播放模块7和屏幕显示模块8,进行语音播报和灯光闪烁提醒。Step 2.4: For the identified dangerous driving behavior, through the voice playback module 7 and the
进一步将危险驾驶行为记录通过无线通讯模块6,连接物联网关9,上传到云端系统进行保存。Further, the dangerous driving behavior record is connected to the Internet of
而且,判断行车安全,具体包含以下步骤:Moreover, judging driving safety includes the following steps:
步骤3.1:在车辆行驶的过程中,视频采集端2中采集车辆行驶过程道路状况的高清视频摄像头,预先采集车辆前方的图像信息,并将图像信息传递给图像处理模块4进行处理。Step 3.1: During the driving process of the vehicle, the
步骤3.2:同样的,图像处理模块4对图像进行预处理,进行图像增强,以减少图像中的图像的噪声。图像处理模块4将处理之后的图像传递给驾驶行为识别模块3进行驾驶行为识别。Step 3.2: Similarly, the image processing module 4 preprocesses the image and performs image enhancement to reduce the noise of the image in the image. The image processing module 4 transmits the processed image to the driving behavior recognition module 3 for driving behavior recognition.
步骤3.3:驾驶行为识别模块3,识别图像中的物体,通过内置的模型,来判断车辆的行车安全,具体包含:对车辆前方车道图像进行处理获得车道数量、车道边线信息,并且进一步处理获得车道中的当前汽车位置,判断车辆是否在预定的一段时间内压到路面车道边线,来判断汽车是否偏离车道;对车辆前方行车图像进行处理,识别前方车辆、行人等障碍物,在一定时间或距离内,识别车辆是否存在潜在的碰撞危险。Step 3.3: The driving behavior recognition module 3, recognizes the objects in the image, and judges the driving safety of the vehicle through the built-in model, which specifically includes: processing the image of the lane in front of the vehicle to obtain the number of lanes and lane edge information, and further processing to obtain the lane The current car position in the vehicle is determined by judging whether the vehicle is pressed against the sideline of the road lane within a predetermined period of time to determine whether the car deviates from the lane; the driving image in front of the vehicle is processed, and obstacles such as vehicles and pedestrians in front are identified. , to identify if the vehicle has a potential collision hazard.
步骤3.4:识别出来的行车安全提醒,通过语音播放模块7和屏幕显示模块8,进行语音播报和灯光闪烁提醒。Step 3.4: For the identified driving safety reminder, the voice broadcast module 7 and the
步骤3.5:进一步将行车安全提醒记录通过无线通讯模块6,连接物联网关9,上传到云端系统进行保存。Step 3.5: The driving safety reminder record is further connected to the
而且,提供语音播报和灯光提醒功能,具体包括:针对车载机器人识别的危险驾驶行为,车道偏离、碰撞事件行车安全事件,通过语音播放模块7进行语音播报,通过屏幕显示模块8进行灯光提醒;针对云端系统识别的违规出行分析、能源补给提醒,通过语音播放模块7进行语音播报提醒。Moreover, voice broadcast and light reminder functions are provided, specifically including: for dangerous driving behaviors recognized by the vehicle-mounted robot, lane departure, and collision events, driving safety events, voice broadcast through the voice playback module 7, and light reminders through the
而且,提供实时视频监控,具体包括:管理人员在云端系统选择查看指定车辆的驾驶员驾车或者车辆前方行驶的监控视频,云端系统通过物联网关9向智能机器人下发指令,智能机器人接收到指令后,通过视频采集端2,采集对应的视频信息,通过智能机器人发送给云端系统,管理员通过云端系统实时监控。Moreover, real-time video monitoring is provided, which specifically includes: managers choose to view the monitoring video of the driver of the designated vehicle driving or driving in front of the vehicle in the cloud system, the cloud system sends instructions to the intelligent robot through the Internet of
而且,进行违规出行分析,具体包括:云端系统在接收到车辆轨迹,并且判断车辆出行时,实时分析云端车辆出行申请数据,判断车辆是否存在用车申请,如果不存在,云端系统通过物联网关9向智能机器人下发未携工单出行警告,智能机器人通过语音播放模块7进行语音提醒,提醒驾驶员违规出行;云端系统接收到车辆轨迹,实时分析车辆轨迹,并且对比预先定义的敏感地点坐标,在预先定义的固定时间内,车辆轨迹在敏感地点坐标的固定范围内时,判断车辆存在敏感地点停放超时的驾驶行为,云端系统通过物联网关9向智能机器人下发敏感地点停放警告,智能机器人通过语音播放模块7进行语音提醒,提醒驾驶员违规出行。In addition, the analysis of illegal travel includes: when the cloud system receives the vehicle trajectory and determines that the vehicle travels, it analyzes the cloud vehicle travel application data in real time, and determines whether the vehicle has a vehicle application. If not, the cloud system passes the Internet of Things gateway. 9. Send a travel warning without a work order to the intelligent robot, and the intelligent robot will give a voice reminder through the voice playback module 7 to remind the driver to travel illegally; the cloud system receives the vehicle trajectory, analyzes the vehicle trajectory in real time, and compares the pre-defined coordinates of sensitive locations , within a predefined fixed time, when the vehicle trajectory is within the fixed range of the coordinates of the sensitive location, it is judged that the vehicle has a driving behavior of parking overtime in a sensitive location, and the cloud system issues a parking warning to the intelligent robot through the IoT gateway The robot makes a voice reminder through the voice playback module 7 to remind the driver to travel illegally.
而且,提供能源补给提醒,具体包括:当云端系统接收到用车申请,确定车辆需要出行时,通过用车申请中的出发地和目的地,预先计算车辆任务行程。燃油车辆出行时,通过云端系统收集到的车辆历史油耗信息,OBD终端采集1实时上传的车辆油量,实时计算燃油是否满足行程要求,不满足时,云端系统通过物联网关9向智能机器人下发油量不足警告,智能机器人通过语音播放模块7进行语音提醒,提醒及时加油;电动车辆出行时,通过云端系统收集到的车辆历史耗电量信息,OBD终端采集1实时上传的车辆剩余电量,实时计算电量是否满足行程要求,不满足时,云端系统通过物联网关9向智能机器人下发电量不足警告,智能机器人通过语音播放模块7进行语音提醒,提醒及时充电。Moreover, providing an energy supply reminder specifically includes: when the cloud system receives a vehicle application and determines that the vehicle needs to travel, pre-calculating the vehicle task itinerary based on the departure and destination in the vehicle application. When the fuel vehicle travels, the historical fuel consumption information of the vehicle is collected through the cloud system, and the OBD terminal collects the real-time upload of the vehicle fuel quantity, and calculates in real time whether the fuel meets the travel requirements. For the warning of insufficient fuel output, the intelligent robot will give a voice reminder through the voice playback module 7 to remind to refuel in time; when the electric vehicle travels, the historical power consumption information of the vehicle is collected through the cloud system, and the OBD terminal collects the real-time upload of the remaining power of the vehicle. Calculate in real time whether the power meets the travel requirements. If not, the cloud system sends a warning of insufficient power generation to the intelligent robot through the
另外,本发明优选的各模块具体型号如下:OBD终端采集,Y-BOX400;视频采集端,HDL-6624HC;本地存储模块,金士顿SDC10;无线通讯模块,华为ME909S-821;语音播放模块,LM1875T;屏幕显示模块,SDWn035T63T。In addition, the specific models of the preferred modules in the present invention are as follows: OBD terminal acquisition, Y-BOX400; video acquisition terminal, HDL-6624HC; local storage module, Kingston SDC10; wireless communication module, Huawei ME909S-821; voice playback module, LM1875T; Screen display module, SDWn035T63T.
最后,本发明的未述之处均采用现有技术中的成熟产品及成熟技术手段。Finally, the parts not mentioned in the present invention all adopt mature products and mature technical means in the prior art.
应当理解的是,对本领域普通技术人员来说,可以根据上述说明加以改进或变换,而所有这些改进和变换都应属于本发明所附权利要求的保护范围。It should be understood that for those skilled in the art, improvements or changes can be made according to the above description, and all these improvements and changes should fall within the protection scope of the appended claims of the present invention.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210370860.9A CN114446010A (en) | 2022-04-11 | 2022-04-11 | A vehicle-mounted robot system and its driving management method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210370860.9A CN114446010A (en) | 2022-04-11 | 2022-04-11 | A vehicle-mounted robot system and its driving management method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114446010A true CN114446010A (en) | 2022-05-06 |
Family
ID=81358530
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210370860.9A Pending CN114446010A (en) | 2022-04-11 | 2022-04-11 | A vehicle-mounted robot system and its driving management method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114446010A (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115984785A (en) * | 2022-12-14 | 2023-04-18 | 上海智能网联汽车技术中心有限公司 | System for realizing intelligent internet automobile universe supervision |
CN117041503A (en) * | 2023-10-10 | 2023-11-10 | 四川科泰智能电子有限公司 | High-performance flash memory array video identification equipment and method |
CN117163055A (en) * | 2023-09-08 | 2023-12-05 | 苏州宇洽科技有限公司 | Display console based on vehicle-mounted control |
CN117612334A (en) * | 2023-12-14 | 2024-02-27 | 鱼快创领智能科技(南京)有限公司 | A driving safety reminder system and method based on smart watch |
CN118506253A (en) * | 2024-07-18 | 2024-08-16 | 中汽数据(天津)有限公司 | Driver safe driving monitoring system and method |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110191058A1 (en) * | 2009-08-11 | 2011-08-04 | Certusview Technologies, Llc | Locating equipment communicatively coupled to or equipped with a mobile/portable device |
CN102629415A (en) * | 2012-04-28 | 2012-08-08 | 山东交通学院 | Automatic active early warning system for highway rescue |
CN102685516A (en) * | 2011-03-07 | 2012-09-19 | 李慧盈 | Active safety type assistant driving method based on stereoscopic vision |
CN104751600A (en) * | 2015-03-03 | 2015-07-01 | 北京虹安翔宇信息科技有限公司 | Anti-fatigue driving safety equipment based on iris recognition and application method thereof |
CN105389864A (en) * | 2015-10-16 | 2016-03-09 | 江苏南亿迪纳数字科技发展有限公司 | Method for extracting automobile UBI (usage based insurance) messages |
CN113052997A (en) * | 2021-03-08 | 2021-06-29 | 青岛卡沃斯智能制造有限公司 | Intelligent robot system and method for escort of hazardous chemical substances |
-
2022
- 2022-04-11 CN CN202210370860.9A patent/CN114446010A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110191058A1 (en) * | 2009-08-11 | 2011-08-04 | Certusview Technologies, Llc | Locating equipment communicatively coupled to or equipped with a mobile/portable device |
CN102685516A (en) * | 2011-03-07 | 2012-09-19 | 李慧盈 | Active safety type assistant driving method based on stereoscopic vision |
CN102629415A (en) * | 2012-04-28 | 2012-08-08 | 山东交通学院 | Automatic active early warning system for highway rescue |
CN104751600A (en) * | 2015-03-03 | 2015-07-01 | 北京虹安翔宇信息科技有限公司 | Anti-fatigue driving safety equipment based on iris recognition and application method thereof |
CN105389864A (en) * | 2015-10-16 | 2016-03-09 | 江苏南亿迪纳数字科技发展有限公司 | Method for extracting automobile UBI (usage based insurance) messages |
CN113052997A (en) * | 2021-03-08 | 2021-06-29 | 青岛卡沃斯智能制造有限公司 | Intelligent robot system and method for escort of hazardous chemical substances |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115984785A (en) * | 2022-12-14 | 2023-04-18 | 上海智能网联汽车技术中心有限公司 | System for realizing intelligent internet automobile universe supervision |
CN117163055A (en) * | 2023-09-08 | 2023-12-05 | 苏州宇洽科技有限公司 | Display console based on vehicle-mounted control |
CN117163055B (en) * | 2023-09-08 | 2024-05-07 | 苏州宇洽科技有限公司 | Display console based on vehicle-mounted control |
CN117041503A (en) * | 2023-10-10 | 2023-11-10 | 四川科泰智能电子有限公司 | High-performance flash memory array video identification equipment and method |
CN117612334A (en) * | 2023-12-14 | 2024-02-27 | 鱼快创领智能科技(南京)有限公司 | A driving safety reminder system and method based on smart watch |
CN118506253A (en) * | 2024-07-18 | 2024-08-16 | 中汽数据(天津)有限公司 | Driver safe driving monitoring system and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN114446010A (en) | A vehicle-mounted robot system and its driving management method | |
US12106661B2 (en) | Determining causation of traffic events and encouraging good driving behavior | |
WO2021223458A1 (en) | Driving risk unified quantification method based on comprehensive consideration of human, vehicle and road factors | |
CN108053616A (en) | A kind of hazardous materials transportation vehicle driving safe early warning auxiliary system | |
CN104875731B (en) | Method for identifying rapid acceleration or rapid deceleration of vehicle in real time by using satellite positioning data | |
CN106297409A (en) | A kind of Intelligent traffic safety device and its implementation | |
CN108860166A (en) | Processing system and processing method occur for pilotless automobile accident | |
CN106114502A (en) | A kind of intelligent automobile aid system | |
CN103208205A (en) | Vehicle safety driving early warning method based on vehicle internet | |
CN106251276A (en) | Long-distance truck intelligent management system | |
CN114360210A (en) | Vehicle fatigue driving early warning system | |
CN109035867A (en) | A kind of device that can improve traffic safety and traffic efficiency | |
CN112140995A (en) | Intelligent automobile safe driving system based on network cloud | |
CN110083162A (en) | Self-driving vehicle control method and system based on mixed traffic flow state | |
CN116665154A (en) | Perception and early warning methods for pedestrian traffic incidents on night roads | |
CN103077608A (en) | Method for obtaining evidence of behavior of intentionally running yellow light of driver | |
CN206194138U (en) | Real -time warning system that occupies public transportation lane violating regulations | |
CN106899629A (en) | A kind of method and system of wagon control | |
CN116341897A (en) | Vehicle safety supervision method, device, equipment and storage medium | |
CN114954307A (en) | Driving assistance system based on artificial intelligence | |
CN115240174A (en) | A driver's operation behavior recognition method, device and vehicle monitoring system | |
CN110807929A (en) | Traffic police auxiliary command information analysis and research and judgment system | |
CN110310488A (en) | Method and system for generating large truck violation message | |
CN116030433A (en) | A vehicle digital management and analysis method based on driving behavior analysis | |
CN107622663A (en) | A kind of highway Emergency Vehicle Lane intelligent monitor system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220506 |
|
RJ01 | Rejection of invention patent application after publication |