[go: up one dir, main page]

CN106846870A - The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision - Google Patents

The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision Download PDF

Info

Publication number
CN106846870A
CN106846870A CN201710100828.8A CN201710100828A CN106846870A CN 106846870 A CN106846870 A CN 106846870A CN 201710100828 A CN201710100828 A CN 201710100828A CN 106846870 A CN106846870 A CN 106846870A
Authority
CN
China
Prior art keywords
vehicle
parking lot
parking
intelligent
intelligent vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710100828.8A
Other languages
Chinese (zh)
Inventor
岑明
胡适
曾素华
李银国
孔令上
冯明驰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University of Post and Telecommunications
Original Assignee
Chongqing University of Post and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University of Post and Telecommunications filed Critical Chongqing University of Post and Telecommunications
Priority to CN201710100828.8A priority Critical patent/CN106846870A/en
Publication of CN106846870A publication Critical patent/CN106846870A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0968Systems involving transmission of navigation instructions to the vehicle
    • G08G1/096805Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route
    • G08G1/096811Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route where the route is computed offboard
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

本发明请求保护一种基于集中式视觉的停车场‑车辆协同的智能停车系统及方法。该系统由停车场服务中心、智能车辆车载设备和用户移动终端组成。停车场服务中心包括视觉传感器组、车辆跟踪、路径规划、数据管理和通信模块。视觉传感器组的观测范围覆盖停车场内的所有通行区域;车辆跟踪模块融合视觉传感器组采集的图像,检测通行区域内的车辆目标的位置与姿态;路径规划模块根据车辆当前位置、姿态及停车位规划出行驶路径。车载设备包括通信模块和车辆控制模块。车辆控制模块接收服务中心规划的路径,控制车辆按该路径自动驾驶到终点。用户移动终端用于向停车场服务中心发出驶入/驶出停车场的请求信息。本发明实现车辆出入停车场的自动化与智能化。

The present invention claims a centralized vision-based parking lot-vehicle coordinated intelligent parking system and method. The system consists of a parking lot service center, intelligent vehicle on-board equipment and user mobile terminals. The parking lot service center includes vision sensor group, vehicle tracking, path planning, data management and communication modules. The observation range of the visual sensor group covers all the passing areas in the parking lot; the vehicle tracking module fuses the images collected by the visual sensor group to detect the position and attitude of the vehicle target in the passing area; the path planning module based on the current position, attitude and parking space of the vehicle Plan out the driving route. The on-board equipment includes a communication module and a vehicle control module. The vehicle control module receives the route planned by the service center, and controls the vehicle to automatically drive to the destination according to the route. The user's mobile terminal is used to send request information for entering/exiting the parking lot to the parking lot service center. The invention realizes the automation and intelligentization of vehicles entering and exiting the parking lot.

Description

基于集中式视觉的停车场-车辆协同的智能停车系统及方法Parking lot-vehicle collaborative intelligent parking system and method based on centralized vision

技术领域technical field

本发明属于智能交通及自动控制领域,具体涉及一种基于集中式视觉的停车场-车辆协同的智能停车系统及方法。The invention belongs to the field of intelligent transportation and automatic control, in particular to an intelligent parking system and method based on centralized vision-based parking lot-vehicle coordination.

背景技术Background technique

传统停车场仅实现了计时收费、车位查询、车牌识别等基础服务功能,自动化与智能化水平不高。与室外停车场相比,室内停车场往往具有环境复杂、道路狭窄、视野不开阔等特点,导致车辆在驶入时对空闲车位的寻找以及在驶出时对车辆的寻找都较为麻烦。此外,目前针对智能车辆停车问题的解决方案通常只关注单个智能车辆本身,使得智能车辆对停车场全局的感知能力有限,停车场与车辆之间缺乏有效的协同关系,不能提供更高质量的停车服务。Traditional parking lots only realize basic service functions such as hourly charging, parking space inquiry, and license plate recognition, and the level of automation and intelligence is not high. Compared with outdoor parking lots, indoor parking lots often have the characteristics of complex environment, narrow roads, and limited vision, which make it more troublesome for vehicles to find vacant parking spaces when driving in and to find vehicles when driving out. In addition, the current solutions to the parking problem of intelligent vehicles usually only focus on a single intelligent vehicle itself, which makes the intelligent vehicle's ability to perceive the overall situation of the parking lot limited, lacks an effective collaborative relationship between the parking lot and the vehicle, and cannot provide higher quality parking. Serve.

中国专利申请:视觉辅助系统和引导车辆的方法(申请号:200580045956.2)公开了一种视觉辅助系统和引导车辆的方法,该系统包括为车辆收集位置数据的位置确认接收机、为车辆收集视觉数据的视觉模块。该专利提出利用视觉传感器辅助定位的思想,由GPS获得位置数据和视觉传感器获得的视觉位置数据加权得到车辆位置,从而辅助车辆控制。该专利以GPS为主,机器视觉为辅助,仅仅适用于能够获得GPS数据的室外停车场,并不适用于室内停车场自动停车需求。中国专利申请:一种基于鸟瞰系统的辅助泊车方法(申请号:201310109884.X)公开了一种基于机器视觉辅助泊车方法,该方法通过安装在车辆前后四个方位的摄像机来对周围的环境进行图像采集,经过图像处理技术,将车辆周围的环境信息以图像的方式返回给驾驶员,使得输出结果具有一定直观性。该系统仅依赖于车载传感器,未通过车辆与停车场之间的协同来实现停车。中国专利申请:一种全自动泊车系统(申请号:CN201410215303.5)公开了一种全自动泊车系统,利用环境信息采集系统的超声波传感器和摄像机获取泊车信息,规划出可行的泊车路径,作出相关指令,将指令发送各执行机构,并获得的实际反馈信号对规划的泊车路径进行时时的修正,实现对车辆的闭环控制。该系统同样仅依赖于车载传感器,未通过车辆与停车场之间的协同来实现停车。中国专利申请:一种与智能停车场协同的智能车辆自动驾驶系统和方法(申请号:201610107483.4)公开了一种与智能停车场协同的智能车辆自动驾驶系统和方法,该方法实现了车辆与停车场之间的协同,但后台服务系统只进行位置分配与地图传输,而环境检测与路径规划由车辆进行,依赖于车载传感器的支持。中国专利申请:基于分布式视觉的停车场-车辆协同智能停车系统及方法(申请号:201610228232.1)公开了一种基于分布式视觉的停车场-车辆协同智能停车系统及方法,由停车场服务中心通过分布式视觉传感器覆盖停车场区域来检测目标运动状态及障碍物,分配停车位置并规划车辆行驶路径。该方法采用分布式结构,每个视觉传感器都需要一个局部跟踪器模块,在视觉传感器数量较多时成本会比较高。Chinese patent application: Visual Assistance System and Method for Guiding Vehicles (Application No.: 200580045956.2) discloses a visual assistance system and method for guiding vehicles, the system includes a location confirmation receiver for collecting location data for vehicles, and collecting visual data for vehicles vision module. This patent proposes the idea of using the visual sensor to assist positioning, and the position data obtained by GPS and the visual position data obtained by the visual sensor are weighted to obtain the vehicle position, thereby assisting vehicle control. This patent is mainly based on GPS and assisted by machine vision. It is only applicable to outdoor parking lots that can obtain GPS data, and is not suitable for automatic parking requirements in indoor parking lots. Chinese patent application: A method of assisted parking based on a bird's-eye view system (application number: 201310109884.X) discloses a method of assisted parking based on machine vision. The environment carries out image acquisition, and through image processing technology, the environmental information around the vehicle is returned to the driver in the form of images, so that the output results are intuitive. The system relies only on on-board sensors and does not achieve parking through coordination between the vehicle and the parking lot. Chinese patent application: A fully automatic parking system (application number: CN201410215303.5) discloses a fully automatic parking system, which uses the ultrasonic sensor and camera of the environmental information collection system to obtain parking information and plans feasible parking Make relevant instructions, send the instructions to each actuator, and obtain actual feedback signals to constantly correct the planned parking path to achieve closed-loop control of the vehicle. The system also relies only on on-board sensors and does not achieve parking through coordination between the vehicle and the parking lot. Chinese patent application: An intelligent vehicle automatic driving system and method coordinated with an intelligent parking lot (application number: 201610107483.4) discloses an intelligent vehicle automatic driving system and method coordinated with an intelligent parking lot, which realizes the vehicle and parking Collaboration between fields, but the background service system only performs location allocation and map transmission, while environment detection and path planning are performed by vehicles, relying on the support of on-board sensors. Chinese patent application: Parking lot-vehicle collaborative intelligent parking system and method based on distributed vision (application number: 201610228232.1) discloses a parking lot-vehicle collaborative intelligent parking system and method based on distributed vision, by the parking lot service center Cover the parking lot area with distributed vision sensors to detect target motion status and obstacles, allocate parking positions and plan vehicle driving paths. This method adopts a distributed structure, and each visual sensor requires a local tracker module, and the cost will be relatively high when the number of visual sensors is large.

本发明针对室内停车场的车辆自动驶入/驶出需求,提出一种基于集中式视觉的停车场与车辆协同的智能停车系统和方法,减少了复杂停车场环境下停车、寻车的困难,实现了车辆出入停车场的自动化与智能化,并降低对系统配置的要求。Aiming at the requirement of automatic entry/exit of vehicles in the indoor parking lot, the present invention proposes a centralized vision-based intelligent parking system and method for synergy between the parking lot and the vehicle, which reduces the difficulty of parking and finding a car in a complex parking lot environment. It realizes the automation and intelligence of vehicles entering and exiting the parking lot, and reduces the requirements for system configuration.

发明内容Contents of the invention

本发明旨在解决以上现有技术的问题。提出了一种减少了复杂停车场环境下停车、寻车的困难,实现了车辆出入停车场的自动化与智能化,并降低对系统配置的要求、降低成本的基于集中式视觉的停车场-车辆协同的智能停车系统及方法。本发明的技术方案如下:The present invention aims to solve the above problems of the prior art. A parking lot-vehicle based on centralized vision is proposed to reduce the difficulty of parking and finding cars in a complex parking lot environment, realize the automation and intelligence of vehicles entering and leaving the parking lot, and reduce the requirements for system configuration and cost. Coordinated intelligent parking system and method. Technical scheme of the present invention is as follows:

一种基于集中式视觉的停车场-车辆协同的智能停车系统,包括停车场服务中心、智能车辆车载设备和用户移动终端,A parking lot-vehicle collaborative smart parking system based on centralized vision, including a parking lot service center, smart vehicle on-board equipment and user mobile terminals,

所述的停车场服务中心包括视觉传感器组、车辆跟踪模块、路径规划模块、数据管理模块以及停车场通信模块,所述视觉传感器组用于采集停车场通行区域的图像序列并实时传输到车辆跟踪模块;所述车辆跟踪模块接收来自视觉传感器组的图像序列,通过逆投影变换、配准和拼接,得到停车场内的全局图像,在全局图像上检测停车场通行区域的车辆目标位置及障碍物信息,获得停车场实时地图;所述路径规划模块用于根据智能车辆当前位置、终点以及停车场实时地图实时规划出车辆的行驶路径;数据管理模块用于对车位数据进行查询、分配与更新,并存储停车场实时地图、运动车辆目标位置及其行驶路径;所述停车场通信模块用于接收来自用户移动终端的驶入/驶出请求,并将路径规划模块规划的行驶路径发送到智能车辆;The parking lot service center includes a visual sensor group, a vehicle tracking module, a path planning module, a data management module and a parking lot communication module, and the visual sensor group is used to collect image sequences of the parking lot passing area and transmit them to the vehicle tracking module in real time module; the vehicle tracking module receives the image sequence from the visual sensor group, obtains the global image in the parking lot through back projection transformation, registration and splicing, and detects the vehicle target position and obstacles in the parking lot passing area on the global image Information to obtain a real-time map of the parking lot; the path planning module is used to plan the driving path of the vehicle in real time according to the current position, the terminal point and the real-time map of the parking lot of the smart vehicle; the data management module is used to query, allocate and update the parking space data, And store the real-time map of the parking lot, the target position of the moving vehicle and its driving path; the parking lot communication module is used to receive the entry/exit request from the user's mobile terminal, and send the driving path planned by the path planning module to the smart vehicle ;

所述的智能车辆车载设备包括车辆通信模块与车辆控制模块两部分,所述车辆通信模块用于接收来自停车场服务中心的路径规划模块规划的行驶路径;车辆控制模块根据接收到的停车场服务中心规划的路径,控制智能车辆按该路径自动驾驶到终点;The on-board equipment of the intelligent vehicle includes two parts, a vehicle communication module and a vehicle control module, the vehicle communication module is used to receive the driving path planned by the path planning module from the parking lot service center; the vehicle control module is based on the received parking lot service The path planned by the center controls the intelligent vehicle to automatically drive to the end point according to the path;

所述的用户移动终端具有用户终端通信模块,实现向停车场服务中心发出驶入/驶出停车场的请求信息,并能接收停车场服务中心发送的处理结果。The user mobile terminal has a user terminal communication module, which realizes sending request information for entering/exiting the parking lot to the parking lot service center, and can receive processing results sent by the parking lot service center.

进一步的,所述车辆跟踪模块接收并处理来自视觉传感器组的图像序列,具体包括以下步骤:Further, the vehicle tracking module receives and processes the image sequence from the visual sensor group, specifically including the following steps:

2.1接收来自视觉传感器组的实时图像序列;2.1 Receive a real-time image sequence from the visual sensor group;

2.2对接收到的不同视觉传感器获得的各图像分别利用对应视觉传感器通过参数标定获得的内部参数进行畸变校正,然后进行逆投影变换,将各图像视角统一变换到俯视角度;2.2 Perform distortion correction on the images obtained by different visual sensors received by using the internal parameters obtained by the corresponding visual sensor through parameter calibration, and then perform inverse projection transformation to uniformly transform the viewing angles of each image to the overlooking angle;

2.3对经过步骤2.2矫正处理和逆投影变换后的各图像进行配准和拼接,得到停车场内的全局图像;2.3 Registration and splicing are performed on the images after step 2.2 correction processing and back projection transformation to obtain the global image in the parking lot;

2.4从全局图像中检测目标车辆并计算其位置和姿态角,进行跟踪滤波得到目标车辆运动状态的最优估计;从全局图像中检测障碍物,根据目标车辆及障碍物生成停车场的实时地图。2.4 Detect the target vehicle from the global image and calculate its position and attitude angle, perform tracking filtering to obtain the optimal estimation of the target vehicle's motion state; detect obstacles from the global image, and generate a real-time map of the parking lot according to the target vehicle and obstacles.

进一步的,在智能车辆驶入停车场时,所述路径规划模块规划的终点是停车场服务中心为该车辆分配的车位位置;在智能车辆驶出停车场时,所述路径规划模块规划的终点是用户请求的停车场出口位置。Further, when the intelligent vehicle enters the parking lot, the end point planned by the path planning module is the parking space allocated to the vehicle by the parking lot service center; when the intelligent vehicle exits the parking lot, the end point planned by the path planning module is the exit location of the parking lot requested by the user.

进一步的,在车辆驶入停车场的过程中,数据管理模块根据给定的车位分配方法(例如距离目的地最近),查找距离待停车辆最近的空闲车位及其坐标,并在驶入任务完成后更新空闲车位信息;在车辆驶出停车场过程中,数据管理模块根据目标车辆信息查找相应车辆停放位置,根据出口位置查找出口在实时地图的坐标,并在驶出任务完成后更新空闲车位信息。Furthermore, during the process of the vehicle entering the parking lot, the data management module searches for the free parking space and its coordinates closest to the vehicle to be parked according to the given parking space allocation method (such as the closest to the destination), and completes Then update the free parking space information; in the process of driving out of the parking lot, the data management module searches for the corresponding vehicle parking position according to the target vehicle information, finds the coordinates of the exit on the real-time map according to the exit position, and updates the free parking space information after the exit task is completed .

一种所述系统的基于集中式视觉的停车场-车辆协同的智能停车方法,当智能车辆驶入停车场时包括以下步骤:A parking lot-vehicle coordinated intelligent parking method based on centralized vision of the system, comprising the following steps when the intelligent vehicle enters the parking lot:

5.1当智能车辆行驶到停车场入口时,车主利用用户移动终端向停车场服务中心发送车辆当前位置以及驶入请求;5.1 When the smart vehicle drives to the entrance of the parking lot, the owner uses the user's mobile terminal to send the vehicle's current location and entry request to the parking lot service center;

5.2停车场服务中心通过停车场通信模块接收步骤5.1中用户移动终端发送的驶入请求,进行身份验证后,将车辆当前位置信息以及驶入请求转发给数据管理模块,由数据管理模块分配空闲车位,确定空闲车位位置;5.2 The parking lot service center receives the entry request sent by the user's mobile terminal in step 5.1 through the parking lot communication module, and after identity verification, forwards the vehicle's current location information and the entry request to the data management module, which allocates free parking spaces , to determine the location of the free parking space;

5.3停车场服务中心视觉传感器组采集停车场通行区域的图像序列,实时传输到车辆跟踪模块进行处理,检测停车场通行区域的车辆目标的位置、姿态及障碍物的位置,并构造停车场实时地图;5.3 The visual sensor group of the parking lot service center collects the image sequence of the parking lot passing area, transmits it to the vehicle tracking module for processing in real time, detects the position, posture and obstacle position of the vehicle target in the parking lot passing area, and constructs a real-time map of the parking lot ;

5.4停车场服务中心路径规划模块以智能车辆当前位置为起点,以分配的车位位置为终点,根据步骤5.3的停车场实时地图规划智能车辆行驶路径;5.4 The path planning module of the parking lot service center takes the current location of the smart vehicle as the starting point and the allocated parking space as the end point, and plans the driving path of the smart vehicle according to the real-time map of the parking lot in step 5.3;

5.5停车场服务中心通信模块将智能车辆的当前位置、姿态以及规划的车辆行驶路径发送给智能车辆,并将智能车辆当前位置与分配的车位位置发送给用户移动终端;5.5 The communication module of the parking lot service center sends the current position, posture and planned vehicle driving path of the smart vehicle to the smart vehicle, and sends the current position of the smart vehicle and the allocated parking space to the user's mobile terminal;

5.6智能车辆车载设备通信模块接收步骤5.5中的智能车辆的当前位置、姿态以及规划的车辆行驶路径;5.6 The communication module of the on-board equipment of the intelligent vehicle receives the current position, attitude and the planned vehicle driving path of the intelligent vehicle in step 5.5;

5.7智能车辆车载设备车辆控制模块根据步骤5.6中通信模块接收到的信息控制智能车辆自动驾驶;5.7 The vehicle control module of the on-board equipment of the intelligent vehicle controls the automatic driving of the intelligent vehicle according to the information received by the communication module in step 5.6;

5.8重复步骤5.3~5.7,直到智能车辆驶入指定车位,驶入任务结束。5.8 Repeat steps 5.3 to 5.7 until the smart vehicle enters the designated parking space, and the entering task is over.

进一步的,当智能车辆驶出时的方法包括以下步骤:Further, when the intelligent vehicle drives out, the method includes the following steps:

6.1车主利用用户移动终端向停车场服务中心发送车辆身份、驶出请求以及出口位置;6.1 The owner uses the user's mobile terminal to send the vehicle identity, exit request and exit location to the parking lot service center;

6.2停车场服务中心通信模块接收到驶出请求,进行身份验证后,将车辆身份、驶出请求以及出口位置信息转发给数据管理模块,查找车辆停放位置;6.2 The communication module of the parking lot service center receives the exit request, and after identity verification, forwards the vehicle identity, exit request and exit location information to the data management module to find the parking location of the vehicle;

6.3停车场服务中心视觉传感器组采集停车场通行区域的图像序列,实时传输到车辆跟踪模块进行处理,检测停车场通行区域的车辆目标的位置、姿态及障碍物的位置,并构造停车场实时地图;6.3 The visual sensor group of the parking lot service center collects the image sequence of the parking lot passing area, transmits it to the vehicle tracking module for processing in real time, detects the position, posture and obstacle position of the vehicle target in the parking lot passing area, and constructs a real-time map of the parking lot ;

6.4停车场服务中心路径规划模块以智能车辆当前位置为起点,以出口位置为终点,根据步骤6.3的停车场实时地图规划智能车辆行驶路径;6.4 The route planning module of the parking lot service center takes the current position of the smart vehicle as the starting point and the exit position as the end point, and plans the driving route of the smart vehicle according to the real-time map of the parking lot in step 6.3;

6.5停车场服务中心通信模块将智能车辆的当前位置、姿态以及规划的车辆行驶路径发送给智能车辆,并将智能车辆当前位置发送给用户移动终端;6.5 The communication module of the parking lot service center sends the current position, posture and planned vehicle driving path of the smart vehicle to the smart vehicle, and sends the current position of the smart vehicle to the user's mobile terminal;

6.6智能车辆车载设备通信模块接收步骤6.5中的智能车辆的当前位置、姿态以及规划的车辆行驶路径;6.6 The communication module of the on-board equipment of the intelligent vehicle receives the current position, attitude and the planned vehicle driving path of the intelligent vehicle in step 6.5;

6.7智能车辆车载设备车辆控制模块根据步骤6.6中通信模块接收到的信息控制智能车辆自动驾驶;6.7 The vehicle control module of the on-board equipment of the intelligent vehicle controls the automatic driving of the intelligent vehicle according to the information received by the communication module in step 6.6;

6.8重复步骤4.3~6.7,直到智能车辆到达出口,驶出任务结束。6.8 Repeat steps 4.3 to 6.7 until the intelligent vehicle reaches the exit, and the exit task is over.

进一步的,所述步骤2.2逆投影变换,将各图像视角统一变换到俯视角度;包括步骤:利用摄像机的外部参数完成图像坐标几何变换,使之转换成为俯视图,所述外部参数有:摄像机垂直视角2α、摄像机水平视角2β、摄像机俯仰角θ、摄像机安装高度h,令相机的分辨率为m*n,则世界坐标系下的路面坐标和图像坐标系的路面坐标(x,y,0)和图像坐标系下的图像坐标(u,v)之间的关系为:Further, the step 2.2 inverse projection transforms uniformly transforms the angles of view of each image to the angle of view; it includes the step of: using the external parameters of the camera to complete the geometric transformation of the image coordinates to convert it into an overhead view. The external parameters include: the vertical angle of view of the camera 2α, camera horizontal angle of view 2β, camera pitch angle θ, camera installation height h, let the resolution of the camera be m*n, then the road surface coordinates in the world coordinate system and the road surface coordinates in the image coordinate system (x, y, 0) and The relationship between the image coordinates (u, v) in the image coordinate system is:

以图像中心为坐标原点对上述公式求反,有:Taking the center of the image as the coordinate origin to invert the above formula, there are:

利用求反公式对源图像进行几何变换即可得到逆投影变换图像。The inverse projection transformed image can be obtained by geometrically transforming the source image using the inversion formula.

进一步的,所述停车场服务中心车辆跟踪模块具有车辆定位和多目标跟踪模块,包括以下步骤:Further, the vehicle tracking module of the parking lot service center has a vehicle positioning and multi-target tracking module, comprising the following steps:

(1)利用连续多帧的全局图像建立背景模型;(1) Establish a background model using global images of continuous multiple frames;

(2)运用背景差分法检测出车辆目标,根据检测结果初始化搜索窗口;(2) Use the background difference method to detect the vehicle target, and initialize the search window according to the detection result;

(3)Kalman滤波器的初始化;(3) Initialization of the Kalman filter;

(4)利用初始化状态信息或上一时刻的状态信息来预测当前时刻车辆的目标位置;(4) Utilize the initialization state information or the state information of the previous moment to predict the target position of the vehicle at the current moment;

(5)在预测值附近一定范围内运用自适应均值漂移算法对车辆目标进行迭代搜索,直到搜索到最佳匹配目标;(5) Use the adaptive mean shift algorithm to iteratively search for the vehicle target within a certain range near the predicted value until the best matching target is found;

(6)利用评价参数对搜索结果进行评估,判断跟踪目标是否存在遮挡或者颜色干扰,如果搜索结果错误,则利用预测值来替代搜索结果;否则,将搜索结果作为跟踪结果;(6) Use the evaluation parameters to evaluate the search results to determine whether there is occlusion or color interference in the tracking target. If the search results are wrong, use the predicted value to replace the search results; otherwise, use the search results as the tracking results;

(7)如果连续M帧出现跟踪目标和预测目标之间的像素差值大于T个像素的情况,则将其标记为新目标,并为新目标分配新的搜索框和Kalman滤波器,从而实现多目标跟踪;(7) If the pixel difference between the tracking target and the predicted target is greater than T pixels in consecutive M frames, it will be marked as a new target, and a new search box and Kalman filter will be assigned to the new target, so as to achieve multi-target tracking;

(8)将上述图像坐标转换到世界坐标,保存到数据管理模块,并发送至路径规划模块;(8) Convert the above-mentioned image coordinates to world coordinates, save to the data management module, and send to the path planning module;

(9)利用跟踪结果来更新Kalman滤波器的状态,重复步骤(4)、(5)、(6)、(7)、(8),继续对车辆目标进行跟踪。(9) Use the tracking result to update the state of the Kalman filter, repeat steps (4), (5), (6), (7), and (8), and continue to track the vehicle target.

本发明的优点及有益效果如下:Advantage of the present invention and beneficial effect are as follows:

本发明提出一种基于集中式视觉的停车场-车辆协同的智能停车系统及方法。本系统利用移动通信网络实现了智能车辆与后台服务中心、用户移动终端与后台服务中心的互联,利用停车场后台服务中心检测各车辆运动状态、规划车辆行驶路径,结合智能车辆的自动驾驶功能,实现了车辆出入停车场的自动化与智能化,减少了复杂停车场环境下停车、寻车的困难。通过将多个视觉传感器的图像集中处理,降低停车系统配置要求。The invention proposes a parking lot-vehicle coordinated intelligent parking system and method based on centralized vision. This system uses the mobile communication network to realize the interconnection between the intelligent vehicle and the background service center, the user's mobile terminal and the background service center, uses the background service center of the parking lot to detect the movement status of each vehicle, plans the vehicle driving path, and combines the automatic driving function of the intelligent vehicle. It realizes the automation and intelligence of vehicles entering and exiting the parking lot, and reduces the difficulty of parking and finding cars in complex parking lot environments. Reduce parking system configuration requirements by centralizing images from multiple vision sensors.

附图说明Description of drawings

图1.本发明基于集中式视觉的停车场-车辆协同的智能停车系统总体架构;Fig. 1. the overall structure of the intelligent parking system of parking lot-vehicle coordination of the present invention based on centralized vision;

图2.本发明实现智能车辆自动驶入停车场的流程;Fig. 2. the present invention realizes the flow process of intelligent vehicle driving into the parking lot automatically;

图3.本发明实现智能车辆自动驶出停车场的流程;Fig. 3. the present invention realizes the flow process that the intelligent vehicle drives out of the parking lot automatically;

图4.本发明停车场服务中心的视觉传感器组设置效果;Fig. 4. the vision sensor group setting effect of parking lot service center of the present invention;

图5.本发明停车场服务中心视觉传感器组中单个视觉传感器安装示意图;Fig. 5. installation diagram of a single visual sensor in the visual sensor group of the parking lot service center of the present invention;

图6.本发明停车场服务中心车辆跟踪模块的全局图像生成流程;Figure 6. The global image generation process of the vehicle tracking module of the parking lot service center of the present invention;

图7.本发明停车场服务中心车辆跟踪模块的车辆检测与跟踪流程。Figure 7. The vehicle detection and tracking process of the vehicle tracking module of the parking lot service center of the present invention.

具体实施方式detailed description

以下结合附图,对本发明作进一步说明:Below in conjunction with accompanying drawing, the present invention will be further described:

本发明提出一种基于集中式视觉的停车场-车辆协同的智能停车系统及方法,利用移动通信网络实现智能车辆-停车场服务中心、用户移动终端-停车场服务中心互联,利用停车场服务中心的视觉传感器组和车辆跟踪模块检测各车辆运动状态、规划各智能车辆行驶路径,结合智能车辆的自动驾驶功能,引导智能车辆自动驾驶,最终实现智能车辆自动驶入/驶出停车场。The present invention proposes a parking lot-vehicle collaborative intelligent parking system and method based on centralized vision. The mobile communication network is used to realize the interconnection between the intelligent vehicle-parking service center and the user mobile terminal-parking service center. The advanced visual sensor group and vehicle tracking module detect the movement status of each vehicle, plan the driving path of each intelligent vehicle, combine the automatic driving function of the intelligent vehicle, guide the automatic driving of the intelligent vehicle, and finally realize the automatic driving of the intelligent vehicle into/out of the parking lot.

以下结合附图和具体实例对本发明的具体实施方式进行描述。The specific implementation manners of the present invention will be described below in conjunction with the accompanying drawings and specific examples.

如图1所示为本发明提出的一种基于集中式视觉的停车场-车辆协同的智能停车系统的总体架构。该系统由停车场服务中心、智能车辆车载设备和用户移动终端三部分组成。As shown in Fig. 1, it is an overall architecture of a parking lot-vehicle cooperative intelligent parking system based on centralized vision proposed by the present invention. The system consists of three parts: the parking lot service center, the on-board equipment of the intelligent vehicle and the user's mobile terminal.

所述的停车场服务中心包括视觉传感器组、车辆跟踪模块、路径规划模块、数据管理模块以及通信模块。视觉传感器组用于采集停车场通行区域的图像序列并实时传输到车辆跟踪模块。车辆跟踪模块接收并处理来自视觉传感器组的图像序列,实时检测停车场通行区域的车辆目标的位置、姿态及障碍物的位置,构造停车场实时地图。路径规划模块根据停车场实时地图、智能车辆当前位置以及终点规划出行驶路径,其中,智能车辆驶入停车场时的终点是停车场服务中心为该车辆分配的车位位置,智能车辆驶出停车场时的终点是用户请求的停车场出口位置。数据管理模块用于对车位数据进行查询、分配与更新,并存储停车场实时地图、运动车辆目标的位置及其行驶路径。在车辆驶入停车场时,数据管理模块根据给定的车位分配方法查找合适的空闲车位及其坐标,并更新空闲车位信息;在车辆驶出停车场时,数据管理模块根据车辆信息查找停放位置,根据出口位置查找出口在实时地图的坐标,并在驶出任务完成后更新空闲车位信息。通信模块用于接收来自用户移动终端的驶入/驶出请求,将规划的行驶路径发送到智能车辆,并将智能车辆当前位置与终点位置发送给用户移动终端。The parking lot service center includes a visual sensor group, a vehicle tracking module, a path planning module, a data management module and a communication module. The visual sensor group is used to collect the image sequence of the parking lot passing area and transmit it to the vehicle tracking module in real time. The vehicle tracking module receives and processes the image sequence from the visual sensor group, detects the position, posture and obstacle position of the vehicle target in the parking area in real time, and constructs a real-time map of the parking lot. The path planning module plans the driving path according to the real-time map of the parking lot, the current location of the smart vehicle and the destination. The destination of the smart vehicle when it enters the parking lot is the location of the parking space allocated for the vehicle by the parking lot service center, and the smart vehicle drives out of the parking lot. The end point of time is the exit position of the parking lot requested by the user. The data management module is used to query, allocate and update the parking space data, and store the real-time map of the parking lot, the position of the moving vehicle target and its driving path. When the vehicle enters the parking lot, the data management module finds the appropriate free parking space and its coordinates according to the given parking space allocation method, and updates the information of the free parking space; when the vehicle leaves the parking lot, the data management module searches for the parking position according to the vehicle information , find the coordinates of the exit on the real-time map according to the exit position, and update the free parking space information after the exit task is completed. The communication module is used to receive the entry/exit request from the user's mobile terminal, send the planned driving route to the smart vehicle, and send the current position and end position of the smart vehicle to the user's mobile terminal.

所述智能车辆车载设备包括通信模块与车辆控制模块。通信模块用于接收来自停车场服务中心的规划的本车行驶路径;车辆控制模块根据接收到的停车场服务中心规划的路径,控制智能车辆按该路径自动驾驶到终点。The on-board equipment of the intelligent vehicle includes a communication module and a vehicle control module. The communication module is used to receive the planned driving path of the vehicle from the parking lot service center; the vehicle control module controls the intelligent vehicle to automatically drive to the destination according to the path planned by the parking lot service center.

所述用户移动终端用于向停车场服务中心发出驶入/驶出停车场的请求信息,并接收停车场服务中心发送的处理结果:在驶入时为智能车辆当前位置及分配的车位位置,在驶出时为智能车辆当前位置与出口位置信息。The user mobile terminal is used to send request information for entering/exiting the parking lot to the parking lot service center, and receive the processing result sent by the parking lot service center: when driving in, it is the current position of the intelligent vehicle and the allocated parking space position, When driving out, it is the current position and exit position information of the smart vehicle.

如图2所示为本发明实现智能车辆自动驶入停车场的流程,包括以下步骤:As shown in Fig. 2, it is the flow process that the present invention realizes that the intelligent vehicle drives into the parking lot automatically, including the following steps:

(1)当智能车辆行驶到停车场入口时,车主利用用户移动终端向停车场服务中心发送车辆当前位置以及驶入请求;(1) When the smart vehicle drives to the entrance of the parking lot, the owner uses the user's mobile terminal to send the vehicle's current location and entry request to the parking lot service center;

(2)停车场服务中心通过通信模块接收步骤(1)中用户移动终端发送的驶入请求,进行身份验证后,将车辆当前位置信息以及驶入请求转发给数据管理模块,由数据管理模块分配空闲车位,确定空闲车位位置;(2) The parking lot service center receives the entry request sent by the user's mobile terminal in step (1) through the communication module, and after identity verification, forwards the vehicle's current location information and the entry request to the data management module, which distributes Empty parking space, determine the location of the vacant parking space;

(3)停车场服务中心视觉传感器组采集停车场通行区域的图像序列,实时传输到车辆跟踪模块进行处理,检测停车场通行区域的车辆目标的位置、姿态及障碍物的位置,并构造停车场实时地图;(3) The visual sensor group of the parking lot service center collects the image sequence of the parking lot passing area, transmits it to the vehicle tracking module for processing in real time, detects the position, posture and obstacle position of the vehicle target in the parking lot passing area, and constructs the parking lot real-time map;

(4)停车场服务中心路径规划模块以智能车辆当前位置为起点,以分配的车位位置为终点,根据步骤(3)的停车场实时地图规划智能车辆行驶路径;(4) The path planning module of the parking lot service center takes the current position of the smart vehicle as the starting point, and takes the allocated parking space position as the end point, and plans the driving path of the smart vehicle according to the real-time map of the parking lot in step (3);

(5)停车场服务中心通信模块将智能车辆的当前位置、姿态以及规划的车辆行驶路径发送给智能车辆,并将智能车辆当前位置与分配的车位位置发送给用户移动终端;(5) The communication module of the parking lot service center sends the current position, posture and planned vehicle driving path of the smart vehicle to the smart vehicle, and sends the current position of the smart vehicle and the allocated parking space to the user's mobile terminal;

(6)智能车辆车载设备通信模块接收步骤(5)中的智能车辆的当前位置、姿态以及规划的车辆行驶路径;(6) the current position, attitude and the vehicle travel path of the intelligent vehicle in the intelligent vehicle vehicle equipment communication module receiving step (5);

(7)智能车辆车载设备车辆控制模块根据步骤(6)中通信模块接收到的信息控制智能车辆自动驾驶;(7) The vehicle control module of the vehicle-mounted equipment of the intelligent vehicle controls the automatic driving of the intelligent vehicle according to the information received by the communication module in step (6);

(8)重复步骤(3)~(7),直到智能车辆驶入指定车位,驶入任务结束。(8) Steps (3) to (7) are repeated until the intelligent vehicle enters the designated parking space, and the entering task ends.

如图3所示为本发明实现智能车辆自动驶出停车场的流程,包括以下步骤:As shown in Fig. 3, it is the flow process that the present invention realizes that the intelligent vehicle drives out of the parking lot automatically, including the following steps:

(1)车主利用用户移动终端向停车场服务中心发送车辆身份、驶出请求以及出口位置;(1) The owner uses the user's mobile terminal to send the vehicle identity, exit request and exit location to the parking lot service center;

(2)停车场服务中心通信模块接收到驶出请求,进行身份验证后,将车辆身份、驶出请求以及出口位置信息转发给数据管理模块,查找车辆停放位置;(2) The communication module of the parking lot service center receives the exit request, and after identity verification, forwards the vehicle identity, exit request and exit location information to the data management module to find the parking location of the vehicle;

(3)停车场服务中心视觉传感器组采集停车场通行区域的图像序列,实时传输到车辆跟踪模块进行处理,检测停车场通行区域的车辆目标的位置、姿态及障碍物的位置,并构造停车场实时地图;(3) The visual sensor group of the parking lot service center collects the image sequence of the parking lot passing area, transmits it to the vehicle tracking module for processing in real time, detects the position, posture and obstacle position of the vehicle target in the parking lot passing area, and constructs the parking lot real-time map;

(4)停车场服务中心路径规划模块以智能车辆当前位置为起点,以出口位置为终点,根据步骤(3)的停车场实时地图规划智能车辆行驶路径;(4) The path planning module of the parking lot service center takes the current position of the smart vehicle as the starting point, and takes the exit position as the end point, and plans the driving path of the smart vehicle according to the real-time map of the parking lot in step (3);

(5)停车场服务中心通信模块将智能车辆的当前位置、姿态以及规划的车辆行驶路径发送给智能车辆,并将智能车辆当前位置与出口位置发送给用户移动终端;(5) The communication module of the parking lot service center sends the current position, posture and planned vehicle driving path of the intelligent vehicle to the intelligent vehicle, and sends the current position and exit position of the intelligent vehicle to the user's mobile terminal;

(6)智能车辆车载设备通信模块接收步骤(5)中的智能车辆的当前位置、姿态以及规划的车辆行驶路径;(6) the current position, attitude and the vehicle travel path of the intelligent vehicle in the intelligent vehicle vehicle equipment communication module receiving step (5);

(7)智能车辆车载设备车辆控制模块根据步骤(6)中通信模块接收到的信息控制智能车辆自动驾驶;(7) The vehicle control module of the vehicle-mounted equipment of the intelligent vehicle controls the automatic driving of the intelligent vehicle according to the information received by the communication module in step (6);

(8)重复步骤(3)~(7),直到智能车辆到达出口,驶出任务结束。(8) Steps (3)-(7) are repeated until the intelligent vehicle reaches the exit, and the exit task ends.

如图4所示为本发明停车场服务中心的视觉传感器组设置效果示例。As shown in Fig. 4, it is an example of the setting effect of the visual sensor group in the parking lot service center of the present invention.

所述视觉传感器组中包含安装在停车场内不同地点的多个视觉传感器,各个视觉传感器的观测范围有部分重叠,但多个视觉传感器观测范围的并集覆盖停车场的全部出入口区域及通行区域。本示例仅用于描述视觉传感器组设置效果,并不只限于图中这一种场景。The visual sensor group includes a plurality of visual sensors installed at different locations in the parking lot, and the observation ranges of each visual sensor partially overlap, but the union of the observation ranges of multiple visual sensors covers all the entrance and exit areas and passing areas of the parking lot . This example is only used to describe the effect of the vision sensor group setting, and is not limited to the scene in the picture.

图5所示为本发明停车场服务中心视觉传感器组中单个视觉传感器安装示意图。设停车场全局坐标系的原点为O(0,0,0),作为示例的视觉传感器C的坐标为(xc,yc,h)。视觉传感器C包含外部参数:2α(垂直视角)、2β(水平视角)、θ(俯仰角),h(高度)。其中,安装高度h固定,其余参数可以通过标定获取。Fig. 5 is a schematic diagram showing the installation of a single visual sensor in the visual sensor group of the parking lot service center of the present invention. Assume that the origin of the global coordinate system of the parking lot is O(0,0,0), and the coordinates of the visual sensor C as an example are (x c , y c , h). The visual sensor C includes external parameters: 2α (vertical viewing angle), 2β (horizontal viewing angle), θ (pitch angle), h (height). Among them, the installation height h is fixed, and other parameters can be obtained through calibration.

图6所示为本发明停车场服务中心车辆跟踪模块的全局图像生成流程,包括以下步骤:Figure 6 shows the global image generation process of the vehicle tracking module of the parking lot service center of the present invention, including the following steps:

(1)接收视觉传感器组采集的图像,对来自每个视觉传感器的图像分别进行畸变校正;(1) Receive images collected by the visual sensor group, and perform distortion correction on images from each visual sensor;

(2)对来自每个视觉传感器的图像分别进行逆投影变换,使之转换成为俯视图。设视觉传感器C的分辨率为m*n,根据视觉传感器成像原理,对应于视觉传感器C的世界坐标系下的坐标(x,y,0)和图像坐标系下的坐标(u,v)之间的关系为:(2) Perform inverse projection transformation on the images from each visual sensor to convert them into a top view. Assuming that the resolution of the visual sensor C is m*n, according to the imaging principle of the visual sensor, it corresponds to the difference between the coordinates (x, y, 0) in the world coordinate system of the visual sensor C and the coordinates (u, v) in the image coordinate system The relationship between is:

从上述公式(1)-(2)可解出逆投影变换关系:From the above formulas (1)-(2), the inverse projection transformation relationship can be solved:

(3)根据逆投影变换得到的俯视图图像之间的单应性矩阵,逐个将图像映射到停车场全局坐标系,进行融合和边界平滑处理,得到全局图像。(3) According to the homography matrix between the top view images obtained by the inverse projection transformation, the images are mapped to the global coordinate system of the parking lot one by one, and the fusion and boundary smoothing are performed to obtain the global image.

图7所示为本发明停车场服务中心车辆跟踪模块的车辆检测与跟踪流程,包括以下步骤:Figure 7 shows the vehicle detection and tracking process of the vehicle tracking module of the parking lot service center of the present invention, including the following steps:

(1)初始化:利用连续多帧的全局图像建立背景模型,设定车辆姿态角从-90°到90°的模板共[180/R]个,其中R为模板组分辨率,并初始化Kalman滤波器;(1) Initialization: use continuous multi-frame global images to establish a background model, set a total of [180/R] templates with vehicle attitude angles from -90° to 90°, where R is the resolution of the template group, and initialize the Kalman filter device;

(2)利用背景差分法检测出车辆目标,根据检测结果初始化搜索窗口;(2) Use the background difference method to detect the vehicle target, and initialize the search window according to the detection result;

(3)利用初始化状态信息或上一时刻的状态信息根据Kalman滤波器来预测当前时刻车辆目标的位置;(3) Utilize the initialization state information or the state information of the last moment to predict the position of the vehicle target at the current moment according to the Kalman filter;

(4)在预测值附近一定范围内用连续自适应均值漂移算法(ContinuouslyAdaptive Mean-SHIFT,CamShift)对车辆目标进行迭代搜索,直到搜索到最佳匹配目标;(4) Use Continuously Adaptive Mean-SHIFT (CamShift) to iteratively search for the vehicle target within a certain range near the predicted value until the best matching target is found;

(5)利用评价参数对搜索结果进行评估,判断跟踪目标是否存在严重的遮挡或者颜色干扰,如果搜索结果错误,则利用预测值来替代搜索结果;否则,将搜索结果作为跟踪结果;(5) Use the evaluation parameters to evaluate the search results to determine whether there is serious occlusion or color interference in the tracking target. If the search results are wrong, use the predicted value to replace the search results; otherwise, use the search results as the tracking results;

(6)如果连续M帧出现跟踪目标和预测目标之间的像素差值大于T个像素的情况,则将其标记为新目标,并为新目标分配新的搜索框和Kalman滤波器,从而实现多车辆目标的跟踪;(6) If the pixel difference between the tracking target and the predicted target is greater than T pixels in consecutive M frames, it will be marked as a new target, and a new search box and Kalman filter will be assigned to the new target, so as to achieve Tracking of multiple vehicle targets;

(7)对检测出的每一车辆目标的图像,与姿态角模板进行匹配,则最佳匹配模板对应的角度即为该车辆当前的姿态角度;(7) The image of each detected vehicle target is matched with the attitude angle template, and the angle corresponding to the best matching template is the current attitude angle of the vehicle;

(8)利用跟踪结果来更新Kalman滤波器的状态,(8) Use the tracking result to update the state of the Kalman filter,

(9)重复步骤(3)-(9),继续对车辆目标进行跟踪。(9) Repeat steps (3)-(9) to continue tracking the vehicle target.

以上这些实施例应理解为仅用于说明本发明而不用于限制本发明的保护范围。在阅读了本发明的记载的内容之后,技术人员可以对本发明作各种改动或修改,这些等效变化和修饰同样落入本发明权利要求所限定的范围。The above embodiments should be understood as only for illustrating the present invention but not for limiting the protection scope of the present invention. After reading the contents of the present invention, skilled persons can make various changes or modifications to the present invention, and these equivalent changes and modifications also fall within the scope defined by the claims of the present invention.

Claims (5)

1. the intelligent parking system that a kind of parking lot based on centralized vision-vehicle is cooperateed with, it is characterised in that:Including parking lot Service centre, intelligent vehicle mobile unit and the part of customer mobile terminal three, wherein
The parking lot service centre includes vision sensor group, vehicle tracking module, path planning module, data management module And communication module, vision sensor group is for gathering the image sequence of parking lot traffic areas and being real-time transmitted to vehicle tracking Module;The vehicle tracking module receives the image sequence from vision sensor group, by Inverse projection, registration and spelling Connect, obtain the global image in parking lot, position, the attitude of the vehicle target of parking lot traffic areas are detected on global image And the position of barrier, construct parking lot real-time map;Path planning module is current according to parking lot real-time map, intelligent vehicle Position and terminal cook up driving path;Data management module is used to that parking stall data to be inquired about, distributed and updated, and deposits Storage parking lot real-time map, the position of moving vehicle target and its driving path;Communication module is used to receive from user's movement Request is sailed/rolled away to terminal into, and the driving path of planning is sent into intelligent vehicle;
The intelligent vehicle mobile unit includes communication module and vehicle control module, and communication module is used to receive from parking lot This car driving path of the planning of service centre;Vehicle control module controls intelligent vehicle according to the path of the planning for receiving By the path automatic Pilot to terminal;
The customer mobile terminal is used to be sent to parking lot service centre the solicited message for sailing/rolling away from parking lot into, and receives The result that parking lot service centre sends.
2. the intelligent parking system that the parking lot based on centralized vision according to claim 1-vehicle is cooperateed with, its feature It is:Can realize that intelligent vehicle sails the specified location in parking lot into from parking automatically outside the venue, and be sailed automatically from parking lot Go out to specified outlet.
3. the intelligent parking system that the parking lot based on the centralized vision-vehicle of system according to claim 1,2 is cooperateed with, Characterized in that, the intelligent vehicle method of sailing into is comprised the following steps:
3.1 when intelligent vehicle drives to Entrance, and car owner is sent using customer mobile terminal to parking lot service centre Current vehicle position and sail request into;
3.2 parking lot service centres sail request into by what customer mobile terminal in communication module receiving step 3.1 sent, carry out After authentication, by current vehicle position information and sail request into and be transmitted to data management module, by data management module point With idle parking stall, it is determined that idle parking stall position;
3.3 parking lot service centre vision sensor groups gather the image sequence of parking lot traffic areas, are real-time transmitted to vehicle Tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and is constructed Parking lot real-time map;
With intelligent vehicle current location as starting point, the parking stall position with distribution is 3.4 parking lot service centre path planning modules Terminal, the parking lot real-time map planning intelligent vehicle driving path according to step 3.3;
3.5 parking lot service centre communication modules are by the vehicle running path of the current location of intelligent vehicle, attitude and planning Intelligent vehicle is sent to, and intelligent vehicle current location is sent to customer mobile terminal with the parking stall position of distribution;
The current location of the intelligent vehicle in 3.6 intelligent vehicle vehicle equipment communication module receiving steps 3.5, attitude and planning Vehicle running path;
The information that 3.7 intelligent vehicle mobile unit vehicle control modules are received according to communication module in step 3.6 controls intelligence Vehicular automatic driving;
3.8 repeat steps 3.3~3.7, until intelligent vehicle sails specified parking stall into, the task of sailing into terminates.
4. the intelligent parking system that the parking lot based on the centralized vision-vehicle of system according to claim 1,2 is cooperateed with, Characterized in that, intelligent vehicle rolls method away from comprising the following steps:
4.1 car owners send testing vehicle register, roll request and outlet port away from using customer mobile terminal to parking lot service centre;
4.2 parking lot service centre communication modules are received rolls request away from, and after carrying out authentication, by testing vehicle register, rolling away from please Ask and exits location information is transmitted to data management module, search storing cycle position;
4.3 parking lot service centre vision sensor groups gather the image sequence of parking lot traffic areas, are real-time transmitted to vehicle Tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and is constructed Parking lot real-time map;
4.4 parking lot service centre path planning modules with intelligent vehicle current location as starting point, with outlet port as terminal, root According to the parking lot real-time map planning intelligent vehicle driving path of step 4.3;
4.5 parking lot service centre communication modules are by the vehicle running path of the current location of intelligent vehicle, attitude and planning Intelligent vehicle is sent to, and intelligent vehicle current location and outlet port are sent to customer mobile terminal;
The current location of the intelligent vehicle in 4.6 intelligent vehicle vehicle equipment communication module receiving steps 4.5, attitude and planning Vehicle running path;
The information that 4.7 intelligent vehicle mobile unit vehicle control modules are received according to communication module in step 4.6 controls intelligence Vehicular automatic driving;
4.8 repeat steps 4.3~4.7, export until intelligent vehicle is reached, and the task of rolling away from terminates.
5. according to claim 1 and 2 the parking lot service centre vehicle tracking module of system method for tracking target, it is special Levy and be, comprised the following steps in each process cycle:
5.1 receive the real-time image sequences from vision sensor group;
Each image of 5.2 pairs of different vision sensors acquisitions for receiving is utilized respectively correspondence vision sensor and passes through parameter calibration The inner parameter of acquisition carries out distortion correction, then carries out Inverse projection, and the unification of each image aspects is transformed into depression angle;
5.3 pairs carry out registration and splicing by each image after step 5.2 correction process and Inverse projection, obtain in parking lot Global image;
5.4 detect target vehicle from global image, are tracked the optimal estimation that filtering obtains target vehicle motion state;From Barrier is detected in global image, the real-time map in parking lot is generated according to target vehicle and barrier.
CN201710100828.8A 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision Pending CN106846870A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710100828.8A CN106846870A (en) 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710100828.8A CN106846870A (en) 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision

Publications (1)

Publication Number Publication Date
CN106846870A true CN106846870A (en) 2017-06-13

Family

ID=59134825

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710100828.8A Pending CN106846870A (en) 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision

Country Status (1)

Country Link
CN (1) CN106846870A (en)

Cited By (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107146468A (en) * 2017-07-12 2017-09-08 中国地质大学(武汉) Recognition method and system and management method and system of parking spaces in parking lot
CN107633694A (en) * 2017-09-04 2018-01-26 浙江省邮电工程建设有限公司 A kind of parking management system of pilotless automobile
CN108045377A (en) * 2017-12-12 2018-05-18 途客思科技(天津)有限公司 The method and system of intelligent mobile vehicle
CN108198450A (en) * 2017-12-26 2018-06-22 佛山市道静科技有限公司 A kind of intelligent parking system based on wireless telecommunications
CN108230708A (en) * 2018-01-25 2018-06-29 贵州宜行智通科技有限公司 Vehicle is driven out to Pathfinding system and method
CN108399785A (en) * 2018-03-15 2018-08-14 斑马网络技术有限公司 Find the method, apparatus and storage medium of vehicle
CN109631896A (en) * 2018-07-23 2019-04-16 同济大学 A kind of parking lot autonomous parking localization method based on vehicle vision and motion information
CN109817013A (en) * 2018-12-19 2019-05-28 新大陆数字技术股份有限公司 Parking stall state identification method and device based on video flowing
CN109859260A (en) * 2017-11-30 2019-06-07 华为技术有限公司 Method, device and computer-readable storage medium for determining parking space position
CN110032195A (en) * 2019-05-06 2019-07-19 广东工业大学 A kind of Vehicular automatic driving system
CN110126817A (en) * 2018-12-16 2019-08-16 初速度(苏州)科技有限公司 A kind of method and system parked or recalled between adaptive arbitrary point and fixed point
CN110271540A (en) * 2018-03-15 2019-09-24 罗伯特·博世有限公司 Method for controlling a vehicle and system for guiding vehicle
CN110444044A (en) * 2019-08-27 2019-11-12 纵目科技(上海)股份有限公司 Vehicle pose detection system, terminal and storage medium based on ultrasonic sensor
CN110689761A (en) * 2019-12-11 2020-01-14 上海赫千电子科技有限公司 Automatic parking method
CN110706501A (en) * 2018-07-09 2020-01-17 上海擎感智能科技有限公司 Off-vehicle intelligent service interaction method, on-vehicle terminal and storage medium
CN110874950A (en) * 2018-09-03 2020-03-10 上海博泰悦臻电子设备制造有限公司 Navigation system/method, computer readable storage medium and device for user parking
CN111311952A (en) * 2020-02-27 2020-06-19 平安国际智慧城市科技股份有限公司 Control method and device for vehicle parking, computer equipment and storage medium
CN111326001A (en) * 2020-02-26 2020-06-23 中国联合网络通信集团有限公司 Method and device for automatic driving
CN111397611A (en) * 2020-03-05 2020-07-10 北京百度网讯科技有限公司 Path planning method and device and electronic equipment
CN111833637A (en) * 2019-04-17 2020-10-27 阿里巴巴集团控股有限公司 Vehicle monitoring method, device, equipment and system
CN111845714A (en) * 2019-04-26 2020-10-30 东莞潜星电子科技有限公司 Automatic parking system based on intelligent visual deep learning
CN111862609A (en) * 2020-07-27 2020-10-30 湖南汽车工程职业学院 Parking lot parking path selection method based on 5G technology
CN111951598A (en) * 2019-05-17 2020-11-17 杭州海康威视数字技术股份有限公司 A vehicle tracking monitoring method, device and system
CN112002032A (en) * 2019-05-07 2020-11-27 孙占娥 Method, device, equipment and computer readable storage medium for guiding vehicle driving
CN112863225A (en) * 2019-11-28 2021-05-28 长城汽车股份有限公司 Method and device for passenger-replacing parking
CN112863213A (en) * 2020-12-26 2021-05-28 武汉光庭信息技术股份有限公司 Unmanned parking system and method based on automatic driving
CN112908016A (en) * 2020-12-24 2021-06-04 南京酷朗电子有限公司 Method for guiding vehicle driving based on parking space monitoring camera shooting
CN113129640A (en) * 2019-12-31 2021-07-16 北京四维图新科技股份有限公司 Automatic parking method and equipment
CN113324552A (en) * 2021-05-28 2021-08-31 上海国际汽车城(集团)有限公司 Intelligent automobile high-precision map system based on edge calculation
CN113401116A (en) * 2020-03-16 2021-09-17 哥白尼汽车有限责任公司 Method and system for autonomous driving of a vehicle
WO2021203868A1 (en) * 2020-04-08 2021-10-14 华为技术有限公司 Data processing method and device
CN114360278A (en) * 2021-11-29 2022-04-15 江铃汽车股份有限公司 Parking control method and system
CN115126312A (en) * 2022-04-11 2022-09-30 上海萃钛智能科技有限公司 Intelligent stereo garage and unmanned parking and warehousing method
CN115273531A (en) * 2022-07-15 2022-11-01 孙楚 Intelligent parking management system based on Internet of things
CN115424468A (en) * 2022-06-01 2022-12-02 星即科技(上海)有限公司 Parking stall detecting system based on many cameras fuse
CN115909795A (en) * 2023-03-09 2023-04-04 斯润天朗(北京)科技有限公司 Autonomous parking system and method based on parking lot cooperation
CN115909726A (en) * 2022-11-01 2023-04-04 中电科星河北斗技术(西安)有限公司 Smart parking method, device and storage medium based on situation awareness
CN116153128A (en) * 2022-12-26 2023-05-23 华人运通(上海)自动驾驶科技有限公司 Vehicle positioning and parking guidance method and system in a parking lot
TWI857628B (en) * 2023-05-31 2024-10-01 賽威科技股份有限公司 Method and system for avoiding abnormal event during automatic parking

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030122687A1 (en) * 2001-12-27 2003-07-03 Philips Electronics North America Corportion Computer vision based parking assistant
KR20050078676A (en) * 2004-01-31 2005-08-08 엄두섭 Parking management system
CN102819965A (en) * 2012-08-27 2012-12-12 红门智能科技股份有限公司 Parking guidance and searching system for parking lot
CN103871271A (en) * 2014-03-26 2014-06-18 陕西科技大学 Underground parking lot intelligent guiding system and guiding method thereof
CN204258976U (en) * 2014-12-10 2015-04-08 泉州市宇云电子科技有限公司 A kind of vehicle-mounted panoramic visible system
CN105702083A (en) * 2016-04-13 2016-06-22 重庆邮电大学 Distributed vision-based parking lot-vehicle cooperative intelligent parking system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030122687A1 (en) * 2001-12-27 2003-07-03 Philips Electronics North America Corportion Computer vision based parking assistant
KR20050078676A (en) * 2004-01-31 2005-08-08 엄두섭 Parking management system
CN102819965A (en) * 2012-08-27 2012-12-12 红门智能科技股份有限公司 Parking guidance and searching system for parking lot
CN103871271A (en) * 2014-03-26 2014-06-18 陕西科技大学 Underground parking lot intelligent guiding system and guiding method thereof
CN204258976U (en) * 2014-12-10 2015-04-08 泉州市宇云电子科技有限公司 A kind of vehicle-mounted panoramic visible system
CN105702083A (en) * 2016-04-13 2016-06-22 重庆邮电大学 Distributed vision-based parking lot-vehicle cooperative intelligent parking system and method

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
刘敬坤: "室内移动机器人的动态路径规划", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
孟庆斌: "基于单目视觉的智能小车障碍物检测研究", 《中国优秀硕士学位论文全文数据库》 *
张宝龙 等: "一种针对车载全景系统的图像拼接算法的仿真", 《电子与信息学报》 *
杨钰超: "汽车全景图像主动安全系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
王鹏程: "基于多图像传感器融合的全景泊车辅助系统研究", 《中国优秀硕士学位论文全文数据库 工程科技Ⅱ辑》 *

Cited By (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107146468A (en) * 2017-07-12 2017-09-08 中国地质大学(武汉) Recognition method and system and management method and system of parking spaces in parking lot
CN107633694A (en) * 2017-09-04 2018-01-26 浙江省邮电工程建设有限公司 A kind of parking management system of pilotless automobile
CN109859260A (en) * 2017-11-30 2019-06-07 华为技术有限公司 Method, device and computer-readable storage medium for determining parking space position
CN109859260B (en) * 2017-11-30 2021-02-12 华为技术有限公司 Method and device for determining parking position and computer readable storage medium
CN108045377A (en) * 2017-12-12 2018-05-18 途客思科技(天津)有限公司 The method and system of intelligent mobile vehicle
CN108198450A (en) * 2017-12-26 2018-06-22 佛山市道静科技有限公司 A kind of intelligent parking system based on wireless telecommunications
CN108230708A (en) * 2018-01-25 2018-06-29 贵州宜行智通科技有限公司 Vehicle is driven out to Pathfinding system and method
CN108399785A (en) * 2018-03-15 2018-08-14 斑马网络技术有限公司 Find the method, apparatus and storage medium of vehicle
CN110271540A (en) * 2018-03-15 2019-09-24 罗伯特·博世有限公司 Method for controlling a vehicle and system for guiding vehicle
CN110271540B (en) * 2018-03-15 2025-07-29 罗伯特·博世有限公司 Method for controlling a vehicle and system for guiding a vehicle
CN110706501A (en) * 2018-07-09 2020-01-17 上海擎感智能科技有限公司 Off-vehicle intelligent service interaction method, on-vehicle terminal and storage medium
CN109631896A (en) * 2018-07-23 2019-04-16 同济大学 A kind of parking lot autonomous parking localization method based on vehicle vision and motion information
CN109631896B (en) * 2018-07-23 2020-07-28 同济大学 Parking lot autonomous parking positioning method based on vehicle vision and motion information
CN110874950A (en) * 2018-09-03 2020-03-10 上海博泰悦臻电子设备制造有限公司 Navigation system/method, computer readable storage medium and device for user parking
CN110126817A (en) * 2018-12-16 2019-08-16 初速度(苏州)科技有限公司 A kind of method and system parked or recalled between adaptive arbitrary point and fixed point
CN110126817B (en) * 2018-12-16 2023-01-06 魔门塔(苏州)科技有限公司 Method and system for self-adapting to parking or recalling between any point and fixed point
CN109817013A (en) * 2018-12-19 2019-05-28 新大陆数字技术股份有限公司 Parking stall state identification method and device based on video flowing
CN111833637A (en) * 2019-04-17 2020-10-27 阿里巴巴集团控股有限公司 Vehicle monitoring method, device, equipment and system
CN111845714A (en) * 2019-04-26 2020-10-30 东莞潜星电子科技有限公司 Automatic parking system based on intelligent visual deep learning
CN110032195A (en) * 2019-05-06 2019-07-19 广东工业大学 A kind of Vehicular automatic driving system
CN112002032A (en) * 2019-05-07 2020-11-27 孙占娥 Method, device, equipment and computer readable storage medium for guiding vehicle driving
CN111951598A (en) * 2019-05-17 2020-11-17 杭州海康威视数字技术股份有限公司 A vehicle tracking monitoring method, device and system
CN111951598B (en) * 2019-05-17 2022-04-26 杭州海康威视数字技术股份有限公司 Vehicle tracking monitoring method, device and system
CN110444044A (en) * 2019-08-27 2019-11-12 纵目科技(上海)股份有限公司 Vehicle pose detection system, terminal and storage medium based on ultrasonic sensor
CN112863225A (en) * 2019-11-28 2021-05-28 长城汽车股份有限公司 Method and device for passenger-replacing parking
CN110689761A (en) * 2019-12-11 2020-01-14 上海赫千电子科技有限公司 Automatic parking method
CN113129640A (en) * 2019-12-31 2021-07-16 北京四维图新科技股份有限公司 Automatic parking method and equipment
CN111326001A (en) * 2020-02-26 2020-06-23 中国联合网络通信集团有限公司 Method and device for automatic driving
CN111311952A (en) * 2020-02-27 2020-06-19 平安国际智慧城市科技股份有限公司 Control method and device for vehicle parking, computer equipment and storage medium
CN111397611A (en) * 2020-03-05 2020-07-10 北京百度网讯科技有限公司 Path planning method and device and electronic equipment
CN113401116A (en) * 2020-03-16 2021-09-17 哥白尼汽车有限责任公司 Method and system for autonomous driving of a vehicle
CN113401116B (en) * 2020-03-16 2024-08-27 哥白尼汽车有限责任公司 Method and system for autonomous driving vehicle
US12162474B2 (en) 2020-04-08 2024-12-10 Huawei Technologies Co., Ltd. Data processing method and apparatus
WO2021203868A1 (en) * 2020-04-08 2021-10-14 华为技术有限公司 Data processing method and device
CN111862609A (en) * 2020-07-27 2020-10-30 湖南汽车工程职业学院 Parking lot parking path selection method based on 5G technology
CN112908016B (en) * 2020-12-24 2022-06-03 南京酷朗电子有限公司 Method for guiding vehicle driving based on parking space monitoring camera shooting
CN112908016A (en) * 2020-12-24 2021-06-04 南京酷朗电子有限公司 Method for guiding vehicle driving based on parking space monitoring camera shooting
CN112863213A (en) * 2020-12-26 2021-05-28 武汉光庭信息技术股份有限公司 Unmanned parking system and method based on automatic driving
CN113324552A (en) * 2021-05-28 2021-08-31 上海国际汽车城(集团)有限公司 Intelligent automobile high-precision map system based on edge calculation
CN113324552B (en) * 2021-05-28 2023-03-14 上海国际汽车城(集团)有限公司 Intelligent automobile high-precision map system based on edge calculation
CN114360278A (en) * 2021-11-29 2022-04-15 江铃汽车股份有限公司 Parking control method and system
CN115126312A (en) * 2022-04-11 2022-09-30 上海萃钛智能科技有限公司 Intelligent stereo garage and unmanned parking and warehousing method
CN115424468A (en) * 2022-06-01 2022-12-02 星即科技(上海)有限公司 Parking stall detecting system based on many cameras fuse
WO2024012604A1 (en) * 2022-07-15 2024-01-18 孙楚 Intelligent parking management system based on internet of things
CN115273531A (en) * 2022-07-15 2022-11-01 孙楚 Intelligent parking management system based on Internet of things
CN115909726A (en) * 2022-11-01 2023-04-04 中电科星河北斗技术(西安)有限公司 Smart parking method, device and storage medium based on situation awareness
CN116153128A (en) * 2022-12-26 2023-05-23 华人运通(上海)自动驾驶科技有限公司 Vehicle positioning and parking guidance method and system in a parking lot
CN115909795A (en) * 2023-03-09 2023-04-04 斯润天朗(北京)科技有限公司 Autonomous parking system and method based on parking lot cooperation
TWI857628B (en) * 2023-05-31 2024-10-01 賽威科技股份有限公司 Method and system for avoiding abnormal event during automatic parking

Similar Documents

Publication Publication Date Title
CN106846870A (en) The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision
CN105702083B (en) Parking lot based on distributed vision-vehicle cooperative intelligent shutdown system and method
CN107093328B (en) Parking lot navigation system and method based on machine vision
CN110304049B (en) Environmental active perception type parking lot automatic parking system
CN106846892A (en) Parking lot vehicle cooperative intelligent shutdown system and method based on machine vision
CN110689761B (en) A method of automatic parking
Furgale et al. Toward automated driving in cities using close-to-market sensors: An overview of the v-charge project
CN105946853B (en) The system and method for long range automatic parking based on Multi-sensor Fusion
US20170267233A1 (en) Method for autonomous vehicle parking
CN112537294B (en) Automatic parking control method and electronic equipment
CN111081064A (en) An automatic parking system and automatic valet parking method based on vehicle Ethernet
CN105679068A (en) Intelligent vehicle automatic driving system and method in cooperation with intelligent parking lot
CN112150547B (en) A method and device for determining the posture of a vehicle body and a surround-view visual odometry system
US20240393116A1 (en) Method and Assistance Apparatus for Supporting Vehicle Functions in a Parking Lot, and Motor Vehicle
US11884265B1 (en) Parking assistance method and parking assistance device
CN112071105A (en) High-precision map-based automatic driving receiving method and device for parking lot
CN106092123A (en) A kind of video navigation method and device
CN115472037B (en) A parking assistance method based on field end positioning
CN115565262A (en) Parking charging automatic inspection robot and method
CN113135179A (en) Parking detection method, device, equipment, system and storage medium
CN111739332B (en) Parking lot management system
CN107705611A (en) Parking lot car searching method based on intelligent carriage
CN116013081A (en) Mobile intelligent parking search and navigation integrated service system and method
CN116343522A (en) A method for unmanned parking in smart parks based on spatio-temporal vehicle re-identification
CN113312403B (en) Map acquisition method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170613