[go: up one dir, main page]

CN109815867A - A kind of crowd density estimation and people flow rate statistical method - Google Patents

A kind of crowd density estimation and people flow rate statistical method Download PDF

Info

Publication number
CN109815867A
CN109815867A CN201910031587.5A CN201910031587A CN109815867A CN 109815867 A CN109815867 A CN 109815867A CN 201910031587 A CN201910031587 A CN 201910031587A CN 109815867 A CN109815867 A CN 109815867A
Authority
CN
China
Prior art keywords
crowd density
density estimation
convolutional layers
layer
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910031587.5A
Other languages
Chinese (zh)
Inventor
朱杰
沈波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Donghua University
Original Assignee
Donghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Donghua University filed Critical Donghua University
Priority to CN201910031587.5A priority Critical patent/CN109815867A/en
Publication of CN109815867A publication Critical patent/CN109815867A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Analysis (AREA)

Abstract

本发明涉及一种人群密度估计和人流量统计方法,本发明使用了多尺度融合的人群密度估计模型,该模型由深层网络和浅层网络组成,其中深层网络是基于VGG‑16而设计的。浅层网络主要是用来学习图片上所占像素比较小的目标的特征。而且多尺度融合的人群密度估计模型提取了深层网络不同卷积层的特征,将它们和深层网络和浅层网络的输出融合进行人群密度估计。同时将人群密度估计模型的输出当作人流量统计模型的输入,从而将两个模型融合在一起,这样不仅能大大加快神经网络的训练速度,在实际生活中的运用也更加广泛。本发明不仅提高了人群密度任务和人流量同任务的准确率,同时将人群密度估计任务和人流量统计任务在一个模型中完成。

The present invention relates to a method for crowd density estimation and human flow statistics. The present invention uses a multi-scale fusion crowd density estimation model, which consists of a deep network and a shallow network, wherein the deep network is designed based on VGG-16. The shallow network is mainly used to learn the features of objects with relatively small pixels on the image. Moreover, the multi-scale fusion crowd density estimation model extracts the features of different convolutional layers of the deep network, and fuses them with the outputs of the deep network and the shallow network for crowd density estimation. At the same time, the output of the crowd density estimation model is used as the input of the people flow statistics model, so that the two models are fused together, which can not only greatly speed up the training speed of the neural network, but also be more widely used in real life. The invention not only improves the accuracy of the task of crowd density and the same task of people flow, but also completes the task of crowd density estimation and people flow statistics in one model.

Description

A kind of crowd density estimation and people flow rate statistical method
Technical field
The present invention relates to a kind of crowd density estimation neural network based and people flow rate statistical methods, belong to Video security Monitoring technology field.
Background technique
Crowd density estimation is that information is handled to the crowd is dense using machine and software, extracts its feature and calculate The process of total number of persons in crowd density image out, and people flow rate statistical is the information extracted between successive frame picture, is calculated Pass through number somewhere in a period of time.Crowd density estimation and people flow rate statistical are typically used to Video security monitoring neck Domain.For example, more than the flow of the people and the places such as complicated occasion such as railway station, subway station carry out video monitoring, by population analysis, Intellectualized monitoring is carried out, the abnormal behaviour of group in scene is detected.
In current crowd density estimation and people flow rate statistical research, it is main using one end to end regression model come At the model is to be proposed based on AlexNet, but changed 4096 neurons of the full articulamentum of the last layer into one Single neuron is used to estimate the number in picture.But in the picture calculated due to crowd density estimation and people flow rate statistical The larger reason of crowd density, so many difficulties can be faced when research, such as target occlusion, target deformation, change of scale Deng.For example pixel ratio shared by people of the dense graph on piece close to camera is very big, but shared by the people far from camera Pixel it is especially small, be thus that neural network is also difficult disposably to finish all density informations of this picture.Meanwhile scheming When crowd density is larger in piece, interpersonal block also can be very serious, so last estimated result often and is paid no attention to Think.
Summary of the invention
The purpose of the present invention is: improve the accuracy rate of crowd density estimation and people flow rate statistical task.
In order to achieve the above object, the technical solution of the present invention is to provide a kind of crowd density estimation and people flow rate statisticals Method, which comprises the following steps:
Step 1 carries out pretreatment operation to crowd density picture;
Personage head on pretreated crowd density picture point is marked by step 2, and it is identical to generate size Bianry image generates thermodynamic chart, a thermodynamic chart and and thermodynamic chart using Gaussian kernel normalization algorithm to the bianry image of generation Corresponding crowd density figure is at one group of training set;
Step 3, the training set for obtaining step 2 are put into Density estimating model and are trained, and Density estimating model is by depth Layer network and shallow-layer network composition, in which:
Deep layer network is the VGG-16 for removing full articulamentum, and VGG-16 is made of five groups of full convolutional layers, the first of VGG-16 Group convolutional layer and second group of convolutional layer are there are two full convolutional layer, and the full convolutional layer of third group of VGG-16, the 4th group of full convolutional layer It is all made of three full convolutional layers with the 5th group of full convolutional layer, only first group of convolutional layer, second group of convolutional layer, the full convolution of third group It is connected to one layer of maximum pond layer behind layer and the 4th group of full convolutional layer, is connected to first group of convolutional layer, second group of convolutional layer, the The step-length of maximum pond layer after three groups of full convolutional layers is 2, the step-length of the maximum pond layer after being connected to the 4th group of full convolutional layer It is 1
Shallow-layer network possesses three-layer coil lamination and three layers of pond layer;
Two upper convolutional layers have been added after directly the output of deep layer network and the output of shallow-layer network are connected, and have been made The size for obtaining the characteristic pattern that Density estimating model finally exports is identical with the size of original crowd's density map piece;
Step 4, the Density estimating model completed according to training, by the output of Density estimating model as the defeated of bilayer LSTM Out to connect crowd density estimation model and people flow rate statistical model, it is completed at the same time crowd density estimation task and people Traffic statistics task.
Preferably, in step 2, generate the thermodynamic chart the following steps are included:
Its parameter is made to two-dimensional Gaussian kernel normalization first and for one, dimensional Gaussian then is used to the bianry image Core normalization algorithm generates thermodynamic chart, so that the point that pixel value is one in bianry image scatter, makes all pixels around the point Value adds up and is one.
Preferably, in step 2, the normalized calculation formula H (x) of Gaussian kernel are as follows:
In formula, what A was represented be personage head in crowd density picture it is labeled come out it is all Point, a is a point in A, and what x was represented is the location of pixels in thermodynamic chart, and σ is the variance of Gaussian kernel N.
Due to the adoption of the above technical solution, compared with prior art, the present invention having the following advantages that and actively imitating Fruit: present invention uses the crowd density estimation model of Multiscale Fusion, which is made of deep layer network and shallow-layer network, Mid-deep strata network is designed based on VGG-16, only deep layer network eliminated on the basis of VGG-16 full articulamentum and Layer 5 pond layer, and the step-length of the 4th layer of pond layer is changed to 1.And shallow-layer network is only by three-layer coil lamination and three layers of pond Layer composition, shallow-layer network are primarily used to the shared lesser clarification of objective of pixel ratio on study picture.And Multiscale Fusion The crowd density estimation model extraction feature of deep layer network difference convolutional layer, by they and deep layer network and shallow-layer network Output is integrated into row crowd density estimation.Simultaneously by the output of crowd density estimation model as the defeated of people flow rate statistical model Enter, so that together by two Model Fusions, the training speed of neural network can not only be greatly speeded up in this way, in real life Utilization also more extensively.The present invention not only increases crowd density task and flow of the people with the accuracy rate of task, while by people Group's density estimation task and people flow rate statistical task are completed in a model.
Detailed description of the invention
Fig. 1 is a kind of flow chart of crowd density estimation and people flow rate statistical method provided by the invention.
Specific embodiment
Present invention will be further explained below with reference to specific examples.It should be understood that these embodiments are merely to illustrate the present invention Rather than it limits the scope of the invention.In addition, it should also be understood that, after reading the content taught by the present invention, those skilled in the art Member can make various changes or modifications the present invention, and such equivalent forms equally fall within the application the appended claims and limited Range.
Embodiments of the present invention are related to a kind of crowd density estimation neural network based and people flow rate statistical method, such as Shown in Fig. 1, comprising the following steps: pre-processed to crowd density image;Personage head on pretreated image is used Point, which is marked, generates the identical bianry image of size, generates heating power using Gaussian kernel normalization algorithm to the bianry image of generation Figure, an original image and a thermodynamic chart are just one group of training set;Above-mentioned training set is put into crowd density estimation network It is trained, crowd density estimation network is made of deep layer network and shallow-layer network, and mid-deep strata network is set based on VGG-16 Meter, shallow-layer network possesses three-layer coil lamination and three layers of pond layer;According to training complete crowd density estimation network, by it The output as bilayer LSTM is exported to crowd density estimation network and people flow rate statistical are connected to the network, the network energy Enough it is completed at the same time crowd density estimation task and people flow rate statistical task.It is specific as follows:
Step 1 collects cut out image block in present frame according to the collected data, image block is done pretreatment operation: first Image block size is adjusted to 225 ' 225 pixel sizes, then finds out the pixel mean value of all pixels point, then with each pixel Pixel value subtract pixel mean value and obtain normalized image block.
Personage's head point on pretreated image is marked the identical bianry image of generation size by step 2, Thermodynamic chart is generated using Gaussian kernel normalization algorithm to the bianry image of generation, an original image and a thermodynamic chart are just one Group training set.Specific step is as follows:
Step 2.1 makes its parameter to two-dimensional Gaussian kernel normalization first and for one, then uses above-mentioned bianry image Two-dimensional Gaussian kernel normalization algorithm generates thermodynamic chart.This method makes the point that pixel value is one in bianry image scatter, and makes this Point surrounding all pixels value adds up and is one.The normalized calculation formula of Gaussian kernel is as follows:
In formula (1), what A was represented, which is that personage head in original image is labeled, comes out all points, and a is one in A Point, what x was represented is the location of pixels in thermodynamic chart, and σ is the variance of Gaussian kernel N.
Step 2.2 is equal to all pixels value addition on the thermodynamic chart generated by the above method in original image Number, the total number of persons that can be calculated by the following formula in original image:
Wherein H (x) represents the pixel value of x point on thermodynamic chart.It goes to train crowd density estimation network by this thermodynamic chart It enables to network not have to the position for focusing on personage in image again, and is concerned with the number in image.And by this The thermodynamic chart that mode generates can obtain the substantially distribution of crowd in original image.
Above-mentioned training set is put into density estimation network and is trained by step 3, density estimation network by deep layer network and Shallow-layer network composition, mid-deep strata network is designed based on VGG-16, and shallow-layer network possesses three-layer coil lamination and three layers of pond Layer.Specific step is as follows:
Step 3.1 learns high-level semantics information on density map using deep layer network, which is a kind of similar In the model of VGG-16.Crowd density estimation task is realized using the good VGG-16 of pre-training.Although VGG-16 design is first Inner feelings is used to as image classification network, but the convolution kernel inside VGG-16 is extraordinary general vision descriptor. VGG-16 has been used in various Computer Vision Tasks such as Target Segmentation, target detection, target tracking etc..Base In this characteristic of VGG-16, the good VGG-16 sorter network of pre-training is finely adjusted to complete crowd density estimation task.But It is that classification task is different with crowd density estimation task always, classification task is to classify to a picture, and crowd is close Degree estimation task is that the prediction of Pixel-level is carried out to picture, is added to obtain total people by will export pixel value all on picture Number.For simple, the output of classification task is some discrete points, and the output of crowd density estimation task is a Zhang Erwei Image.So present invention removes the full articulamentums inside VGG-16, so that our crowd density estimation network becomes full volume Product network.
VGG-16 is made of five groups of full convolutional layers, and there are two full convolutional layers for first and second groups of convolutional layers of VGG-16, and Third, the 4th and the 5th group of full convolutional layer are all made of three full convolutional layers.The convolution of all convolutional layers in every group of convolutional layer Core size is all 3 × 3, and the convolution carried out in every group of convolutional layer will not all change the size and dimension of output characteristic pattern.But It is one layer of maximum pond layer (max-pooling) to be all connected to behind every group of convolutional layer, and the step-length of maximum pond layer is 2.Cause This, entire deep layer crowd density estimation network one shares 5 maximum pond layers, and it is defeated that this, which allows for last output picture size, Enter the 1/32 of picture size.In order to make the deep layer network of crowd density estimation network as the output size of shallow-layer network, this Invention removes the subsequent pond layer of the 5th group of convolutional layer of deep layer network and sets the pond layer step-length after the 4th group of convolutional layer It is 1.After being handled in this way, the output picture size of deep layer network becomes inputting the 1/8 of picture.
Step 3.2, because density image in number it is more, some people distant from camera often only show in the picture One hand or one leg are shown, they often only account for several pixels even pixel.Due to they feature very Unconspicuous reason, so extremely difficult to the detection of crowd density estimation image Small Target.If continuing to use deep layer herein Network detects Small object, then last accuracy rate will be very low.Generate this effect be due to receptive field, such as In above-mentioned deep layer network, the pixel of crowd density estimation network exported in picture sense shared in input picture There are tens pixels by open country, but small target only only has several pixels, so the feature of Small object is by so Ignored after the convolutional calculation of multilayer, this accuracy rate for having resulted in crowd density estimation task reduces.
Therefore, the present invention proposes shallow-layer network on the basis of deep layer network, which is mainly used to learn in picture The feature of Small object.Because not needing the high-level semantics information of study image, only only there are three convolution for shallow-layer network Layer and three average pond layers.Each convolutional layer has 24 convolution kernels, and the size of convolution kernel is 5 × 5.Because of maximum Chi Huayou It may cause the loss of statistics total number of persons, so maximum pond layer is changed to average pond layer.The step-length of each averagely pond layer It is 2, so the output picture size of shallow-layer network is input picture size 1/8.
Step 3.3, the output due to deep layer network and the output of shallow-layer network are all the 1/8 of input picture, it is possible to Directly the output of deep layer network and the output of shallow-layer network are connected.I.e. in the case where not changing output picture size, Directly it is overlapped in dimension.Meanwhile in order to preferably complete crowd density estimation task, the present invention is extracted deep layer network Conv2-2, Conv3-3 and Conv4-3 layers of feature.For the feature of the Conv2-2 layer extracted, face adds the present invention behind One layer of convolutional layer is added, which there are 128 convolution kernels, and the size of convolution kernel is 9 × 9, step-length 4.Simultaneously for extraction The feature of the Conv3-3 layer arrived, also face is added to one layer of convolutional layer to the present invention behind, which has 128 convolution kernels, volume Product core size is 9 × 9, step-length 2.For the feature for the Conv4-3 layer that extraction obtains, also face is added to one layer of convolution behind Layer, the convolutional layer have 128 convolution kernels, and convolution kernel size is 4 × 4, step-length 1.Behind them add convolutional layer be in order to Keep the size for obtaining characteristic pattern by Conv2-2, Conv3-3 and Conv4-3 layers of extraction identical, the characteristic pattern energy extracted in this way Output with shallow-layer network and deep layer network is directly attached.By extracting the feature of different layers, crowd density estimation network It can learn the density information more advanced into density picture, improve the accuracy rate of crowd density estimation model.
After aforesaid operations, the dimension for finally exporting picture is 920 dimensions, and the size for exporting picture is input picture 1/8.In order to make to reduce the parameter of network while output picture size is identical with picture size is inputted, the present invention is merging more rulers It joined two up-sampling layers after degree feature.First up-sampling layer has 512 convolution kernels, and convolution kernel size is 5 × 5, step A length of 4.Second up-sampling layer also has 512 convolution kernels, and convolution kernel size is 3 × 3.By the two up-sampling layer processing Afterwards, the characteristic pattern of one 512 dimension can be obtained, the size of this feature figure is identical with original picture size.This operation can not only Keep output picture size identical with picture size is inputted, to smoothly complete crowd density estimation task, while also can be reduced people The parameter of group's density estimation network, accelerates network training speed.One 1 × 1 is finally added behind crowd density estimation model Convolution kernel, do so primarily to change the dimension of characteristic pattern, characteristic pattern and thermodynamic chart compared, calculate Loss function.Finally, we, which only need to export pixel value addition all on characteristic pattern, can obtain on input picture Total number of persons.
Step 4, according to training complete crowd density estimation network, by it output as bilayer LSTM output thus Crowd density estimation network and people flow rate statistical network connection are got up, which can be completed at the same time crowd density estimation task With people flow rate statistical task.Specific step is as follows:
Step 4.1, theoretically, the number of plies of neural network is deeper, and the performance of neural network is better.This is theoretical in circulation mind Through equally applicable in network.Two layers of LSTM is used in crowd density estimation and people flow rate statistical task so merging at us. By stacking two layers of LSTM, people flow rate statistical model being capable of information more effectively on learning time sequence picture.Standard is followed Ring neural network only has one layer, we increase LSTM in the present invention.Because increasing one layer of LSTM, first layer it is defeated It is the input of the second layer out.
Step 4.2, input are time series picture, and each moment someone enters monitoring area while also someone walks out prison Region is controlled, so at different times, the total number of persons in image is possible to not change, but always by the number of this area Changing.The crowd density estimation model of Multiscale Fusion of the picture at each moment Jing Guo above-mentioned introduction calculates thermodynamic chart, All pixels value on thermodynamic chart is added to the total number of persons that can be calculated on original image.The heating power that each time point is exported Figure as two layers of LSTM input because LSTM can calculate the information on continuous time series picture, it is possible to last The total number of persons in this period by monitoring area is exported on one LSTM, so that crowd density estimation task and flow of the people be united Meter task is combined together.
It is not difficult to find that present invention uses than use one end to end regression model have stronger learning sample pictorial information Ability.It goes to realize people flow rate statistical task, this hair compared to directly time series original image is directly inputted in LSTM The input of the people flow rate statistical model of bright proposition is the output of crowd's Density estimating model.The present invention not only increases flow of the people system The accuracy rate of meter task, while also combining crowd density estimation task and people flow rate statistical task.

Claims (3)

1.一种人群密度估计和人流量统计方法,其特征在于,包括以下步骤:1. a crowd density estimation and people flow statistics method, it is characterized in that, comprise the following steps: 步骤1、对人群密度图片进行预处理操作;Step 1. Preprocess the crowd density image; 步骤2、将预处理后的人群密度图片上的人物头部用点标记出来,生成大小相同的二值图像,对生成的二值图像利用高斯核归一化算法产生热力图,一张热力图及与热力图相对应的人群密度图形成一组训练集;Step 2. Mark the head of the person on the preprocessed crowd density image with dots, generate a binary image of the same size, and use the Gaussian kernel normalization algorithm for the generated binary image to generate a heat map, a heat map. and the crowd density map corresponding to the heat map to form a set of training sets; 步骤3、将步骤2得到的训练集放入密度估计模型中进行训练,密度估计模型由深层网络和浅层网络组成,其中:Step 3. Put the training set obtained in step 2 into the density estimation model for training. The density estimation model consists of a deep network and a shallow network, where: 深层网络为移除全连接层的VGG-16,VGG-16由五组全卷积层组成,VGG-16的第一组卷积层和第二组卷积层有两个全卷积层,而VGG-16的第三组全卷积层、第四组全卷积层和第五组全卷积层都由三个全卷积层组成,仅第一组卷积层、第二组卷积层、第三组全卷积层和第四组全卷积层后面连接了一层最大池化层,连接在第一组卷积层、第二组卷积层、第三组全卷积层后的最大池化层的步长为2,连接在第四组全卷积层后的最大池化层的步长为1The deep network is VGG-16 that removes the fully connected layer. VGG-16 consists of five groups of fully convolutional layers. The first group of convolutional layers and the second group of convolutional layers of VGG-16 have two fully convolutional layers. The third group of fully convolutional layers, the fourth group of fully convolutional layers and the fifth group of fully convolutional layers of VGG-16 are all composed of three fully convolutional layers, only the first group of convolutional layers and the second group of convolutional layers. A layer of maximum pooling layer is connected behind the product layer, the third group of fully convolutional layers, and the fourth group of fully convolutional layers, which are connected to the first group of convolutional layers, the second group of convolutional layers, and the third group of fully convolutional layers. The max-pooling layer after the layer has a stride of 2, and the max-pooling layer connected after the fourth set of fully convolutional layers has a stride of 1. 浅层网络拥有三层卷积层和三层池化层;The shallow network has three convolutional layers and three pooling layers; 直接把深层网络的输出和浅层网络的输出连接起来后再加入了两个上卷积层,使得密度估计模型最后输出的特征图的大小和原始人群密度图片的大小相同;The output of the deep network and the output of the shallow network are directly connected, and then two upper convolution layers are added, so that the size of the feature map output by the density estimation model is the same as the size of the original crowd density image; 步骤4、根据训练完成的密度估计模型,将密度估计模型的输出作为双层LSTM的输出从而将人群密度估计模型和人流量统计模型连接起来,同时完成人群密度估计任务和人流量统计任务。Step 4. According to the density estimation model completed by training, the output of the density estimation model is used as the output of the double-layer LSTM to connect the crowd density estimation model and the people flow statistics model, and simultaneously complete the crowd density estimation task and the people flow statistics task. 2.如权利要求1所述一种人群密度估计和人流量统计方法,其特征在于,步骤2中,产生所述热力图包括以下步骤:2. a kind of crowd density estimation and people flow statistics method as claimed in claim 1 is characterized in that, in step 2, generating described heat map comprises the following steps: 首先对二维高斯核归一化使它的参数和为一,然后对所述二值图像使用二维高斯核归一化算法生成热力图,使得二值图像中像素值为一的点分散开,使该点周围所有像素值加起来和为一。First, normalize the two-dimensional Gaussian kernel to make the sum of its parameters equal to one, and then use the two-dimensional Gaussian kernel normalization algorithm to generate a heat map for the binary image, so that the points with a pixel value of one in the binary image are scattered. , so that all pixel values around the point add up to one. 3.如权利要求1所述一种人群密度估计和人流量统计方法,其特征在于,步骤2中,所述高斯核归一化的计算公式H(x)为:3. a kind of crowd density estimation and people flow statistics method as claimed in claim 1, is characterized in that, in step 2, described Gaussian kernel normalized calculation formula H(x) is: 式中,A代表的是人群密度图片中的人物头部被标记出来所有的点,a是A中的一个点,x代表的是热力图中的像素位置,σ是高斯核N的方差。 In the formula, A represents all the points marked on the head of the person in the crowd density image, a is a point in A, x represents the pixel position in the heat map, and σ is the variance of the Gaussian kernel N.
CN201910031587.5A 2019-01-14 2019-01-14 A kind of crowd density estimation and people flow rate statistical method Pending CN109815867A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910031587.5A CN109815867A (en) 2019-01-14 2019-01-14 A kind of crowd density estimation and people flow rate statistical method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910031587.5A CN109815867A (en) 2019-01-14 2019-01-14 A kind of crowd density estimation and people flow rate statistical method

Publications (1)

Publication Number Publication Date
CN109815867A true CN109815867A (en) 2019-05-28

Family

ID=66603469

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910031587.5A Pending CN109815867A (en) 2019-01-14 2019-01-14 A kind of crowd density estimation and people flow rate statistical method

Country Status (1)

Country Link
CN (1) CN109815867A (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110210603A (en) * 2019-06-10 2019-09-06 长沙理工大学 Counter model construction method, method of counting and the device of crowd
CN110263849A (en) * 2019-06-19 2019-09-20 合肥工业大学 A kind of crowd density estimation method based on multiple dimensioned attention mechanism
CN110874573A (en) * 2019-10-30 2020-03-10 汇纳科技股份有限公司 Method, device, electronic terminal and medium for generating density map based on residual error operation
CN110991375A (en) * 2019-12-10 2020-04-10 北京航空航天大学 Group behavior analysis method and device
CN111611878A (en) * 2020-04-30 2020-09-01 杭州电子科技大学 A Video Image-Based Approach for Crowd Counting and Future Traffic Prediction
CN111639668A (en) * 2020-04-17 2020-09-08 北京品恩科技股份有限公司 Crowd density detection method based on deep learning
CN111652152A (en) * 2020-06-04 2020-09-11 上海眼控科技股份有限公司 Crowd density detection method and device, computer equipment and storage medium
CN111710009A (en) * 2020-05-29 2020-09-25 北京百度网讯科技有限公司 Generation method, device, electronic device and storage medium of human flow density
CN111709300A (en) * 2020-05-20 2020-09-25 杭州电子科技大学 Crowd Counting Method Based on Video Image
CN112001274A (en) * 2020-08-06 2020-11-27 腾讯科技(深圳)有限公司 Crowd density determination method, device, storage medium and processor
CN112101455A (en) * 2020-09-15 2020-12-18 重庆市农业科学院 Tea lesser leafhopper identification and counting method based on convolutional neural network
CN112101195A (en) * 2020-09-14 2020-12-18 腾讯科技(深圳)有限公司 Crowd density estimation method and device, computer equipment and storage medium
CN112101214A (en) * 2020-09-15 2020-12-18 重庆市农业科学院 A heatmap-based fast-counting network structure of the tea net bug
CN112232333A (en) * 2020-12-18 2021-01-15 南京信息工程大学 Real-time passenger flow thermodynamic diagram generation method in subway station
CN113052827A (en) * 2021-03-30 2021-06-29 齐鲁工业大学 Crowd counting method and system based on multi-branch expansion convolutional neural network
CN113158780A (en) * 2021-03-09 2021-07-23 中国科学院深圳先进技术研究院 Regional crowd density estimation method, electronic device and storage medium
WO2022188030A1 (en) * 2021-03-09 2022-09-15 中国科学院深圳先进技术研究院 Crowd density estimation method, electronic device and storage medium
CN115083112A (en) * 2022-08-22 2022-09-20 枫树谷(成都)科技有限责任公司 Intelligent early warning emergency management system and deployment method thereof

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103218816A (en) * 2013-04-18 2013-07-24 中山大学 Crowd density estimation method and pedestrian volume statistical method based on video analysis
CN107330364A (en) * 2017-05-27 2017-11-07 上海交通大学 A kind of people counting method and system based on cGAN networks
CN107506692A (en) * 2017-07-21 2017-12-22 天津大学 A kind of dense population based on deep learning counts and personnel's distribution estimation method
CN107742099A (en) * 2017-09-30 2018-02-27 四川云图睿视科技有限公司 A kind of crowd density estimation based on full convolutional network, the method for demographics
CN107967451A (en) * 2017-11-23 2018-04-27 常州大学 A kind of method for carrying out crowd's counting to static image using multiple dimensioned multitask convolutional neural networks
CN108260087A (en) * 2018-01-31 2018-07-06 福州大学 A kind of indoor stream of people's distribution forecasting method based on WIIFI long short-term memories
CN108388852A (en) * 2018-02-09 2018-08-10 北京天元创新科技有限公司 A kind of region crowd density prediction technique and device based on deep learning

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103218816A (en) * 2013-04-18 2013-07-24 中山大学 Crowd density estimation method and pedestrian volume statistical method based on video analysis
CN107330364A (en) * 2017-05-27 2017-11-07 上海交通大学 A kind of people counting method and system based on cGAN networks
CN107506692A (en) * 2017-07-21 2017-12-22 天津大学 A kind of dense population based on deep learning counts and personnel's distribution estimation method
CN107742099A (en) * 2017-09-30 2018-02-27 四川云图睿视科技有限公司 A kind of crowd density estimation based on full convolutional network, the method for demographics
CN107967451A (en) * 2017-11-23 2018-04-27 常州大学 A kind of method for carrying out crowd's counting to static image using multiple dimensioned multitask convolutional neural networks
CN108260087A (en) * 2018-01-31 2018-07-06 福州大学 A kind of indoor stream of people's distribution forecasting method based on WIIFI long short-term memories
CN108388852A (en) * 2018-02-09 2018-08-10 北京天元创新科技有限公司 A kind of region crowd density prediction technique and device based on deep learning

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
JIE ZHU 等: "People counting and pedestrian flow statistics based on convolutional neural network and recurrent neural network", 《2018 33RD YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC)》 *
LOKESH BOOMINATHAN 等: "CrowdNet: A Deep Convolutional Network for Dense Crowd Counting", 《ARXIV》 *
徐洋 等: "基于多层BP神经网络和无参数微调的人群计数方法", 《计算机科学》 *
袁烨 等: "基于卷积神经网络的人群计数研究", 《成组技术与生产现代化》 *

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110210603A (en) * 2019-06-10 2019-09-06 长沙理工大学 Counter model construction method, method of counting and the device of crowd
CN110263849B (en) * 2019-06-19 2021-03-09 合肥工业大学 A crowd density estimation method based on multi-scale attention mechanism
CN110263849A (en) * 2019-06-19 2019-09-20 合肥工业大学 A kind of crowd density estimation method based on multiple dimensioned attention mechanism
CN110874573A (en) * 2019-10-30 2020-03-10 汇纳科技股份有限公司 Method, device, electronic terminal and medium for generating density map based on residual error operation
CN110874573B (en) * 2019-10-30 2022-05-13 汇纳科技股份有限公司 Method, device, electronic terminal and medium for generating density map based on residual error operation
CN110991375A (en) * 2019-12-10 2020-04-10 北京航空航天大学 Group behavior analysis method and device
CN110991375B (en) * 2019-12-10 2020-12-15 北京航空航天大学 A group behavior analysis method and device
CN111639668A (en) * 2020-04-17 2020-09-08 北京品恩科技股份有限公司 Crowd density detection method based on deep learning
CN111611878A (en) * 2020-04-30 2020-09-01 杭州电子科技大学 A Video Image-Based Approach for Crowd Counting and Future Traffic Prediction
CN111709300A (en) * 2020-05-20 2020-09-25 杭州电子科技大学 Crowd Counting Method Based on Video Image
CN111710009A (en) * 2020-05-29 2020-09-25 北京百度网讯科技有限公司 Generation method, device, electronic device and storage medium of human flow density
CN111652152A (en) * 2020-06-04 2020-09-11 上海眼控科技股份有限公司 Crowd density detection method and device, computer equipment and storage medium
CN112001274A (en) * 2020-08-06 2020-11-27 腾讯科技(深圳)有限公司 Crowd density determination method, device, storage medium and processor
CN112001274B (en) * 2020-08-06 2023-11-17 腾讯科技(深圳)有限公司 Crowd density determining method, device, storage medium and processor
CN112101195B (en) * 2020-09-14 2024-04-26 腾讯科技(深圳)有限公司 Crowd density estimation method, device, computer equipment and storage medium
CN112101195A (en) * 2020-09-14 2020-12-18 腾讯科技(深圳)有限公司 Crowd density estimation method and device, computer equipment and storage medium
CN112101455A (en) * 2020-09-15 2020-12-18 重庆市农业科学院 Tea lesser leafhopper identification and counting method based on convolutional neural network
CN112101455B (en) * 2020-09-15 2022-08-09 重庆市农业科学院 Tea lesser leafhopper identification and counting method based on convolutional neural network
CN112101214B (en) * 2020-09-15 2022-08-26 重庆市农业科学院 Network structure for rapidly counting tea plant bugs based on thermodynamic diagrams
CN115661491A (en) * 2020-09-15 2023-01-31 重庆市农业科学院 Monitoring method for pest control in tea tree planting
CN112101214A (en) * 2020-09-15 2020-12-18 重庆市农业科学院 A heatmap-based fast-counting network structure of the tea net bug
CN112232333A (en) * 2020-12-18 2021-01-15 南京信息工程大学 Real-time passenger flow thermodynamic diagram generation method in subway station
CN113158780A (en) * 2021-03-09 2021-07-23 中国科学院深圳先进技术研究院 Regional crowd density estimation method, electronic device and storage medium
WO2022188030A1 (en) * 2021-03-09 2022-09-15 中国科学院深圳先进技术研究院 Crowd density estimation method, electronic device and storage medium
CN113158780B (en) * 2021-03-09 2023-10-27 中国科学院深圳先进技术研究院 Regional crowd density estimation method, electronic equipment and storage media
CN113052827A (en) * 2021-03-30 2021-06-29 齐鲁工业大学 Crowd counting method and system based on multi-branch expansion convolutional neural network
CN115083112A (en) * 2022-08-22 2022-09-20 枫树谷(成都)科技有限责任公司 Intelligent early warning emergency management system and deployment method thereof

Similar Documents

Publication Publication Date Title
CN109815867A (en) A kind of crowd density estimation and people flow rate statistical method
CN113496217B (en) Face micro-expression recognition method in video image sequence
Khalid et al. DFGNN: An interpretable and generalized graph neural network for deepfakes detection
Reddy et al. Facial expression recognition in the wild, by fusion of deep learnt and hand-crafted features
CN112766159A (en) Cross-database micro-expression identification method based on multi-feature fusion
Guo et al. Facial expression recognition: a review
CN108268859A (en) A kind of facial expression recognizing method based on deep learning
CN110020606A (en) A kind of crowd density estimation method based on multiple dimensioned convolutional neural networks
CN108830262A (en) Multi-angle human face expression recognition method under natural conditions
CN108491835A (en) Binary channels convolutional neural networks towards human facial expression recognition
Benkaddour CNN based features extraction for age estimation and gender classification
CN106778506A (en) A kind of expression recognition method for merging depth image and multi-channel feature
CN113963032A (en) A Siamese Network Structure Target Tracking Method Fusion Target Re-identification
CN108830237B (en) Facial expression recognition method
CN113158943A (en) Cross-domain infrared target detection method
CN112861605A (en) Multi-person gait recognition method based on space-time mixed characteristics
Gammulle et al. Coupled generative adversarial network for continuous fine-grained action segmentation
CN115482595B (en) Specific character visual sense counterfeiting detection and identification method based on semantic segmentation
CN108960076A (en) Ear recognition and tracking based on convolutional neural networks
CN108846344A (en) A kind of pedestrian's posture multiple features INTELLIGENT IDENTIFICATION method merging deep learning
Jayabharathi et al. A comprehensive analysis on face recognition using various deep learning techniques
Fan et al. Multi-modality recognition of human face and ear based on deep learning
CN117274885B (en) Face fake video detection method
Dixit et al. Face recognition using approximated bezier curve and supervised learning approach
Sadeq et al. Comparison Between Face and Gait Human Recognition Using Enhanced Convolutional Neural Network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190528

WD01 Invention patent application deemed withdrawn after publication