Disclosure of Invention
The invention provides an intelligent recommendation method and system for interactive elevator advertisements, which are used for solving the problem that the prior art lacks of carrying out association analysis on interactive behavior data of passengers and advertisements and does not maximize advertisement delivery benefits.
On the premise of having a touch type advertisement display screen, the intelligent recommendation method and system for the elevator advertisement are combined with passenger attribute (system initiative analysis) and interaction information (interaction behaviors such as sliding the display screen by passengers, clicking the advertisement and the like, and passenger initiative feedback information), are further explored on the basis of the existing research, and the intelligent recommendation method and system for the elevator advertisement are designed, have certain robustness and high accuracy, are beneficial to users to obtain better advertisement service, and realize maximized advertisement putting benefit.
The technical scheme adopted by the invention is that the intelligent recommending method for the interactive elevator advertisement comprises the following steps:
passenger information is collected in the elevator through the monitoring camera, and passenger interaction scene information is collected through the touch advertisement screen;
analyzing the passenger information based on a passenger attribute identification algorithm;
storing the interaction scenario information into a database module, and constructing an advertisement information set and an interaction scenario database according to the interaction scenario information;
Based on an interaction scene database, intelligently recommending advertisements to passengers based on a scene-aware FP-growth recommendation method;
obtaining relevant advertisements interested by target passengers in the whole elevator cluster, and carrying out local correction on the results;
Searching for a target passenger and recommending an advertisement to the target passenger.
As a preferred mode of the intelligent recommendation method for the interactive elevator advertisement, the method for constructing the advertisement information set and the interactive scene database according to the interactive scene information comprises the following steps:
Constructing an advertisement information set, wherein S= { S 1,s2,...,sm }, S i={k1,k2,ki,....Km},1≤i≤m,si is a sequence of advertisements k i focused in a t 1 time period of a target passenger, the beginning time of the t 1 time period is when the passenger clicks an advertisement interface, and the ending time is when the passenger leaves an elevator;
An interaction scenario database is constructed, namely D= { D 1,d2,...,dn }, wherein D i={[x,y]:s1,s2,...},1≤i≤n,di represents specific interaction scenario data, namely a thing database formed by target passengers and advertisement information sets, wherein [ x, y ] represents target passenger attributes, x is gender attribute, and y is age attribute.
As a preferable mode of the intelligent recommendation method for the advertisement of the interactive elevator, the time threshold t 2、t3;t2 is increased in the process of constructing the advertisement information set, the camera continuously loses passenger information to indicate that passengers leave the elevator, the advertisement screen automatically exits from the interactive interface until the next click is received, the construction of the advertisement information set is restarted, if the time period from the time when the passengers click the advertisement k i to the time when the advertisement is switched is greater than t 3, k i is added to s i, and otherwise, no addition is carried out.
As a preferable mode of the intelligent recommendation method for the interactive elevator advertisement, the method for intelligently recommending the advertisement to the passenger based on the FP-growth recommendation algorithm of the context awareness based on the interactive context database comprises the following steps:
The method comprises the steps of establishing a head list, namely, the number of each k i in an advertisement information set S, defining the minimum support degree as T MS,TMS E (0, 1), scanning the advertisement information set S to obtain the count of all frequent 1 item sets (k 1,k2,ki) C k2,Cki..a.). Then deleting items with support below the threshold T MS, placing frequent 1 item sets into the item header table, and arranging in descending order of support;
Constructing an FP-tree, scanning an advertisement information set, eliminating the read original data without frequent 1 item set, arranging the read original data in descending order according to the support degree, reading the ordered data set, inserting the ordered data set into the FP-tree according to the ordered sequence, wherein the node with the front ordering is a root node and the node with the back ordering is a child node, adding 1 to the corresponding count if the common root node exists, and connecting the node corresponding to the head list with the new node through a node linked list if the new node exists until all the data are inserted into the FP-tree;
The method comprises the steps of excavating an FP-tree, sequentially and upwards finding a condition mode base corresponding to an item of the item head table from the bottom item of the item head table, recursively excavating from the condition mode base to obtain a frequent item set of the item head table, defining the item number N FP of the frequent item set, and returning only the frequent item set meeting the item number requirement;
and defining a global weighting parameter, and carrying out batch normalization on the occurrence times of the specific items of the maximum frequent item set to serve as the global weighting parameter corresponding to each specific item.
As a preferred mode of the intelligent recommendation method for the interactive elevator advertisement, the method for locally correcting the result comprises the following steps:
clustering the interactive data scene information of specific points based on a K-means algorithm, wherein the size of the clusters is equal to the attribute category of the passengers, and carrying out batch normalization on the advertisement occurrence times in each cluster;
And defining an advertisement attention threshold T P, reserving advertisement items with scores higher than T P, and generating a new advertisement catalogue.
As a preferred mode of the intelligent recommendation method for the interactive elevator advertisement, the method for searching the target passengers comprises the following steps:
After a passenger enters an elevator, detecting the position of the passenger based on a deep learning algorithm, detecting the position of the human eyes based on an opencv human eye detection model (haarcascade _eye.xml), performing template matching according to a human eye state library, and performing human eye attention position detection on the passenger, wherein the human eye state library comprises 5 types of forward, left, right, upper and lower attention, and when the passenger faces the advertisement screen, the human eye state is considered to be forward due to the fact that the camera is positioned above the advertisement screen, and establishing a target passenger model:
F(x)=αR1(x)+βR2(x)
Wherein x is a specific passenger, R 1 (x) is the area of a passenger detection frame, R 2 (x) is the confidence level of the passenger facing the right front, alpha and beta are weight factors of corresponding factors respectively, F (x) is the final score, and the passengers are ranked according to the weight factors, the priority of the passenger is confirmed, the priority of the passenger is higher and is the main target passenger, and the advertisement catalogue is recommended based on the attribute of the passenger.
As a preferred mode of the intelligent interactive elevator advertisement recommending method, the method for recommending advertisements to the target passengers comprises the following steps:
generating a target passenger advertisement catalog based on a scene-aware FP-growth recommendation algorithm;
The advertisement catalogue of the target passenger x is played, the camera still detects the target passenger x, if no other target passenger exists, the content in the advertisement catalogue is played in turn, and if other target passenger x+i exists, the advertisement catalogue corresponding to x+i is played;
The advertisement catalogue of the target passenger x is not completely played, the target passenger x gets out of the ladder, if no other target passenger exists, the advertisement screen resumes default playing, and if other target passenger x+i exists, the advertisement catalogue corresponding to x+i is sequentially played according to the priority.
The invention also provides an intelligent interactive elevator advertisement recommendation system, which comprises:
the data center control center is responsible for calculating, storing and transmitting the data information of the whole elevator cluster;
the information acquisition module is used for acquiring attribute information and interaction information of passengers in the elevator;
the passenger attribute analysis module is used for obtaining passenger attribute information based on a deep learning algorithm;
The database module is used for storing the scene information of the interaction between the passenger and the touch advertisement screen in a data form;
The global recommendation module analyzes database information based on a scene-aware FP-growth recommendation algorithm and intelligently recommends advertisements to passengers based on the data of the whole elevator cluster;
the local correction module is used for further analyzing specific point location information based on K-means to make comprehensive judgment on the basis of global recommendation.
The intelligent recommendation method and system for the elevator advertisement have the advantages that on the premise of the touch type advertisement display screen, the intelligent recommendation method and system for the elevator advertisement are combined with passenger attributes and interaction information, are further explored on the basis of existing researches, have certain robustness and high accuracy, are beneficial to users to obtain better advertisement service, and achieve maximum advertisement putting benefit.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings, but embodiments of the present invention are not limited thereto.
Example 1:
referring to fig. 1, the embodiment discloses an intelligent recommendation method for an interactive elevator advertisement, which comprises the following steps:
and S1, collecting passenger information in the elevator through a monitoring camera, and collecting passenger interaction scene information through a touch advertisement screen.
The elevator environment is that an elevator touch advertisement screen is arranged in an elevator and on the left side or the right side of the same side as an elevator door, one side of a key is avoided, the elevator passengers face the elevator, a monitoring camera is positioned at the top of a car and right above the advertisement screen, the whole elevator area can be monitored, and passengers in front of the advertisement screen can be accurately analyzed.
The touch advertisement screen is provided with a main playing window and an advertisement catalog window, advertisements can be daily rolled and played in the main playing window, a rolling bar can be slid in the advertisement catalog window, any interested advertisement can be clicked, and if the currently played advertisement is the last advertisement in the advertisement catalog, the advertisement screen can be used for broadcasting in turn.
The information acquisition is divided into two parts, wherein one part is used for acquiring passenger information through the monitoring camera, and the other part is used for acquiring passenger interaction scene information through the touch advertisement screen. The passenger information is fed back to S2, and the interaction scenario information is fed back to S3.
And S2, analyzing the passenger information based on a passenger attribute identification algorithm.
The passenger information is analyzed based on the passenger attribute recognition algorithm, and the embodiment only feeds back and analyzes the sex information and the age information of the passenger. In addition, it is also possible to consider adding attribute information such as the height of the passenger, clothing, whether to wear the clothing, and the like.
Passenger attribute recognition is paid attention to in the field of video monitoring, and in order to improve accuracy of passenger attribute recognition, a deep learning method is adopted. The present embodiment identifies the gender, age of the passenger based on the attribute-localization model (Attribute Localization Module, ALM). The model does not need additional region marking (realized by STN (Spatial Transformer Networks)), can perform end-to-end training under multi-scale depth supervision, and is obviously superior to most of the existing methods in three pedestrian attribute data sets of PETA, RAP and PA-100K, wherein the Females (sexes: males, females) accuracy in the RAP data set reaches 96%, and the AgeLess accuracy reaches 88%, which are superior to the baseline model of the RAP data set. The RAP data set has 41585 pedestrian samples, contains 72 attributes, is collected from 26 cameras monitored indoors, has resolution ranging from 36×92 to 344×554, and has a certain similarity with an elevator scene.
And S3, storing the interaction scenario information into a database module, and constructing an advertisement information set and an interaction scenario database according to the interaction scenario information.
The passenger interacts with the advertising screen, selects the advertisement of interest through the catalog window, clicks the jump to obtain advertisement details. The recommendation system stores the passenger attributes and the interaction scenario information in the database module. The interaction scenario information refers to a sequence of advertisements that the targeted passenger is interested in over a period of time. The specific process is as follows.
Constructing an advertisement information set, wherein s= { S 1,s2,...,sm }, S i={k1,k2,ki,....Km},1≤i≤m,si is a sequence of advertisements k i focused by a target passenger in a t 1 time period, the beginning time of the t 1 time period is the time period when the passenger clicks an advertisement interface, the ending time of the t 1 time period is the time period when the passenger leaves an elevator, the continuous loss of the passenger information by a camera in an increasing time threshold t 2、t3;t2 time period indicates that the passenger leaves the elevator, the advertisement screen automatically exits from the interactive interface until the next click is received, the advertisement information set is restarted, and if the time period from the time when the passenger clicks the advertisement k i to the time when the advertisement k 3 is greater than t 3, k i is added into S i, otherwise, the advertisement screen is not added.
An interaction scenario database is constructed, namely D= { D 1,d2,...,dn }, wherein D i={[x,y]:s1,s2,...},1≤i≤n,di represents specific interaction scenario data, namely a thing database formed by target passengers and advertisement information sets, wherein [ x, y ] represents target passenger attributes, x is gender attribute, and y is age attribute. In addition, other attributes such as height, clothes, whether to wear the ornaments and the like can also be added.
S4, based on the interaction scene database, intelligently recommending advertisements to passengers based on a scene-aware FP-growth recommendation algorithm.
The FP-growth is an algorithm for mining data association rules, effectively compresses a database into a data structure with a small storage space, overcomes the defect of multiple-scanning the database in the classical algorithm Aprior, only needs to scan the database twice, and converts the problem of finding a long frequent pattern into a strategy of recursion pattern growth, thereby avoiding generating a large number of candidate sets and greatly reducing the time complexity of the algorithm.
The specific process is as follows:
The method comprises the steps of establishing a head list, namely, the number of each k i in an advertisement information set S, defining the minimum support degree as T MS,TMS E (0, 1), scanning the advertisement information set S to obtain the count of all frequent 1 item sets (k 1,k2,ki) C k2,Cki..a.). Then deleting items with support below the threshold T MS, placing frequent 1 item sets into the item header table, and arranging in descending order of support;
Constructing an FP-tree, scanning an advertisement information set, eliminating the read original data without frequent 1 item set, arranging the read original data in descending order according to the support degree, reading the ordered data set, inserting the ordered data set into the FP-tree according to the ordered sequence, wherein the node with the front ordering is a root node and the node with the back ordering is a child node, adding 1 to the corresponding count if the common root node exists, and connecting the node corresponding to the head list with the new node through a node linked list if the new node exists until all the data are inserted into the FP-tree;
The method comprises the steps of excavating an FP-tree, sequentially and upwards finding a condition mode base corresponding to an item of the item head table from the bottom item of the item head table, recursively excavating from the condition mode base to obtain a frequent item set of the item head table, defining the item number N FP of the frequent item set, and returning only the frequent item set meeting the item number requirement;
and defining a global weighting parameter, and carrying out batch normalization on the occurrence times of the specific items of the maximum frequent item set to serve as the global weighting parameter corresponding to each specific item.
S5, obtaining relevant advertisements interested by target passengers in the whole elevator cluster, and carrying out local correction on the results.
Relevant advertisements of interest to the target passengers in the whole elevator cluster are obtained from the global recommendation of S4, but each specific point should also take into account its own relative independence when recommending. Based on a K-means algorithm, clustering the interactive data scene information of specific points, wherein the size of the clusters is equal to the attribute category of passengers, and carrying out batch normalization on the advertisement occurrence times in each cluster. And (3) weighting and reordering similar commodities in the clustering result by combining the global recommendation of the S4. An advertisement attention threshold T P is defined, advertisement items with scores higher than T P are reserved, and a new advertisement catalog is generated.
And S6, searching for the target passengers and recommending advertisements to the target passengers.
After a passenger enters an elevator, detecting the position of the passenger based on a deep learning algorithm, detecting the position of a human eye based on an opencv eye detection model (haarcascade _eye.xml), and performing template matching according to a human eye state library to detect the attention position of the passenger, wherein the human eye state library comprises 5 types of attention to the front, left, right, upper and lower directions, and when the passenger faces the advertisement screen, the human eye state is considered to be the front, and a target passenger model is established because the camera is positioned above the advertisement screen:
F(x)=αR1(x)+βR2(x)
Wherein x is a specific passenger, R 1 (x) is the area of a passenger detection frame, R 2 (x) is the confidence level of the passenger facing the right front, alpha and beta are weight factors of corresponding factors respectively, F (x) is the final score, and the passengers are ranked according to the weight factors, the priority of the passenger is confirmed, the priority of the passenger is higher and is the main target passenger, and the advertisement catalogue is recommended based on the attribute of the passenger.
The method for recommending advertisements to the target passengers comprises the following steps:
And generating a target passenger advertisement catalog based on a scene-aware FP-growth recommendation algorithm. And after the advertisement catalogue of the target passenger x is played, the camera still detects the target passenger x, if no other target passenger exists, the contents in the advertisement catalogue are played in turn, and if other target passenger x+i exists, the advertisement catalogue corresponding to x+i is played. The advertisement catalogue of the target passenger x is not completely played, the target passenger x gets out of the ladder, if no other target passenger exists, the advertisement screen resumes default playing, and if other target passenger x+i exists, the advertisement catalogue corresponding to x+i is sequentially played according to the priority.
Example 2
Referring to fig. 2, the embodiment discloses an interactive elevator advertisement intelligent recommendation system, which includes:
the data center control center is responsible for calculating, storing and transmitting the data information of the whole elevator cluster;
the information acquisition module is used for acquiring attribute information and interaction information of passengers in the elevator;
the passenger attribute analysis module is used for obtaining passenger attribute information based on a deep learning algorithm;
The database module is used for storing the scene information of the interaction between the passenger and the touch advertisement screen in a data form;
The global recommendation module analyzes database information based on a scene-aware FP-growth recommendation algorithm and intelligently recommends advertisements to passengers based on the data of the whole elevator cluster;
the local correction module is used for further analyzing specific point location information based on K-means to make comprehensive judgment on the basis of global recommendation, so that advertisement recommendation is more accurate and efficient.
The foregoing embodiments are merely for illustrating the technical solution of the present invention, but not for limiting the same, and although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that modifications may be made to the technical solution described in the foregoing embodiments or equivalents may be substituted for parts of the technical features thereof, and such modifications or substitutions do not depart from the spirit and scope of the technical solution of the embodiments of the present invention in essence.