CN110377854A - User access activity information monitoring method and device, computer equipment - Google Patents

Abstract

The invention discloses a method and device for monitoring user access behavior information, and computer equipment, and relates to the technical field of web page processing. The monitoring system has a large volume, the pressure on the database and server is too large, the data query is difficult and the efficiency is low. Including sending a monitoring data acquisition request, and counting the web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the web server; / or webpage sharing data and/or webpage page data are classified and aggregated respectively, the data obtained after classification and aggregation is stored, and storage location information is generated; monitoring logs are generated according to user access behavior information and storage location information corresponding to the data. .

Description

User access behavior information monitoring method and device, computer equipment

technical field

The present invention relates to the technical field of web page processing, in particular to a method and device for monitoring user access behavior information, and computer equipment.

Background technique

With the continuous optimization of web technology, in order to monitor the status of the web page in real time, the traffic of the web page is generally monitored to determine the user's browsing situation. At present, user access behavior information is all the access behavior data generated by users browsing web pages. The existing web browsing monitoring only monitors data such as traffic pv, independent visitor uv, etc. The purpose of data monitoring and analysis of user behavior; on the other hand, the general monitoring system has a large volume, and the storage pressure on the database and web server is too large, which makes data query difficult and reduces the efficiency of monitoring data.

SUMMARY OF THE INVENTION

In view of this, the present invention provides a method and device for monitoring user access behavior information, and computer equipment, the main purpose of which is to solve the problem that the existing web browsing monitoring only monitors data such as visits pv, independent visitors uv, etc., which cannot be well satisfied. Business personnel analyze the purpose of user behavior through data monitoring, and the general monitoring system is large in size, the pressure on the database and server is too large, data query is difficult and the efficiency is low.

According to one aspect of the present invention, a method for monitoring user access behavior information is provided, comprising:

Send a monitoring data acquisition request, and count the web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the web server;

According to the data structure, the statistics of web page access data, and/or web page sharing data, and/or web page data are respectively classified and aggregated, and the web page access data, and/or web page sharing data, and/or web pages obtained after the classification and aggregation are aggregated. Store page data and generate storage location information;

The monitoring log is generated according to the webpage access data, and/or the webpage sharing data, and/or storage location information corresponding to the webpage page data.

Further, the sending of the monitoring data acquisition request, and the web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the statistics web server include:

When a page loading instruction is detected, a request for obtaining webpage access data is sent to the webpage server, and the webpage id, terminal device number, terminal device information, terminal location information, reading source information, sharing information returned by the webpage server are counted. Tier information; and/or,

When a webpage sharing instruction is detected, a webpage sharing data acquisition request is sent to the webpage server, the webpage id, terminal device number, and sharing destination information returned by the webpage server are counted, and the sharing level information of the webpage is analyzed. cumulative; and/or,

When a webpage page click instruction is detected, a webpage page data acquisition request is sent to the webpage server, and the webpage page click information returned by the webpage server is counted.

Further, when a webpage page click instruction is detected, a webpage page data acquisition request is sent to the webpage server, and statistics on webpage click information returned by the webpage server include:

When a webpage page click instruction is detected, a webpage page data acquisition request is sent to the webpage server, and a webpage page data acquisition request response is received, and the webpage page data acquisition request response carries webpage page element click information, webpage page browsing information Time accumulation information; according to the webpage page element click information and the webpage page browsing time accumulation information, the webpage page click information is counted.

Further, according to the data structure, the statistics of webpage access data, and/or webpage sharing data, and/or webpage page data are classified and aggregated respectively, and the webpage access data and/or webpage sharing data obtained after the classification and aggregation are aggregated. , and/or web page data, and generate storage location information including:

Analyze the statistics of web page access data, and/or web page sharing data, and/or the data structure of web page data;

When the parsed data structure is a simple type data structure, the web page access data, and/or the web page sharing data, and/or the web page data are aggregated and stored in containers with different storage capacities according to time-limited requirements to generate Storage location information, the simple type data structure is a data structure that only performs incremental changes in the amount of data; or,

When the parsed data structure is a complex type of data structure, the web page access data, and/or the web page sharing data, and/or the web page page data are filtered according to preset redundancy conditions, and the filtered web page is filtered. Access data, and/or web page sharing data, and/or web page data are cached according to user id, browsing id, and timestamp to generate storage location information. The complex type data structure is for processing data forms and data expressions. data structure.

Further, when the parsed data structure is a complex type data structure, the webpage access data, and/or the webpage sharing data, and/or the webpage page data are filtered according to preset redundancy conditions, Cache the filtered web page access data, and/or web page sharing data, and/or web page data according to the user id, browsing id, and timestamp, and generate storage location information including:

When the parsed data structure is a complex type of data structure, determine whether the webpage access data, and/or the webpage sharing data, and/or the webpage page data is expired data according to the user id, browsing id, and timestamp; If it is non-expired data, store the webpage access data, and/or the webpage sharing data, and/or the webpage page data respectively corresponding to the user id, the browsing id, and the timestamp In the cache location of , generate storage location information.

Further, after the monitoring log is generated according to the webpage access data, and/or the webpage sharing data, and/or the storage location information corresponding to the webpage page data, the method further includes:

Send a delayed message through the message queue, read the user access behavior information and delay time in the delayed message, and compare the timestamp of the delayed message with the timestamp corresponding to the cached user id and browsing id , if the timestamp corresponding to the cached user id and browsing id is smaller than the timestamp of the delayed message, it is determined that the user access behavior information is redundant data, if the timestamp corresponding to the cached user id and browsing id If the time stamp is greater than the time stamp of the delayed message, the user access behavior information is cached.

Further, when the parsed data structure is a simple type data structure, the web page access data, and/or the web page sharing data, and/or the web page data are aggregated and stored in different storage capacities according to time limit requirements. In the container of , before generating the storage location information, it also includes:

Configure a preset number of containers with different storage validity periods and different access durations. The storage validity period is determined in a manner of storage validity period=the most recent time required, and the access duration is determined in the manner of access duration=accuracy of statistics, so The setting method of the preset number is preset number=storage validity period/access duration.

According to another aspect of the present invention, a device for monitoring user access behavior information is provided, comprising:

A statistics module, used to send a monitoring data acquisition request, and to count web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the web server;

The storage module is used to store the statistics of webpage access data, and/or webpage sharing data, and/or webpage page data according to the data structure, respectively classify and aggregate the webpage access data obtained after classification and aggregation, and/or webpage sharing. data, and/or web page data, and generate storage location information;

A generating module, configured to generate a monitoring log according to the webpage access data, and/or the webpage sharing data, and/or storage location information corresponding to the webpage page data.

Further, the statistical module includes:

The first statistical unit is configured to send a request for obtaining webpage access data to the webpage server when a page loading instruction is detected, and count the webpage id, terminal device number, terminal device information, and terminal location returned by the webpage server information, reading source information, sharing tier information; and/or,

The second statistical unit is configured to send a webpage sharing data acquisition request to the webpage server when a webpage sharing instruction is detected, count the webpage id, terminal device number, and sharing destination information returned by the webpage server, and analyze all the sharing level information of the pages described above; and/or,

A third statistics unit, configured to send a request for obtaining web page data to the web server when a web page click instruction is detected, and to count the web page click information returned by the web server.

Further, the third statistical unit is specifically configured to send a web page data acquisition request to the web server when a web page click instruction is detected, and receive a web page data acquisition request response, the web page data acquisition The request response carries webpage element click information and webpage page browsing time accumulation information; the webpage page click information is counted according to the webpage element click information and the webpage page browsing time accumulation information.

Further, the storage module includes:

Parsing unit, used for parsing the statistics of webpage access data, and/or webpage sharing data, and/or the data structure of webpage page data;

The first storage unit is used to aggregate and store the web page access data, and/or the web page sharing data, and/or the web page data to different data structures according to time limit requirements when the parsed data structure is a simple type data structure. In the container of the storage capacity, the storage location information is generated, and the simple type data structure is a data structure that only performs incremental changes in the amount of data; or,

The second storage unit is configured to, when the parsed data structure is a complex type of data structure, perform processing on the webpage access data, and/or the webpage sharing data, and/or the webpage page data according to preset redundancy conditions Filter, cache the filtered web page access data, and/or web page sharing data, and/or web page data according to the user id, browsing id, and timestamp to generate storage location information, and the complex type data structure is a pair of data in the form of , Data structure for data expression processing.

Further, the second storage unit is specifically used for judging the webpage access data and/or the webpage sharing data according to the user id, browsing id and timestamp when the parsed data structure is a complex type data structure, and/or whether the web page data is expired data; if it is non-expired data, the web page access data, and/or the web page sharing data, and/or the web page data are respectively stored in the In the cache location corresponding to the user id, the browsing id, and the timestamp, storage location information is generated.

Further, the device also includes:

A determination module, configured to send a delayed message through a message queue, read user access behavior information and delay time in the delayed message, and correspond the timestamp of the delayed message with the cached user id and browsing id If the timestamp corresponding to the cached user id and browsing id is smaller than the timestamp of the delayed message, it is determined that the user access behavior information is redundant data. If the cached user id, browsing id If the timestamp corresponding to the id is greater than the timestamp of the delayed message, the user access behavior information is cached.

Further, the device also includes:

A configuration module, used to configure a preset number of containers with different storage validity periods and different access durations, the storage validity period is determined by the storage validity period=the most recent time required, and the access duration is determined by the access duration=statistics The preset number is set in the following manner: preset number=storage validity period/access duration.

According to another aspect of the present invention, a storage medium is provided, wherein the storage medium stores at least one executable instruction, and the executable instruction enables a processor to perform operations corresponding to the foregoing method for monitoring user access behavior information.

According to yet another aspect of the present invention, a computer device is provided, comprising: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface can communicate with each other through the communication bus. communication;

The memory is used for storing at least one executable instruction, and the executable instruction enables the processor to perform operations corresponding to the above-mentioned method for monitoring user access behavior information.

With the above technical solutions, the technical solutions provided by the embodiments of the present invention have at least the following advantages:

The invention provides a method and device for monitoring user access behavior information, and computer equipment, which is different from the prior art web browsing monitoring only by monitoring data such as visits pv, independent visitors uv and the like, and the monitoring system is relatively large, and the database and Compared with the excessive pressure on the server, the embodiment of the present invention collects statistics on the web page access data, and/or web page sharing data, and/or web page page data returned by the web page server, and collects statistics on the web page access data, and/or Web page sharing data and/or web page data are classified and aggregated, respectively, into corresponding storage locations, and storage location information is generated, and monitoring logs are generated according to the storage location information. The location information directly retrieves the data that needs to be queried, which reduces the storage pressure on the database and the server, so that when querying the monitoring data, it can be searched according to the data stored in the monitoring server, and the monitoring efficiency of the user's access behavior is improved.

The above description is only an overview of the technical solutions of the present invention, in order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand , the following specific embodiments of the present invention are given.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

1 shows a flowchart of a method for monitoring user access behavior information provided by an embodiment of the present invention;

2 shows a flowchart of another method for monitoring user access behavior information provided by an embodiment of the present invention;

3 shows a block diagram of a composition of an apparatus for monitoring user access behavior information provided by an embodiment of the present invention;

FIG. 4 shows a block diagram of the composition of another device for monitoring user access behavior information provided by an embodiment of the present invention;

FIG. 5 shows a schematic structural diagram of a computer device provided by an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

An embodiment of the present invention provides a method for monitoring user access behavior information. As shown in FIG. 1 , the method includes:

101. Send a monitoring data acquisition request, and count webpage access data, and/or webpage sharing data, and/or webpage page data carried in the response to the monitoring data acquisition request returned by the webpage server.

For the embodiment of the present invention, the user access behavior information is all the access behavior data generated by the user by browsing the web page. Generally, the user accesses the information in the web page by clicking the link in the web page, and the user sends the web page to the server through the terminal. The browsing request achieves the purpose of obtaining web page information. During this process, the user generates access behavior by browsing the web page. User access behavior information includes web page access data, and/or web page sharing data, and/or web page data, and the web page access data includes pv data, uv data, such as ten-minute visits, hourly visits, daily visits Page sharing data includes hourly sharing volume, daily sharing volume, total sharing volume, sharing destination, dissemination level, etc. The dissemination level corresponds to each sharing level The amount of access pv and uv, the webpage page data includes page access depth information, page access duration, page churn rate, page element clicks, etc., which are not specifically limited in the embodiment of the present invention.

The webpage server is a server that receives a webpage access request, and may be a cloud or a local server, which is not specifically limited in the embodiment of the present invention. In this embodiment of the present invention, in order to monitor the user access behavior information, the current server sends a webpage access data acquisition request to the webpage server, and counts the webpage access data and/or webpage according to the specific data carried in the response to the webpage access data acquisition request. Share data, and/or web page data. The webpage access data acquisition request is sent by the current server, and the request carries specific data to be acquired, such as the number of users accessing a certain website.

It should be noted that the statistics of webpage access data, and/or webpage sharing data, and/or webpage page data may include the calculation of pv data, uv data and other data. Calculation of data such as total amount, sharing destination, and dissemination level, and calculation of data such as page access depth information, page access duration, page churn rate, and page element clicks. The user access behavior information in the embodiment of the present invention is stored in the database in the server so as to be directly retrieved.

102. According to the data structure, the statistics of webpage access data, and/or webpage sharing data, and/or webpage page data are respectively classified and aggregated, and the webpage access data and/or webpage sharing data obtained after the classification and aggregation are aggregated. or web page data for storage, and generate storage location information.

Wherein, the classification aggregation is to perform different classification processing on webpage access data, and/or webpage sharing data, and/or webpage page data according to different business requirements, for example, classifying and aggregating the number of visits every 10 minutes, according to The city level classifies and aggregates the traffic, which is not specifically limited in this embodiment of the present invention. In addition, in order to facilitate the monitoring of the classified and aggregated data, the classified and aggregated webpage access data, and/or webpage sharing data, and/or webpage page data are respectively stored in different storage locations, and generated according to the storage locations. The storage location information corresponding to the webpage access data, and/or the webpage sharing data, and/or the webpage page data respectively.

103. Generate a monitoring log according to the webpage access data, and/or the webpage sharing data, and/or storage location information corresponding to the webpage page data.

Wherein, the monitoring log records corresponding web page access data, and/or web page sharing data, and/or web page data according to different storage location information. The amount of data that users visit webpage a in minutes.

The invention provides a method for monitoring user access behavior information, which is different from the prior art web browsing monitoring only by monitoring data such as the number of visits pv, independent visitors uv and the like, and the monitoring system has a large volume, and the pressure on the database and the server is too large. In contrast, the embodiment of the present invention collects statistics on webpage access data, and/or webpage sharing data, and/or webpage page data returned by the webpage server, and collects statistics on webpage access data, and/or webpage sharing data, and / or web page data is classified and aggregated, and the method is divided into the corresponding storage location, and the storage location information is generated, and the monitoring log is generated according to the storage location information, so as to realize the direct retrieval through the storage location information in the monitoring log when querying the monitoring data The data that needs to be queried reduces the storage pressure of the database and the server, so that when querying the monitoring data, it is searched according to the data stored in the monitoring server, and the monitoring efficiency of the user's access behavior is improved.

An embodiment of the present invention provides another method for monitoring user access behavior information. As shown in FIG. 2 , the method includes:

201a, when a page loading instruction is detected, send a webpage access data acquisition request to the webpage server, and count the webpage id, terminal device number, terminal device information, terminal location information, and reading source information returned by the webpage server , share level information.

For the embodiment of the present invention, the client sends a page loading instruction to both the web server and the current server, so that the current server monitors the user's access behavior. When the current server detects the page loading instruction sent by the user in the client When the web page server processes the web page loading instruction and feeds back web page data to the client, the current client sends a web page access data acquisition request to the web server, and the web page access data acquisition request carries web page loading information, thereby According to the returned webpage loading request response statistics, the statistical objects include webpage id, terminal device number, terminal device information, terminal location information, reading source information, and sharing level information.

It should be noted that the statistics in step 201a are calculating the number of web page IDs according to time intervals, calculating the number of terminal equipment numbers according to the webpages browsed, calculating terminal equipment information according to the content of the browsed webpages, that is, the number of terminal equipment names, The number of terminal location information is calculated according to the webpages browsed, the number of sources of webpage content is calculated according to the webpages browsed, the number of layers shared by the visited webpage is calculated, etc., which are not specifically limited in this embodiment of the present invention.

Further, in step 201b parallel to step 201a, when a webpage sharing instruction is detected, send a webpage sharing data acquisition request to the webpage server, and count the webpage id, terminal device number, and sharing destination information returned by the webpage server. , and accumulate the sharing level information of the webpage.

For the embodiment of the present invention, the client sends a page sharing instruction to both the web server and the current server, so that the current server monitors the user's access behavior. When the current server detects the page sharing instruction sent by the user in the client When the web page server processes the web page sharing instruction and feeds back web page data to the client, the current client sends a web page sharing data acquisition request to the web server, and the web page sharing data acquisition request carries the web page sharing information, thereby According to the returned webpage sharing request response statistics, the statistical objects include webpage ID, terminal device number, sharing destination information, and the sharing level information of the webpage is accumulated. The sharing level information of a web page is the number of communication levels that the web page is shared by users. For example, after web page a is shared by user 1, user 2 browses and shares it, and user 3 browses the web page analyzed by user 2 and shares it. The calculated number of levels to level 2.

It should be noted that the statistics in step 201b include calculating the number of web page IDs sharing the web page, calculating the number of terminal device numbers sharing the web page, and calculating the number of analysis destination information shared by the web page.

Further, in step 201c parallel to step 201a, when a webpage page click instruction is detected, a webpage page data acquisition request is sent to the webpage server, and the webpage page click information returned by the webpage server is counted.

For the embodiment of the present invention, the client sends a webpage page click instruction to both the webpage server and the current server, so that the current server monitors the user's access behavior. When the current server detects the webpage sent by the user in the client When the command is clicked, the web server processes the click command of the web page and feeds back the web page data to the client. Therefore, the current client sends a web page data acquisition request to the web server, and the web page data acquisition request carries the web page. Therefore, according to the returned web page request response statistics, the statistical object is web page click information, such as clicks on various elements of the web page.

For this embodiment of the present invention, step 201c may specifically be: when a webpage click instruction is detected, send a webpage data acquisition request to the webpage server, and receive a webpage data acquisition request response, the webpage data acquisition request The response carries webpage element click information and webpage page browsing time accumulation information; webpage page click information is counted according to the webpage element click information and the webpage page browsing time accumulation information.

For the embodiment of the present invention, for the statistics of web page data, when it is detected that the client triggers a web page click instruction, a web page data acquisition request is sent to the web server, so as to collect the required page information, including web page element clicks information, accumulated information of web page browsing time, etc. For application scenarios under different systems, data collection methods for web pages are different. The embodiment of the present invention includes two different statistical methods. When a click event is triggered for an element, it is first determined whether the element has been clicked, and if so, only the click needs to be processed. The number of times, otherwise get the clicked element id, name, type, description, store them in the object respectively, and put them in the corresponding page object. Among them, the trading platform and browser under the ios system judge whether it is the first page and whether it is the first time to enter this page when the user enters the page. If not, record the timestamp of entering this page, minus the above The time stamp of a page leaving, find the time difference, and add it to the stay time of the previous web page as the cumulative information of the page browsing time. If it is not the first time, it will not be accumulated. In addition, in order to monitor the webpage software of this scenario, first obtain user information, obtain the information, and store it in the object of the whole week. Every time you enter the page or switch pages, the object data of the whole week is sent. If the request is sent when the visibility state is visible, the current timestamp is obtained, the timestamp of the last request is subtracted, and the time difference is accumulated in the stay time of the previous page, which is used as the accumulated information of the page browsing time. Further, by detecting the visibilitychange event, determine the visibilitystate state. When it is visible, the page is in the browsing state. When it is hidden, the page is hidden and not in the browsing state. Make sure that the visibilitychange is only executed once, and the page stay time will appear when executed multiple times. It is accumulated on the page that was hidden for the first time, and it will not appear when executed once, so as to monitor whether the page has been entered, and determine whether the time and elements are accumulated in the corresponding page when entering the page, if so, click on the element and determine whether it has been clicked. Element, if so, accumulate the number of clicks in the corresponding element object. If the element has not been clicked, add the object in the corresponding field of the global object, and obtain the information that needs to be collected for the clicked element, and place it in the object. If it does not enter the page If the time and elements are accumulated in the corresponding page, no processing is performed, only the page stay time is calculated and stored, and when the monitoring does not enter the page, an object is added to the global object storage page field, and then it is judged whether to click on the page element, If there is no click, only the dwell time is processed. If the page element is clicked, it is judged again whether the element has been clicked. In addition, due to the possibility of skipping page browsing, or returning to continue browsing, the id of the currently entered page must be recorded, or the number of items stored in order to accumulate and add the information in the page. When sending requests in rotation, Record the time stamp sent, and bring the object of the whole week, because the user does not exit according to the normal procedure and cannot obtain the data, so only the left webpage has errors, and the error is very small. For transaction receipts and browsers under the Android system, after entering the page event, first obtain user information and activity information, store them in the global object, and record the id of the current page to determine whether it is the entered page, and if so, determine whether Whether to click on the element, if so, judge whether the element has been clicked. If the number of clicks is accumulated, if the element has not been clicked, a new object is added to the corresponding field in the corresponding global object, and the information of the clicked element is collected and placed in this object. If the element has not been clicked, only the dwell time of the page is processed and accumulated. If the page is not entered, a new piece of data is added to the global object to store the page information, and then it is judged whether the element is clicked. If so, it is judged whether the clicked element has been clicked. If so, you need to accumulate the number of clicks. If there is no click, collect the click element information and store it in the object, and put the object in the field corresponding to the global object. If there is no click element, you only need to assign the page dwell time. In addition, after recording the id of the current page, it is determined whether there is a trigger event within 60 seconds. If there is a user browsing, no processing is performed. If not, the default user does not continue to browse the page, and the rotation training is cleared to send the interface request.

202. Analyze the statistics of webpage access data, and/or webpage sharing data, and/or a data structure of webpage page data.

For the embodiments of the present invention, in order to facilitate the processing of a large amount of data, the web page access data, and/or the web page sharing data, and/or the data structure of the web page page data are parsed. Wherein, the data structure includes a simple type data structure and a complex type data structure, and the simple type data structure is that the simple type data structure is a data structure that only needs to perform incremental changes in the amount of data, that is, a data structure that only needs to perform simple incremental changes, for example Single-level structure data, pv, uv, total share, etc., multi-level structure data regional access, dissemination level, etc.; complex type data structure is the data structure for processing data form and data expression, that is, it needs to be processed The data structure, such as statistics of visits at a certain time interval, page visit duration, page visit depth, etc.

It should be noted that, the parsing method specifically divides the data structure according to whether the acquired data needs to be processed, which is not specifically limited in the embodiment of the present invention.

203a. When the parsed data structure is a simple type data structure, the webpage access data, and/or the webpage sharing data, and/or the webpage page data are aggregated and stored in containers of different storage capacities according to time limit requirements to generate storage location information.

For the embodiment of the present invention, in order to prepare for aggregated storage of simple data structures, aggregated storage of webpage access data, and/or webpage sharing data, and/or webpage page data is performed according to time limit requirements. The time limit requirement may be daily, weekly, etc., which is not specifically limited in the embodiment of the present invention. The aggregation of data of simple types of data structures is incremental calculation according to different stages, and stored in containers with different storage capacities respectively, and divides the dimensions of webpage access data, and/or webpage sharing data, and/or webpage page data After that, you can make increments. For example, single-level data, such as the total amount of PV, is to increase the number of visits to the specified page, and multi-level data, such as the daily volume of PV, is to increase the number of visits of the specified page on the specified date. It is then stored through different storage containers.

Further, before step 203a, the embodiment of the present invention further includes: configuring a preset number of containers with different storage validity periods and different access durations. The determination method of the duration is access duration=accuracy of statistics, and the setting method of the preset number is preset number=storage validity period/access duration.

For example, configure 20 containers, each container represents the number of visits within 30 consecutive seconds, and each container has a validity period of 10 minutes. When the validity period expires, the traffic in the container will be automatically cleared. When a h5 page is accessed, according to Calculate the current system time, calculate the current corresponding container number, and add +1 to the number of visits in the container with the corresponding number.

It should be noted that, using the data stored in the storage container, when querying, the number of visits in each container can be queried and added. The relevant formula is: the validity period of the container = the most recent time required, such as 10 minutes; Corresponding access duration = precision of statistics, that is, the deviation value of time. The number of containers = the validity period of the container/the access duration corresponding to the container; the container number corresponding to the current time = (current timestamp/accuracy of statistics)/(validity period of the container/accuracy of statistics).

For example, the number of visitors (uv) statistics of the h5 page No. 001 on 2018/11/11: a When the h5 page is loaded, it will notify the server No. 001 to be accessed by the user Zhang San; b The server queries the records in the cache database, Determine whether Zhang San has visited No.001; c If he has visited, no uv record will be performed; d If he has not visited, then according to the current server date, such as 2018/11/11, make No.001 in the cache database in 2018 /11/11's uv number is incremented by 1; e adds Zhang San to the cache database to record that he has visited No.001; f saves No.001's uv number on 2018/11/11 to the database in an asynchronous manner .

203b, when the parsed data structure is a complex type data structure, filter the webpage access data, and/or the webpage sharing data, and/or the webpage page data according to preset redundancy conditions, and filter the filtered data. The webpage access data, and/or webpage sharing data, and/or webpage page data are cached according to the user id, browsing id, and timestamp to generate storage location information.

For the embodiment of the present invention, in order to avoid data redundancy caused by a large number of repeated data during data storage, it is necessary to filter the data by using a preset redundancy condition, and the preset redundancy condition is whether the data is outdated, for example, Including whether the data in a specific time interval is repeated, whether the page data is lost, the data of page loss is the data generated by the user leaving the web page after the user clicks the web page and the web page is not loaded.

For this embodiment of the present invention, step 203b may specifically be as follows: when the parsed data structure is a complex type data structure, determine the webpage access data, and/or the webpage sharing data according to the user id, browsing id, and timestamp, and /or whether the web page data is expired data; if it is non-expired data, the web page access data, and/or the web page sharing data, and/or the web page data are respectively stored to the user with the user id, the browsing id, and the cache location corresponding to the timestamp, generate storage location information.

Wherein, the expired data refers to the repetition of data within a specific time period, and/or is page loss data, that is, the web page access data and/or web page sharing data within a specific time period are determined according to the user id, browsing id, and timestamp, and/or Whether the web page data is expired data, for example, when user id234432 browses a web page in one day, the recorded time stamps corresponding to the browsed web page are 2.31 browse web page a, 2.36 browse web page a, 5.06 browse web page v, and in one day, browse web page a Timestamps within a specific time period of 5 minutes are filtered out as duplicates. In addition, when webpage access data, and/or webpage sharing data, and/or webpage page data are stored, they are stored in the storage locations corresponding to the user id, browsing id, and timestamp id, for example, user 88676 browses webpage 2335 is the data corresponding to timestamp 4.45-5.36 is stored in storage location 1. The storage location information in the embodiment of the present invention may be the name of the storage location, or may be a label randomly generated for the storage location, etc., which is not specifically limited in the embodiment of the present invention.

204. Generate a monitoring log according to the webpage access data, and/or the webpage sharing data, and/or storage location information corresponding to the webpage page data.

This step is the same as the method of step 103 shown in FIG. 1 , and will not be repeated here.

Further, in order to avoid sending an alarm to the webpage server when the webpage is loaded with delay during the monitoring process, and feeding it back to the technician for abnormal processing, the embodiment of the present invention further includes: sending a delayed message through a message queue, reading all the information. User access behavior information and delay time in the delayed message, compare the timestamp of the delayed message with the timestamp corresponding to the cached user id and browsing id, if the cached user id and browsing id correspond to If the timestamp of the cached user id and browsing id are greater than the timestamp of the delayed message, then the user access behavior information is determined to be redundant data. The user access behavior information is cached.

For the embodiment of the present invention, in order to prevent the data corresponding to the delayed loading of the webpage from being redundant data, the time stamp of the delayed message is compared with the time stamp of the user id and the browsing id in the access data generated after loading. If the timestamp is greater than the timestamp of the delayed message, it is non-redundant data, and the corresponding user access behavior information is cached.

Further, this embodiment of the present invention may further include: sending monitoring information according to preset time intervals. For the embodiment of the present invention, in order to report the monitored user access behavior information in time, the monitoring information is sent according to preset time intervals, and the monitoring information carries the monitoring log, so that the monitoring personnel can obtain the monitoring needs from the corresponding storage location. user access behavior information. The preset time interval may be 1 day or 1 week, which is not specifically limited in the embodiment of the present invention.

The present invention provides another method for monitoring user access behavior information. In this embodiment of the present invention, statistics are performed on web page access data, and/or web page sharing data, and/or web page data returned by the web server, and the statistics of the web pages are collected. Access data, and/or web page sharing data, and/or web page data are classified and aggregated, respectively, to corresponding storage locations, and storage location information is generated, and monitoring logs are generated according to the storage location information, so as to realize the monitoring data query. Through the storage location information in the monitoring log, the data to be queried can be directly retrieved, reducing the storage pressure on the database and the server, so that when querying the monitoring data, the data stored in the monitoring server can be searched, and the monitoring efficiency of user access behavior can be improved. .

Further, as an implementation of the method shown in FIG. 1 , an embodiment of the present invention provides a device for monitoring user access behavior information. As shown in FIG. 3 , the device includes: a statistics module 31 , a storage module 32 , and a generation module 33 .

A statistics module 31, configured to send a monitoring data acquisition request, and count web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the web server;

The storage module 32 is used to store the statistics of webpage access data, and/or webpage sharing data, and/or webpage page data according to the data structure, respectively classify and aggregate the webpage access data obtained after classification and aggregation, and/or webpage share data, and/or web page data for storage, and generate storage location information;

The generating module 33 is configured to generate a monitoring log according to the webpage access data, and/or the webpage sharing data, and/or the storage location information corresponding to the webpage page data.

The present invention provides a user access behavior information monitoring device, which is compared with the prior art web browsing monitoring only by monitoring data such as the number of visits pv, independent visitors uv and the like, and the monitoring system has a large volume and excessive pressure on the database and server In contrast, the embodiment of the present invention collects statistics on webpage access data, and/or webpage sharing data, and/or webpage page data returned by the webpage server, and collects statistics on webpage access data, and/or webpage sharing data, and / or web page data is classified and aggregated, and the method is divided into the corresponding storage location, and the storage location information is generated, and the monitoring log is generated according to the storage location information, so as to realize the direct retrieval through the storage location information in the monitoring log when querying the monitoring data The data that needs to be queried reduces the storage pressure of the database and the server, so that when querying the monitoring data, it is searched according to the data stored in the monitoring server, and the monitoring efficiency of the user's access behavior is improved.

Further, as an implementation of the method shown in FIG. 2, an embodiment of the present invention provides another device for monitoring user access behavior information. As shown in FIG. 4, the device includes: a statistics module 41, a storage module 42, and a generation module 43. A determination module 44 and a configuration module 45.

A statistics module 41, configured to send a monitoring data acquisition request, and count web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the web server;

The storage module 42 is used to store the statistics of webpage access data, and/or webpage sharing data, and/or webpage page data according to the data structure, respectively classify and aggregate the webpage access data obtained after the classification and aggregation, and/or webpage share data, and/or web page data for storage, and generate storage location information;

The generating module 43 is configured to generate a monitoring log according to the webpage access data, and/or the webpage sharing data, and/or storage location information corresponding to the webpage page data.

Further, the statistics module 41 includes:

The first statistics unit 4101 is configured to send a web page access data acquisition request to the web page server when a page loading instruction is detected, and count the web page id, terminal device number, terminal device information, terminal device returned by the web page server location information, reading source information, sharing tier information; and/or,

The second statistics unit 4102 is configured to send a web page sharing data acquisition request to the web server when a web page sharing instruction is detected, count the web page id, terminal device number, and sharing destination information returned by the web server, and analyze the The sharing level information of the webpage is accumulated; and/or,

The third statistical unit 4103 is configured to send a webpage page data acquisition request to the webpage server when a webpage page click instruction is detected, and count the webpage page click information returned by the webpage server.

Further, the third statistical unit 4103 is specifically configured to send a webpage page data acquisition request to the webpage server when a webpage page click instruction is detected, and receive a webpage page data acquisition request response, the webpage page data The acquisition request response carries webpage page element click information and webpage page browsing time accumulation information; and the webpage page click information is counted according to the webpage element click information and the webpage page browsing time accumulation information.

Further, the storage module 42 includes:

A parsing unit 4201, configured to parse the statistics of webpage access data, and/or webpage sharing data, and/or the data structure of webpage page data;

The first storage unit 4202 is used to aggregate and store the web page access data, and/or the web page sharing data, and/or the web page data to In containers of different storage capacities, storage location information is generated, and the simple type data structure is a data structure that only performs incremental changes in the amount of data; or,

The second storage unit 4203 is configured to, when the parsed data structure is a complex type data structure, store the webpage access data, and/or the webpage sharing data, and/or the webpage page data according to preset redundancy conditions Perform filtering, cache the filtered web page access data, and/or web page sharing data, and/or web page data according to the user id, browsing id, and timestamp, and generate storage location information. The data structure that is processed by the form and data representation.

Further, the second storage unit 4203 is specifically used to judge the webpage access data and/or the webpage sharing data according to the user id, browsing id and timestamp when the parsed data structure is a complex type data structure. , and/or whether the web page data is expired data; if it is non-expired data, the web page access data, and/or the web page sharing data, and/or the web page data are respectively stored in the In the cache location corresponding to the user id, the browsing id, and the timestamp, storage location information is generated.

Further, the device also includes:

The determining module 44 is configured to send the delayed message through the message queue, read the user access behavior information and the delay time in the delayed message, and compare the time stamp of the delayed message with the cached user id and browsing id The corresponding timestamps are compared. If the timestamps corresponding to the cached user id and browsing id are smaller than the timestamp of the delayed message, it is determined that the user access behavior information is redundant data. If the timestamp corresponding to the browsing id is greater than the timestamp of the delayed message, the user access behavior information is cached.

Further, the device also includes:

The configuration module 45 is used to configure a preset number of containers with different storage validity periods and different access durations. The storage validity period is determined by the storage validity period=the most recent time required, and the access duration is determined by the access duration= The precision of the statistics, the preset number is set in the following manner: preset number = storage validity period/access duration.

The present invention provides another user access behavior information monitoring device, which is different from the prior art web browsing monitoring only by monitoring data such as visits pv, independent visitors uv and the like, and the monitoring system is relatively large, and the pressure on the database and the server is excessive. In contrast, in this embodiment of the present invention, statistics are performed on the webpage access data, and/or webpage sharing data, and/or webpage page data returned by the webpage server, and the collected webpage access data, and/or webpage sharing data, and/or web page data are classified and aggregated, respectively, to the corresponding storage location, and the storage location information is generated, and the monitoring log is generated according to the storage location information. Get the data that needs to be queried, reduce the storage pressure of the database and the server, so that when querying the monitoring data, search according to the data stored in the monitoring server, and improve the monitoring efficiency of user access behavior.

According to an embodiment of the present invention, a storage medium is provided, and the storage medium stores at least one executable instruction, and the computer-executable instruction can execute the method for monitoring user access behavior information in any of the foregoing method embodiments.

FIG. 5 shows a schematic structural diagram of a computer device provided according to an embodiment of the present invention. The specific embodiment of the present invention does not limit the specific implementation of the computer device.

As shown in FIG. 5 , the computer device may include: a processor (processor) 502 , a communications interface (Communications Interface) 504 , a memory (memory) 506 , and a communication bus 508 .

The processor 502 , the communication interface 504 , and the memory 506 communicate with each other through the communication bus 508 .

The communication interface 504 is used to communicate with network elements of other devices such as clients or other servers.

The processor 502 is configured to execute the program 510, and may specifically execute the relevant steps in the foregoing embodiments of the method for monitoring user access behavior information.

Specifically, the program 510 may include program code including computer operation instructions.

The processor 502 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the computer equipment may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.

The memory 506 is used to store the program 510 . Memory 506 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.

The program 510 can specifically be used to cause the processor 502 to perform the following operations:

Send a monitoring data acquisition request, and count the web page access data, and/or web page sharing data, and/or web page data carried in the response to the monitoring data acquisition request returned by the web server;

According to the data structure, the statistics of web page access data, and/or web page sharing data, and/or web page data are respectively classified and aggregated, and the web page access data, and/or web page sharing data, and/or web pages obtained after the classification and aggregation are aggregated. Store page data and generate storage location information;

The monitoring log is generated according to the webpage access data, and/or the webpage sharing data, and/or storage location information corresponding to the webpage page data.

Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present invention can be implemented by a general-purpose computing device, which can be centralized on a single computing device, or distributed in a network composed of multiple computing devices Alternatively, they may be implemented in program code executable by a computing device, such that they may be stored in a storage device and executed by the computing device, and in some cases, in a different order than here The steps shown or described are performed either by fabricating them separately into individual integrated circuit modules, or by fabricating multiple modules or steps of them into a single integrated circuit module. As such, the present invention is not limited to any particular combination of hardware and software.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims (10)

1. a kind of user access activity information monitoring method characterized by comprising

Monitoring data acquisition request is sent, the webpage that the monitoring data acquisition request response that statistical web page server-side returns carries is visited Ask data, and/or webpage sharing data, and/or webpage data；

According to data structure to the web page access data, and/or webpage sharing data, and/or webpage data point after statistics Classification polymerization is not carried out, to the web page access data, and/or webpage sharing data, and/or Webpage obtained after classification polymerization Data are stored, and generate storage location information；

According to the web page access data, and/or the webpage sharing data, and/or the webpage data is corresponding deposits It stores up location information and generates monitoring log.

2. the method according to claim 1, wherein the transmission monitoring data acquisition request, statistical web page clothes The monitoring data acquisition request that end returns of being engaged in responds the web page access data carried, and/or webpage sharing data, and/or webpage Page data includes:

When detecting page load instruction, Xiang Suoshu web service end sends web page access data acquisition request, and counts institute The webpage id of web service end return is stated, terminal device number, terminal device information, terminal positional information, source-information is read, divides Enjoy hierarchical information；And/or

When detecting that webpage shares instruction, Xiang Suoshu web service end sends webpage sharing data acquisition request, described in statistics The webpage id of web service end return, terminal device number, share whereabouts information, and the sharing hierarchical information of the webpage is carried out It is accumulative；And/or

When detecting Webpage click commands, Xiang Suoshu web service end sends webpage data acquisition request, statistics The Webpage click information that the web service end returns.

3. according to the method described in claim 2, it is characterized in that, described when detecting Webpage click commands, to institute It states web service end and sends webpage data acquisition request, count the Webpage click information that the web service end returns Include:

When detecting Webpage click commands, Xiang Suoshu web service end sends webpage data acquisition request, and connects The response of webpage data acquisition request is received, Webpage element is carried in the webpage data acquisition request response and clicks Information, Webpage browsing time cumulative information；When according to the Webpage element click information, Webpage browsing Between cumulative information statistical web page page click information.

4. method according to claim 1 or 2, which is characterized in that described to visit according to data structure the webpage after statistics Ask that data, and/or webpage sharing data, and/or webpage data carry out classification polymerization respectively, to what is obtained after classification polymerization Web page access data, and/or webpage sharing data, and/or webpage data are stored, and generate storage location packet It includes:

The data structure of web page access data, and/or webpage sharing data, and/or webpage data after parsing statistics；

When the data structure of parsing is simple types data structure, then according to time limit demand to the web page access data, and/or The webpage sharing data, and/or webpage data polymerization are stored into the container of different memory sizes, generate storage Location information, the simple types data structure are only to carry out the data structure of data volume increment variation；Or,

When the data structure of parsing is complex type data structure, then to the web page access data, and/or webpage sharing Data, and/or the webpage data are filtered according to default redundancy condition, by filtered web page access data and/ Or webpage sharing data, and/or webpage data are cached according to user id, browsing id, timestamp, generate storage location Information, the complex type data structure are the data structure handled data mode, representation.

5. according to the method described in claim 4, it is characterized in that, described when the data structure of parsing is complex type data knot Structure, then it is superfluous according to presetting to the web page access data, and/or the webpage sharing data, and/or the webpage data Remaining condition is filtered, by filtered web page access data, and/or webpage sharing data, and/or webpage data according to User id, browsing id, timestamp cache, and generate storage location information and include:

When the data structure of parsing is complex type data structure, then the webpage is judged according to user id, browsing id, timestamp It accesses data, and/or the webpage sharing data, and/or whether the webpage data is stale data；If non-expired Data then store the web page access data, and/or the webpage sharing data, and/or the webpage data respectively To in cache location corresponding with the user id, the browsing id, the timestamp, storage location information is generated.

6. according to the method described in claim 4, it is characterized in that, described according to the web page access data, and/or the net After page sharing data, and/or the corresponding storage location information of the webpage data generate monitoring log, the method is also Include:

By message queue forward delay interval message, user access activity information and the delay time in the delay message are read, The timestamp of delay message timestamp corresponding with user id, browsing id after caching is compared, if after caching User id, the corresponding timestamp of browsing id are less than the timestamp of the delay message, it is determined that the user access activity information It is cached for redundant data if the user id, the corresponding timestamp of browsing id after caching are greater than the timestamp of the delay message The user access activity information.

7. according to the method described in claim 4, it is characterized in that, described when the data structure of parsing is simple types data knot Structure, then according to time limit demand to the web page access data, and/or the webpage sharing data, and/or the Webpage number It stores according to polymerization into the container of different memory sizes, before generation storage location information, further includes:

Configure the container of the predetermined number with different storage validity periods, different access duration, the determination of the storage validity period Mode is storage validity period=demand nearest time, and the method for determination of the access duration is access duration=statistic essence Degree, the setting means of the predetermined number are predetermined number=storage validity period/access duration.

8. a kind of user access activity information monitoring device characterized by comprising

Statistical module, for sending monitoring data acquisition request, the monitoring data acquisition request that statistical web page server-side returns is rung The web page access data, and/or webpage sharing data, and/or webpage data that should be carried；

Memory module, for store according to data structure to after statistics web page access data, and/or webpage sharing data and/ Or webpage data carries out classification polymerization respectively, shares number to the web page access data, and/or webpage that obtain after classification polymerization According to, and/or webpage data stored, and generate storage location information；

Generation module, for according to the web page access data, and/or the webpage sharing data, and/or the Webpage The corresponding storage location information of data generates monitoring log.

9. a kind of storage medium, it is stored with an at least executable instruction in the storage medium, the executable instruction makes to handle Device executes such as the corresponding operation of user access activity information monitoring method of any of claims 1-7.

10. a kind of computer equipment, comprising: processor, memory, communication interface and communication bus, the processor described are deposited Reservoir and the communication interface complete mutual communication by the communication bus；

The memory executes the processor as right is wanted for storing an at least executable instruction, the executable instruction Ask the corresponding operation of user access activity information monitoring method described in any one of 1-7.