CN102523296B - Method, device and system for optimizing wireless webpage browsing resources - Google Patents

Abstract

The embodiment of the present invention discloses a method for optimizing wireless webpage browsing resources, including: identifying an HTTP webpage request packet from received network data packets; and obtaining a webpage ID of a webpage that a user requests to browse according to the identified HTTP webpage request packet; Match the webpage ID with the pre-established webpage information table; if the matching is successful, obtain the webpage information corresponding to the webpage ID from the webpage information table, calculate the GBR matching the webpage information according to the webpage information, and send the GBR to The base station, so that the base station allocates bandwidth resources of the wireless web page session to the user according to the GBR. Correspondingly, the embodiment of the present invention also discloses a method for establishing a webpage information table, a wireless webpage browsing resource optimization device, and a wireless network resource optimization system. Through the above technical solutions, GBR can be calculated and allocated according to the specific information of each webpage. , realizing resource optimization during wireless web browsing.

Description

Wireless webpage browsing resource optimization method, device and system

technical field

The invention relates to the wireless field, in particular to resource optimization technology for wireless web page browsing.

Background technique

In the wave of development of the mobile Internet, with the explosion and maturity of the industrial chain of portable terminals such as smart phones and tablet PCs, various applications based on mobile terminals such as web browsing, mobile instant messaging, mobile communities, and mobile payment are emerging in an endless stream. Among them, wireless web browsing is currently the most common mobile Internet application used by users because it can provide people with fresh and massive information in real time.

At present, the basic flow of the wireless web browsing service is as follows: after the mobile terminal is turned on, a PDP (Package Data Protocol, packet data protocol) connection to the PDP and PDP attachment is established. When the mobile terminal needs to send data, the PDP is activated and an IP address is obtained. RNC (Radio Network Controller, The wireless network controller) configures GBR (guarantee bitrate, guaranteed bit rate) according to the wireless static policy (the static policy is generally set by the operator), and switches to the DCH (Dedicated Channel, dedicated channel) state, and sends the web page packet to the mobile terminal data.

In the existing solution, when a user browses a wireless webpage, the RNC configures GBR according to the wireless static policy; when the GBR is too low, the webpage display time is longer, resulting in low QOS for webpage browsing and affecting user experience; when the GBR is too high, Although the QOS of web browsing is guaranteed, wireless resources will be wasted.

Contents of the invention

In order to improve user experience and reduce waste of wireless resources when users browse wireless webpages, an embodiment of the present invention provides a method for optimizing wireless webpage browsing resources, including:

Identify the hypertext transfer protocol HTTP webpage request packet from the received network packet, and the HTTP webpage request packet is sent when the user requests to browse the webpage;

Obtain the webpage ID of the webpage that the user requests to browse according to the identified HTTP webpage request packet;

Match the acquired web page ID with the pre-established web page information table;

If the matching is successful, obtain the webpage information corresponding to the webpage ID from the webpage information table, calculate the guaranteed bit rate GBR matching the webpage information according to the webpage information, and send the GBR to the base station to making the base station allocate bandwidth resources for wireless webpage sessions to the user according to the GBR.

The embodiment of the present invention also provides a wireless webpage browsing resource optimization device, including:

An identification module, configured to identify an HTTP webpage request packet from the received network data packet, the HTTP webpage request packet is sent when the user requests to browse the webpage;

An acquisition module, configured to acquire the webpage ID of the webpage that the user requests to browse from the HTTP webpage request packet identified by the identification module;

A matching module, configured to match the webpage ID obtained by the acquisition module with a pre-established webpage information table;

A strategy module, configured to obtain the webpage information corresponding to the webpage ID from the webpage information table when the matching module successfully matches, calculate the GBR matching the webpage information according to the webpage information, and store the The GBR is sent to the base station, so that the base station allocates bandwidth resources for wireless webpage sessions to the user according to the GBR.

An embodiment of the present invention provides a wireless network resource optimization system, including: a wireless network controller and a base station, characterized in that,

The wireless network controller is used to identify the HTTP webpage request packet from the received network data packet; according to the identified HTTP webpage request packet, obtain the webpage ID of the webpage that the user requests to browse;

Matching the obtained web page ID with the pre-established web page information table; if the matching is successful, obtain the web page information corresponding to the web page ID from the web page information table, and calculate the GBR matching the web page information according to the web page information , and sending the GBR to the base station;

The base station is configured to receive the GBR, and allocate bandwidth resources for wireless webpage sessions to the user according to the GBR.

An embodiment of the present invention provides a method for establishing a web page information table, including:

Identify the HTTP webpage request packet and the HTTP response packet corresponding to the HTTP webpage request packet from the received network data packet, and the HTTP webpage request packet is sent when the user requests to browse the webpage;

According to the HTTP webpage request packet, obtain the webpage ID of the webpage that the user requests to browse;

By analyzing the HTTP response packet corresponding to the HTTP webpage request packet, the webpage information is obtained through statistics;

An association relationship between the webpage ID and the webpage information is established.

The embodiment of the present invention also provides a device for establishing a web page information table, including:

A webpage data identification module, configured to identify an HTTP webpage request packet and an HTTP response packet corresponding to the HTTP webpage request packet from the received network data packets;

A webpage ID acquisition module, configured to obtain the webpage ID of the webpage that the user requests to browse according to the HTTP webpage request packet;

A webpage information statistics module, used to obtain webpage information by analyzing the HTTP response packet corresponding to the HTTP webpage request packet;

The associating module is used for associating the webpage information with the webpage ID and adding it to the webpage information table.

Through the above technical solutions, the embodiment of the present invention obtains the web page information of the web page accessed by the user by querying the web page information table based on the identification of web page data, and calculates and allocates GBR according to the specific information of each web page, so as to realize the dynamic adjustment of GBR, and Compared with the existing technical solutions, the dynamically adjusted GBR can better match different web browsing services, which greatly reduces the occurrence of the GBR being too high or too low in the prior art, improves the user experience and improves user experience. Ensure the QOS of web browsing and maximize the use of wireless resources.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

FIG. 1 is a flow chart of a method for optimizing wireless webpage browsing resources provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of a web page information table provided by an embodiment of the present invention;

FIG. 3 is a flow chart of a method for optimizing wireless webpage browsing resources provided by an embodiment of the present invention;

Fig. 4 is a flow chart of a method for adding webpage information records provided by an embodiment of the present invention;

FIG. 5 is a flow chart of a method for establishing a web page information table provided by an embodiment of the present invention;

FIG. 6 is a structural diagram of a device for establishing a webpage information table provided by an embodiment of the present invention;

FIG. 7 is a structural diagram of a wireless network controller provided by an embodiment of the present invention;

FIG. 8 is a structural diagram of a record adding module of a wireless network controller provided by an embodiment of the present invention;

FIG. 9 is a structural diagram of a wireless web browsing resource optimization system provided by an embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

In order to enable those skilled in the art to better understand the technical solutions provided by the embodiments of the present invention, some simple introductions are made to the HTTP (Hyper Text Transfer Protocol, hypertext transfer protocol) communication mechanism of the webpage session (session) and the wireless network GBR :

HTTP is the most widely used network protocol on the Internet, and all WWW files must comply with this standard. The HTTP protocol defines how a Web client requests a Web page from a Web server during a web page session, and how the server transmits a Web page to the client. The HTTP protocol adopts a request/response model. During a complete web page session, the web browser and web server will follow the HTTP protocol to complete the following four steps:

(1) Establish a web page session connection;

Before conducting a web page session, the web browser must first establish a connection with the web server through the network. The connection is completed through TCP. It is called a TCP/IP network. HTTP is a higher-level application layer protocol than TCP. According to the rules, only after the establishment of the lower-level protocol can the connection of the higher-level protocol be established. Therefore, the TCP connection must be established first. The port number of the general TCP connection is 80;

(2) Web browser sends HTTP web page request packet to Web server;

Once a TCP connection is established, the web browser will send an HTTP webpage request packet to the web server according to the URL requested by the user. The HTTP webpage request packet includes: request method, URL, protocol version, request header, and request data. Among them, the request methods of the HTTP protocol include GET, POST, HEAD, PUT, DELETE, OPTIONS, TRACE, CONNECT, and generally only use the GET method when browsing web pages; URL (Uniform Resource Locator, Uniform Resource Locator) is a standard on the Internet. The address of the resource. The URL consists of three parts: protocol, domain name, and request address. The complete URL uniquely determines a requested resource, which can be a page, content module, file or multimedia resource, etc. For example, browse the homepage of NetEase => sports channel => For Serie A, their URLs are http://www.163.com/=>http://sports.163.com/=>http://sports.163.com/yj/. The request header consists of keyword/value pairs, one pair per line, and the keyword and value are separated by a colon ":". The request header informs the server about the information requested by the client. Typical request headers are:

User-Agent: the browser type that generated the request;

Accept: a list of content types recognized by the client;

Host: The requested host name, which allows multiple domain names to be in the same IP address, that is, a virtual host.

Request data is not used in GET method but in POST method.

(3) The Web server accepts the request and returns an HTTP response packet;

The web server parses the request and locates the requested resource. The server writes a copy of the resource to a TCP socket, which is read by the client. An HTTP response packet consists of 4 parts: status line, response header, blank line and response data.

(4) Release the connection TCP connection.

GBR is the abbreviation of Guarantee Bit Rate, which specifically refers to the minimum bandwidth allocated by RNC for packet data services to meet the minimum bandwidth requirements of packet data services. At present, the GBR of the wireless network is configured by the base station according to the wireless static policy in the RNC, and for the wireless web browsing service, it is generally 64Kbps.

As shown in FIG. 1 , an embodiment of the present invention provides a wireless web browsing resource optimization method, including:

S101, identifying the HTTP webpage request packet from the received network data packet, the HTTP webpage request packet is sent when the user requests to browse the webpage;

According to the HTTP communication mechanism of the webpage session introduced earlier, after the TCP connection of the webpage session is established, the browser sends an HTTP webpage request packet according to the URL entered by the user, and the web server sends the webpage request packet of the webpage requested by the user after receiving the HTTP webpage request packet. The content is sent to the browser in the form of an HTTP response packet. It should be noted that due to the hierarchical structure of web pages, a web page may contain various contents, such as html (Hypertext Markup Language, text markup language), script, CSS (Cascading Style Sheet, cascading style sheet) and pictures, Correspondingly, each of the above-mentioned contents corresponds to a resource on the web server. Therefore, during a web page session, there may be multiple HTTP web page request packets for requesting different resources from the web server to obtain complete information of the entire web page. For example: the first HTTP web page request packet is used for the Web to obtain HTML files from the server, and then the HTTP web page request packets are sent sequentially to obtain pictures, scripts and other content from the Web server.

It should be noted that since HTTP is an application layer protocol, in order to identify HTTP webpage request packets from network data packets, the embodiment of the present invention adopts DPI technology. DPI is the abbreviation of Deep Packet Inspection (Deep Packet Inspection). The so-called "depth" is compared with the level of SPI (Simple Packet Inspection, simple message identification). SPI only analyzes the transport layer (layer 4) of the data packet below content, including source address, destination address, source port, destination port, and protocol type. In addition to the previous level analysis, DPI also adds application layer analysis (7-layer analysis). By analyzing the data packets in the application flow The content is detected to determine the real application of the data packet, because illegal applications can disguise the port number, but it is currently difficult to hide the protocol characteristics of the application layer.

Specifically, in one embodiment, the DPI characteristic word recognition method can be used to analyze the received data packet header and data part, and match the parsed fields with the corresponding characteristic fields of the HTTP web page request packet. Specifically, if it is analyzed that the TCP port number in the header of the data packet is 80, the data part of the data packet contains the request method GET, and the protocol type is HTTP, and the URL suffix name is .jsp, .asp, .php, .htm, .html, .shtml, it can be determined that the data packet is an HTTP web page request packet; of course, it is understandable that the more fields to parse and match, the more accurate the result of the determination will be.

Of course, it can be understood that, to identify the HTTP web page request packet from the received data packets, other identification technologies may also be used, such as application layer protocol identification technology, keyword matching or behavior feature analysis technology.

S102. Obtain the webpage ID of the webpage that the user requests to browse according to the identified HTTP webpage request packet;

It should be noted that the webpage ID is an identifier used to distinguish different webpages, and the identifier is unique.

In one embodiment of the present invention, after the webpage session TCP connection is established, the URL in the first HTTP webpage request packet received is used as the webpage ID. Specifically, by parsing the specific field in the first HTTP webpage request packet identified by S101, the main URL of the webpage can be obtained, and then use this URL as the webpage ID; in another embodiment, the webpage ID can also be Calculation method acquisition: parse the specific fields in the first HTTP webpage request packet identified by S101, and extract the URL and host fields in the HTTP webpage request packet, and then pass the extracted URL field and host field through the string The concatenation function is concatenated into one field, and finally the concatenated fields are hashed with a hash algorithm to obtain a sequence number of a specific length, and this sequence number is used as the web page ID. Specifically, the MD5 algorithm (the fifth edition of the message digest algorithm) can be used as the hash algorithm for calculating the webpage ID, that is, MD5 (URL+host) can be used to obtain the webpage ID; of course, it is understandable that other methods can also be used. The hash algorithm, such as SHA-1, is not particularly limited in this embodiment of the present invention.

S103, matching the acquired web page ID with a pre-established web page information table, the web page information table including web page IDs of web pages frequently used by users and web page information corresponding to each web page ID;

In one embodiment, when matching, the obtained webpage ID can be used as a key value, and a hash (hash) index method can be used to match with the webpage information table. As a specific search method, the Hash index method has the advantage of rapid search and can improve the matching speed. It can be understood that the hash index method is not the only way to achieve matching, so the hash index method should not be interpreted as a limitation to the embodiment of the present invention as an example. It can be understood that in another embodiment, it can also be used b-tree binary tree index, r-tree index or full-text index.

FIG. 2 is a schematic diagram of a webpage information table provided by an embodiment of the present invention. According to FIG. 2 , the specific information of the webpage includes but not limited to: the size of the webpage, the hierarchy of the webpage, and the type of the webpage. Among them, the size of the web page is the amount of data contained in the entire web page; the level of the web page corresponds specifically to the directory structure of the web page, the first-level directory is the home page, the number of layers is 1, the number of sub-pages in the second-level directory is 2, and so on; The web page type is used to represent the content topic of the web page, such as news, sports, or finance. It should be noted that Fig. 2 is only an example of a webpage information data table in the embodiment of the present invention, and the webpage information table shown in Fig. 2 only provides a typical way of realizing the webpage information table, and is not the only one. Optimize and improve on the basis of the table. For example, in one embodiment, if factors such as the character set, author, version, and webpage keywords of the webpage need to be considered, these corresponding information can be added to the webpage information table.

It should be noted that the webpage information table may be fixed, or may be updated according to the user's access situation.

S104, if the matching is successful, obtain the webpage information corresponding to the webpage ID from the webpage information table, calculate a guaranteed bit rate GBR matching the webpage information according to the webpage information, and send the GBR to the base station , so that the base station allocates bandwidth resources for wireless webpage sessions to the user according to the GBR.

Specifically, in one embodiment, the method for calculating the matching GBR according to the webpage information includes:

(1) Obtain the webpage size and webpage hierarchy from the webpage information;

(2) divide the webpage size by the standard time to obtain the GBR matching the webpage information; or divide the webpage size by the webpage level, and then divide by the standard time to obtain the GBR matching the webpage information; or divide the webpage information by the webpage size The GBR matching the webpage information is obtained by dividing the webpage level by the user level coefficient.

Among them, the standard time is statically configured by the operator, such as 1s, which represents the average time required for a user to obtain a complete web page information; the user level coefficient is set according to the user type, for example, gold user = 1, silver user = 2. Bronze users = 3. Specifically, the above calculation method can be expressed as: GBR=webpage size/standard time; in another embodiment, the calculation method of GBR can be: GBR=webpage size/standard time*webpage level; in another embodiment Among them, the calculation method of GBR can also be GBR=webpage size/standard time*webpage level/user level coefficient.

After the GBR calculation is completed, the RNC sends the GBR to the base station in the form of a GBR configuration file, and the base station allocates bandwidth resources for webpage sessions according to the GBR configuration file, so that the GBR can be dynamically adjusted according to the webpage information.

Through the above technical solutions, the embodiment of the present invention obtains the web page information of the web page accessed by the user by querying the web page information table based on the identification of web page data, and calculates and allocates GBR according to the specific information of each web page, so as to realize the dynamic adjustment of GBR, and Compared with the existing technical solutions, the dynamically adjusted GBR can better match different web browsing services, greatly reducing the situation that the GBR is too high or too low in the prior art, improving the user experience and ensuring the web page Maximize the use of wireless resources while browsing QOS.

As shown in FIG. 3, an embodiment of the present invention provides a wireless web browsing resource optimization method, including:

S301, identifying the HTTP webpage request packet from the received network data packet, the HTTP webpage request packet is sent when the user requests to browse the webpage;

In one embodiment, the DPI feature word recognition method can be used to analyze the header and data part of the received data packet, and match the parsed fields with the corresponding feature fields of the HTTP webpage request packet. Specifically, if it is analyzed that the TCP port number in the header of the data packet is 80, the data part of the data packet contains the request method GET, and the protocol type is HTTP, and the URL suffix name is .jsp, .asp, .php, .htm, .html, .shtml, it can be determined that the data packet is an HTTP web page request packet; of course, it is understandable that the more fields to parse and match, the more accurate the result of the determination will be.

S302. Obtain the webpage ID of the webpage that the user requests to browse according to the identified HTTP webpage request packet;

It should be noted that the webpage ID is an identifier used to distinguish different webpages, and the identifier is unique.

In one embodiment of the present invention, after the webpage session TCP connection is established, the URL in the first HTTP webpage request packet received is used as the webpage ID. Specifically, by parsing the specific field in the first HTTP webpage request packet identified by S101, the main URL of the webpage can be obtained, and then use this URL as the webpage ID; in another embodiment, the webpage ID can also be Calculation method acquisition: parse the specific fields in the first HTTP webpage request packet identified by S101, and extract the URL and host fields in the HTTP webpage request packet, and then pass the extracted URL field and host field through the string The concatenation function is concatenated into one field, and finally the concatenated fields are hashed with a hash algorithm to obtain a sequence number of a specific length, and this sequence number is used as the web page ID. Specifically, the MD5 algorithm (the fifth edition of the message digest algorithm) can be used as the hash algorithm for calculating the webpage ID, that is, MD5 (URL+host) can be used to obtain the webpage ID; of course, it is understandable that other methods can also be used. The hash algorithm, such as SHA-1, is not particularly limited in this embodiment of the present invention.

S303, matching the acquired web page ID with a pre-established web page information table, the web page information table including web page IDs of web pages frequently used by users and web page information corresponding to each web page ID;

In one embodiment, when matching, the obtained webpage ID can be used as a key value, and a hash (hash) index method can be used to match with the webpage information table. As a specific search method, the hash index method has the advantage of rapid search and can improve the matching speed. It can be understood that the hash index method is not the only way to achieve matching, so the hash index method should not be interpreted as a limitation to the embodiment of the present invention as an example. It can be understood that in another embodiment, it can also be used b-tree binary tree index, r-tree index or full-text index.

FIG. 2 is a schematic diagram of a webpage information table provided by an embodiment of the present invention. According to FIG. 2 , the specific information of the webpage includes but not limited to: the size of the webpage, the hierarchy of the webpage, and the type of the webpage. Among them, the size of the webpage refers to the amount of data contained in the entire webpage; the hierarchy of the webpage corresponds specifically to the directory structure of the webpage, the first-level directory is the homepage, the number of layers is 1, the number of sub-pages in the second-level directory is 2, and so on; The web page type is used to represent the content topic of the web page, such as news, sports, or finance. It should be noted that Fig. 2 is only an example of a webpage information data table in the embodiment of the present invention, and the webpage information table shown in Fig. 2 only provides a typical way of realizing the webpage information table, and is not the only one. Optimize and improve on the basis of the table. For example, in one embodiment, if factors such as the character set, author, version, and webpage keywords of the webpage need to be considered, these corresponding information can be added to the webpage information table.

S304. If the matching is successful, obtain the webpage information corresponding to the webpage ID from the webpage information table, calculate a guaranteed bit rate GBR matching the webpage information according to the webpage information, and send the GBR to the base station so that the base station allocates bandwidth resources for wireless webpage sessions to the user according to the GBR;

Specifically, in one embodiment, the method for calculating the matched GBR according to the webpage information includes:

(1) Obtain the webpage size and webpage hierarchy from the webpage information;

(2) divide the webpage size by the standard time to obtain the GBR matching the webpage information; or divide the webpage size by the webpage level, and then divide by the standard time to obtain the GBR matching the webpage information; or divide the webpage information by the webpage size The GBR matching the webpage information is obtained by dividing the webpage level by the user level coefficient.

Among them, the standard time is statically configured by the operator, such as 1s, which represents the average time required for a user to obtain a complete web page information, and the user level coefficient is set according to the user type, for example, gold user = 1, silver user = 2. Bronze users = 3. Specifically, the above calculation method can be expressed as: GBR=webpage size/standard time; in another embodiment, the calculation method of GBR can be: GBR=webpage size/standard time*webpage level; in another embodiment Among them, the calculation method of GBR can also be GBR=webpage size/standard time*webpage level/user level coefficient.

After the GBR calculation is completed, the GBR is sent to the base station in the form of a GBR configuration file, and the base station allocates the bandwidth resources of the web page session according to the GBR configuration file, so that the GBR can be dynamically adjusted according to the web page information.

S305. If the matching is unsuccessful, send the pre-configured GBR to the base station, so that the base station allocates bandwidth resources for wireless webpage sessions to the user according to the pre-configured GBR;

In one embodiment, if the matching is unsuccessful, it means that the currently accessed web page information is not recorded in the web page information table, and at this time the pre-configured GBR (configured by the user, such as 64kbps) is issued in the form of a GBR configuration file To the base station, the base station allocates the bandwidth of the web page session according to the GBR configuration file.

In another embodiment, as shown in the dashed box in FIG. 3 , the wireless webpage browsing resource optimization method provided in the embodiment of the present invention further includes:

S306. Add the unsuccessfully matched webpage ID and corresponding webpage information as a new record to the webpage information table.

In one embodiment, if the matching is unsuccessful, it means that the currently visited webpage is not recorded in the webpage information table, and belongs to a new webpage. In order to optimize resources when subsequent users visit this webpage, it is necessary to add this new The webpage information of the webpage is entered into the webpage information table to provide a basis for calculating the GBR.

In one embodiment, as shown in FIG. 4, S306 specifically includes:

S3601. Identify the HTTP response packet corresponding to the HTTP webpage request packet from the received network data packet;

It should be noted that, according to the HTTP communication mechanism of web browsing, after the web server receives the HTTP webpage request packet sent by the web browser, it will send the resource requested by the web browser to the browser in the form of an HTTP response packet, that is, an HTTP webpage request The packet corresponds to an HTTP response packet. Therefore, in one embodiment, the HTTP response packet can be simply identified according to the following rules: the next data packet received after the browser sends the HTTP webpage request packet is the corresponding HTTP webpage request packet. The HTTP response packet. Therefore, after the HTTP web page request packet is identified according to the method described in step S301, its corresponding HTTP response packet can be identified. In another embodiment, the method of identifying the DPI characteristic word may also be used to analyze and match the content of the network data packet, so as to identify the HTTP response packet.

S3602, analyzing the HTTP response packet corresponding to the identified HTTP webpage request packet, and counting the webpage information of the webpage that the user requests to browse;

For ease of description, the embodiment of the present invention collectively refers to the HTTP webpage request packet and the HTTP response packet as webpage browsing data packets. The flow contains multiple webpage browsing data packets, so the analysis of the identified webpage browsing data packets is mainly divided into two levels: (1) parsing which webpage browsing data packets belong to the same data flow; Which data streams belong to the same session is analyzed in the stream; the method of DPI feature word recognition in S301 can also be used to realize the above two levels of analysis methods.

Specifically, in one embodiment, the five-tuple (source IP address, source port, destination IP address, destination port, and transport layer protocol number) in the webpage browsing data packet is parsed, if five of the two webpage browsing data packets If the tuple meets any of the following two conditions, it can be determined that the two data packets belong to the same data flow;

(1) The quintuples of the two data packets are exactly the same;

(2) The source IP address in the quintuple of one data packet is the destination IP address in the quintuple of another data packet, and the destination IP address is the source IP address of another data packet, and the remaining three parameters are identical.

Further, the HTTP web page request packets of different data streams are analyzed to obtain the values of the Src and URL fields, and the data streams whose Src and URL are exactly the same are determined to belong to the same session.

In one embodiment, the method for counting the size of the webpage is: first establish a session table and a data flow table, and then record the size and attribution information of each webpage browsing data packet into the session table and the flow table in the process of parsing the data packets (specifically, the size of the data packet and which data flow the data packet belongs to are recorded in the data flow table, and the information of which session the data packet belongs to is recorded in the session table), and finally combined with the above two tables The recorded information counts the size of the webpage; at the same time, the webpage hierarchy and webpage type can be counted by analyzing the main URL, which is the URL of the first HTTP webpage request packet in the session. Specifically, the level of the webpage is judged according to the number of slashes in the main URL, and the type of the webpage is judged according to the keywords in the URL, for example, is the URL /news/lady/default.jsp? user＝abc&refer＝http://www.163.com/lady, judge the webpage level according to the number of slashes (from the beginning of the URL to the end of the question mark, if there is no question mark, it will end with a space), there are 3 slashes in total, then Indicates that this webpage is a third-level webpage; by analyzing the content between the slashes, keywords can be obtained, such as news and lady, indicating that this webpage is a female and news type. If there is no keyword, it means the home page of the website, and the type field is left blank.

S3603. Associate the webpage information of the webpage that the user requests to browse with the webpage ID of the webpage that the user requests to browse, and add it to the webpage information table.

Through the above technical solutions, the embodiment of the present invention obtains the web page information of the web page accessed by the user by querying the web page information table based on the identification of web page data, and calculates and allocates GBR according to the specific information of each web page, so as to realize the dynamic adjustment of GBR, and Compared with the existing technical solutions, the dynamically adjusted GBR can better match different web browsing services, which greatly reduces the situation that the GBR is too high or too low in the prior art, improves the user experience, and ensures Maximize the use of wireless resources while browsing the webpage QOS; further, when the matching is unsuccessful, by adding the webpage information that has not been recorded in the previous webpage information table to the webpage information table during access, when other users access subsequently, Therefore, the GBR can be allocated reasonably to realize the optimization of radio resources.

As shown in Figure 5, an embodiment of the present invention provides a method for establishing a web page information table, including:

S501, identifying an HTTP webpage request packet and an HTTP response packet corresponding to the HTTP webpage request packet from the received network data packets, the HTTP webpage request packet is sent when the user requests to browse the webpage;

Specifically, in one embodiment, a piece of information cache can be set in advance. When a network data packet arrives, the data packet is copied into the information cache, and then the signature word is identified and analyzed for the data packet. If the data packet header is parsed The TCP port number is 80, the data part of the packet contains the request method GET, and the protocol type is HTTP, and the URL suffix name is any one of .jsp, .asp, .php, .htm, .html, .shtml It can be determined that the data packet is an HTTP webpage request packet. Of course, it is understandable that, according to the previously described HTTP communication mechanism for webpage browsing, the next network data packet received by the browser after sending an HTTP webpage request packet must be An HTTP response packet corresponding to the HTTP web page request packet;

S502. According to the HTTP webpage request packet, obtain the webpage ID of the webpage that the user requests to browse, and obtain webpage information by analyzing the HTTP response packet;

In one embodiment of the present invention, the identified URL in the first HTTP webpage request packet is used as the webpage ID. Specifically, by parsing the specific field in the first HTTP webpage request packet identified by S501, the main URL of the webpage can be obtained, and then use this URL as the webpage ID; in another embodiment, the webpage ID can also use Calculation method acquisition: parse the specific fields in the first HTTP webpage request packet identified by S101, and extract the URL and host fields in the HTTP webpage request packet, and then pass the extracted URL field and host field through the string The concatenation function is concatenated into one field, and finally the concatenated fields are hashed with a hash algorithm to obtain a sequence number of a specific length, and this sequence number is used as the web page ID. Specifically, the MD5 algorithm (the fifth edition of the message digest algorithm) can be used as the hash algorithm for calculating the webpage ID, that is, MD5 (URL+host) can be used to obtain the webpage ID; of course, it is understandable that other methods can also be used. The hash algorithm, such as SHA-1, is not particularly limited in this embodiment of the present invention.

The parsing of the identified HTTP response packets is mainly divided into two levels: (1) parsing which HTTP response packets belong to the same data stream; (2) parsing which data streams belong to the same session from multiple data streams; The analysis method of the above two levels can also adopt the method of analyzing the DPI characteristic word in S101.

Specifically, in one embodiment, the five-tuple (source IP address, source port, destination IP address, destination port, and transport layer protocol number) in the HTTP response packet is parsed, if the five-tuple of two HTTP response packets If they are exactly the same, it can be determined that the two data packets belong to the same data flow;

Further, the HTTP web page request packets of different data streams are analyzed to obtain the values of the Src and URL fields, and the data streams whose Src and URL are exactly the same are determined to belong to the same session.

In one embodiment, the method for obtaining the size of the webpage is: first establish a session table and a data flow table, and then record the size and attribution information of each webpage browsing data packet in the session table and the data flow table in S501 during the process of identifying data packets and judging In the flow table (specifically, the size of the data packet and which data flow the data packet belongs to are recorded in the data flow table, and the information of which session the data packet belongs to is recorded in the session table), and finally combine the above two The information recorded in the table counts the size of the webpage; at the same time, the webpage hierarchy and webpage type can be obtained by parsing the main URL, which is the URL of the first HTTP webpage request packet in the session. Specifically, the level of the webpage is judged according to the number of slashes in the main URL, and the type of the webpage is judged according to the keywords in the URL, for example, is the URL /news/lady/default.jsp? user＝abc&refer＝http://www.163.com/lady, judge the webpage level according to the number of slashes (from the beginning of the URL to the end of the question mark, if there is no question mark, it will end with a space), there are 3 slashes in total, then Indicates that this webpage is a third-level webpage; by parsing the content between the slashes, keywords can be obtained, such as news and lady, indicating that this webpage is a female and news type, if there is no keyword, it means the homepage of the website, and the type field is given to null.

S503. Establish an association relationship between the webpage ID and the webpage information.

Through the above technical solutions, the embodiments of the present invention perform in-depth analysis on the network data packets based on the DPI identification method to ensure the accuracy of the analysis. At the same time, the web page information is counted according to the analysis results, and the analyzed results are recorded as web page information. Add it to the web page information table, so that you can directly obtain the specific information of the web page when you visit the web page later.

As shown in Figure 6, an embodiment of the present invention provides a device for establishing a web page information table, including:

The webpage information identification module 610 is used to identify the HTTP webpage request packet and the HTTP response packet corresponding to the HTTP webpage request packet from the received network data packet;

The web page ID obtaining module 620 is used to obtain the web page ID of the web page that the user requests to browse according to the HTTP web page request packet,

The webpage information statistics module 630 is used to obtain the webpage information by analyzing the HTTP response packet corresponding to the HTTP webpage request packet;

An associating module 640, configured to associate the webpage information with the webpage ID and add it to the webpage information table.

Further, in one embodiment, the obtaining module 620 specifically includes:

The feature word unit 6201 is used to connect the URL and the host field in the HTTP web page request packet into a feature field through a string connection function;

A serial number unit 6202, configured to use a hash algorithm to hash the feature field to obtain a serial number of a specific length;

The webpage ID unit 6203 is configured to use the sequence number of a specific length as the webpage ID.

Through the above technical solutions, the embodiments of the present invention perform in-depth analysis on the network data packets based on the DPI identification method to ensure the accuracy of the analysis. At the same time, the web page information is counted according to the analysis results, and the analyzed results are recorded as web page information. Add it to the web page information table, so that you can directly obtain the specific information of the web page when you visit the web page later.

As shown in FIG. 7, an embodiment of the present invention provides a device for optimizing wireless webpage browsing resources, including:

An identification module 710, configured to identify the HTTP web page request packet from the received network data packet;

In one embodiment, the identification module can use a feature word identification method to analyze the header and data part of the received data packet, and match the parsed fields with the corresponding feature fields of the HTTP webpage request packet. Specifically, if it is analyzed that the TCP port number in the header of the data packet is 80, the data part of the data packet contains the request method GET, and the protocol type is HTTP, and the URL suffix name is .jsp, .asp, .php, .htm, .html, .shtml, it can be determined that the data packet is an HTTP web page request packet; of course, it is understandable that the more fields to parse and match, the more accurate the result of the determination will be.

The obtaining module 720 is used to obtain the web page ID of the web page that the user requests to browse according to the HTTP web page request packet identified by the identification module 610;

In one embodiment of the present invention, the obtaining module 720 uses the URL in the first HTTP webpage request packet received after the webpage session TCP connection is established as the webpage ID. Specifically, by parsing the specific field in the first HTTP webpage request packet identified by the identification module 710, the main URL of the webpage can be obtained, and then use this URL as the webpage ID; in another embodiment, the webpage ID is also It can be obtained by calculating: parsing the specific field in the first HTTP webpage request packet identified by the identification module 710, and extracting the URL and host fields in the HTTP webpage request packet, and then combining the extracted URL field and host The fields are connected into one field through the string concatenation function, and finally the concatenated fields are hashed with a hash algorithm to obtain a serial number of a specific length, and the serial number is used as the web page ID. Specifically, the MD5 algorithm (the fifth edition of the message digest algorithm) can be used as the hash algorithm for calculating the webpage ID, that is, MD5 (URL+host) can be used to obtain the webpage ID; of course, it is understandable that other methods can also be used. The hash algorithm, such as SHA-1, is not particularly limited in this embodiment of the present invention.

The matching module 730 is used to match the webpage ID obtained by the acquisition module 720 with a pre-established webpage information table, the webpage information table includes the webpage ID of the user's frequently used webpage and the webpage information corresponding to each webpage ID;

In one embodiment, the matching module 730 may use the webpage ID acquired by the acquiring module 720 as a key value, and use a hash (hash) index method to match with the webpage information table. As a specific search method, the hash index method has the advantage of rapid search and can improve the matching speed. It can be understood that the hash index method is not the only way to achieve matching, so the hash index method is taken as an example and should not be construed as a limitation to the embodiment of the present invention.

The policy module 740 is configured to calculate a GBR matching the webpage information according to the webpage information in the webpage information table when the matching module 730 matches successfully, and send the GBR to the base station, so that the base station allocates the wireless webpage session according to the GBR bandwidth resources.

Further, the policy module 740 is also configured to deliver the pre-configured GBR to the base station when the matching module 730 fails to match, so that the base station allocates bandwidth resources of the wireless webpage session according to the GBR.

In one embodiment, if the matching module 730 matches successfully, it means that the webpage information corresponding to the webpage ID has been recorded in the table in the webpage information table, so the strategy module 740 can use the webpage information that matches the webpage ID in the webpage information table. information to calculate the GBR, and send the calculated GBR to the base station in the form of a GBR configuration file to allocate bandwidth resources for wireless webpage sessions.

Specifically, in one embodiment, the method for calculating the matched GBR according to the webpage information includes:

(1) Obtain the webpage size and webpage hierarchy from the webpage information;

(2) divide the webpage size by the standard time to obtain the GBR matching the webpage information; or divide the webpage size by the webpage level, and then divide by the standard time to obtain the GBR matching the webpage information; or divide the webpage information by the webpage size The GBR matching the webpage information is obtained by dividing the webpage level by the user level coefficient.

Among them, the standard time is statically configured by the operator, such as 1s, which represents the average time required for a user to obtain a complete web page information; the user level coefficient is set according to the user type, for example, gold user = 1, silver user = 2. Bronze users = 3. Specifically, the above calculation method can be expressed as: GBR=webpage size/standard time; in another embodiment, the calculation method of GBR can be: GBR=webpage size/standard time*webpage level; in another embodiment Among them, the calculation method of GBR can also be GBR=webpage size/standard time*webpage level/user level coefficient.

After the GBR is calculated, the policy module 740 sends the GBR to the base station in the form of a GBR configuration file, and the base station allocates bandwidth resources for webpage sessions according to the GBR configuration file, so that the GBR can be dynamically adjusted according to the webpage information.

As shown in the dashed box in Figure 7, in one embodiment, the device for optimizing wireless webpage browsing resources also includes:

The record adding module 750 is used to add the web page ID and the corresponding web page information as a new record to the web page information table with the unsuccessful matching;

Further, as shown in FIG. 8, in one embodiment, the record adding module 750 specifically includes:

The first identifying unit 7501 is configured to identify the HTTP response packet corresponding to the HTTP web page request packet from the received network data packet;

In one embodiment, the identification unit 7501 can simply identify the HTTP response packet according to the following rules: the next data packet received by the browser after sending the HTTP webpage request packet is the HTTP response packet corresponding to the HTTP webpage request packet.

In another embodiment, the identification unit 7501 may also use the DPI feature word identification method to analyze and match the content of the network data packet, so as to identify the HTTP response packet.

Analysis and statistics unit 7502, for analyzing the HTTP response packet corresponding to the HTTP webpage request packet identified by identification unit 7501, and counting the webpage information;

The storage unit 7503 is configured to associate the webpage information of the webpage that the user requests to browse with the webpage ID of the webpage that the user requests to browse, and add it to the webpage information table.

Through the above technical solutions, the embodiment of the present invention obtains the web page information of the web page accessed by the user by querying the web page information table based on the identification of web page data, and calculates and allocates GBR according to the specific information of each web page, so as to realize the dynamic adjustment of GBR, and Compared with the existing technical solutions, the dynamically adjusted GBR can better match different web browsing services, which greatly reduces the situation that the GBR is too high or too low in the prior art, improves the user experience, and ensures Maximize the use of wireless resources while browsing the webpage QOS; further, add the webpage information that was not recorded in the previous webpage information table to the webpage information table when accessing through the record adding module, so as to realize the update of the webpage information table, so that when the follow-up When other users visit and revisit the webpage, the matching GBR can be calculated to realize resource optimization.

As shown in FIG. 9, an embodiment of the present invention provides a wireless network resource optimization system, including:

A wireless network controller 80, where the wireless network controller 80 is the wireless network controller described in the embodiment of the present invention;

A base station 90, the base station is configured to receive the GBR sent by the radio network controller 80, and allocate bandwidth for webpage sessions to users according to the GBR.

In the embodiment of the present invention, based on the above technical solutions, the wireless network controller obtains the webpage information of the webpage accessed by the user by querying the webpage information table based on the identification of the webpage data, and calculates and allocates GBR according to the specific information of each webpage, so as to realize GBR Dynamic adjustment, compared with the existing technical solutions, the dynamically adjusted GBR can better match different web browsing services, greatly reducing the situation that the GBR is too high or too low in the prior art, and improving the user experience , and realize the maximum utilization of wireless resources while ensuring the QOS of webpage browsing; further, the wireless network controller adds the webpage information that has not been recorded in the previous webpage information table to the webpage information table when accessing through the record adding module, so as to realize the webpage The update of the information table, so that when other users visit the webpage again, the wireless network controller can calculate the matching GBR according to the updated webpage information table, and send it to the base station for wireless resource configuration to realize resource allocation. Optimization.

The above descriptions are only a few embodiments of the present invention, and those skilled in the art can make various changes or modifications to the present invention according to the disclosure of the application documents without departing from the spirit and scope of the present invention.

Claims (18)

1. A wireless web browsing resource optimization method, characterized in that, comprising: Identify the hypertext transfer protocol HTTP webpage request packet from the received network packet, and the HTTP webpage request packet is sent when the user requests to browse the webpage; The Uniform Resource Locator URL and the host field in the HTTP web page request packet are connected into a feature field by a string connection function; Using a hash algorithm to hash the feature field to obtain a serial number of a specific length; using the serial number of a specific length as the webpage ID of the webpage that the user requests to browse; Matching the webpage ID of the webpage that the user requests to browse with the pre-established webpage information table; If the matching is successful, obtain the webpage information corresponding to the webpage ID from the webpage information table, calculate the guaranteed bit rate GBR matching the webpage information according to the webpage information, and send the GBR to the base station to making the base station allocate bandwidth resources for wireless webpage sessions to the user according to the GBR. 2. The method according to claim 1, wherein the hash algorithm is the fifth edition of the message digest algorithm MD5 or the secure hash algorithm SHA-1. 3. The method according to claim 1 or 2, wherein the webpage information in the webpage information table includes: webpage size, webpage hierarchy and/or webpage type. 4. The method according to claim 3, wherein the calculating the GBR matching the web page information according to the web page information comprises: Obtaining the webpage size and webpage hierarchy from the webpage information; Divide the webpage size by the standard time to obtain the GBR that matches the webpage information, and the standard time is the average time required for the user to obtain a complete webpage information; or divide the webpage size by the webpage level, and then divide by the standard time, Obtain the GBR matching the webpage information; or divide the webpage size by the webpage level, and then divide by the user level coefficient to obtain the GBR matching the webpage information. 5. The method of claim 3, further comprising: If the matching is unsuccessful, the pre-configured GBR is sent to the base station, so that the base station allocates bandwidth resources for wireless webpage sessions to the user according to the pre-configured GBR. 6. The method according to claim 5, wherein, if the matching is unsuccessful, after sending the pre-configured GBR to the base station, further comprising: Add the webpage ID and the corresponding webpage information that are not successfully matched to the webpage information table as new records. 7. The method according to claim 6, wherein, adding the unsuccessfully matched webpage ID and corresponding webpage information to the webpage information table as a new record specifically includes: Identify the HTTP response packet corresponding to the HTTP web page request packet from the received network data packet; By analyzing the HTTP response packet corresponding to the HTTP webpage request packet, the webpage information of the webpage requested by the user is obtained by statistics; Associating the webpage information of the webpage that the user requests to browse with the webpage ID of the webpage that the user requests to browse, and adding them to the webpage information table. 8. The method according to claim 1, wherein the identifying the HTTP webpage request packet from the received network packet comprises: By performing deep packet inspection (DPI) on the received network data packets, HTTP webpage request packets are identified from the received network data packets. 9. A wireless web browsing resource optimization device, comprising: The identification module is used to identify the hypertext transfer protocol HTTP webpage request packet from the received network data packet, and the HTTP webpage request packet is sent when the user requests to browse the webpage; An acquisition module, configured to acquire the webpage identification ID of the webpage that the user requests to browse from the HTTP webpage request packet identified by the identification module; A matching module, configured to match the webpage ID obtained by the acquisition module with a pre-established webpage information table; A policy module, configured to obtain the webpage information corresponding to the webpage ID from the webpage information table when the matching module successfully matches, and calculate the guaranteed bit rate GBR matching the webpage information according to the webpage information, and sending the GBR to the base station, so that the base station allocates bandwidth resources for wireless webpage sessions to the user according to the GBR; The acquisition module includes: A feature word unit, used to connect the URL and the host field in the HTTP webpage request packet into a feature field through a string connection function; A serial number unit, configured to use a hash algorithm to hash the characteristic field to obtain a serial number of a specific length; The webpage ID unit is used to use the serial number of a specific length as the webpage ID. 10. The apparatus of claim 9, further comprising: A record adding module, configured to add the unsuccessfully matched webpage ID and corresponding webpage information as a new record to the webpage information table when the matching by the matching module is unsuccessful; 11. The device according to claim 10, wherein the record adding module specifically comprises: The identifying unit identifies the HTTP response packet corresponding to the HTTP web page request packet from the received network data packet; The analysis and statistics unit is used to obtain the webpage information of the webpage requested by the user by analyzing the HTTP response packet corresponding to the HTTP webpage request packet; A storage unit, configured to associate the webpage information of the webpage requested by the user with the webpage ID of the webpage requested by the user and add it to the webpage information table. 12. The device according to claim 11, wherein the identifying unit is specifically configured to, by performing deep packet inspection (DPI) on the received network data packets, to identify HTTP web page request package. 13. A wireless network resource optimization system, comprising: a wireless network controller and a base station, characterized in that, The wireless network controller is used to identify the hypertext transfer protocol HTTP webpage request packet from the received network data packet, and the HTTP webpage request packet is sent when the user requests to browse the webpage; The Uniform Resource Locator URL and the host field are connected into a feature field through a string concatenation function; the feature field is hashed with a hash algorithm to obtain a serial number of a specific length; the serial number of a specific length As the webpage ID of the webpage requested by the user to browse; Match the webpage ID of the webpage that the user requests to browse with the pre-established webpage information table; if the matching is successful, obtain the webpage information corresponding to the webpage ID from the webpage information table, and calculate the corresponding webpage information according to the webpage information The guaranteed bit rate GBR matching the web page information, and sending the GBR to the base station; The base station is configured to receive the GBR, and allocate bandwidth resources for wireless webpage sessions to the user according to the GBR. 14. The system according to claim 13, wherein the wireless network controller is further configured to, when the acquired web page ID fails to match the pre-established web page information table, send the pre-configured GBR to The base station configures radio resources. 15. The system according to claim 13, wherein the wireless network controller is further configured to, when the acquired web page ID fails to match the pre-established web page information table, send the pre-configured GBR to The base station configures wireless resources, and adds the unsuccessfully matched webpage ID and corresponding webpage information as a new record to the webpage information table. 16. A method for setting up a web page information table, comprising: Identify the HTTP response packet corresponding to the Hypertext Transfer Protocol HTTP webpage request packet and the HTTP webpage request packet from the received network data packet, and the HTTP webpage request packet is sent when the user requests to browse the webpage; The Uniform Resource Locator URL and the host field in the HTTP web page request packet are connected into a feature field by a string connection function; the feature field is hashed with a hash algorithm to obtain a sequence number of a specific length; The serial number of a specific length is used as the webpage ID of the webpage that the user requests to browse; By analyzing the HTTP response packet corresponding to the HTTP webpage request packet, the webpage information is obtained through statistics; An association relationship between the webpage ID and the webpage information is established. 17. The method according to claim 18 or 19, wherein the webpage information includes: webpage size, webpage hierarchy and/or webpage type. 18. A device for setting up a web page information table, characterized in that it comprises: The web page data identification module is used to identify the hypertext transfer protocol HTTP web page request packet and the HTTP response packet corresponding to the HTTP web page request packet from the received network data packet; The web page ID obtaining module is used to obtain the web page identification ID of the web page that the user requests to browse according to the HTTP web page request packet; A webpage information statistics module, used to obtain webpage information by analyzing the HTTP response packet corresponding to the HTTP webpage request packet; An associating module, configured to associate the webpage information with the webpage ID and add it to the webpage information table; The acquisition module includes: A feature word unit, used to connect the Uniform Resource Locator URL and the host field in the HTTP web page request packet into a feature field by a string connection function; A serial number unit, configured to use a hash algorithm to hash the characteristic field to obtain a serial number of a specific length; The webpage ID unit is used to use the serial number of a specific length as the webpage ID.